-- Logs begin at Fri 2021-11-05 14:05:26 UTC, end at Fri 2021-11-05 15:41:59 UTC. -- Nov 05 14:36:33.073743 dv-neutron-816850-1-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Nov 05 14:36:35.801704 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.common.config [-] Logging enabled! Nov 05 14:36:35.802287 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 05 14:36:35.802424 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=113473) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 05 14:36:35.805713 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.common.config [-] Logging enabled! Nov 05 14:36:35.805976 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 05 14:36:35.806296 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=113473) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 05 14:36:35.807246 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 05 14:36:35.807490 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 05 14:36:35.807858 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 05 14:36:35.808109 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 05 14:36:35.808341 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 05 14:36:35.808694 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.809123 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 05 14:36:35.809448 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.809746 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.810043 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.810345 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.810639 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.810926 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.811221 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.811526 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.811815 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.812097 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.812392 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.812711 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.813000 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] config_source = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.813294 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.813583 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.813870 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] debug = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.814157 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.814584 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.815006 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.815292 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.815586 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.815863 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.816139 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.816417 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.816730 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.817063 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] host = dv-neutron-816850-1-hyperv {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.817346 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.817637 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.817928 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.818218 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.818506 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.818776 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.819064 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.819344 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_dir = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.819619 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.819898 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.820721 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.821019 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.821315 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.821542 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.821767 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.822060 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.822355 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.822635 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.822915 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.823193 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.823470 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.823748 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.824019 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.824305 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.824615 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.824908 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.825188 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.825464 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.825738 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.826014 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.826301 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.826577 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.826852 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.827129 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.827418 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.827691 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.827967 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.828270 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.828580 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.828869 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.829159 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.829437 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.829723 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.829997 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.830271 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_journal = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.830543 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_json = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.830818 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.831092 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.831375 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.831651 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.831924 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.832201 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.832504 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.832796 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:35.833098 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.833650 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.833955 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.834242 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.834547 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.834829 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.835121 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.835403 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.835694 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.836622 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.836919 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.837202 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.837494 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.837776 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.838075 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.838380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.838678 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.838973 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.839254 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.839533 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.839813 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.840096 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.840387 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.840695 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.840989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.841281 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.841564 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.841855 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.842152 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.842451 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.842731 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.843014 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.843308 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.843592 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.843870 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.844153 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.844446 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.844754 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.845034 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.845322 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.845604 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.845882 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.846159 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.846442 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.846736 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.847017 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.847290 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.847565 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.847847 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.848124 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.848412 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.848716 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.848995 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.849271 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.849551 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.849829 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.850104 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.850385 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.850660 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.850939 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.851213 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.851519 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.851798 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.852075 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.852353 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.852658 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.852934 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.853214 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.853490 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.853764 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.854045 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.854324 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.854609 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.854891 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.855192 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.855475 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.855765 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.856040 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.856322 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.856640 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.856923 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.857207 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.857490 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.857766 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.858061 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.858349 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.858637 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.858922 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.859204 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.859527 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.859811 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.860098 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.860381 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.860687 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.860975 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.861260 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.861556 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.861850 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.862149 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.862449 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.862746 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.863029 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.863344 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.863627 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:35.863845 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 05 14:36:35.864088 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=113473) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 05 14:36:36.297802 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=113473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 05 14:36:36.298081 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=113473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 05 14:36:36.298389 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=113473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 05 14:36:36.298727 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 05 14:36:36.627393 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.627611 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.627883 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.629131 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.629419 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.629686 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.664835 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.665118 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.665390 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.681122 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.681405 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.681677 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.711901 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.712186 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.712474 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.748823 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.749101 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.749373 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.994731 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.995380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.995380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.995573 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:36.996224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.128195 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.128548 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.128843 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.129120 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.129394 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.129712 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.129977 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.130238 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.130523 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.130782 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.131313 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.131601 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.131950 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.132249 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.132762 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.133216 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.133569 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.133849 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.134131 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.134398 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.134676 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.134936 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.135223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.135612 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.135868 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.136118 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.136571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.136817 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.137059 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.137302 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.137539 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.137775 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:37.138146 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 05 14:36:37.141661 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 05 14:36:37.145716 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 05 14:36:37.149839 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])]) Nov 05 14:36:37.151492 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 05 14:36:37.151960 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 05 14:36:37.152300 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 05 14:36:37.152719 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 05 14:36:37.155561 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 05 14:36:37.155817 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 05 14:36:37.156171 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 05 14:36:37.161569 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 05 14:36:37.185084 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 05 14:36:37.185543 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.185845 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=113473) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 05 14:36:37.186212 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.187622 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=113473) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 05 14:36:37.187908 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 05 14:36:37.188160 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 05 14:36:37.191392 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.191677 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.255539 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 05 14:36:37.255726 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 05 14:36:37.255967 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 05 14:36:37.256343 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 05 14:36:37.276618 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_db.sqlalchemy.engines [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 05 14:36:37.806619 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing driver for type 'gre' Nov 05 14:36:37.807152 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] gre ID ranges: [(1, 1000)] Nov 05 14:36:37.858865 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing driver for type 'local' Nov 05 14:36:37.859269 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing driver for type 'vlan' Nov 05 14:36:37.872765 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] VlanTypeDriver initialization complete Nov 05 14:36:37.873116 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing driver for type 'vxlan' Nov 05 14:36:37.873667 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] vxlan ID ranges: [(1, 1000)] Nov 05 14:36:37.924506 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing extension driver 'port_security' Nov 05 14:36:37.924854 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.extensions.port_security [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] PortSecurityExtensionDriver initialization complete Nov 05 14:36:37.925198 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing mechanism driver 'openvswitch' Nov 05 14:36:37.925528 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing mechanism driver 'hyperv' Nov 05 14:36:37.932845 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.plugin [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=113473) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:37.933682 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.934059 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.934418 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.934961 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.935407 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.935767 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.936119 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.936549 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.936973 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.937326 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.937674 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.938074 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.938514 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.938872 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.939216 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.939623 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.940051 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.940421 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.940773 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.941223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.941650 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > address_group after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.942015 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > address_group after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.942362 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > address_group after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.942781 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=113473) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 05 14:36:37.943164 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] ML2 OVO RPC backend initialized. {{(pid=113473) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 05 14:36:37.943878 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.944236 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.944690 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.945046 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > networks before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.945398 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.945752 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > ports before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.946101 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.946458 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnets before_response 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.946809 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.947156 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.947496 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.947839 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.948180 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.948556 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.948899 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.949239 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.949584 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > subnet after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.950165 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.plugin [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Modular L2 Plugin initialization complete Nov 05 14:36:37.950498 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading services supported by the core plugin {{(pid=113473) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 05 14:36:37.950830 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.plugins.ml2.managers [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Got port-security extension from driver 'port_security' Nov 05 14:36:37.951297 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.extensions.vlantransparent [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Disabled vlantransparent extension. Nov 05 14:36:37.951798 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=113473) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 05 14:36:37.952115 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: router Nov 05 14:36:37.988353 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.988776 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_create 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.989149 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router before_create 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.989514 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.989887 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.990243 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_delete 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.990604 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > floatingip after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.991078 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > floatingip after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.991444 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_create 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.991795 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.992782 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.993137 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.993500 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.993916 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.994286 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.994630 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.994971 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: subnet after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.995504 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.995655 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > port precommit_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.996003 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_create 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.996349 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.996724 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.997084 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router after_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.997429 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_delete 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.997790 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_create 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.998151 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router_interface after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.998500 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_update 55549900 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.998872 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > agent after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.999230 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > agent after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:37.999581 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > network after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.000443 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Tracking information for resource: router configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:38.000805 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Tracking information for resource: floatingip configured {{(pid=113473) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 05 14:36:38.005725 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.db.l3_agentschedulers_db [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 05 14:36:38.006316 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.006685 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.007046 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.007410 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: port after_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.008234 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router before_create 55550100 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.008647 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_delete 55550100 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.009015 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_create 55550100 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.009374 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > router precommit_update 55550100 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.014255 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.provider_configuration [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service providers = [] {{(pid=113473) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 05 14:36:38.014628 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.db.servicetype_db [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=113473) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 05 14:36:38.017654 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.service_base [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=113473) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 05 14:36:38.018008 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.service_base [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=113473) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 05 14:36:38.018353 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.service_base [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=113473) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 05 14:36:38.019255 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.services.service_base [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=113473) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 05 14:36:38.019632 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.services.service_base [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 05 14:36:38.020013 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.020332 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 05 14:36:38.032379 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded METERING plugin. Description: METERING {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.032747 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: auto_allocate Nov 05 14:36:38.038556 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: network precommit_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.039462 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: network precommit_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.039989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.040314 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: tag Nov 05 14:36:38.047137 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.047475 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: timestamp Nov 05 14:36:38.051341 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.051673 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: network_ip_availability Nov 05 14:36:38.057302 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.057632 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.057995 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.058714 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.059039 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: flavors Nov 05 14:36:38.064063 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.064405 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading Plugin: revisions Nov 05 14:36:38.068773 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=113473) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 05 14:36:38.069167 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.771s {{(pid=113473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 05 14:36:38.069915 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=113473) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 05 14:36:38.070781 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Initializing extension manager. Nov 05 14:36:38.071298 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: __init__.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.071643 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: __pycache__ {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.071980 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.072314 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: address_group.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.073104 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.073662 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: address-group Nov 05 14:36:38.073989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: address_scope.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.074712 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.075229 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: address-scope Nov 05 14:36:38.075556 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: admin_state_down_before_update.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.076550 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.077070 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: router-admin-state-down-before-update Nov 05 14:36:38.077396 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: agent.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.078108 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.078623 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: agent Nov 05 14:36:38.078947 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: agent_resources_synced.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.079866 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.080390 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: agent-resources-synced Nov 05 14:36:38.080747 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: allowedaddresspairs.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.082541 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.083072 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: allowed-address-pairs Nov 05 14:36:38.083664 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: auto_allocated_topology.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.084802 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.085330 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: auto-allocated-topology Nov 05 14:36:38.085685 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: availability_zone.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.086425 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.086946 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: availability_zone Nov 05 14:36:38.087279 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: availability_zone_filter.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.088213 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.088778 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: availability_zone_filter Nov 05 14:36:38.089108 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: data_plane_status.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.090036 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.090562 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension data-plane-status not supported by any of loaded plugins Nov 05 14:36:38.090893 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: default_subnetpools.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.091826 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.092347 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: default-subnetpools Nov 05 14:36:38.092699 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: dhcpagentscheduler.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.093516 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.094037 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: dhcp_agent_scheduler Nov 05 14:36:38.094364 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: dns.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.095292 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.095813 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension dns-integration not supported by any of loaded plugins Nov 05 14:36:38.096140 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: dns_domain_ports.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.097094 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.097613 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 05 14:36:38.097940 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.098875 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.099391 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 05 14:36:38.099721 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: dvr.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.100393 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.100930 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: dvr Nov 05 14:36:38.101270 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: ecmp_routes.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.102710 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.103223 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension ecmp_routes not supported by any of loaded plugins Nov 05 14:36:38.103549 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: empty_string_filtering.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.104500 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.105025 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: empty-string-filtering Nov 05 14:36:38.105351 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.106284 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.106797 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 05 14:36:38.107123 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.108045 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.108596 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 05 14:36:38.108922 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: external_net.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.109852 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.110373 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: external-net Nov 05 14:36:38.110703 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: extra_dhcp_opt.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.111621 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.112137 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: extra_dhcp_opt Nov 05 14:36:38.112499 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: extraroute.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.113405 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.113924 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: extraroute Nov 05 14:36:38.114250 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: extraroute_atomic.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.115288 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.115817 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: extraroute-atomic Nov 05 14:36:38.116148 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: filter_validation.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.117092 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.117621 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: filter-validation Nov 05 14:36:38.117955 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: fip_pf_description.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.118881 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.119399 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 05 14:36:38.119726 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: fip_port_details.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.120696 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.121224 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: fip-port-details Nov 05 14:36:38.121553 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: flavors.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.122803 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.123331 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: flavors Nov 05 14:36:38.123662 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.125397 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.125938 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 05 14:36:38.126271 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: floatingip_pools.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.126980 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.127499 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: floatingip-pools Nov 05 14:36:38.127826 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: ip_allocation.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.128798 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.129314 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension ip_allocation not supported by any of loaded plugins Nov 05 14:36:38.129640 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: ip_substring_port_filtering.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.130626 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.131104 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: ip-substring-filtering Nov 05 14:36:38.131432 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l2_adjacency.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.132367 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.133435 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension l2_adjacency not supported by any of loaded plugins Nov 05 14:36:38.133758 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.134729 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.135254 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: router Nov 05 14:36:38.135580 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3_conntrack_helper.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.137899 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.138443 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 05 14:36:38.138781 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3_ext_gw_mode.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.139731 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.140256 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: ext-gw-mode Nov 05 14:36:38.140623 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3_ext_ha_mode.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.141560 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.142081 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: l3-ha Nov 05 14:36:38.142409 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3_flavors.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.143337 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.143855 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: l3-flavors Nov 05 14:36:38.144181 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.145136 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.145661 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: l3-port-ip-change-not-allowed Nov 05 14:36:38.145993 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: l3agentscheduler.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.147039 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.147564 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: l3_agent_scheduler Nov 05 14:36:38.147895 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: logging.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.149500 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.150036 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension logging not supported by any of loaded plugins Nov 05 14:36:38.150370 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: metering.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.151125 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.151718 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: metering Nov 05 14:36:38.152050 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.153310 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.153844 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: metering_source_and_destination_fields Nov 05 14:36:38.154180 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: multiprovidernet.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.155128 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.155651 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: multi-provider Nov 05 14:36:38.155991 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: netmtu.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.156962 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.157489 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: net-mtu Nov 05 14:36:38.157819 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: netmtu_writable.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.158748 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.159264 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: net-mtu-writable Nov 05 14:36:38.159596 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: network_availability_zone.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.160620 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.161158 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: network_availability_zone Nov 05 14:36:38.161497 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: network_ip_availability.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.162621 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.163146 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: network-ip-availability Nov 05 14:36:38.163479 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: network_segment_range.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.164799 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.165323 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension network-segment-range not supported by any of loaded plugins Nov 05 14:36:38.165651 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: pagination.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.166655 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.166998 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: pagination Nov 05 14:36:38.167332 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: port_device_profile.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.168279 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.168841 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: port-device-profile Nov 05 14:36:38.169173 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: port_mac_address_regenerate.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.170109 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.170629 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: port-mac-address-regenerate Nov 05 14:36:38.170963 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: port_numa_affinity_policy.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.171898 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.172424 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: port-numa-affinity-policy Nov 05 14:36:38.172790 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: port_resource_request.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.173720 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.174235 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension port-resource-request not supported by any of loaded plugins Nov 05 14:36:38.174563 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: port_resource_request_groups.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.175539 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.176063 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 05 14:36:38.176391 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: portbindings.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.177358 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.177880 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: binding Nov 05 14:36:38.178209 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: portbindings_extended.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.180041 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.180609 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: binding-extended Nov 05 14:36:38.180939 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: portsecurity.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.181880 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.182402 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: port-security Nov 05 14:36:38.182730 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: project_id.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.183723 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.184055 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: project-id Nov 05 14:36:38.184380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: providernet.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.185389 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.185917 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: provider Nov 05 14:36:38.186246 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.189903 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.190444 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos not supported by any of loaded plugins Nov 05 14:36:38.190780 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_bw_limit_direction.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.192049 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.192614 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 05 14:36:38.192954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.193891 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.194414 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 05 14:36:38.194743 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_default.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.195694 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.196223 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-default not supported by any of loaded plugins Nov 05 14:36:38.196594 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_fip.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.197257 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.197767 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-fip not supported by any of loaded plugins Nov 05 14:36:38.198093 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_gateway_ip.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.199034 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.199554 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 05 14:36:38.199884 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_port_network_policy.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.200842 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.201363 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 05 14:36:38.201689 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.202738 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.203264 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 05 14:36:38.203595 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_pps_rule.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.204852 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.205563 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-pps not supported by any of loaded plugins Nov 05 14:36:38.205905 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_rule_type_details.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.206839 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.207364 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 05 14:36:38.207695 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: qos_rules_alias.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.209034 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.209563 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 05 14:36:38.209892 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: quota_check_limit.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.211338 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.211867 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: quota-check-limit Nov 05 14:36:38.212198 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: quotasv2.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.213188 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.213523 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: quotas Nov 05 14:36:38.213853 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: quotasv2_detail.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.217051 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.217402 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: quota_details Nov 05 14:36:38.217743 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: rbac.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.218822 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.219361 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: rbac-policies Nov 05 14:36:38.219694 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: rbac_address_group.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.220676 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.221205 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: rbac-address-group Nov 05 14:36:38.221534 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: rbac_address_scope.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.222475 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.223006 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: rbac-address-scope Nov 05 14:36:38.223337 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: rbac_security_groups.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.224272 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.224825 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: rbac-security-groups Nov 05 14:36:38.225151 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: rbac_subnetpool.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.226095 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.227216 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: rbac-subnetpool Nov 05 14:36:38.227542 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: revisionifmatch.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.228521 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.229048 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: revision-if-match Nov 05 14:36:38.229375 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: revisions.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.230505 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.231037 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: standard-attr-revisions Nov 05 14:36:38.231368 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: router_availability_zone.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.232049 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.232602 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: router_availability_zone Nov 05 14:36:38.232930 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: routerservicetype.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.233873 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.234399 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension router-service-type not supported by any of loaded plugins Nov 05 14:36:38.234726 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.235666 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.236190 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: security-groups-normalized-cidr Nov 05 14:36:38.236541 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: security_groups_port_filtering.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.237553 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.238076 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: port-security-groups-filtering Nov 05 14:36:38.238400 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: security_groups_remote_address_group.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.239339 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.239862 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: security-groups-remote-address-group Nov 05 14:36:38.240188 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: security_groups_shared_filtering.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.241159 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.241682 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: security-groups-shared-filtering Nov 05 14:36:38.242039 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.242636 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 05 14:36:38.242963 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: securitygroup.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.252849 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.253395 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: security-group Nov 05 14:36:38.253738 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: segment.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.254547 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.255066 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension segment not supported by any of loaded plugins Nov 05 14:36:38.255403 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.256363 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.256921 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 05 14:36:38.257256 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: servicetype.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.258520 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.259050 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: service-type Nov 05 14:36:38.259386 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: sorting.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.260388 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.260753 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: sorting Nov 05 14:36:38.261085 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: standard_attr_segment.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.262021 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.262548 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 05 14:36:38.262877 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: standardattrdescription.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.263539 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.264058 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: standard-attr-description Nov 05 14:36:38.264387 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: stateful_security_group.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.265359 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.265886 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: stateful-security-group Nov 05 14:36:38.266217 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: stdattrs_common.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.266797 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 05 14:36:38.267123 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.268062 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.268633 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 05 14:36:38.268961 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnet_onboard.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.270054 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.270589 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: subnet_onboard Nov 05 14:36:38.270918 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnet_segmentid_writable.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.271884 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.272411 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 05 14:36:38.272763 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnet_service_types.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.274241 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.274774 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: subnet-service-types Nov 05 14:36:38.275102 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnetallocation.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.276206 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.276771 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: subnet_allocation Nov 05 14:36:38.277107 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.277786 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.278309 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: subnetpool-prefix-ops Nov 05 14:36:38.278637 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.279589 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.280115 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 05 14:36:38.280442 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: tagging.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.281540 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.282069 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: standard-attr-tag Nov 05 14:36:38.282401 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: timestamp.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.283641 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.284171 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loaded extension: standard-attr-timestamp Nov 05 14:36:38.284535 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: trunk.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.285611 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.286135 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension trunk not supported by any of loaded plugins Nov 05 14:36:38.286463 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: trunk_details.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.287407 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.287927 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension trunk-details not supported by any of loaded plugins Nov 05 14:36:38.288253 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: uplink_status_propagation.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.289834 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.290355 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 05 14:36:38.290681 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Loading extension file: vlantransparent.py {{(pid=113473) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 05 14:36:38.291446 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=113473) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 05 14:36:38.292057 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extension vlan-transparent not supported by any of loaded plugins Nov 05 14:36:38.296397 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:network Nov 05 14:36:38.296973 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnet Nov 05 14:36:38.297630 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnetpool Nov 05 14:36:38.298324 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:port Nov 05 14:36:38.299662 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.300117 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service FLAVORS assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.300783 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.301214 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.301550 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:router Nov 05 14:36:38.301991 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:floatingip Nov 05 14:36:38.302482 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service METERING assigned prefix: /metering {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.303926 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.304302 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.304719 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=113473) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:36:38.305751 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of CountableResource for resource:rbac_policy Nov 05 14:36:38.306190 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:security_group Nov 05 14:36:38.306639 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 05 14:36:38.307373 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service CORE assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.307667 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnetpool Nov 05 14:36:38.308016 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] subnetpool is already registered Nov 05 14:36:38.308473 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service CORE assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.308805 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnetpool Nov 05 14:36:38.309140 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] subnetpool is already registered Nov 05 14:36:38.311538 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.311992 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service FLAVORS assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.312654 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.313096 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.313435 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:router Nov 05 14:36:38.313776 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] router is already registered Nov 05 14:36:38.314196 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:floatingip Nov 05 14:36:38.314533 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] floatingip is already registered Nov 05 14:36:38.315014 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service METERING assigned prefix: /metering {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.315730 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of CountableResource for resource:rbac_policy Nov 05 14:36:38.316061 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] rbac_policy is already registered Nov 05 14:36:38.316520 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:security_group Nov 05 14:36:38.316867 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] security_group is already registered Nov 05 14:36:38.317279 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 05 14:36:38.317624 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] security_group_rule is already registered Nov 05 14:36:38.318112 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service CORE assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.318451 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnetpool Nov 05 14:36:38.318785 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] subnetpool is already registered Nov 05 14:36:38.319216 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.v2.resource_helper [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Service CORE assigned prefix: {{(pid=113473) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 05 14:36:38.319543 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Creating instance of TrackedResource for resource:subnetpool Nov 05 14:36:38.319876 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING neutron.quota.resource_registry [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] subnetpool is already registered Nov 05 14:36:38.321656 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: extensions {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.323136 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: address-groups {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.324685 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: address-scopes {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.325897 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: agents {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.327175 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: auto-allocated-topology {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.328425 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: availability_zones {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.329677 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: dhcp-networks {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.331101 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: dhcp-agents {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.332653 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: routers {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.335054 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: flavors {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.336907 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: service_profiles {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.338147 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: next_providers {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.339606 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: service_profiles {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.341111 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: floatingip-pools {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.342433 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: routers {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.344603 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: floatingips {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.345892 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: l3-routers {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.347298 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: l3-agents {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.348759 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: metering-labels {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.350033 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: metering-label-rules {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.351979 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: network-ip-availabilities {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.353302 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: bindings {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.354876 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: quotas {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.356583 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: quotas {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.358142 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: rbac-policies {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.359353 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: security-groups {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.360705 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: security-group-rules {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.361958 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: service-providers {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.363188 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: subnetpools {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.364625 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: subnetpools {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.366146 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.367863 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.369711 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.371520 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.373268 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.375243 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.376984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.379757 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.381598 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.383384 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron.api.extensions [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Extended resource: tags {{(pid=113473) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 05 14:36:38.389586 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING keystonemiddleware.auth_token [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 05 14:36:38.394076 dv-neutron-816850-1-hyperv neutron-server[113473]: WARNING keystonemiddleware.auth_token [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 05 14:36:38.403381 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Acquired lock "singleton_lock" {{(pid=113473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 05 14:36:38.403860 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_concurrency.lockutils [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Releasing lock "singleton_lock" {{(pid=113473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 05 14:36:38.404533 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Starting 2 workers Nov 05 14:36:38.409311 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Started child 113580 {{(pid=113473) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 05 14:36:38.413763 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Started child 113581 {{(pid=113473) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 05 14:36:38.415582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.416208 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO neutron.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Neutron service started, listening on 0.0.0.0:9696 Nov 05 14:36:38.416586 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Publish callbacks [] for process, before_spawn {{(pid=113473) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.417094 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [-] (113580) wsgi starting up on http://0.0.0.0:9696 Nov 05 14:36:38.419104 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Starting 1 workers Nov 05 14:36:38.420256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.422135 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [-] (113581) wsgi starting up on http://0.0.0.0:9696 Nov 05 14:36:38.424470 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Started child 113582 {{(pid=113473) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 05 14:36:38.425062 dv-neutron-816850-1-hyperv neutron-server[113473]: INFO oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Starting 1 workers Nov 05 14:36:38.429899 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Started child 113583 {{(pid=113473) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 05 14:36:38.430701 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG neutron_lib.callbacks.manager [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] Publish callbacks [] for process, after_spawn {{(pid=113473) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.430849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] calling RpcWorker wait() {{(pid=113582) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 05 14:36:38.431367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.service [None req-98976d23-7c4b-40c3-a116-b04093b7501b None None] returning from RpcWorker wait() {{(pid=113582) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 05 14:36:38.432676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.432824 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=113473) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 05 14:36:38.433028 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 05 14:36:38.433153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:38.433256 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 05 14:36:38.433432 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 05 14:36:38.433739 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 05 14:36:38.433926 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 05 14:36:38.434389 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.434677 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.434928 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.435188 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.435479 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.436205 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.436507 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.436942 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.437041 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.437238 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:38.438156 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.438156 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.438156 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.438156 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.438775 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.439122 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.439692 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.440072 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.440630 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.440914 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.441336 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_source = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.441820 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.442597 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.443027 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] debug = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.443472 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.444324 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.444787 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.445314 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.445614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.446064 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.446481 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.446950 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.447401 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.447658 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.447935 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.448223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.448519 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.448736 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.448985 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.449231 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.449484 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.449727 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.450213 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] host = dv-neutron-816850-1-hyperv {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.450443 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.450684 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.450917 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.451178 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.451428 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.451652 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.451909 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.452170 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.452423 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.452697 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.452958 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.453217 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.453465 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_dir = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.453709 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.453875 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_options = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.454094 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.454373 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.454626 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.454825 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.454996 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.455177 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.455447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.455582 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.455845 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.456067 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.456283 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.456524 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.456833 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.457236 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.457673 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.457993 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.458252 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.458741 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.459020 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.459252 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.459482 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.459734 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.459975 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.460216 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.460465 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.461211 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.461442 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.461659 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.461903 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.462174 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.462411 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.462666 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.462907 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.463155 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.463432 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.463663 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.463891 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.464105 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.464379 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.464633 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.464876 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.465130 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.465343 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.465648 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.465851 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.466021 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_journal = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.466256 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_json = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.466466 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.466704 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.466990 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.467181 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.467351 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.467563 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.467781 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.468035 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.470989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.472179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.472179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.472179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.472179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.472179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.478447 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479412 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.479571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.481001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.482224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.483614 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.488649 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.488649 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.488649 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.488649 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.488906 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.489197 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.490233 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.490233 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.490233 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.490233 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.490522 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.491984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.492406 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.493954 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.495791 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.496031 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.496608 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.496839 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.497074 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.498113 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.498364 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.498630 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.498842 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.499065 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.499269 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.499548 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.499859 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.500519 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.501196 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.501456 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.501714 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.501961 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.502212 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.502438 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.506134 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.506408 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.506716 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.506977 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.507240 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.507507 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.507788 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.508079 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.508338 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.508747 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.508983 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.509239 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.509496 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.509774 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.510039 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.511890 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.512182 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.512446 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.512777 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.513043 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.513365 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.513617 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.513903 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.514231 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.514503 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.514778 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.515037 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.515300 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.515581 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.515860 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.516126 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.516380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.516888 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.517159 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.517428 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.517693 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.517914 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.518141 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.518378 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.518712 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.518967 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.519223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.519410 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.519693 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.519934 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.520190 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.520486 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.520822 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.521084 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.521337 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.521591 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.521816 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.522073 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.522328 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.522546 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.522787 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.522987 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.523757 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.523995 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.524438 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.524708 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.527063 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.527308 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.527557 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.527809 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.528053 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.528326 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.528559 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.528814 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.529071 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.529298 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.529530 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530053 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530053 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530215 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530443 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530746 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.530989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.531856 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.531856 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.531856 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.532131 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.532131 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.532364 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.532797 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.533052 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.533276 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.533505 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.534068 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.534295 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.534550 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.534789 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.535052 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.535303 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.536185 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.536489 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.536753 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.537007 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.537231 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.537495 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.537793 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.538038 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.538248 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.538470 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.538689 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.539509 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.539755 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.540001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.540216 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.540495 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.540666 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.540885 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.541101 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.541969 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.542237 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.542479 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.542742 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.542990 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.543569 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.543807 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.544027 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.544784 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.545096 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.545369 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.545689 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.546990 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.547222 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.547448 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.547681 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.547910 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.548129 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.548404 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.548646 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.548860 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.549088 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.549310 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.549524 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.549771 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.549980 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.550192 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.550419 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.550638 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.550849 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.551082 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.551293 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.551503 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.551724 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.551941 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.552174 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.552486 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.552982 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.553208 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.553482 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.553730 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.553988 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.554233 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.554578 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.554797 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.555065 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.555284 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.555502 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.555725 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.555979 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.556290 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.556594 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.556845 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.557100 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.557428 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.557652 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.557921 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.559709 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.560047 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.560409 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.560719 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.560981 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.561257 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.561508 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.561761 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.561986 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.562245 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.562486 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.562709 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.562996 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.563246 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.563476 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.563717 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.563948 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.564167 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.564422 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.564824 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.567327 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.567598 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.567769 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 05 14:36:38.568312 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=113473) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 05 14:36:38.568526 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 05 14:36:38.568692 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 05 14:36:38.568899 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 05 14:36:38.569078 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 05 14:36:38.569235 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 05 14:36:38.569444 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.569605 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.569763 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.569920 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.570600 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.570780 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.570939 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.571096 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.571403 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.572104 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.572311 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.572923 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573097 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573259 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573415 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573571 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573725 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.573881 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.574042 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.574200 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] config_source = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.574633 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.574790 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.574946 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] debug = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.575098 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.575294 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.576211 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.576484 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.576647 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.576838 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577049 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577210 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577364 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577517 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577672 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577826 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.577979 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578131 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578285 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578437 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578595 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578766 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.578902 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] host = dv-neutron-816850-1-hyperv {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579038 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579195 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579350 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579502 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579655 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579808 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.579964 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580121 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580276 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580424 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580593 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580742 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.580888 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_dir = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.581022 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.581148 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_options = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.581282 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.581411 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.582874 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.583080 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.583246 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584487 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584487 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584487 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584724 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584804 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.584882 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.585049 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.585206 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.585381 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.585547 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.585702 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.586372 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.586476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:38.586566 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.586676 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.586854 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.586981 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587133 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587287 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587443 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587597 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587748 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.587902 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588055 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588209 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588363 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588609 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588769 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.588923 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589078 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589231 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589384 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589538 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589690 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.589848 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590001 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590154 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590308 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590460 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590612 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590765 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.590918 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_journal = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591070 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_json = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591375 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591526 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591682 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591853 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.591994 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.592144 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.592298 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 05 14:36:38.592490 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.592651 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.592820 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.592976 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593133 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593289 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593445 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593600 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593756 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.593912 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594074 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594231 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594396 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594553 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594708 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.594866 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595022 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595179 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595338 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595493 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595649 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595805 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.595968 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.596124 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.596279 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.596435 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.596675 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.596857 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.597185 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.597347 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.597682 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.598534 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.598731 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.599089 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.599262 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.599759 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601052 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601245 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601413 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601574 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601740 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.601903 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.602074 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.602218 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.602376 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603467 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603467 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603467 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603467 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603792 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603792 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.603953 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.604275 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.604436 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.604617 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.604787 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.605050 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.605223 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.605414 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.605736 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.605901 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606059 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606215 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606373 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606531 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606687 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.606857 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607013 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607169 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607326 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607484 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607641 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.607933 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.608129 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.608297 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.608472 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.608631 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.609061 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.609530 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.609690 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.610725 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.610886 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.611489 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.611675 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.611835 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.611996 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612157 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612314 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612497 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612655 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612827 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.612985 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613141 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613297 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613454 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613610 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613767 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.613924 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614080 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614237 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614393 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614548 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614708 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.614863 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615020 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615176 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615332 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615488 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615645 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615802 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.615958 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616114 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616270 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616426 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616603 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616760 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.616969 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617127 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617287 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617445 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617608 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617775 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.617931 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618088 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618244 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618400 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618556 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618712 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.618868 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619030 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619189 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619346 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619509 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619676 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619832 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.619989 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620146 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620322 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620497 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620657 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620813 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.620969 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.621124 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.621279 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.621507 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.621675 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623097 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623273 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623490 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623624 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623847 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.623978 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.625929 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.626418 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.626593 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.626763 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.626935 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627102 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627266 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627428 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627590 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627750 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.627911 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.628070 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.628228 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.628386 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.628648 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.628926 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.629193 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.629294 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.629458 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.629620 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.629783 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630026 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630194 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630351 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630578 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630754 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630837 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.630982 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.631140 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.631299 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.631532 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.631700 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.631858 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.632015 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.632171 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.632329 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633034 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633200 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633357 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633514 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633685 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.633843 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.634000 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.634157 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.634313 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.634470 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.634626 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.635361 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.635529 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.635690 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.636473 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.636856 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.637034 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.637199 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.637359 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.637842 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638005 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638163 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638321 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638605 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638772 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.638931 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639176 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639359 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639517 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639661 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639818 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.639974 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640130 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640287 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640443 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640632 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640791 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.640947 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641104 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641260 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641416 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641641 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641803 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.641960 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642123 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642279 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642435 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642600 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642756 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.642912 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643068 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643224 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643380 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643545 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643700 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.643856 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644011 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644166 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644322 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644504 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644664 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644820 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.644984 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645140 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645296 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645452 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645618 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645774 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.645932 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646088 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646246 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646401 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646559 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646719 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.646885 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647046 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647203 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647366 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647531 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647694 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.647849 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648010 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648222 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648382 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648559 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648715 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.648872 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649029 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649186 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649342 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649517 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649644 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649812 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.649945 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650101 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650256 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650413 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650568 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650724 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.650880 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.651035 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.651191 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 05 14:36:38.651340 dv-neutron-816850-1-hyperv neutron-server[113473]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=113473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 05 14:36:38.740382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 36926) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:36:38.749597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [-] 10.222.0.30 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0069807 Nov 05 14:36:50.040764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-385c0310-803a-4e50-8b92-5ff1aaf2cc6d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:36:50.101789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-385c0310-803a-4e50-8b92-5ff1aaf2cc6d None None] No non-hosted networks {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 05 14:36:50.127800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.agentschedulers_db [None req-385c0310-803a-4e50-8b92-5ff1aaf2cc6d None None] DHCP Agent not found on host dv-neutron-816850-1-hyperv {{(pid=113582) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 05 14:36:50.290985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e6c7987d-ee91-462d-96f2-f121b5f420a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:52.340347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5e644f92-5a8f-466d-8905-eb20868d016c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:52.423502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-201d5fa6-3860-4e4b-a341-d7c43c3491de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:53.353397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:54.828841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:55.842788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:36:55.844551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.845303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.845950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.846493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.847225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.847867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.848440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.849376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.850071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.850668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.851310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.851876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:36:55.852581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-816850-1-hyperv', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:55.860346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-816850-1-hyperv', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:36:56.081436 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.db.l3_hamode_db [None req-ed98b416-ae9d-4a97-a357-c168ae0adb80 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 05 14:36:56.163877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed98b416-ae9d-4a97-a357-c168ae0adb80 None None] Routers set() bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:36:56.164238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed98b416-ae9d-4a97-a357-c168ae0adb80 None None] Router IDs set() for agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 05 14:36:56.209486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37018) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:36:56.734170 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING oslo_policy.policy [None req-9f429ec7-1196-4d33-9020-e9fa3fc3d2cf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:36:56.734733 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING oslo_policy.policy [None req-9f429ec7-1196-4d33-9020-e9fa3fc3d2cf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:36:56.960047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-9f429ec7-1196-4d33-9020-e9fa3fc3d2cf admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:36:56.961180 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9f429ec7-1196-4d33-9020-e9fa3fc3d2cf admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7502244 Nov 05 14:36:59.470358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37034) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:36:59.778243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] Request body: {'subnetpool': {'is_default': True, 'default_prefixlen': 26, 'shared': True, 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:36:59.872357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.policy [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=113580) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 05 14:36:59.918424 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING oslo_policy.policy [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:36:59.918790 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING oslo_policy.policy [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:36:59.927185 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.quota [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] Loaded quota_driver: . Nov 05 14:37:00.013917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785315294003', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785315293510', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785315281879', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785315279259', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785314805318', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785315259781', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-2023931', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1865144', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-903892', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-674284'] for rbac-policy, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:00.076551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:00.077698 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1c9757f4-7c56-49a7-bb00-eb54fdb11121 admin admin] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6063728 Nov 05 14:37:02.823660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37046) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:03.115601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Request body: {'network': {'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'name': 'private'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:03.144587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Made reservation on behalf of c68e069375e249f1a75464c0686b0ffd for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:37:03.147371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.164139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.275370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.279132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.298741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 603} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:37:03.326205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8785316554478', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.326770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Unsubscribe: segment precommit_create {{(pid=113580) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 05 14:37:03.327275 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Added segment 29b75da8-159b-4a5d-bfbe-28f41c3fd7f8 of type vlan for network bf160792-a09b-4087-8b28-6616042b88c7 Nov 05 14:37:03.342958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11045651-9eae-4ccc-b069-b3bf77ae481c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:03.389838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.390191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.390522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.390846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.391166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.391502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.391821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.392153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.392492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.392801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.393111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.393428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Tracked resource versions report: Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: pushed versions: Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: { 'AddressGroup': {'1.2'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'ConntrackHelper': {'1.0'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Log': {'1.0'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Network': {'1.1'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Port': {'1.7'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'PortForwarding': {'1.2'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'QosPolicy': {'1.10'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroup': {'1.5'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SubPort': {'1.0'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Subnet': {'1.1'}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Trunk': {'1.1'}} Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: consumer versions: Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'ConntrackHelper': '1.0', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Log': '1.0', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Network': '1.1', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Port': '1.7', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'PortForwarding': '1.2', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'QosPolicy': '1.10', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroup': '1.5', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroupRule': '1.2', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SubPort': '1.0', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Subnet': '1.1', Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Trunk': '1.1'}} Nov 05 14:37:03.394712 dv-neutron-816850-1-hyperv neutron-server[113580]: {{(pid=113580) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:37:03.444540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.482490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.483597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:03.484282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:03.564517 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7395964 Nov 05 14:37:03.581897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38bfa085-5305-4aed-8e82-e21bc77693d7 admin admin] Pushing event updated for resources: {'Network': ['ID=bf160792-a09b-4087-8b28-6616042b88c7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:03.594753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network bf160792-a09b-4087-8b28-6616042b88c7 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:37:06.307200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37060) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:06.813706 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING oslo_policy.policy [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:37:06.814262 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING oslo_policy.policy [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:37:07.260726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.policy [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=113581) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 05 14:37:07.306687 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING oslo_policy.policy [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:37:07.307050 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING oslo_policy.policy [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 05 14:37:07.315689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:07.317651 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f586ed6-44a8-43e2-ab7b-878f16119412 admin admin] 10.222.0.30 "GET /v2.0/networks/bf160792-a09b-4087-8b28-6616042b88c7 HTTP/1.1" status: 200 len: 825 time: 1.0084300 Nov 05 14:37:07.365268 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-15cd6e35-2935-48c1-8948-41d864a5e47a admin admin] 10.222.0.30 "GET /v2.0/subnetpools/5ab8eae2-4046-4286-ba62-ae980d29a730 HTTP/1.1" status: 200 len: 734 time: 0.0408878 Nov 05 14:37:07.375058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Request body: {'subnet': {'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730', 'name': 'private-subnet', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'ip_version': 4, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:07.376650 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.quota [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Loaded quota_driver: . Nov 05 14:37:07.415479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Made reservation on behalf of c68e069375e249f1a75464c0686b0ffd for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:37:07.418739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Publish callbacks [] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:07.704700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:07.775116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Checking segment: {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:37:07.775490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Network hostable DHCP agents. Network: bf160792-a09b-4087-8b28-6616042b88c7, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:37:07.784124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Pushing event updated for resources: {'Subnet': ['ID=7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:07.796878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.797245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.797660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.797999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.798321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.798662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.798984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.799316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.799635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.799949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.800263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.800607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Tracked resource versions report: Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: pushed versions: Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: { 'AddressGroup': {'1.2'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'ConntrackHelper': {'1.0'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Log': {'1.0'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Network': {'1.1'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Port': {'1.7'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'PortForwarding': {'1.2'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'QosPolicy': {'1.10'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroup': {'1.5'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SubPort': {'1.0'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Subnet': {'1.1'}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Trunk': {'1.1'}} Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: consumer versions: Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'ConntrackHelper': '1.0', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Log': '1.0', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Network': '1.1', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Port': '1.7', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'PortForwarding': '1.2', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'QosPolicy': '1.10', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroup': '1.5', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroupRule': '1.2', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SubPort': '1.0', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Subnet': '1.1', Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Trunk': '1.1'}} Nov 05 14:37:07.801901 dv-neutron-816850-1-hyperv neutron-server[113581]: {{(pid=113581) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:37:07.833590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Network bf160792-a09b-4087-8b28-6616042b88c7 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:37:07.847426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, bf160792-a09b-4087-8b28-6616042b88c7) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:07.851859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:07.852520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:07.856702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cc84309-d513-449a-9930-51568be2ff60 None None] Network bf160792-a09b-4087-8b28-6616042b88c7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:37:07.873369 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0f860488-f1a9-4409-97d0-841dcaa8dc8b admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5017858 Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4cc84309-d513-449a-9930-51568be2ff60 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:37:08.029118 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:37:08.040695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c7bea22-576b-4f87-a2c4-c217232ccbd6 None None] Network bf160792-a09b-4087-8b28-6616042b88c7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5c7bea22-576b-4f87-a2c4-c217232ccbd6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:37:08.122260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:37:08.130316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1ff7e88-7462-4869-9a04-7b559ba67505 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:37:08.215969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1ff7e88-7462-4869-9a04-7b559ba67505 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:37:08.574115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-bf160792-a09b-4087-8b28-6616042b88c7', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:37:08.575308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:08.854372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Allocated IP 172.20.0.2 (bf160792-a09b-4087-8b28-6616042b88c7/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6/87b65c3a-7c75-4fea-b9f2-90f2bc4024e8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:37:09.099282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:09.106706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:09.182889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Network bf160792-a09b-4087-8b28-6616042b88c7 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:37:09.187662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:09.193216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Pushing event updated for resources: {'Port': ['ID=87b65c3a-7c75-4fea-b9f2-90f2bc4024e8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:09.195396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:37:09.227393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.227709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.228412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.228412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.228738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.229019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.229344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.229682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.230022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.230346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.230667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.230983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Tracked resource versions report: Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: pushed versions: Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: { 'AddressGroup': {'1.2'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'ConntrackHelper': {'1.0'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Log': {'1.0'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Network': {'1.1'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Port': {'1.7'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'PortForwarding': {'1.2'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'QosPolicy': {'1.10'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroup': {'1.5'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SubPort': {'1.0'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Subnet': {'1.1'}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Trunk': {'1.1'}} Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: consumer versions: Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'ConntrackHelper': '1.0', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Log': '1.0', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Network': '1.1', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Port': '1.7', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'PortForwarding': '1.2', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'QosPolicy': '1.10', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroup': '1.5', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroupRule': '1.2', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SubPort': '1.0', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Subnet': '1.1', Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Trunk': '1.1'}} Nov 05 14:37:09.232346 dv-neutron-816850-1-hyperv neutron-server[113582]: {{(pid=113582) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:37:09.278578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Attempting to bind port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:37:09.278974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Attempting to bind port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:37:09.279394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Attempting to bind port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 on network bf160792-a09b-4087-8b28-6616042b88c7 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:37:09.284209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 36, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:37:09.284631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Checking segment: {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:37:09.285109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:09.285496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Bound using segment: {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:37:09.285969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Bound port: 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:37:09.286379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:09.348309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] For port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:37:09.352446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] For port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=87b65c3a-7c75-4fea-b9f2-90f2bc4024e8,segment=NetworkSegment(29b75da8-159b-4a5d-bfbe-28f41c3fd7f8),segment_id=29b75da8-159b-4a5d-bfbe-28f41c3fd7f8)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:37:09.356893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:09.423895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6c1427-8bbd-44ae-ab93-63ce5f74c7a5 None None] Pushing event updated for resources: {'Port': ['ID=87b65c3a-7c75-4fea-b9f2-90f2bc4024e8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:10.422441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37080) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:10.770896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-8d3a1315-e23c-4fd7-8774-c54f6f0194f4 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:37:10.772544 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8d3a1315-e23c-4fd7-8774-c54f6f0194f4 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3490031 Nov 05 14:37:13.270541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37088) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:13.586349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-6c8467cd-3d81-4b78-a65a-02ff1a2bc580 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:37:13.587309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6c8467cd-3d81-4b78-a65a-02ff1a2bc580 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3157861 Nov 05 14:37:16.328684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37098) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:16.624018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:16.648127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:16.649767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:16.782467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:16.787278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:16.802012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:16.803186 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-91742d93-cf18-406d-bd73-f904b15de49b admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4728432 Nov 05 14:37:17.573343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:37:17.664140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:17.664556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:17.772711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:17.807056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=87b65c3a-7c75-4fea-b9f2-90f2bc4024e8,segment=NetworkSegment(29b75da8-159b-4a5d-bfbe-28f41c3fd7f8),segment_id=29b75da8-159b-4a5d-bfbe-28f41c3fd7f8)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:37:17.811880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:17.857963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=87b65c3a-7c75-4fea-b9f2-90f2bc4024e8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:18.573384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3f49ed2-c930-4af0-a3f1-ed8773a84d51 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:37:18.676450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5cdc2884-0e54-488a-bd7d-9cdb6731d533 None None] Provisioning complete for port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:18.676849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5cdc2884-0e54-488a-bd7d-9cdb6731d533 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:18.717739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3f49ed2-c930-4af0-a3f1-ed8773a84d51 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:37:19.343744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-12dfb8d7-9fb5-4aff-b9f0-a81645b72cc0 None None] Provisioning complete for port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:19.344119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12dfb8d7-9fb5-4aff-b9f0-a81645b72cc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:19.362263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37110) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:19.554507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:37:19.600342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:19.601008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:19.680491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-4a213b97-e744-43c3-aa86-fab8c1283c2b admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:37:19.681483 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4a213b97-e744-43c3-aa86-fab8c1283c2b admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3182721 Nov 05 14:37:19.967432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aff217ff-5f75-4671-b4f8-d8bc575ecb08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.178302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:22.335040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a020c5e-6838-438d-b5b1-ee44acae307e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.497348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'provider:network_type': 'flat', 'name': 'public', 'admin_state_up': True, 'is_default': True, 'router:external': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:22.518083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Made reservation on behalf of 8e71c2ca7e694f9aa939094ae9e27d1c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:37:22.520361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.528430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.599572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.603024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.617946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Reserving flat network on physical network physnet1 {{(pid=113580) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 05 14:37:22.641899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd238a67-7285-4ab6-bf34-bc215754baf5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:22.646569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.646930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Added segment 61488534-ae2d-4393-8e51-d7a4f47ad1d7 of type flat for network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 Nov 05 14:37:22.691645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.722599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.723512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:22.724102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:22.776217 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5967970 Nov 05 14:37:22.790509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0818846a-d6a3-4974-ac76-460517583f75 admin admin] Pushing event updated for resources: {'Network': ['ID=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:22.801293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:37:23.297445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:24.751918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:25.248820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37136) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:25.461042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52180800-b9a1-44ba-9fc7-81ee3b009c6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:25.462423 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-52180800-b9a1-44ba-9fc7-81ee3b009c6e admin admin] 10.222.0.30 "GET /v2.0/subnets/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6 HTTP/1.1" status: 200 len: 849 time: 0.2125750 Nov 05 14:37:25.638983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be7e2dd1-c76c-469d-a0ec-aee6a214c84b admin admin] 10.222.0.30 "GET /v2.0/routers/c4f5a4a1-98be-49b8-8ea5-7adf17462c8b HTTP/1.1" status: 200 len: 704 time: 0.1698866 Nov 05 14:37:25.835965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:25.907939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.201627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Allocated IP 172.20.0.1 (bf160792-a09b-4087-8b28-6616042b88c7/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6/18093367-a504-4240-be4e-620a73d67cff) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:37:26.378838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.442552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.521952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Network bf160792-a09b-4087-8b28-6616042b88c7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:37:26.529658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:26.531657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Pushing event updated for resources: {'Port': ['ID=18093367-a504-4240-be4e-620a73d67cff,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:26.543753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:37:26.544301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.783828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f1493a61-1177-4b43-b265-68e3d724f02d None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:26.784109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f1493a61-1177-4b43-b265-68e3d724f02d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.784411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.815769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f1493a61-1177-4b43-b265-68e3d724f02d None None] Port 18093367-a504-4240-be4e-620a73d67cff cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:37:26.986833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.991499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:26.992232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:27.073431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Pushing event updated for resources: {'Port': ['ID=18093367-a504-4240-be4e-620a73d67cff,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:27.116730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Network bf160792-a09b-4087-8b28-6616042b88c7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:37:27.118026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:27.276593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:37:27.337556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dda9eefe-ddf7-4e90-a47f-4d3dcbcefba5 None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:27.338103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dda9eefe-ddf7-4e90-a47f-4d3dcbcefba5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:27.366607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:37:27.377174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bae48e7d-abd3-4eb2-99e8-3d38a3a7564f admin admin] 10.222.0.30 "PUT /v2.0/routers/c4f5a4a1-98be-49b8-8ea5-7adf17462c8b/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7273734 Nov 05 14:37:27.377652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dda9eefe-ddf7-4e90-a47f-4d3dcbcefba5 None None] Port 18093367-a504-4240-be4e-620a73d67cff cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:37:27.393327 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Sync routers for ids ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:37:27.405908 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Routers {'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:37:27.406713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:37:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:27.597518 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Set router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:37:28.023635 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:26Z', 'revision_number': 2, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port_host': None, '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:26Z', 'revision_number': 2, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:28.073522 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Checking router: c4f5a4a1-98be-49b8-8ea5-7adf17462c8b for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:37:28.073891 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Updating router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b port 18093367-a504-4240-be4e-620a73d67cff binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:37:28.121567 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.628915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.636487 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.805016 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Attempting to bind port 18093367-a504-4240-be4e-620a73d67cff on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:37:28.805419 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Attempting to bind port 18093367-a504-4240-be4e-620a73d67cff by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:37:28.805871 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Attempting to bind port 18093367-a504-4240-be4e-620a73d67cff on network bf160792-a09b-4087-8b28-6616042b88c7 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:37:28.807821 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Pushing event updated for resources: {'Port': ['ID=18093367-a504-4240-be4e-620a73d67cff,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:28.818425 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.818774 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.819107 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.819433 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.819756 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.820083 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.820406 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.820853 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.821195 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.821521 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.821829 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.822144 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Tracked resource versions report: Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: pushed versions: Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: { 'AddressGroup': {'1.2'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'ConntrackHelper': {'1.0'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Log': {'1.0'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Network': {'1.1'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Port': {'1.7'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'PortForwarding': {'1.2'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'QosPolicy': {'1.10'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroup': {'1.5'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SubPort': {'1.0'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Subnet': {'1.1'}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Trunk': {'1.1'}} Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: consumer versions: Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'ConntrackHelper': '1.0', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Log': '1.0', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Network': '1.1', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Port': '1.7', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'PortForwarding': '1.2', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'QosPolicy': '1.10', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroup': '1.5', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroupRule': '1.2', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SubPort': '1.0', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Subnet': '1.1', Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Trunk': '1.1'}} Nov 05 14:37:28.823494 dv-neutron-816850-1-hyperv neutron-server[113583]: {{(pid=113583) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:37:28.825894 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 37, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:37:28.826296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Checking segment: {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:37:28.826777 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.827155 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Bound using segment: {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:37:28.827651 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Bound port: 18093367-a504-4240-be4e-620a73d67cff, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '29b75da8-159b-4a5d-bfbe-28f41c3fd7f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 603, 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:37:28.828048 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.891577 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] For port 18093367-a504-4240-be4e-620a73d67cff, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:37:28.913856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:28.914891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.915209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] For port 18093367-a504-4240-be4e-620a73d67cff, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=18093367-a504-4240-be4e-620a73d67cff,segment=NetworkSegment(29b75da8-159b-4a5d-bfbe-28f41c3fd7f8),segment_id=29b75da8-159b-4a5d-bfbe-28f41c3fd7f8)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:37:28.919480 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:28.976795 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb09daa-9de4-4242-a414-539a73f3d9d1 None None] Pushing event updated for resources: {'Port': ['ID=18093367-a504-4240-be4e-620a73d67cff,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:28.987111 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Routers {'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:37:28.987711 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:37:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:28.993601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:29.032897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] For port 18093367-a504-4240-be4e-620a73d67cff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=18093367-a504-4240-be4e-620a73d67cff,segment=NetworkSegment(29b75da8-159b-4a5d-bfbe-28f41c3fd7f8),segment_id=29b75da8-159b-4a5d-bfbe-28f41c3fd7f8)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:37:29.040878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:29.087459 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] Set router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:37:29.104259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aae82b1-7b94-49b8-aec3-c50be29f840b None None] Pushing event updated for resources: {'Port': ['ID=18093367-a504-4240-be4e-620a73d67cff,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:29.260826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-279bf51e-a05b-4ffe-b262-e03d373f9fb8 None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:29.261218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-279bf51e-a05b-4ffe-b262-e03d373f9fb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:29.296853 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:26Z', 'revision_number': 2, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port_host': None, '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:28Z', 'revision_number': 4, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:29.326157 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9dafecf0-ed61-40fb-abf6-99b05a62d73e None None] The sync data for ids ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'] in dv-neutron-816850-1-hyperv is: [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:26Z', 'revision_number': 2, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port_host': None, '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:28Z', 'revision_number': 4, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:37:29.728770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37158) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:29.859000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2dce24c-b92d-447e-b5aa-8a76056cf5c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:29.860359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a2dce24c-b92d-447e-b5aa-8a76056cf5c9 admin admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 842 time: 0.1306038 Nov 05 14:37:29.870598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.26.5.1', 'cidr': '172.26.5.0/24', 'name': 'public-subnet', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_dhcp': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:29.891429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Made reservation on behalf of 8e71c2ca7e694f9aa939094ae9e27d1c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:37:29.893674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Publish callbacks [] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:30.199321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:37:30.199756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:30.258384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Pushing event updated for resources: {'Subnet': ['ID=55057ba1-ab5e-4ba9-9c9a-e58663fd982d,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:30.263300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:37:30.263651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Network hostable DHCP agents. Network: 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:37:30.280299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:37:30.288853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:30.293567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:30.297973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:30.299521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab7a1b0e-ada1-4c02-a773-c7d28a8d4a11 None None] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:37:30.328537 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0895fc54-4a66-493c-94ea-518c81efe359 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4578056 Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ab7a1b0e-ada1-4c02-a773-c7d28a8d4a11 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:37:30.380596 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:37:30.392014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9937d51c-0e89-46ec-8877-4bb022c9011b None None] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9937d51c-0e89-46ec-8877-4bb022c9011b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:37:30.476111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:37:30.491533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6d3cad0-c274-4a65-9976-0c54f1cf6436 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:37:30.551746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6d3cad0-c274-4a65-9976-0c54f1cf6436 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:37:30.752528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8e194e1-ce59-4eb2-99a7-2cdcef1c6e00 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:37:30.805428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8e194e1-ce59-4eb2-99a7-2cdcef1c6e00 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:37:32.731405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37166) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:32.945728 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24b5cb41-22db-4712-a2d2-367655290153 admin admin] 10.222.0.30 "GET /v2.0/routers/c4f5a4a1-98be-49b8-8ea5-7adf17462c8b HTTP/1.1" status: 200 len: 710 time: 0.2098584 Nov 05 14:37:33.033714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38b44eaa-47a4-4551-8e65-2220787142d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:37:33.035018 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-38b44eaa-47a4-4551-8e65-2220787142d6 admin admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 886 time: 0.0864651 Nov 05 14:37:33.045290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:37:33.293462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:33.527535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:33.602558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:33.792474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Allocated IP 172.26.5.159 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/624d9779-c503-494c-9b9c-d4d23e7bfc8a) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:37:33.903499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:33.963571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:34.026630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:37:34.032131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:37:34.040357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:37:34.085744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Pushing event updated for resources: {'Port': ['ID=624d9779-c503-494c-9b9c-d4d23e7bfc8a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:34.329570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:34.528560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:34.532975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:34.642829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:37:34.754749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:37:34.759077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:34.760075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-69282b08-aac4-4051-9326-3f06f056307a admin admin] 10.222.0.30 "PUT /v2.0/routers/c4f5a4a1-98be-49b8-8ea5-7adf17462c8b HTTP/1.1" status: 200 len: 890 time: 1.7179897 Nov 05 14:37:35.580510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 18093367-a504-4240-be4e-620a73d67cff up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:37:35.630481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:35.630855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:36.288419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Sync routers for ids ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:37:36.300055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Routers {'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:37:36.300798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:37:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:36.504569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Set router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:37:36.889102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159'}], 'enable_snat': True}, 'gw_port_id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:34Z', 'revision_number': 4, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port': {'id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:e7:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:33Z', 'updated_at': '2021-11-05T14:37:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:29Z', 'revision_number': 5, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:36.944700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Checking router: c4f5a4a1-98be-49b8-8ea5-7adf17462c8b for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:37:36.945057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Updating router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b port 624d9779-c503-494c-9b9c-d4d23e7bfc8a binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:37:36.993435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.265207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37178) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:37:37.303260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.308921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.359807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Attempting to bind port 624d9779-c503-494c-9b9c-d4d23e7bfc8a on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:37:37.360182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Attempting to bind port 624d9779-c503-494c-9b9c-d4d23e7bfc8a by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:37:37.360577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Attempting to bind port 624d9779-c503-494c-9b9c-d4d23e7bfc8a on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:37:37.363303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b2ce79-8f1d-4d5c-b827-bebc7afcc301 None None] Pushing event updated for resources: {'Port': ['ID=624d9779-c503-494c-9b9c-d4d23e7bfc8a,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:37.367728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 37, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:37:37.368102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:37:37.368527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.368915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:37:37.369377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Bound port: 624d9779-c503-494c-9b9c-d4d23e7bfc8a, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:37:37.369753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.380502 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-926c4879-023f-4f08-b8bd-6818d5d46b77 admin admin] 10.222.0.30 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1125236 Nov 05 14:37:37.423880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] For port 624d9779-c503-494c-9b9c-d4d23e7bfc8a, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:37:37.429139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] For port 624d9779-c503-494c-9b9c-d4d23e7bfc8a, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=624d9779-c503-494c-9b9c-d4d23e7bfc8a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:37:37.434055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:37.599365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b2ce79-8f1d-4d5c-b827-bebc7afcc301 None None] Pushing event updated for resources: {'Port': ['ID=624d9779-c503-494c-9b9c-d4d23e7bfc8a,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:37.605040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Routers {'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:37:37.605631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:37:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:37.715308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] Set router c4f5a4a1-98be-49b8-8ea5-7adf17462c8b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:37:37.942477 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159'}], 'enable_snat': True}, 'gw_port_id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:34Z', 'revision_number': 4, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port': {'id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:e7:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:33Z', 'updated_at': '2021-11-05T14:37:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:29Z', 'revision_number': 5, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:37:37.969218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-458f6670-60d1-4ff5-87f0-f80589dbc0f1 None None] The sync data for ids ['c4f5a4a1-98be-49b8-8ea5-7adf17462c8b'] in dv-neutron-816850-1-hyperv is: [{'id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'name': 'router1', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159'}], 'enable_snat': True}, 'gw_port_id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:37:16Z', 'updated_at': '2021-11-05T14:37:34Z', 'revision_number': 4, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'gw_port': {'id': '624d9779-c503-494c-9b9c-d4d23e7bfc8a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:e7:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:33Z', 'updated_at': '2021-11-05T14:37:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '18093367-a504-4240-be4e-620a73d67cff', 'name': '', 'network_id': 'bf160792-a09b-4087-8b28-6616042b88c7', 'tenant_id': 'c68e069375e249f1a75464c0686b0ffd', 'mac_address': 'fa:16:3e:2c:ef:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4f5a4a1-98be-49b8-8ea5-7adf17462c8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:37:25Z', 'updated_at': '2021-11-05T14:37:29Z', 'revision_number': 5, 'project_id': 'c68e069375e249f1a75464c0686b0ffd', 'subnets': [{'id': '7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '5ab8eae2-4046-4286-ba62-ae980d29a730'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:37:39.606525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 624d9779-c503-494c-9b9c-d4d23e7bfc8a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:37:39.662544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 624d9779-c503-494c-9b9c-d4d23e7bfc8a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:39.662953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:39.745239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:39.771319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 624d9779-c503-494c-9b9c-d4d23e7bfc8a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=624d9779-c503-494c-9b9c-d4d23e7bfc8a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:37:39.776271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:39.830589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=624d9779-c503-494c-9b9c-d4d23e7bfc8a,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:37:41.610844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 624d9779-c503-494c-9b9c-d4d23e7bfc8a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:37:41.681098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 624d9779-c503-494c-9b9c-d4d23e7bfc8a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:37:41.681611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:48.496143 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:37:49.971668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c783c6db-946d-4000-a61c-2a5d9c6ae51a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:52.343359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bdeceb1-622e-49e9-8eab-7725a9bf20e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:53.301607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:54.763722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:37:55.851688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:19.976111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-24577403-fc3e-4395-a010-1fcef615e77d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:22.344089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3c5e724b-dec9-4a35-b854-cad25168fc7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:23.304921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:24.757582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:25.497145 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:38:25.836206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:49.978930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c3b2c104-ecae-4307-a09d-7f78aafbf748 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:52.349165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3979b26f-d72a-4592-b0e9-0f186b8dbf50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:53.305869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:54.761713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:38:55.838813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:02.497573 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:39:19.815990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37772) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:19.876126 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4f070cb-2c22-425c-b75f-bcb80a12fcfd admin admin] GET failed (client error): The resource could not be found. Nov 05 14:39:19.877478 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b4f070cb-2c22-425c-b75f-bcb80a12fcfd admin admin] 10.222.0.30 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0605302 Nov 05 14:39:19.979844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-553465f2-7f39-4d43-9556-a7eff8eb3995 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:20.035345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb7c5dcc-c88a-4807-b3b1-0a6a82d9790b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:20.036766 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bb7c5dcc-c88a-4807-b3b1-0a6a82d9790b admin admin] 10.222.0.30 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1547461 Nov 05 14:39:22.307410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37782) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:22.352160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-671c6e36-f2cb-4dbc-af9a-ac2841745cf7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:22.401105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c125e2b-fdde-4d86-8211-3890dd688117 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:22.402441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2c125e2b-fdde-4d86-8211-3890dd688117 admin admin] 10.222.0.30 "GET /v2.0/subnets/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6 HTTP/1.1" status: 200 len: 849 time: 0.0940926 Nov 05 14:39:22.412888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:39:22.508496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Publish callbacks [] for subnet, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:22.646119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261'] for subnet, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:22.680053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:22.680688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:22.681951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] 10.222.0.30 "PUT /v2.0/subnets/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6 HTTP/1.1" status: 200 len: 868 time: 0.2726698 Nov 05 14:39:22.686189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb5e0d6a-8c94-4414-a7ab-ced7a69ef035 None None] Network bf160792-a09b-4087-8b28-6616042b88c7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:39:22.699769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:39:22.708241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.708645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.708987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.709320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.709651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.709990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.710318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.710666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.710992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.711314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.711635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.711954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b13baa7-5b5d-4229-a8c3-cabdcdde4b68 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cb5e0d6a-8c94-4414-a7ab-ced7a69ef035 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:39:22.886085 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:39:22.896838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3c95335-9df7-47cf-bbe4-934f4119d1b1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:39:22.949739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3c95335-9df7-47cf-bbe4-934f4119d1b1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:39:23.315548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:23.554087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7f17d484-89cd-45f9-96c4-d3374aed1530 None None] Provisioning complete for port 87b65c3a-7c75-4fea-b9f2-90f2bc4024e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:39:23.554753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f17d484-89cd-45f9-96c4-d3374aed1530 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:23.647085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7f17d484-89cd-45f9-96c4-d3374aed1530 None None] Provisioning complete for port 18093367-a504-4240-be4e-620a73d67cff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:39:23.647448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f17d484-89cd-45f9-96c4-d3374aed1530 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:24.764501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:24.985161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37790) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:25.180896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0478b74-0910-4c6f-b8d7-a01304709141 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:25.181723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0478b74-0910-4c6f-b8d7-a01304709141 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:25.183565 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a0478b74-0910-4c6f-b8d7-a01304709141 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1974399 Nov 05 14:39:25.841393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:27.932236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37798) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:28.142725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b72aa58-3459-4908-ab7a-eaf02013a369 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:28.143098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b72aa58-3459-4908-ab7a-eaf02013a369 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:28.144655 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b72aa58-3459-4908-ab7a-eaf02013a369 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2114167 Nov 05 14:39:30.414541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37806) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:30.540899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f03aa81-255c-4e78-a293-fa9d81f4e7e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:30.542260 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f03aa81-255c-4e78-a293-fa9d81f4e7e3 admin admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 886 time: 0.1267591 Nov 05 14:39:32.826191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37816) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:32.954072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37ebbae4-8e74-4cc0-bd42-07d597599891 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:32.955697 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-37ebbae4-8e74-4cc0-bd42-07d597599891 admin admin] 10.222.0.30 "GET /v2.0/networks/bf160792-a09b-4087-8b28-6616042b88c7 HTTP/1.1" status: 200 len: 869 time: 0.1285667 Nov 05 14:39:35.227291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37824) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:35.350126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-019082db-874c-46e3-8aae-febbf338c61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:35.350566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-019082db-874c-46e3-8aae-febbf338c61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:35.352067 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-019082db-874c-46e3-8aae-febbf338c61a admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1238387 Nov 05 14:39:37.596090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37832) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:37.706067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0198ea55-bd72-4cb2-b82c-50d570e7e865 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:37.706510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0198ea55-bd72-4cb2-b82c-50d570e7e865 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:37.708060 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0198ea55-bd72-4cb2-b82c-50d570e7e865 admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1109533 Nov 05 14:39:39.496190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:39:40.016798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37840) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:40.104370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5af4a628-9069-47de-8733-26e3376e5e47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:40.105714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5af4a628-9069-47de-8733-26e3376e5e47 admin admin] 10.222.0.30 "GET /v2.0/subnets/55057ba1-ab5e-4ba9-9c9a-e58663fd982d HTTP/1.1" status: 200 len: 816 time: 0.0879633 Nov 05 14:39:42.355488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37848) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:39:42.445854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71bb10e7-ff8d-4cfb-8089-07f4f5068403 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:39:42.447191 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71bb10e7-ff8d-4cfb-8089-07f4f5068403 admin admin] 10.222.0.30 "GET /v2.0/subnets/7e1c99bc-e0f6-42a9-87eb-e6f9a6d704f6 HTTP/1.1" status: 200 len: 868 time: 0.0907381 Nov 05 14:39:49.982233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-107bb7db-e454-4b72-a187-28b6204efe14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:52.356213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-081b1f75-2337-43b2-847e-db50f44434f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:53.312018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:54.766385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:39:55.844027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:07.196080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:40:07.242884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-b2ea385e-6193-40f0-839a-3503454de552 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:40:07.243862 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b2ea385e-6193-40f0-839a-3503454de552 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0467947 Nov 05 14:40:09.605611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37910) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:40:09.664370 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-1350be15-ccb8-4182-ae98-13b676a45d1b admin admin] GET failed (client error): The resource could not be found. Nov 05 14:40:09.665662 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1350be15-ccb8-4182-ae98-13b676a45d1b admin admin] 10.222.0.30 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0590968 Nov 05 14:40:09.863589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31ea0715-cad7-41fc-af26-5ad67812182c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:40:09.864980 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31ea0715-cad7-41fc-af26-5ad67812182c admin admin] 10.222.0.30 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1946714 Nov 05 14:40:12.148633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37918) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:40:12.194628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:40:12.217326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Made reservation on behalf of 8e71c2ca7e694f9aa939094ae9e27d1c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:40:12.219757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:12.259933 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.services.revisions.revision_plugin [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Could not find related network for resource to bump revision. Nov 05 14:40:12.275377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 622} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:40:12.287780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8785316554478', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:12.288288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Unsubscribe: segment precommit_create {{(pid=113581) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 05 14:40:12.288775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Added segment 89c45c70-abda-41a2-a005-38b20dc5309a of type vlan for network a7ba848b-6b37-4af7-8857-f74b4bca9843 Nov 05 14:40:12.331862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:12.365471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:12.366402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:40:12.366969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:12.437053 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2872984 Nov 05 14:40:12.462246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Pushing event updated for resources: {'Network': ['ID=a7ba848b-6b37-4af7-8857-f74b4bca9843,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:40:12.469628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.470028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.470379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.470717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.471054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.471426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.471740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.472068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.472397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.472751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.473076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.473398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b770e8ad-4d21-48a8-97c0-dd88e51d40e0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:12.485725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:40:14.746762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37926) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:40:14.814097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-056feff3-64ce-4a98-a205-35539c7f317d admin admin] GET failed (client error): The resource could not be found. Nov 05 14:40:14.815429 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-056feff3-64ce-4a98-a205-35539c7f317d admin admin] 10.222.0.30 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0677052 Nov 05 14:40:14.882726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b5596a6-0825-4591-b3ef-9294f262b616 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:40:14.884119 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b5596a6-0825-4591-b3ef-9294f262b616 admin admin] 10.222.0.30 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0641031 Nov 05 14:40:14.894754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843', 'ip_version': 4, 'description': 'shared-subnet'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:40:14.913316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Made reservation on behalf of 8e71c2ca7e694f9aa939094ae9e27d1c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:40:14.915479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Publish callbacks [] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.075436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.122004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Pushing event updated for resources: {'Subnet': ['ID=4a2bd17f-d985-49b9-ad2c-a812da33c55e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:40:15.136570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Checking segment: {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:40:15.136917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Network hostable DHCP agents. Network: a7ba848b-6b37-4af7-8857-f74b4bca9843, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:40:15.152819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:40:15.160640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a7ba848b-6b37-4af7-8857-f74b4bca9843) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:40:15.165516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:40:15.166090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.171330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-772fb170-a40b-419e-aa05-3108b0902e68 None None] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:40:15.181369 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c0a3a09e-5e67-4420-a817-883292cfad2e admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2905416 Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-772fb170-a40b-419e-aa05-3108b0902e68 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:40:15.248073 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:40:15.258651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b062818a-05e0-491a-94cc-16054425d242 None None] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b062818a-05e0-491a-94cc-16054425d242 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:40:15.331944 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:40:15.341413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7957c594-d468-4a20-821b-24be1b0717b2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:40:15.405665 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7957c594-d468-4a20-821b-24be1b0717b2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:40:15.603697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a7ba848b-6b37-4af7-8857-f74b4bca9843', 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843', 'tenant_id': '8e71c2ca7e694f9aa939094ae9e27d1c', 'fixed_ips': [{'subnet_id': '4a2bd17f-d985-49b9-ad2c-a812da33c55e'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:40:15.604417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.735359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Allocated IP 192.168.233.2 (a7ba848b-6b37-4af7-8857-f74b4bca9843/4a2bd17f-d985-49b9-ad2c-a812da33c55e/e24998b3-a38b-486c-b210-634f003500cd) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:40:15.880745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.887383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:15.925887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:40:15.930817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:40:15.934966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:40:15.942701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Pushing event updated for resources: {'Port': ['ID=e24998b3-a38b-486c-b210-634f003500cd,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:40:15.951956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.952298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.952656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.952988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.953308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.953646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.953969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.954339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.954678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.954998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.955318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:15.955890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:40:16.004992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Attempting to bind port e24998b3-a38b-486c-b210-634f003500cd on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:40:16.005359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Attempting to bind port e24998b3-a38b-486c-b210-634f003500cd by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:40:16.005721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Attempting to bind port e24998b3-a38b-486c-b210-634f003500cd on network a7ba848b-6b37-4af7-8857-f74b4bca9843 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:40:16.010632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 39, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:40:16.011003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Checking segment: {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:40:16.011403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:16.011794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Bound using segment: {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:40:16.012257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Bound port: e24998b3-a38b-486c-b210-634f003500cd, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:40:16.012775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:16.073630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] For port e24998b3-a38b-486c-b210-634f003500cd, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:40:16.076799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] For port e24998b3-a38b-486c-b210-634f003500cd, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e24998b3-a38b-486c-b210-634f003500cd,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:40:16.083037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:16.137993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f325662-209f-497d-bfe0-bd26e079e511 None None] Pushing event updated for resources: {'Port': ['ID=e24998b3-a38b-486c-b210-634f003500cd,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:40:16.495212 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:40:16.962639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f6cd9d9-2c62-4f1c-b17a-95653054d881 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:40:17.035174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f6cd9d9-2c62-4f1c-b17a-95653054d881 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:40:17.052572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] Provisioning complete for port e24998b3-a38b-486c-b210-634f003500cd triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:40:17.052941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:17.209493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:17.259845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] For port e24998b3-a38b-486c-b210-634f003500cd, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e24998b3-a38b-486c-b210-634f003500cd,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:40:17.267911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:17.361284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e51aaba-82d5-4c52-a983-7bad9905e482 None None] Pushing event updated for resources: {'Port': ['ID=e24998b3-a38b-486c-b210-634f003500cd,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:40:17.707660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e24998b3-a38b-486c-b210-634f003500cd up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:40:17.762322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e24998b3-a38b-486c-b210-634f003500cd triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:40:17.762692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:17.810924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4c8c71de-d525-427b-8b23-0d464526146a None None] Provisioning complete for port e24998b3-a38b-486c-b210-634f003500cd triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:40:17.811287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4c8c71de-d525-427b-8b23-0d464526146a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:19.984800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef595988-cc1e-4ecc-bc03-031e57623841 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:22.357890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02b9e0ef-d262-451b-beab-7432b66070ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:23.314327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:24.769277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:25.845838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:49.986713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-447f76a6-37db-4136-b148-cd9d78ad21d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:52.359810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-944d7bef-535b-4862-9fc3-70c906f974cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:53.317839 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:53.494107 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:40:54.772544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:40:55.847919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:19.991720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-13ef6aac-cedb-4337-8055-ffb9ce972465 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:22.362622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8906276-aab1-4b55-b655-2eeee7a37815 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:23.320798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:24.776779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:25.849863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:30.418879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37972) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:41:30.425179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-18d1225b-ce45-4739-9b61-72ef9cfa3270 tempest-verify_tempest_config-1721880660 tempest-verify_tempest_config-1721880660-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:41:30.426204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18d1225b-ce45-4739-9b61-72ef9cfa3270 tempest-verify_tempest_config-1721880660 tempest-verify_tempest_config-1721880660-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0063012 Nov 05 14:41:30.492145 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:41:30.717194 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 37990) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:41:30.815770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:30.887148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:30.890635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:30.936694 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=899328cd8eff431fab0f51129d3f3b3b&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2184212 Nov 05 14:41:30.937696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c90b7d1-97f7-49b5-b1d1-703ebe020985,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:41:30.939452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 37994) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:41:30.944933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.945291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.945645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.945957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.946282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.946625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.946951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.947285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.947608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.947924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.948239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:30.948575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3a79037-2735-4cc6-99fa-83c96b927b6e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.017521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:31.039385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:31.127925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:31.130450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:31.131608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8c90b7d1-97f7-49b5-b1d1-703ebe020985 HTTP/1.1" status: 204 len: 168 time: 0.1901305 Nov 05 14:41:31.139499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c90b7d1-97f7-49b5-b1d1-703ebe020985,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:41:31.146418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.146789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.147129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.147478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.147793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.148136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.148476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.148832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.149259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.149477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.149802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:31.150116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db6983ef-49b9-4c11-be28-9b9b27de69c9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:41:49.993719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f9d15435-5b8b-4d65-aa43-cb224c6aefac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:52.363742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61aad696-57bc-4b75-90a1-1afca6b2ce19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:53.322960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:54.779876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:41:55.850651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:07.490090 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:42:19.995195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-03d2363b-1f1e-4151-85a2-88219d1aa862 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:22.364714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02e1c79f-60e6-4c45-ba59-06113d8dcf3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:23.325383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:24.783144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:25.852016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:44.488182 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 5 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:42:48.078854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1034007'] for agent, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:49.995323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b1bb2bd2-30c1-4da6-8ab3-001be003f785 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:52.365774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-915c2b08-3487-4df5-925f-e31c933b7f8d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:53.327667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:54.786563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:42:55.854265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:02.871842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38066) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:43:02.977364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cd8e5f56-0881-44dd-89ad-042be01e658a admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.1043324 Nov 05 14:43:05.257101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38076) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:43:05.320217 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0a0fcdd-d3a5-419e-9a08-d6acf51e30cc admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4565 time: 0.0620248 Nov 05 14:43:18.023756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:19.998366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1403fab-2749-4067-8cce-1298c24a3cd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:21.489202 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:43:22.366711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de81d7fe-a9f1-46d7-808e-006dbfc213a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:23.331732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:24.789678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:25.855510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:48.028430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:50.000138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3984a419-5520-48cd-b1a1-6d575c544fc5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:52.368431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30d18ee9-eb74-4886-af7a-a79da689f1f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:53.334560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:54.796583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:55.856954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:43:58.488482 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:44:17.629350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38176) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:17.946680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-1091836873-network', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:17.970144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Made reservation on behalf of b398cbd7c6d04e96b90e3a8bcfd826b4 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:17.972814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:17.985822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.061417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.092381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.097363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.112748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:18.137202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.137460 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Added segment c509f189-e51f-483b-b35f-b9ea2b45ee7d of type vlan for network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a Nov 05 14:44:18.174923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=132f4b8d-4ff7-4c3a-a13d-cf06b6275393,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:18.191701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.192066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.192405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.193247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.194049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.194865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.195675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.196254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.197108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.197574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.198084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.198581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Tracked resource versions report: Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: pushed versions: Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: { 'AddressGroup': {'1.2'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'ConntrackHelper': {'1.0'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Log': {'1.0'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Network': {'1.1'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Port': {'1.7'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'PortForwarding': {'1.2'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'QosPolicy': {'1.10'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroup': {'1.5'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SubPort': {'1.0'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Subnet': {'1.1'}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Trunk': {'1.1'}} Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: consumer versions: Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: HyperV agent@hv-neutron-8168: {}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'ConntrackHelper': '1.0', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Log': '1.0', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Network': '1.1', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Port': '1.7', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'PortForwarding': '1.2', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'QosPolicy': '1.10', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroup': '1.5', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SecurityGroupRule': '1.2', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'SubPort': '1.0', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Subnet': '1.1', Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: 'Trunk': '1.1'}} Nov 05 14:44:18.199862 dv-neutron-816850-1-hyperv neutron-server[113581]: {{(pid=113581) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:44:18.206754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.233768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.234746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:18.235326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.300944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38214) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:18.301942 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6698806 Nov 05 14:44:18.307320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Request body: {'subnet': {'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-1091836873-subnet', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:18.320320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25b35aa-d799-4745-b997-122eb45e4550 admin admin] Pushing event updated for resources: {'Network': ['ID=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:18.333365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Made reservation on behalf of b398cbd7c6d04e96b90e3a8bcfd826b4 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:18.333829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:18.336532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.548357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.601935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=40981c52-1a1c-434c-b98f-d3a05d50d8a6,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:18.614572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.614572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.614572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.614572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.614572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.615092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.615273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.615844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.616230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.616588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.616906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.617402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Tracked resource versions report: Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: pushed versions: Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: { 'AddressGroup': {'1.2'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'ConntrackHelper': {'1.0'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Log': {'1.0'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Network': {'1.1'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Port': {'1.7'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'PortForwarding': {'1.2'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'QosPolicy': {'1.10'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroup': {'1.5'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SubPort': {'1.0'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Subnet': {'1.1'}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Trunk': {'1.1'}} Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: consumer versions: Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: HyperV agent@hv-neutron-8168: {}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'ConntrackHelper': '1.0', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Log': '1.0', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Network': '1.1', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Port': '1.7', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'PortForwarding': '1.2', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'QosPolicy': '1.10', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroup': '1.5', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SecurityGroupRule': '1.2', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'SubPort': '1.0', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Subnet': '1.1', Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: 'Trunk': '1.1'}} Nov 05 14:44:18.618515 dv-neutron-816850-1-hyperv neutron-server[113580]: {{(pid=113580) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:44:18.636635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Checking segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:18.637190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Network hostable DHCP agents. Network: 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:18.662112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:18.675900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:18.681402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:18.682254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.691732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f806bbd-3ed7-4d58-ac2d-e6297a43bb91 None None] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:18.723734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38238) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:18.726709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:18.729055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f9478233-638c-4ab0-8131-25a37d4c2fe2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4269664 Nov 05 14:44:18.758872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.761708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3f806bbd-3ed7-4d58-ac2d-e6297a43bb91 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:18.790735 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:18.802906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4007662-77b6-4095-b13c-1e47d53c216a None None] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:18.835103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a4007662-77b6-4095-b13c-1e47d53c216a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:18.886728 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:18.901651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a330ffe-cc03-4ae1-9b79-2e6b6946637a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:18.983061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a330ffe-cc03-4ae1-9b79-2e6b6946637a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:19.013838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.220058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:44:19.220967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.288213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.389825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Allocated IP 172.20.0.2 (4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a/40981c52-1a1c-434c-b98f-d3a05d50d8a6/75e751a9-0e74-46fd-a4fb-738311e1dc68) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:19.407918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.522235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Allocated IP 172.26.5.181 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/501824c9-0f88-46c0-b875-0a1fb46eb708) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:19.576707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.587123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.606998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:19.609705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:19.635795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:19.649480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.693093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.704727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Pushing event updated for resources: {'Port': ['ID=75e751a9-0e74-46fd-a4fb-738311e1dc68,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:19.713296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.713668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.714377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.714377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.714638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.714984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.715320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.715785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.716130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.717070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.717494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.717819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Tracked resource versions report: Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: pushed versions: Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: { 'AddressGroup': {'1.2'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'ConntrackHelper': {'1.0'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Log': {'1.0'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Network': {'1.1'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Port': {'1.7'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'PortForwarding': {'1.2'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'QosPolicy': {'1.10'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroup': {'1.5'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SubPort': {'1.0'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Subnet': {'1.1'}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Trunk': {'1.1'}} Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: consumer versions: Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: HyperV agent@hv-neutron-8168: {}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'ConntrackHelper': '1.0', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Log': '1.0', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Network': '1.1', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Port': '1.7', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'PortForwarding': '1.2', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'QosPolicy': '1.10', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroup': '1.5', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SecurityGroupRule': '1.2', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'SubPort': '1.0', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Subnet': '1.1', Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: 'Trunk': '1.1'}} Nov 05 14:44:19.718935 dv-neutron-816850-1-hyperv neutron-server[113582]: {{(pid=113582) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:44:19.722457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Attempting to bind port 75e751a9-0e74-46fd-a4fb-738311e1dc68 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:19.722947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Attempting to bind port 75e751a9-0e74-46fd-a4fb-738311e1dc68 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:19.723416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Attempting to bind port 75e751a9-0e74-46fd-a4fb-738311e1dc68 on network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:19.729285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 43, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:19.729806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Checking segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:19.730312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.730797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Bound using segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:19.731363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Bound port: 75e751a9-0e74-46fd-a4fb-738311e1dc68, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:19.731945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.743801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Pushing event updated for resources: {'Port': ['ID=501824c9-0f88-46c0-b875-0a1fb46eb708,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:19.756609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:19.757947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:19.760846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:19.800316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] For port 75e751a9-0e74-46fd-a4fb-738311e1dc68, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:19.804208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] For port 75e751a9-0e74-46fd-a4fb-738311e1dc68, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75e751a9-0e74-46fd-a4fb-738311e1dc68,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:19.811469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:19.883182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc17e03c-7158-4749-83a1-93d00d873f5c None None] Pushing event updated for resources: {'Port': ['ID=75e751a9-0e74-46fd-a4fb-738311e1dc68,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:19.955193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38280) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:20.001896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.017370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-49fb8edc-0fca-4812-898b-753cae269946 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.068814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38286) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:20.247713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.374808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-816424850-network', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:20.399485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Made reservation on behalf of 643f5fc30ebb419c9fb85748c2767795 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:20.401063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Router 04a38fc5-d67e-4be6-a52e-5b36bc22986d is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:44:20.402483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.413179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.458350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1377752248-network', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:20.521802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Made reservation on behalf of 3cb2c9da66364ac18972da6a46b083c1 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:20.525130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.544122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.553429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:20.564431 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Sync routers for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:20.578778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.582776 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:20.584085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.584627 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:43:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:20.588929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf6b828e-a74f-4cd1-b79e-978cb96006f6 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.8650882 Nov 05 14:44:20.591048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38304) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:20.598925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.661784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 641} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:20.668582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53618845-9a6d-4f05-aead-32f3c4c8242c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:20.711959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.712676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Added segment b07b665e-5721-4aed-9413-b39d3361eee5 of type vlan for network fc36919c-2228-49a8-98f4-75664fee44eb Nov 05 14:44:20.787168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.821277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.830863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.861214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75a272d8-d137-4f24-9ad2-52f91b26fcb3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:20.866350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.867654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:20.868511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.900342 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.9440622 Nov 05 14:44:20.918748 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:20.922512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38322) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:20.928835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Request body: {'subnet': {'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-816424850-subnet', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:20.930227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 636} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:20.953778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:20.954176 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Added segment 48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f of type vlan for network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 Nov 05 14:44:20.969675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723b8888-3648-4a2f-ba8d-dd240e5efe5e admin admin] Pushing event updated for resources: {'Network': ['ID=fc36919c-2228-49a8-98f4-75664fee44eb,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:20.997000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Made reservation on behalf of 643f5fc30ebb419c9fb85748c2767795 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:20.997228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fc36919c-2228-49a8-98f4-75664fee44eb details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:20.999268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.032212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.061341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.062983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:21.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.099962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 1.0293906 Nov 05 14:44:21.138066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38328) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:21.144876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Request body: {'subnet': {'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1377752248-subnet', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:21.185051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3eed3bf-fa15-4087-a310-73571aefef75 admin admin] Pushing event updated for resources: {'Network': ['ID=fd1ccb7c-d1e8-48e2-b784-b56a587e2542,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:21.198875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Made reservation on behalf of 3cb2c9da66364ac18972da6a46b083c1 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:21.199470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:21.202415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Publish callbacks [] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.336473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f66e2a10-8141-41dd-9614-5b69cf6506fc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:21.401419 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:19Z', 'revision_number': 3, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:21.438762 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Checking router: 04a38fc5-d67e-4be6-a52e-5b36bc22986d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:21.439412 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Updating router 04a38fc5-d67e-4be6-a52e-5b36bc22986d port 501824c9-0f88-46c0-b875-0a1fb46eb708 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:21.478268 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.501807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.535726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] Provisioning complete for port 75e751a9-0e74-46fd-a4fb-738311e1dc68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:21.536999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.558588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38336) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:21.663632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f66e2a10-8141-41dd-9614-5b69cf6506fc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:21.678662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.698620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=84c193ea-9294-4fe7-b33c-753ea27f07be,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:21.726585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Checking segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:21.726585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Network hostable DHCP agents. Network: fd1ccb7c-d1e8-48e2-b784-b56a587e2542, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:21.751025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:21.783829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fd1ccb7c-d1e8-48e2-b784-b56a587e2542) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:21.796387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:21.800048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.834635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-04355c82-c190-43f2-adf6-56351f31f3e6 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.6944540 Nov 05 14:44:21.835240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38348) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:21.839421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Checking segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:21.839765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Network hostable DHCP agents. Network: fc36919c-2228-49a8-98f4-75664fee44eb, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:21.854078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:21.884118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.884742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:21.889702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.894807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.897063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.920370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Network fc36919c-2228-49a8-98f4-75664fee44eb is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:21.951334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75e751a9-0e74-46fd-a4fb-738311e1dc68 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:21.954792 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:21.956259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fc36919c-2228-49a8-98f4-75664fee44eb) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:21.969358 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.014809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-605246762'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:22.020117 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Attempting to bind port 501824c9-0f88-46c0-b875-0a1fb46eb708 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:22.020269 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Attempting to bind port 501824c9-0f88-46c0-b875-0a1fb46eb708 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:22.020623 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Attempting to bind port 501824c9-0f88-46c0-b875-0a1fb46eb708 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:22.041367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:22.041947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.064658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 43, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:22.064658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:22.064658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.066388 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:22.070745 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Bound port: 501824c9-0f88-46c0-b875-0a1fb46eb708, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:22.071176 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.076631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] For port 75e751a9-0e74-46fd-a4fb-738311e1dc68, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75e751a9-0e74-46fd-a4fb-738311e1dc68,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:22.095271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.135733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.180657 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] For port 501824c9-0f88-46c0-b875-0a1fb46eb708, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:22.184203 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] For port 501824c9-0f88-46c0-b875-0a1fb46eb708, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=501824c9-0f88-46c0-b875-0a1fb46eb708,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:22.212164 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.224952 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-014635c4-e81c-488c-b12e-041b2f14c9b2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3010349 Nov 05 14:44:22.225882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38356) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:22.240485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:22.246221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38358) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:22.254114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Made reservation on behalf of cccec644420b4b0e8375c5fdb80b0cf6 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:22.254473 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Pushing event updated for resources: {'Port': ['ID=501824c9-0f88-46c0-b875-0a1fb46eb708,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:22.257237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.272265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.284057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.285780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.286377 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.286760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.287112 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.287450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.287785 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.288133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.288481 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.288834 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.294099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.295099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.295464 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.295804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Tracked resource versions report: Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: pushed versions: Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: { 'AddressGroup': {'1.2'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'ConntrackHelper': {'1.0'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Log': {'1.0'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Network': {'1.1'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Port': {'1.7'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'PortForwarding': {'1.2'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'QosPolicy': {'1.10'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroup': {'1.5'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroupRule': {'1.2'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SubPort': {'1.0'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Subnet': {'1.1'}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Trunk': {'1.1'}} Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: consumer versions: Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: { DHCP agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: HyperV agent@hv-neutron-8168: {}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: L3 agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: Metadata agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: Metering agent@dv-neutron-816850-1-hyperv: {}, Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: Open vSwitch agent@dv-neutron-816850-1-hyperv: { 'AddressGroup': '1.2', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'ConntrackHelper': '1.0', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Log': '1.0', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Network': '1.1', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Port': '1.7', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'PortForwarding': '1.2', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'QosPolicy': '1.10', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroup': '1.5', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SecurityGroupRule': '1.2', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'SubPort': '1.0', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Subnet': '1.1', Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: 'Trunk': '1.1'}} Nov 05 14:44:22.296980 dv-neutron-816850-1-hyperv neutron-server[113583]: {{(pid=113583) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 05 14:44:22.365282 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:22.365917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:43:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:22.367722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.391506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.448239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1cdf7a6e-5fbd-44c0-9e5d-ac76004cebf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.464370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 75e751a9-0e74-46fd-a4fb-738311e1dc68 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:22.465165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.512011 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18d5d19-5fc5-41ea-af15-f07edfa6d4e2 None None] Pushing event updated for resources: {'Port': ['ID=501824c9-0f88-46c0-b875-0a1fb46eb708,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:22.523909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f593df7-b13a-4ea0-b0f3-c535acb9f0df None None] Pushing event updated for resources: {'Port': ['ID=75e751a9-0e74-46fd-a4fb-738311e1dc68,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:22.535606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.538960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38366) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:22.550906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.665290 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:22.787571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.794466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Allocated IP 172.20.0.1 (4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a/40981c52-1a1c-434c-b98f-d3a05d50d8a6/f46cb97e-7afd-4657-be56-0eaeb5e7ad6d) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:22.880305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 631} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:22.898701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3da11b90-b129-44c2-a082-4ad868fc6942,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:22.930720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-232189140'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:22.959389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:22.959735 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Added segment 958e6343-c339-4da9-a5aa-728a69a20293 of type vlan for network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 Nov 05 14:44:22.965988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:23.049590 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:19Z', 'revision_number': 3, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:23.058784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.095645 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5176c01b-8efc-402a-bc42-e61cd00912e0 None None] The sync data for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv is: [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:19Z', 'revision_number': 3, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:23.128777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Made reservation on behalf of 2d89a23b14c44ebcb4e3bbe7874e9e11 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:23.135900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.145285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.164239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.233871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.255138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.261385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:23.262016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.279856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:23.300544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38388) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:23.361626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.381949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.414984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Pushing event updated for resources: {'Network': ['ID=2f53417e-d426-4ec0-bf7b-34f4abd5fc13,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:23.447728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:23.450382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:23.454091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.464117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-08429b65-c6ae-4b92-b9a4-7d4fde1d083a tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 1.9011774 Nov 05 14:44:23.468769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68456adb-3a08-4123-9f63-a19657fc804a None None] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:23.496570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:23.503911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:23.517036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.518205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.608021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Pushing event updated for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-68456adb-3a08-4123-9f63-a19657fc804a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:23.677339 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:23.685830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8aef5ca3-f6da-4cd3-873f-0c465db3c194 None None] Network fc36919c-2228-49a8-98f4-75664fee44eb requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:23.724192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a635580-7b37-470f-a4d6-c2f90c0ed32c None None] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:23.763230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9d5928bd-3e46-4c29-a021-80f4d775f598 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:23.892116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8694bf66-0bb6-4d7c-bcf8-db49011b7b59 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Request body: {'quota': {'network': 2}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:23.895084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.957001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.976796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e3c5410e-14a9-4c3f-aba0-efaf4ca14cda None None] Provisioning complete for port 75e751a9-0e74-46fd-a4fb-738311e1dc68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:23.976796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e3c5410e-14a9-4c3f-aba0-efaf4ca14cda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5a635580-7b37-470f-a4d6-c2f90c0ed32c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:23.978522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:23.996940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75e751a9-0e74-46fd-a4fb-738311e1dc68 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:24.012827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Allocated IP 172.26.5.6 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/19366c25-ca17-4e42-9cc2-78dc5af54481) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8aef5ca3-f6da-4cd3-873f-0c465db3c194 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:24.069226 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:24.074295 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8694bf66-0bb6-4d7c-bcf8-db49011b7b59 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "PUT /v2.0/quotas/b26566c40d7844eaa45e64feee0edbb1 HTTP/1.1" status: 200 len: 368 time: 0.7797949 Nov 05 14:44:24.074924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38404) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.097544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-058ea087-a3e1-473e-ab84-15e51380f3b3 None None] Network fc36919c-2228-49a8-98f4-75664fee44eb requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:24.109856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Request body: {'network': {'project_id': 'b26566c40d7844eaa45e64feee0edbb1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:24.113408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.132260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.169824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.191634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 75e751a9-0e74-46fd-a4fb-738311e1dc68 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:24.192414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.230517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:24.234791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Made reservation on behalf of b26566c40d7844eaa45e64feee0edbb1 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:24.237086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-058ea087-a3e1-473e-ab84-15e51380f3b3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:24.265695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.270059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8e82cf6e-3c09-4013-8608-f43ac40f9504,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:24.273751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.273751 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Added segment 7e00069e-a01a-4b40-8d33-28919507761e of type vlan for network 0ea324eb-5eb1-4a35-912d-f323d8496549 Nov 05 14:44:24.287416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e333d7a-058c-4631-9776-d5edf8ac40f9 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:24.349538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.394826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.400612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:24.401226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.438664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 501824c9-0f88-46c0-b875-0a1fb46eb708 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:24.440635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.461282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38406) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.466312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13', 'binding:host_id': 'hv-neutron-8168', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-649855439'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:24.481031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e333d7a-058c-4631-9776-d5edf8ac40f9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:24.496643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-59e28baf-040f-429e-a8a3-6326d9f5a020 None None] Provisioning complete for port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:24.497425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-59e28baf-040f-429e-a8a3-6326d9f5a020 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.533526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.2794676 Nov 05 14:44:24.533769 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9d5928bd-3e46-4c29-a021-80f4d775f598 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "PUT /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa HTTP/1.1" status: 200 len: 366 time: 1.2295361 Nov 05 14:44:24.533769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38410) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.537795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38412) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.557945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-59e28baf-040f-429e-a8a3-6326d9f5a020 None None] Port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:24.568607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8455dad-7225-44db-bafc-e19875ebc09e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Pushing event updated for resources: {'Network': ['ID=0ea324eb-5eb1-4a35-912d-f323d8496549,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:24.604664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0ea324eb-5eb1-4a35-912d-f323d8496549 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:24.608832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.613396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.628377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.634036 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7d27c14d-225c-4bb5-beb2-12e47ad6dd54 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 732 time: 0.0944688 Nov 05 14:44:24.638572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Made reservation on behalf of c00271e60e414c15bfdd60b4d8f95840 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:24.641079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.642934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38416) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.682236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 600} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:24.685690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 501824c9-0f88-46c0-b875-0a1fb46eb708 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:24.686072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.686958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c401bea9-b4b2-4e1a-8763-8af0f6994def tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa HTTP/1.1" status: 200 len: 366 time: 0.0408587 Nov 05 14:44:24.687827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.693328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38418) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.739893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.740412 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Added segment b3fcc494-6794-4e17-9a99-e3f9890b1407 of type vlan for network ef60e11d-7844-4d8a-98a5-5095454e14e5 Nov 05 14:44:24.743162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2de01acb-5f30-4ce9-8bb3-afc3bc254e57,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:24.770387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5732a698-8e5b-41f4-affa-4d4b49851330 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "DELETE /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa HTTP/1.1" status: 204 len: 168 time: 0.0689418 Nov 05 14:44:24.777256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38420) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.797455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'name': 'tempest-network--385684462', 'router:external': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:24.827421 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7a60ea4f-53ef-4d1f-b7a4-2851331492db tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 470 time: 0.0506697 Nov 05 14:44:24.830380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.836940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38422) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.850115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.850646 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5f7f91d0-f4c6-47a2-85dd-88aa98fbd7f3 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa HTTP/1.1" status: 200 len: 370 time: 0.0124283 Nov 05 14:44:24.858800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38424) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.868378 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ecd5a43-92f0-4107-a1c4-f98c22e92e9a tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa/default HTTP/1.1" status: 200 len: 370 time: 0.0045757 Nov 05 14:44:24.868610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.868742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38426) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:24.870650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:24.871646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.891990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.898911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.915748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 501824c9-0f88-46c0-b875-0a1fb46eb708, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=501824c9-0f88-46c0-b875-0a1fb46eb708,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:24.922213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:24.948148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Allocated IP 172.26.5.28 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/661b4be0-a8d2-427f-9d57-e89bc540536b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:24.985116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:24.986721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=501824c9-0f88-46c0-b875-0a1fb46eb708,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:24.998874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fc36919c-2228-49a8-98f4-75664fee44eb', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:44:24.999759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.002264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:44:25.004392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:25.007832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.010687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:25.015121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.053927 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-7375f660-8662-4eef-8dbc-cc96ca62e5d3 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] delete failed (client error): The resource could not be found. Nov 05 14:44:25.055218 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7375f660-8662-4eef-8dbc-cc96ca62e5d3 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "DELETE /v2.0/quotas/3e948935b20143ee8798c1a204d5dbaa HTTP/1.1" status: 404 len: 348 time: 0.1856275 Nov 05 14:44:25.064207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.065110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.073806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.075630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:25.076224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.097792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Pushing event updated for resources: {'Port': ['ID=19366c25-ca17-4e42-9cc2-78dc5af54481,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.196542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.206615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event updated for resources: {'Network': ['ID=ef60e11d-7844-4d8a-98a5-5095454e14e5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.237365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Pushing event updated for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.242831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.247099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ef60e11d-7844-4d8a-98a5-5095454e14e5 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:25.247706 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8a1dc46a-ea71-4270-acc6-8aa9013709f1 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.1602979 Nov 05 14:44:25.250375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38432) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:25.256419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Request body: {'network': {'project_id': 'b26566c40d7844eaa45e64feee0edbb1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:25.261072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.273487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38434) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:25.274636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port d2a2820b-a1de-453a-b10f-3593482cd665 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:25.332675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.349939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.407498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:25.410329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:25.421227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52581cf1-30b1-490a-a97f-9d592c41bd72,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.422082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:25.434285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Made reservation on behalf of b26566c40d7844eaa45e64feee0edbb1 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:25.435927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Allocated IP 172.20.0.2 (fc36919c-2228-49a8-98f4-75664fee44eb/c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9/41bac42b-ddc9-478a-8ca0-434d858e2da0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:25.436725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.437955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.438300 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Added segment 3e3290ad-fe9e-4360-aec9-20bbafb10302 of type vlan for network 49ae41dc-3eb5-47b3-ac9e-37001c1b94c7 Nov 05 14:44:25.452106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36ca0be1-2739-40ee-86d4-4f45ea91af97,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.472308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Allocated IP 172.20.0.2 (fd1ccb7c-d1e8-48e2-b784-b56a587e2542/84c193ea-9294-4fe7-b33c-753ea27f07be/29716c74-54f7-4923-be4d-b3ff019d83be) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:25.490624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Allocated IP 172.26.5.43 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/74709deb-a69d-4abc-8dea-df27f199edf9) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:25.530978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.571673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:network and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:25.590561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.609065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:25.626838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.693394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:25.703278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 626} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:25.710438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:subnet and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:25.721583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Router 04a38fc5-d67e-4be6-a52e-5b36bc22986d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:44:25.724050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:25.729216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.730175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:25.730761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.733114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.747098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:25.749867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Pushing event updated for resources: {'Port': ['ID=661b4be0-a8d2-427f-9d57-e89bc540536b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.767169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.788374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.842929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 1.3038752 Nov 05 14:44:25.850125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.853424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Pushing event updated for resources: {'Port': ['ID=41bac42b-ddc9-478a-8ca0-434d858e2da0,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.873536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Network fc36919c-2228-49a8-98f4-75664fee44eb is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:25.878983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:25.881364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:25.883069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38436) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:25.883562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 501824c9-0f88-46c0-b875-0a1fb46eb708 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:25.889371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.938524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:25.943065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2697a6fd-e579-4945-8940-c04d9f9001d4 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=49ae41dc-3eb5-47b3-ac9e-37001c1b94c7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:25.979301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:25.979778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Added segment 8e35ab9d-5580-494f-9f23-dc5078518df9 of type vlan for network 742d3fe5-6bdc-4687-95c7-dce40d2632bd Nov 05 14:44:26.047662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 49ae41dc-3eb5-47b3-ac9e-37001c1b94c7 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:26.054047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.054372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.067271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.095550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:subnetpool and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:26.107426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.113571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:26.127858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:26.131139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:26.139639 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-96b4567f-c637-4a32-945e-2cfb0583e94d admin admin] 10.222.0.30 "PUT /v2.0/routers/04a38fc5-d67e-4be6-a52e-5b36bc22986d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5429382 Nov 05 14:44:26.143594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:26.200394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:port and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:26.208421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.212258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port d2a2820b-a1de-453a-b10f-3593482cd665 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:26.231117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:26.243216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Sync routers for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:26.250293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.251223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:26.251794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.253932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:26.256772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Pushing event updated for resources: {'Port': ['ID=29716c74-54f7-4923-be4d-b3ff019d83be,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:26.298288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:26.298925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:26.370708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event updated for resources: {'Network': ['ID=742d3fe5-6bdc-4687-95c7-dce40d2632bd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:26.382910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.395567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Attempting to bind port 41bac42b-ddc9-478a-8ca0-434d858e2da0 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:26.395979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Attempting to bind port 41bac42b-ddc9-478a-8ca0-434d858e2da0 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:26.396390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Attempting to bind port 41bac42b-ddc9-478a-8ca0-434d858e2da0 on network fc36919c-2228-49a8-98f4-75664fee44eb {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:26.404158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 742d3fe5-6bdc-4687-95c7-dce40d2632bd details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:26.407300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:router and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:26.419013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.428393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:26.439499 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d784fcbd-4dec-4c92-b99a-6727c85a0636 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.1877651 Nov 05 14:44:26.440478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:26.442435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38456) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:26.448369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:26.485499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:26.493173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bbe8190c-e5af-41de-84f5-2ee8e62ed4a3 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Request body: {'network': {'project_id': 'b26566c40d7844eaa45e64feee0edbb1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:26.495015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:26.495536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Checking segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:26.496180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.496486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Bound using segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:26.496976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Bound port: 41bac42b-ddc9-478a-8ca0-434d858e2da0, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:26.497585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.498011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.505256 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-bbe8190c-e5af-41de-84f5-2ee8e62ed4a3 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 05 14:44:26.505743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bbe8190c-e5af-41de-84f5-2ee8e62ed4a3 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:44:26.509995 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bbe8190c-e5af-41de-84f5-2ee8e62ed4a3 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.0596662 Nov 05 14:44:26.510600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38458) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:26.518368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 501824c9-0f88-46c0-b875-0a1fb46eb708 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:26.518858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.524151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Attempting to bind port 29716c74-54f7-4923-be4d-b3ff019d83be on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:26.524585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Attempting to bind port 29716c74-54f7-4923-be4d-b3ff019d83be by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:26.524987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Attempting to bind port 29716c74-54f7-4923-be4d-b3ff019d83be on network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:26.526322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Pushing event updated for resources: {'Port': ['ID=74709deb-a69d-4abc-8dea-df27f199edf9,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:26.528257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Router 51c9704a-323f-4947-9153-8af2348f332c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:44:26.533633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.533828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.534759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.535582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > port after_create 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.536045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > port after_delete 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.536585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > port after_update 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.537030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.537410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.537833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.538264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.558580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:floatingip and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:26.571164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:26.571536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Checking segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:26.571923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.572316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Bound using segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:26.572838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Bound port: 29716c74-54f7-4923-be4d-b3ff019d83be, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:26.573254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.628441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=d2a2820b-a1de-453a-b10f-3593482cd665,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:26.645456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:26.704565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.714489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] For port 41bac42b-ddc9-478a-8ca0-434d858e2da0, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:26.722678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:26.726567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] For port 41bac42b-ddc9-478a-8ca0-434d858e2da0, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41bac42b-ddc9-478a-8ca0-434d858e2da0,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:26.755652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.789797 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6fbf50a6-dc65-4634-aed3-f5c4338fe947 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b26566c40d7844eaa45e64feee0edbb1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2740624 Nov 05 14:44:26.790679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:26.807345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.830465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Checking segment: {'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:26.830822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Network hostable DHCP agents. Network: 2f53417e-d426-4ec0-bf7b-34f4abd5fc13, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:26.846731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] For port 29716c74-54f7-4923-be4d-b3ff019d83be, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:26.859062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.859482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.859723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.860046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=113581) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:26.860400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['49ae41dc-3eb5-47b3-ac9e-37001c1b94c7']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:26.890057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e3290ad-fe9e-4360-aec9-20bbafb10302') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:26.890327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e3290ad-fe9e-4360-aec9-20bbafb10302') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:26.904074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.929299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] For port 29716c74-54f7-4923-be4d-b3ff019d83be, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=29716c74-54f7-4923-be4d-b3ff019d83be,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:26.941804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.945438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:26.988447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.003975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9029bc2-146b-40ac-ab44-d396a924d792 None None] Pushing event updated for resources: {'Port': ['ID=41bac42b-ddc9-478a-8ca0-434d858e2da0,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:27.020072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:27.021127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: from cryptography.utils import int_from_bytes Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: from cryptography.utils import int_from_bytes Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:27.026942 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:27.160713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce6a1b-af4e-4d6f-a9c5-08aafa6fdfae None None] Pushing event updated for resources: {'Port': ['ID=29716c74-54f7-4923-be4d-b3ff019d83be,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:27.189717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:27.198662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.202573 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Sync routers for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:27.214267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:27.214870 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:27.224722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 2, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:27.226286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 49ae41dc-3eb5-47b3-ac9e-37001c1b94c7 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:44:27.231566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.252277 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/49ae41dc-3eb5-47b3-ac9e-37001c1b94c7 HTTP/1.1" status: 204 len: 168 time: 1.3664291 Nov 05 14:44:27.254219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38464) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:27.280319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'router:external': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:27.295461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.306114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Checking router: 04a38fc5-d67e-4be6-a52e-5b36bc22986d for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:27.306318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:security_group and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:27.306799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Updating router 04a38fc5-d67e-4be6-a52e-5b36bc22986d port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:27.308503 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28e276da-ad7c-47ff-9a04-7ea3dbb29828 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 5.0724399 Nov 05 14:44:27.309404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31880986-2a51-4735-be88-39352f344cfe tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Network': ['ID=49ae41dc-3eb5-47b3-ac9e-37001c1b94c7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:27.313373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38466) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:27.320169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:27.374124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.480255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:27.485816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.530099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:27.531669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 2f53417e-d426-4ec0-bf7b-34f4abd5fc13) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:27.553383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:27.702118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.705174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Usage tracker for resource:security_group_rule and project:0901b49a31664507bd0ee920fadf9018 is out of sync, need to count used quota {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Nov 05 14:44:27.734180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:27.734542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:27.734907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:27.775282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.777707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.quota.resource [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=113580) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Nov 05 14:44:27.843240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:27.843581 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:27.856916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 2 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:27.869438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.871567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38468) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:27.873325 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d8601ef0-ed0e-4604-9a26-6e57bf8b6c32 tempest-QuotasTest-697476235 tempest-QuotasTest-697476235-project-admin] 10.222.0.30 "GET /v2.0/quotas/0901b49a31664507bd0ee920fadf9018/details.json HTTP/1.1" status: 200 len: 703 time: 2.5869806 Nov 05 14:44:27.896681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'security_group': {'name': 'tempest-securitygroup--543305961', 'description': 'tempest-description--627249400'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:27.912333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:27.915448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.952012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:27.986571 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:25Z', 'revision_number': 3, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:28.003671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.018559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.056176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:28.056545 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Checking router: 51c9704a-323f-4947-9153-8af2348f332c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:28.057010 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Updating router 51c9704a-323f-4947-9153-8af2348f332c port 19366c25-ca17-4e42-9cc2-78dc5af54481 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:28.095205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.096267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.103795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41bac42b-ddc9-478a-8ca0-434d858e2da0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:28.104821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Added segment 06ec69be-c821-40f8-8846-95253fb65f6e of type vlan for network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c Nov 05 14:44:28.111935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140e8bdb-5fe2-4398-94f9-f8eb9d23f488 None None] Pushing event updated for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:28.163406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.183871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Pushing event updated for resources: {'Port': ['ID=74709deb-a69d-4abc-8dea-df27f199edf9,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:28.209529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:28.209862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:28.210425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:28.226734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.234322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8c94a66-be62-4789-a878-7daa79e59cf6 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.6920159 Nov 05 14:44:28.237706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.243165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38472) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:28.258647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1163394619', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'fixed_ips': [{'ip_address': '172.26.5.43'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:28.278193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.286093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.290899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "DELETE /v2.0/security-groups/2de01acb-5f30-4ce9-8bb3-afc3bc254e57 HTTP/1.1" status: 204 len: 168 time: 1.4911308 Nov 05 14:44:28.298244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38474) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:28.298941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:28.299263 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:28.325175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 3 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:28.344509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9c3cb8-2e1f-418a-b92d-2d42b303f2ff tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2de01acb-5f30-4ce9-8bb3-afc3bc254e57,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:28.365821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 41bac42b-ddc9-478a-8ca0-434d858e2da0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:28.366204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.375246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Attempting to bind port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:28.375653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Attempting to bind port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:28.376016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Attempting to bind port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d on network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:28.416432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.485371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:28.485702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:28.486245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:28.492398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Made reservation on behalf of b0c8658ffc9144628f61c919da7f3133 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:28.495953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:28.496262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.496809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.497680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Checking segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:28.498417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.498823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Bound using segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:28.499328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Bound port: f46cb97e-7afd-4657-be56-0eaeb5e7ad6d, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:28.499732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.542844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:28.543167 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:28.550489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38478) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:28.557635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.561229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 4 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:28.593628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.593901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:28.594011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:28.594332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:28.594953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:28.595633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.665089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] For port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:28.669066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] For port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:28.679931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.727832 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.738826 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.791032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b51b81b6-a240-42fe-80e2-040167c023a0 None None] Provisioning complete for port 41bac42b-ddc9-478a-8ca0-434d858e2da0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:28.791619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b51b81b6-a240-42fe-80e2-040167c023a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.798208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:28.806536 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Attempting to bind port 19366c25-ca17-4e42-9cc2-78dc5af54481 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:28.807251 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Attempting to bind port 19366c25-ca17-4e42-9cc2-78dc5af54481 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:28.807813 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Attempting to bind port 19366c25-ca17-4e42-9cc2-78dc5af54481 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:28.819660 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c285f2-e041-475a-a7be-2b727f6ed301 None None] Pushing event updated for resources: {'Port': ['ID=19366c25-ca17-4e42-9cc2-78dc5af54481,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:28.823641 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:28.824300 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:28.824958 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.826085 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:28.826742 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Bound port: 19366c25-ca17-4e42-9cc2-78dc5af54481, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:28.827719 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.830235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:28.830834 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:28.851540 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6fd4869a-208a-4ca8-aa27-76af61cfa671 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 1.5738921 Nov 05 14:44:28.865153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38482) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:28.883072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'subnet': {'network_id': '9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:28.897168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.923382 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] For port 19366c25-ca17-4e42-9cc2-78dc5af54481, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:28.929813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.933154 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] For port 19366c25-ca17-4e42-9cc2-78dc5af54481, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=19366c25-ca17-4e42-9cc2-78dc5af54481,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:28.941490 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:28.960090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.960661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.961617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.961950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > port after_create 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.962291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > port after_delete 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.963412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > port after_update 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.965001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.965340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.966565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:28.966947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:29.027836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:29.030005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.054563 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:29.055110 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.073515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:29.106218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c285f2-e041-475a-a7be-2b727f6ed301 None None] Pushing event updated for resources: {'Port': ['ID=19366c25-ca17-4e42-9cc2-78dc5af54481,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.120854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140e8bdb-5fe2-4398-94f9-f8eb9d23f488 None None] Pushing event updated for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.138323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.146067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:29.147043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.197304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:29.197702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:29.198037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:29.198364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=113580) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 05 14:44:29.198774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['742d3fe5-6bdc-4687-95c7-dce40d2632bd']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.203565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.208390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 5 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:29.241602 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:29.252876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.272731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] device_id is not set on port 32983361-abbd-4a73-8dfa-3ab638c34ee8 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:29.281929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.300178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 41bac42b-ddc9-478a-8ca0-434d858e2da0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41bac42b-ddc9-478a-8ca0-434d858e2da0,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:29.330620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.334250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9f503c71-b473-4aff-82da-65a3d0d6e0c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.363842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.363842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 29716c74-54f7-4923-be4d-b3ff019d83be up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:29.371209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e35ab9d-5580-494f-9f23-dc5078518df9') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.371515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e35ab9d-5580-494f-9f23-dc5078518df9') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.388043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2a3735b-ef65-4280-ad6a-f2bbff39a5f6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.394717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd0fa26e-229f-4e7a-a8ec-f7b283ef1164 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:29.433162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ca006447-f1ef-432d-8d17-18a36a16ac5b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.437467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.458584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:29.458971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:29.459609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:29.473679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:29.474086 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:29.489512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 6 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:29.519756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.525767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4988efa4-9194-4396-99a2-6c1990630c1c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 1.6445723 Nov 05 14:44:29.525767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.529663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38484) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:29.540271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Releasing vlan 626 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:29.541199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.545735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'security_group_rule': {'security_group_id': 'ca006447-f1ef-432d-8d17-18a36a16ac5b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: from cryptography.utils import int_from_bytes Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: from cryptography.utils import int_from_bytes Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:29.553102 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:29.559240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Allocated IP 172.20.0.1 (fc36919c-2228-49a8-98f4-75664fee44eb/c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9/74689f1f-b8e2-419c-b7bb-20c6dc557b76) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:29.570663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:29.571111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:29.571329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:29.571531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:29.606311 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:25Z', 'revision_number': 3, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:29.620402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:29.620689 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:29.621182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:44:29.626476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 7 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:29.640941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=41bac42b-ddc9-478a-8ca0-434d858e2da0,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.673453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:29.673784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:29.674127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:29.683611 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-261b8d9c-709b-4e6c-9456-a256bea79139 None None] The sync data for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv is: [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:25Z', 'revision_number': 3, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:29.687669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:29.688004 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:29.721793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.729921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 29716c74-54f7-4923-be4d-b3ff019d83be triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:29.730443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.798533 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 8 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:29.801041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.807114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd0fa26e-229f-4e7a-a8ec-f7b283ef1164 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:29.821476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:29.831231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.838582 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "DELETE /v2.0/networks/742d3fe5-6bdc-4687-95c7-dce40d2632bd HTTP/1.1" status: 204 len: 168 time: 1.5178308 Nov 05 14:44:29.852658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9f503c71-b473-4aff-82da-65a3d0d6e0c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.853707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38486) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:29.858215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Sync routers for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:29.867643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef73edd8-27ff-4add-9b6a-8862671c5aeb tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event deleted for resources: {'Network': ['ID=742d3fe5-6bdc-4687-95c7-dce40d2632bd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:29.869685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:29.870266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:29.871077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:29.886222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9f503c71-b473-4aff-82da-65a3d0d6e0c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.933946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-32183bf0-ddfb-47c1-824e-d41e1e1bf77d None None] Provisioning complete for port 29716c74-54f7-4923-be4d-b3ff019d83be triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:29.934154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-32183bf0-ddfb-47c1-824e-d41e1e1bf77d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.942020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:29.942517 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:29.945854 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 05 14:44:29.946390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:44:29.948142 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 9 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:29.961376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:29.963012 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2fa858dd-94e7-46bb-a0bf-ebe625bc0c9a admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 8.1267531 Nov 05 14:44:29.968350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38490) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:29.990465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:29.992068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:30.001356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:30.001840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:30.002548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:30.005595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f503c71-b473-4aff-82da-65a3d0d6e0c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=520bbd64-efc5-45be-8723-ece8a1b46f7e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.011469 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca05c487-f030-427f-9d21-4c8b50c1bc29 tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 409 len: 371 time: 1.7636299 Nov 05 14:44:30.011650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.018407 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9f503c71-b473-4aff-82da-65a3d0d6e0c6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a92ced80507e441fa418a346036b5f43&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4321156 Nov 05 14:44:30.018407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38494) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:30.025916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38496) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:30.056090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.068683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:30.069200 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:30.118657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 10 to bind port d2a2820b-a1de-453a-b10f-3593482cd665 Nov 05 14:44:30.141317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.168995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.208809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:30.209471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:30.209849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:30.250680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port d2a2820b-a1de-453a-b10f-3593482cd665 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:30.250680 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port d2a2820b-a1de-453a-b10f-3593482cd665 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:30.252014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.260876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e48ab5a-dfbb-4624-abd0-555436c290b3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.292121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.293566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-37e0fbb8-96e4-402a-b235-eb72825aa901 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7613170 Nov 05 14:44:30.296682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38498) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:30.302928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'security_group_rule': {'security_group_id': 'ca006447-f1ef-432d-8d17-18a36a16ac5b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:30.312408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.336805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.385569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.387987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.407502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:30.410896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-32183bf0-ddfb-47c1-824e-d41e1e1bf77d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.446450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Network fc36919c-2228-49a8-98f4-75664fee44eb is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:30.452757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ef60e11d-7844-4d8a-98a5-5095454e14e5']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:30.463329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:30.463329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:44:30.463329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.466957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:30.472983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Pushing event updated for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.480402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.492219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b3fcc494-6794-4e17-9a99-e3f9890b1407') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:30.492571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b3fcc494-6794-4e17-9a99-e3f9890b1407') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:30.506720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 29716c74-54f7-4923-be4d-b3ff019d83be, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=29716c74-54f7-4923-be4d-b3ff019d83be,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:30.510441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port d2a2820b-a1de-453a-b10f-3593482cd665, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:30.510806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempted to set empty binding levels {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:44:30.519288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.519813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:28Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:30.524177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.524368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Deleting port 74709deb-a69d-4abc-8dea-df27f199edf9 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:30.524368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.537795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.549285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.601250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e67537-4daa-4326-a2a4-5d7beaaecd2f None None] The sync data for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv is: [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:28Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:30.688342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.700198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:30.701326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.716301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.722742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Subnet': ['ID=ab68a5fd-d421-4f3a-bbcb-c915c2142d36,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.725865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Releasing vlan 600 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:30.726437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:30.733137 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:30.808251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=d2a2820b-a1de-453a-b10f-3593482cd665,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.833046 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e988bf47-3d93-4549-b72b-e030fe2973d2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 981 time: 6.3670335 Nov 05 14:44:30.833216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-32183bf0-ddfb-47c1-824e-d41e1e1bf77d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:44:30.833216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-32183bf0-ddfb-47c1-824e-d41e1e1bf77d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:44:30.833216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=29716c74-54f7-4923-be4d-b3ff019d83be,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.834051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38500) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:30.858179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.874531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.880135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/520bbd64-efc5-45be-8723-ece8a1b46f7e HTTP/1.1" status: 204 len: 168 time: 0.8506489 Nov 05 14:44:30.898109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.948283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.952801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:30.983700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7300bffa-344e-4b30-a6d3-411b7a476928 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=520bbd64-efc5-45be-8723-ece8a1b46f7e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:30.995449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Calling delete_port for 74709deb-a69d-4abc-8dea-df27f199edf9 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:30.997603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.007582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.090123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9807d428-4a6e-47dd-8bfb-26311dd0a6d2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:31.107291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Checking segment: {'id': '06ec69be-c821-40f8-8846-95253fb65f6e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:31.112319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Network hostable DHCP agents. Network: 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:31.125088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.129903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] 10.222.0.30 "DELETE /v2.0/networks/ef60e11d-7844-4d8a-98a5-5095454e14e5 HTTP/1.1" status: 204 len: 168 time: 1.2735636 Nov 05 14:44:31.150908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b04aa81-e1b5-41ef-b8ed-32216d4a8f21 tempest-QuotasNegativeTest-1571777943 tempest-QuotasNegativeTest-1571777943-project-admin] Pushing event deleted for resources: {'Network': ['ID=ef60e11d-7844-4d8a-98a5-5095454e14e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:31.319693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.324867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 19366c25-ca17-4e42-9cc2-78dc5af54481 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:31.326332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f7d9d83-5284-4b2e-90a6-9d644018b410 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0269513 Nov 05 14:44:31.330005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:31.350561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:31.493905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:31.532812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38510) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:31.612768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Deleting port d2a2820b-a1de-453a-b10f-3593482cd665 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:31.613109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.627611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7550cb50-5492-47d3-9ea8-3c35950c2828 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.645276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:31.659314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 19366c25-ca17-4e42-9cc2-78dc5af54481 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:31.661296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.678075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:31.681210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.746054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:26Z', 'revision_number': 3, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:31.791334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.830095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Checking router: 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:31.831520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Updating router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 port 661b4be0-a8d2-427f-9d57-e89bc540536b binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:31.917276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:31.931606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port d2a2820b-a1de-453a-b10f-3593482cd665, host hv-neutron-8168, got binding levels [] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:31.931965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.039661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.042155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.080939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a17a7ec4-9cfa-4071-a5ce-a881c2c4da92 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 3.2114549 Nov 05 14:44:32.105999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30c9af8a-d00f-461e-bfb7-225cd3369ba0 None None] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:32.112786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.133401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6df45760-88ec-4fd4-9361-507faf3628e8 None None] Network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:32.139652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.141991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38514) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:32.182972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Calling delete_port for d2a2820b-a1de-453a-b10f-3593482cd665 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:32.277961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'floatingip': {'floating_network_id': '9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:32.281036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.303744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Pushing event updated for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:32.419447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38518) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:32.425760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.439285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Pushing event deleted for resources: {'Port': ['ID=74709deb-a69d-4abc-8dea-df27f199edf9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:32.527461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7550cb50-5492-47d3-9ea8-3c35950c2828 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.565595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 19366c25-ca17-4e42-9cc2-78dc5af54481, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=19366c25-ca17-4e42-9cc2-78dc5af54481,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:32.572766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7550cb50-5492-47d3-9ea8-3c35950c2828 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.596818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.597826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41bac42b-ddc9-478a-8ca0-434d858e2da0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:32.619935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.705894 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7550cb50-5492-47d3-9ea8-3c35950c2828 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0901b49a31664507bd0ee920fadf9018&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1698141 Nov 05 14:44:32.708827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38522) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:32.715850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7550cb50-5492-47d3-9ea8-3c35950c2828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2714fdc6-9d5e-4dca-b92e-9434e53a6283,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:32.718931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-19ddeacd-d50b-4592-90e8-98985888ee94 None None] Provisioning complete for port 29716c74-54f7-4923-be4d-b3ff019d83be triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:32.719397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-19ddeacd-d50b-4592-90e8-98985888ee94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.741473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.744320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.745895 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-01e97f4e-b554-485c-8eb8-14416186443e tempest-ExternalNetworksAdminNegativeTestJSON-292153720 tempest-ExternalNetworksAdminNegativeTestJSON-292153720-project-admin] 10.222.0.30 "DELETE /v2.0/floatingips/aa6dadd9-b7c2-4fd0-80cb-524c49aadef6 HTTP/1.1" status: 204 len: 168 time: 2.7259579 Nov 05 14:44:32.749748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.769004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.839908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event deleted for resources: {'Port': ['ID=d2a2820b-a1de-453a-b10f-3593482cd665,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:32.855662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.859660 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7659f394-6d2a-4355-b144-545fedd2625e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "DELETE /v2.0/ports/d2a2820b-a1de-453a-b10f-3593482cd665 HTTP/1.1" status: 204 len: 168 time: 2.0206969 Nov 05 14:44:32.870280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38526) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6df45760-88ec-4fd4-9361-507faf3628e8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:32.901573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:32.914515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:32.938742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd82a948-c161-4d57-a6d8-80cb8a67b6a9 None None] Network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:32.940384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.015465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.018815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.020177 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2714fdc6-9d5e-4dca-b92e-9434e53a6283 HTTP/1.1" status: 204 len: 168 time: 0.3094299 Nov 05 14:44:33.021467 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-f152e198-cdef-42ae-a130-0b1a564105eb tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:44:33.034027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=19366c25-ca17-4e42-9cc2-78dc5af54481,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:33.035796 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f152e198-cdef-42ae-a130-0b1a564105eb tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports/d2a2820b-a1de-453a-b10f-3593482cd665 HTTP/1.1" status: 404 len: 333 time: 0.1643748 Nov 05 14:44:33.056121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:33.060014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7067de5-e919-46fc-8744-3e5bceef864a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2714fdc6-9d5e-4dca-b92e-9434e53a6283,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:33.078450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-841915252'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:33.127138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Made reservation on behalf of c00271e60e414c15bfdd60b4d8f95840 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:33.130239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.164579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c218a241-beab-45cd-8d09-d71470ba0472 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.168184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 41bac42b-ddc9-478a-8ca0-434d858e2da0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:33.168583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.169261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port c78a2fcc-3860-46dd-900f-e520dcefbffe yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-dd82a948-c161-4d57-a6d8-80cb8a67b6a9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:33.196713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:33.225565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07e2e3b7-002d-4d3e-93d1-4370e04bddbf None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:33.261009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:33.315948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.344580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.362878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-19ddeacd-d50b-4592-90e8-98985888ee94 None None] Provisioning complete for port 41bac42b-ddc9-478a-8ca0-434d858e2da0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:33.363242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-19ddeacd-d50b-4592-90e8-98985888ee94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.394837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.423769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.467389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.494184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07e2e3b7-002d-4d3e-93d1-4370e04bddbf None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:33.500911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Network fc36919c-2228-49a8-98f4-75664fee44eb is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:33.517427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712555e0-7ccc-4365-93a0-fa211f71e858 None None] Pushing event updated for resources: {'Port': ['ID=661b4be0-a8d2-427f-9d57-e89bc540536b,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:33.529945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Attempting to bind port 661b4be0-a8d2-427f-9d57-e89bc540536b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:33.530315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Attempting to bind port 661b4be0-a8d2-427f-9d57-e89bc540536b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:33.530695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Attempting to bind port 661b4be0-a8d2-427f-9d57-e89bc540536b on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:33.532171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.545152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:33.545529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:33.545930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.546316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:33.546920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Bound port: 661b4be0-a8d2-427f-9d57-e89bc540536b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:33.547212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.552563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:33.630165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=c78a2fcc-3860-46dd-900f-e520dcefbffe,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:33.647182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85fe763a-0852-4e89-a47a-29373f4efe57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.651058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:33.660836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:33.666988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:33.667972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:33.668661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.711136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a2d6c678-c66c-4e2a-a215-cc470da32a90 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 0.6472495 Nov 05 14:44:33.715612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38544) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:33.723987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:33.756191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] For port 661b4be0-a8d2-427f-9d57-e89bc540536b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:33.767211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] For port 661b4be0-a8d2-427f-9d57-e89bc540536b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=661b4be0-a8d2-427f-9d57-e89bc540536b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:33.780278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.795618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Allocated IP 172.20.0.1 (fd1ccb7c-d1e8-48e2-b784-b56a587e2542/84c193ea-9294-4fe7-b33c-753ea27f07be/e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:33.874207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.937324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85fe763a-0852-4e89-a47a-29373f4efe57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.945964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85fe763a-0852-4e89-a47a-29373f4efe57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:33.952916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 19366c25-ca17-4e42-9cc2-78dc5af54481 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:33.995275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c218a241-beab-45cd-8d09-d71470ba0472 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.014689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712555e0-7ccc-4365-93a0-fa211f71e858 None None] Pushing event updated for resources: {'Port': ['ID=661b4be0-a8d2-427f-9d57-e89bc540536b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.030590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c218a241-beab-45cd-8d09-d71470ba0472 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.061755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Allocated IP 172.20.0.3 (9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c/ab68a5fd-d421-4f3a-bbcb-c915c2142d36/a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:34.069204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-85fe763a-0852-4e89-a47a-29373f4efe57 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c5a4d28d81df4a6593c463039412f80d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8032765 Nov 05 14:44:34.072190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fe763a-0852-4e89-a47a-29373f4efe57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acdc82ec-b191-4ebc-9e5d-10ef3d8d9d23,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.077284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38552) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:34.104893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:34.108135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:34.110066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Provisioning complete for port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:34.110475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.115507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Allocated IP 172.26.5.142 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/e67ade8d-82e3-4146-b9ba-d9da0956006e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:34.171524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c218a241-beab-45cd-8d09-d71470ba0472 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=00a66048969046b4882224f051a30641&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6980708 Nov 05 14:44:34.181943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38554) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:34.219418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c218a241-beab-45cd-8d09-d71470ba0472 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d904248f-a24c-4ed5-a34d-3eda6bcc7b47,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.220741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Router 51c9704a-323f-4947-9153-8af2348f332c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:44:34.226178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.248153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port c78a2fcc-3860-46dd-900f-e520dcefbffe yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:34.266047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.279340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.280964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.284032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.361511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.386896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.423705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=c78a2fcc-3860-46dd-900f-e520dcefbffe,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.425091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.477107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.483276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.489260 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/acdc82ec-b191-4ebc-9e5d-10ef3d8d9d23 HTTP/1.1" status: 204 len: 168 time: 0.4107254 Nov 05 14:44:34.490287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.491258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.491679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.499128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.502696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.508040 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d904248f-a24c-4ed5-a34d-3eda6bcc7b47 HTTP/1.1" status: 204 len: 168 time: 0.3249681 Nov 05 14:44:34.510288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.517151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.517563 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.518289 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 2 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.536417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.537018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.537439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.542319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:34.546295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc06373e-a499-4e5a-bec4-63f40ef0c94d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acdc82ec-b191-4ebc-9e5d-10ef3d8d9d23,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.551850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.557847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:34.565218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.565614 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.570484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Sync routers for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:34.579576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 3 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.587745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9f9d0f14-9add-4918-bc8f-ce8c769eb2c7 admin admin] 10.222.0.30 "PUT /v2.0/routers/51c9704a-323f-4947-9153-8af2348f332c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2733178 Nov 05 14:44:34.590198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715f5cd5-d8c8-466d-8eba-9c8bb3724ba0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d904248f-a24c-4ed5-a34d-3eda6bcc7b47,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.591648 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:34.605187 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:34.607365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.636912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.637909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:34.638680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Pushing event updated for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.639486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.640135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.658835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.659164 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.659544 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 4 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.688370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.688743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.688969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.698260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.698260 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.698514 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 5 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.710972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:34.712699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.713029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.713363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.714989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:34.718742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.718968 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.719855 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 6 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.738494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.739229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.739734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.744527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.745262 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.745825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 7 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.759709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.760266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.760837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.765487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.766037 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.766793 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 8 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.779406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:34.784854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.788210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.793271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.793793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.800975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.801602 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.803433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 9 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.806270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:34.829508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.829925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.830391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.833406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:34.840492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.840492 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.841396 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 10 to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe Nov 05 14:44:34.843582 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:34.875199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:34.875403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:34.875740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:34.880744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:34.880744 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port c78a2fcc-3860-46dd-900f-e520dcefbffe on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:34.880969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.904817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Port': ['ID=a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:34.914522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.964606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 19366c25-ca17-4e42-9cc2-78dc5af54481 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:34.965143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:34.977242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:35.011569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port c78a2fcc-3860-46dd-900f-e520dcefbffe, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:35.011898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempted to set empty binding levels {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:44:35.018145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.072262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:35.095692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:35.098202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] In _notify_port_updated(), no bound segment for port c78a2fcc-3860-46dd-900f-e520dcefbffe on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:44:35.099053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.099651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.103990 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "PUT /v2.0/ports/c78a2fcc-3860-46dd-900f-e520dcefbffe HTTP/1.1" status: 200 len: 976 time: 1.3844137 Nov 05 14:44:35.110764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38578) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:35.148785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.175766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d50804d-a3c4-42ef-92c2-854aefe66ffc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:35.178396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad348c3-18d9-45d0-9780-2e3efa782507 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=c78a2fcc-3860-46dd-900f-e520dcefbffe,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:35.198972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'Port': ['ID=e67ade8d-82e3-4146-b9ba-d9da0956006e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:35.274535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] For port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:35.294332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:26Z', 'revision_number': 3, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:35.299310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.300231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.300837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.301469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.301753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.303379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.303908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.304315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.304817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.305273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.305874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.305978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.306179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.306612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.307062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.308512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.308965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:35.315808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-db0b8011-986c-4e15-8654-79acfb09b441 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 14202 time: 0.2022588 Nov 05 14:44:35.316903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38584) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:35.323942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 2, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:35.384713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Checking router: 51c9704a-323f-4947-9153-8af2348f332c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:35.385168 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Updating router 51c9704a-323f-4947-9153-8af2348f332c port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:35.389262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a9daf05-b9ed-4d47-8d25-c015fe716738 None None] The sync data for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv is: [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:26Z', 'revision_number': 3, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:35.396048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f46cb97e-7afd-4657-be56-0eaeb5e7ad6d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:35.437280 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.468176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38586) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:35.541444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Provisioning complete for port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:35.546110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.554448 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0fe6955d-5972-4844-9767-ccd19b98946e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b0c8658ffc9144628f61c919da7f3133&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0835416 Nov 05 14:44:35.556730 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:44:35.559462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38588) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:35.590786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.600599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:35.621597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Pushing event updated for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:35.628029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Deleting port c78a2fcc-3860-46dd-900f-e520dcefbffe {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:35.628361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.643476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d50804d-a3c4-42ef-92c2-854aefe66ffc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:35.658490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.693988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f10157c4-2e7b-4338-a292-6baec01c5438 None None] Port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:35.754689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf54d175-7476-4ffa-a8b5-54075600a9e2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.804620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.806576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port c78a2fcc-3860-46dd-900f-e520dcefbffe, host hv-neutron-8168, got binding levels [] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:35.806912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.809822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:35.810190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.852490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Calling delete_port for c78a2fcc-3860-46dd-900f-e520dcefbffe owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:35.909747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:35.935054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.023678 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.044572 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.064754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.115101 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b05ce1-cbb9-4ce3-9561-010edb8f6275 None None] Pushing event updated for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:36.210136 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Attempting to bind port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:36.211072 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Attempting to bind port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:36.211661 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Attempting to bind port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 on network fc36919c-2228-49a8-98f4-75664fee44eb {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:36.211851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.218147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.220179 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:36.221068 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Checking segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:36.221690 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.222326 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Bound using segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:36.222445 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f2a3735b-ef65-4280-ad6a-f2bbff39a5f6 HTTP/1.1" status: 204 len: 168 time: 0.6606562 Nov 05 14:44:36.223168 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Bound port: 74689f1f-b8e2-419c-b7bb-20c6dc557b76, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:36.223784 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.300426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5641396c-06b4-4891-b368-7e84681eca38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2a3735b-ef65-4280-ad6a-f2bbff39a5f6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:36.330239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.352352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 29716c74-54f7-4923-be4d-b3ff019d83be up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:36.370496 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] For port 74689f1f-b8e2-419c-b7bb-20c6dc557b76, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:36.378954 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] For port 74689f1f-b8e2-419c-b7bb-20c6dc557b76, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=74689f1f-b8e2-419c-b7bb-20c6dc557b76,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:36.391668 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.407268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38606) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:36.434210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event deleted for resources: {'Port': ['ID=c78a2fcc-3860-46dd-900f-e520dcefbffe,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:36.458327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.465169 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-63dfa5bf-fe37-476a-8029-073ebae69f60 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "DELETE /v2.0/ports/c78a2fcc-3860-46dd-900f-e520dcefbffe HTTP/1.1" status: 204 len: 168 time: 1.1436408 Nov 05 14:44:36.467309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38610) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:36.501171 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:36.502180 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:36.532287 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a50f6c5-9b8b-467b-aa7c-65d608da5420 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:44:36.534067 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4a50f6c5-9b8b-467b-aa7c-65d608da5420 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports/c78a2fcc-3860-46dd-900f-e520dcefbffe HTTP/1.1" status: 404 len: 333 time: 0.0646031 Nov 05 14:44:36.549939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38612) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:36.560646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-631429187', 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:36.618235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Made reservation on behalf of c00271e60e414c15bfdd60b4d8f95840 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:36.621326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.664211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port da959fe8-b00a-40cb-a714-c8018454c678 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:36.667978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 29716c74-54f7-4923-be4d-b3ff019d83be triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:36.669292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.741224 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:36.783842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf54d175-7476-4ffa-a8b5-54075600a9e2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.838859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf54d175-7476-4ffa-a8b5-54075600a9e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:36.965564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-289895728', 'router:external': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:37.031614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Made reservation on behalf of 958d110f5740449b9e7fb352ead488b2 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:37.040511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.088124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.149722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] Provisioning complete for port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:37.150093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.199017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf54d175-7476-4ffa-a8b5-54075600a9e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cd2e3fd-981d-4a64-b382-8b7d85d5908d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.208133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.310940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.335910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Pushing event updated for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.402423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.405635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.417343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf54d175-7476-4ffa-a8b5-54075600a9e2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=231e6d12704a499e9d2acf468a517a68&name=default HTTP/1.1" status: 200 len: 2996 time: 1.8133233 Nov 05 14:44:37.418174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.435403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38626) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:37.460121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 661b4be0-a8d2-427f-9d57-e89bc540536b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:37.552646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38632) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:37.559461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1303290866', 'description': 'tempest-description--965307378'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:37.586201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] For port 74689f1f-b8e2-419c-b7bb-20c6dc557b76, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=74689f1f-b8e2-419c-b7bb-20c6dc557b76,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:37.609956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.611543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.617304 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b05ce1-cbb9-4ce3-9561-010edb8f6275 None None] Pushing event updated for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.626536 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:36Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:37.655830 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb76829d-95f0-4c8a-8541-473ba628f468 None None] The sync data for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv is: [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:36Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:37.693034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.694694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.700623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-955b7ad4-8cec-4602-9102-a9ff35f3d26b None None] Pushing event updated for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.711140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 661b4be0-a8d2-427f-9d57-e89bc540536b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:37.711684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.729648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.742207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:37.755986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.772509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:37.772742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b88386f3-683a-4690-97ff-46215a502742 None None] Provisioning complete for port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:37.773255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b88386f3-683a-4690-97ff-46215a502742 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.776853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.790175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.800507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:37.801551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:37.802158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.814502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=da959fe8-b00a-40cb-a714-c8018454c678,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.850239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 646} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:37.858922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.878567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b88386f3-683a-4690-97ff-46215a502742 None None] Port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:37.909022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.909359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Added segment 32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9 of type vlan for network 6433e70e-3942-4d29-8fe3-33efce7027d9 Nov 05 14:44:37.910648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffccb97b-6ecd-4eae-a89f-c23aca1819dd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:37.932987 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3ab3adeb-cb0d-4cd0-ad49-5db6d3bc67de tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 1.3818865 Nov 05 14:44:37.933119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b88386f3-683a-4690-97ff-46215a502742 None None] Provisioning complete for port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:37.933437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b88386f3-683a-4690-97ff-46215a502742 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:37.945187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38638) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:37.987455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.013591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 661b4be0-a8d2-427f-9d57-e89bc540536b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=661b4be0-a8d2-427f-9d57-e89bc540536b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:38.025369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.025661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.026467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f46cb97e-7afd-4657-be56-0eaeb5e7ad6d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:38.082631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.105743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'Port': ['ID=e67ade8d-82e3-4146-b9ba-d9da0956006e,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.118636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.119451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.129261 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ad2c678-a4c9-48de-81c0-b74222235f7a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 6.7801464 Nov 05 14:44:38.129480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.136319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c79eb162-9809-465f-9299-3cae9656d77d tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:38.143327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c79eb162-9809-465f-9299-3cae9656d77d tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports/da959fe8-b00a-40cb-a714-c8018454c678 HTTP/1.1" status: 200 len: 954 time: 0.1946383 Nov 05 14:44:38.149249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38642) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:38.160336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.191933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=661b4be0-a8d2-427f-9d57-e89bc540536b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.207545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:38.207926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.210101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.213327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.214832 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6cd2e3fd-981d-4a64-b382-8b7d85d5908d HTTP/1.1" status: 204 len: 168 time: 0.7775345 Nov 05 14:44:38.277167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'SecurityGroup': ['ID=40e045d3-0c39-49ee-9afb-128e4a54e42c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.295075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.306811 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-926dee77-9ad9-48ce-ba45-a94ac0fad6fb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.7483733 Nov 05 14:44:38.308028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38648) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:38.318298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'security_group_rule': {'security_group_id': '40e045d3-0c39-49ee-9afb-128e4a54e42c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:38.363841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.370267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.393360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:38.397814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.407854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-122ce257-004e-4081-9d9a-d87aa46c5797 None None] Provisioning complete for port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:38.408397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-122ce257-004e-4081-9d9a-d87aa46c5797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.412371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.436089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4e3b9af-dd61-495c-8e02-22e24a748dc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cd2e3fd-981d-4a64-b382-8b7d85d5908d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.582648 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 870 time: 2.1743064 Nov 05 14:44:38.586066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38664) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:38.591900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'subnet': {'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:38.597617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032fcd06-34d7-43d4-954a-006de164e4e5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Network': ['ID=6433e70e-3942-4d29-8fe3-33efce7027d9,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.618741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:38.625993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.640972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:38.641741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Deleting port da959fe8-b00a-40cb-a714-c8018454c678 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:38.642135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.666591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.746853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Made reservation on behalf of 958d110f5740449b9e7fb352ead488b2 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:38.749796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.752388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:38.768151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:38.779184 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 6.5711398 Nov 05 14:44:38.783885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f098aa38-06cd-4c59-9d93-6eb4c09b90f7 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Port': ['ID=a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:38.789576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38668) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:38.958669 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dfef964e-08f5-4536-a699-9f1582f0865a tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "GET /v2.0/floatingips?floating_network_id=9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c HTTP/1.1" status: 200 len: 689 time: 0.1662259 Nov 05 14:44:38.965009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38672) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:38.984752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.044875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Calling delete_port for da959fe8-b00a-40cb-a714-c8018454c678 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:39.239449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-85aa182a-c045-496f-82f5-1e73b0bbc522 None None] Provisioning complete for port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:39.240084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-85aa182a-c045-496f-82f5-1e73b0bbc522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.250373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.252610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:44:39.296487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.332375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.333186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 661b4be0-a8d2-427f-9d57-e89bc540536b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:39.385078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event deleted for resources: {'Port': ['ID=da959fe8-b00a-40cb-a714-c8018454c678,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:39.426555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.430779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a073a08e-cd9f-4da1-ab94-4d34fd66ff87 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "DELETE /v2.0/ports/da959fe8-b00a-40cb-a714-c8018454c678 HTTP/1.1" status: 204 len: 168 time: 1.2797196 Nov 05 14:44:39.440787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38690) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:39.446965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-85aa182a-c045-496f-82f5-1e73b0bbc522 None None] Port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:39.504326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=72be53f6-d070-4fc1-92f0-3a0f3d1ca805,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:39.514886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.518469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38698) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:39.534840 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 05 14:44:39.541107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.546523 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c6d1426-2fd9-47ba-aa3c-d7204a737ad2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:44:39.548504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 661b4be0-a8d2-427f-9d57-e89bc540536b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:39.548689 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c6d1426-2fd9-47ba-aa3c-d7204a737ad2 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports/da959fe8-b00a-40cb-a714-c8018454c678 HTTP/1.1" status: 404 len: 333 time: 0.1059790 Nov 05 14:44:39.548890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.549187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38700) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:39.552003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ad0e09a-2631-4864-afdf-8d11ce2c8b5a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.2369502 Nov 05 14:44:39.555658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38702) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:39.578785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'security_group_rule': {'security_group_id': '40e045d3-0c39-49ee-9afb-128e4a54e42c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:39.590523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1581369691'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:39.652441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Made reservation on behalf of c00271e60e414c15bfdd60b4d8f95840 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:39.655702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.661285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:39.691170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 74689f1f-b8e2-419c-b7bb-20c6dc557b76 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:39.714039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port beaec8ab-c7b3-4074-9d81-b63457f226f5 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:39.785334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.792871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:39.794148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:39.895180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-9e2d8b83-893a-42cb-bba4-5c1925256e1f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--543305961&fields=id&tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4 HTTP/1.1" status: 200 len: 267 time: 0.3686624 Nov 05 14:44:40.010650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:40.023648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Sync routers for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:40.032114 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fc07acd4-998c-42d7-81bb-52554a1edbb8 admin admin] 10.222.0.30 "PUT /v2.0/routers/29e22c11-bb69-42c5-9ed8-f394e0cf82c3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.0582049 Nov 05 14:44:40.038567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:40.039284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:40.071641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Deleting port a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:40.073476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.109859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-1771361613', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:40.141255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.184920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.199266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:40.228644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5afa99c2-5d10-48cb-bcc8-2df8f7535afa,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:40.245628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Made reservation on behalf of ba93a2f5334e4d4f9e682494e3b32a23 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:40.248221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.263691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.267865 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4cac4753-2043-45f9-afe8-3c6a2bdc2bd4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7137339 Nov 05 14:44:40.274540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38722) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:40.277634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.281198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.290251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:40.338361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38728) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:40.357609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-c0c2701a-9f47-434a-b77d-e84e8e3952fc tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:40.364556 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-c0c2701a-9f47-434a-b77d-e84e8e3952fc tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/networks?id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 200 len: 812 time: 0.4682977 Nov 05 14:44:40.378678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:44:40.380417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.390818 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-6027c06f-9edd-4dae-959d-f14b44cbb63b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/quotas/b398cbd7c6d04e96b90e3a8bcfd826b4 HTTP/1.1" status: 200 len: 375 time: 0.0253348 Nov 05 14:44:40.459169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.464885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.465267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.506490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Calling delete_port for a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:40.551347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.554487 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-10e33d59-9311-4127-b7c0-6a1b0571b87b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1546636 Nov 05 14:44:40.557055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Subnet': ['ID=4cd64ba4-2d2e-45d6-9348-34e5d3273d39,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:40.562251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1743979874'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:40.603546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 2, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:40.646423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Checking segment: {'id': '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:40.646782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network hostable DHCP agents. Network: 6433e70e-3942-4d29-8fe3-33efce7027d9, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:40.662848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Checking router: 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:40.664162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Updating router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:40.665505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:40.682341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:40.701890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:40.702205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.702389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:40.702947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.705247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=beaec8ab-c7b3-4074-9d81-b63457f226f5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:40.746297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Made reservation on behalf of 6153fb48842c46b2b0fdaee6d13f5997 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:40.752874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.753053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.764032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.769902 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a2785c36-8518-4fd7-803f-a078202554bd tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.1864412 Nov 05 14:44:40.775319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:40.776693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] device_id is not set on port abeb67c3-e214-4e77-9f05-4de863dfd254 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:40.779805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-4194ed48-210f-4229-80c5-5dc3ca4726e5 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:44:40.781600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:40.785065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-4194ed48-210f-4229-80c5-5dc3ca4726e5 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1037323 Nov 05 14:44:40.785896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.795745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:40.885987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 6433e70e-3942-4d29-8fe3-33efce7027d9) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:40.895745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:40.896734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:40.942204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5c436bf-0037-44cc-9db6-e6b10148636f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:40.950996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3387309c-6452-45a7-84f1-eb6bb2fd9ad4 None None] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:41.003244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.006523 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-d356c6b1-5e27-4626-ba01-5e87910e94d8 service neutron] 10.222.0.30 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2074192 Nov 05 14:44:41.009277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ff5dd29a-0de4-4412-b1c3-4532143f6258 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.4213748 Nov 05 14:44:41.018529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38740) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:41.024480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-961654086', 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:41.111995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3387309c-6452-45a7-84f1-eb6bb2fd9ad4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:41.117466 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:41.128989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e78b4f8-edd2-4ec1-87da-243b665aa8ca None None] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:41.177088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Allocated IP 172.26.5.13 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/abeb67c3-e214-4e77-9f05-4de863dfd254) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:41.179336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Made reservation on behalf of 958d110f5740449b9e7fb352ead488b2 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:41.182059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.208477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.288836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4e78b4f8-edd2-4ec1-87da-243b665aa8ca None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:41.292199 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:41.294815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] device_id is not set on port 7bca28e5-d62a-433b-82a4-862e43fe8329 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:41.306731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.313749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0150de6d-c1bc-4999-9788-9072ef647ed2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:41.328910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Port': ['ID=a23ab0ae-5ec8-40e3-821e-2ca65a4a0dd4,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.336888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.343705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.373308 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-53455bdd-4fd4-471e-91b8-40ba9df9ca78 service neutron] 10.222.0.30 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3657727 Nov 05 14:44:41.403185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 600} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:41.420546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'SecurityGroup': ['ID=db324925-669d-456a-8b16-49cf79925111,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.438086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.438347 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Added segment fb41554e-4f67-4861-9fb0-f63c955cfbd9 of type vlan for network a86c0d03-9a76-4e86-b54e-4effb464c4ed Nov 05 14:44:41.439751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.487000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38744) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:41.492730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1497955808', 'description': 'tempest-description--1041083046'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:41.532928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.588079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] device_id is not set on port beaec8ab-c7b3-4074-9d81-b63457f226f5 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:41.600792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d030a45-cceb-4aad-908d-426d0b8d6d98 None None] Pushing event updated for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.601738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.20.0.10 (6433e70e-3942-4d29-8fe3-33efce7027d9/4cd64ba4-2d2e-45d6-9348-34e5d3273d39/7bca28e5-d62a-433b-82a4-862e43fe8329) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:41.608956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.614284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.624239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.641061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Attempting to bind port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:41.641609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Attempting to bind port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:41.641823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Attempting to bind port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a on network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:41.649423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.657139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:41.657774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Checking segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:41.658270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.658794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Bound using segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:41.659430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Bound port: e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:41.660579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.662167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.664558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0150de6d-c1bc-4999-9788-9072ef647ed2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:41.669543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:41.670162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.682526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.696752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.704203 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.3620274 Nov 05 14:44:41.711186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38748) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:41.733017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'subnet': {'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:41.849637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] For port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:41.855802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=beaec8ab-c7b3-4074-9d81-b63457f226f5,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.871816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] For port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:41.885875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:41.904866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=ab68a5fd-d421-4f3a-bbcb-c915c2142d36,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.908742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eaaff57-6b4f-4bbf-95b2-329213c0bb5c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Network': ['ID=a86c0d03-9a76-4e86-b54e-4effb464c4ed,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:41.924909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38768) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:41.941778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:41.978415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.000243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:42.000243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:42.000243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:42.021608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.028623 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:42.063732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '06ec69be-c821-40f8-8846-95253fb65f6e') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:42.063732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '06ec69be-c821-40f8-8846-95253fb65f6e') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:42.086352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.090891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:42.091513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:42.096103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d030a45-cceb-4aad-908d-426d0b8d6d98 None None] Pushing event updated for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:42.110588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.117379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Releasing vlan 609 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:42.117979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.118286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Pushing event updated for resources: {'Port': ['ID=abeb67c3-e214-4e77-9f05-4de863dfd254,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:42.128004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:42.128507 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:42.146618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 2 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:42.165825 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 05 14:44:42.192588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:42.192920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:42.193296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:42.195525 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:42.201919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.220314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Network': ['ID=9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:42.222824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:44:42.229130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.235832 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc226fe3-25c9-4b1a-87c7-34f4adf4e5e2 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c HTTP/1.1" status: 204 len: 168 time: 3.2688296 Nov 05 14:44:42.241020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38772) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.247295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.380401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd0c23ea-5f7d-4d66-9238-5c6bb2fc1e82 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:42.388832 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-57abb59e-905f-4602-b182-b918983a2080 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 691 time: 0.1466124 Nov 05 14:44:42.396140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38778) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.454524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:42.467046 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4e1a60e-cdcf-454b-9b38-6b5f19181cc7 req-30b9aa65-5404-4297-963d-2dc104285e3a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.5322948 Nov 05 14:44:42.486538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.494049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:42.500821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:42.501271 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:42.513738 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 3 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:42.531797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Made reservation on behalf of 6153fb48842c46b2b0fdaee6d13f5997 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:42.535661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.539467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:42.545035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Allocated IP 172.26.5.23 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/26349d09-e999-4803-9bc7-71ebfce01836) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:42.562653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:42.579191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd0c23ea-5f7d-4d66-9238-5c6bb2fc1e82 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:42.623182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.628539 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.1352046 Nov 05 14:44:42.637776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.641943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.642409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.642860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.643300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.644287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.644884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.645476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:42.653486 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6b095ddd-0a46-4f9a-8d67-7b6948f936c6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4608 time: 0.2561853 Nov 05 14:44:42.654120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38786) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.654902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38788) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.659516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'security_group_rule': {'security_group_id': '1245440e-5dfc-42f9-a460-fe077039d6bf', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:42.719928 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-3721a4e2-a44b-4936-bd7c-137c54955696 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] delete failed (client error): The resource could not be found. Nov 05 14:44:42.724337 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3721a4e2-a44b-4936-bd7c-137c54955696 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/floatingips/383dd5e9-39b3-4c4b-97bb-081cd204014d HTTP/1.1" status: 404 len: 345 time: 0.0412462 Nov 05 14:44:42.728544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38790) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.739746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.755463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c242c36c-9e84-4b80-ab8c-7f04f6fe4e56 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] DELETE failed (client error): The resource could not be found. Nov 05 14:44:42.756027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c242c36c-9e84-4b80-ab8c-7f04f6fe4e56 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:44:42.766231 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c242c36c-9e84-4b80-ab8c-7f04f6fe4e56 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/9f0e3b53-b1dc-4bd1-aa95-298ad3a4729c HTTP/1.1" status: 404 len: 339 time: 0.0353558 Nov 05 14:44:42.766588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.772226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38794) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:42.777508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'name': 'tempest-network--2104232464', 'router:external': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:42.801608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:42.802113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:42.802540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:42.811870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a948c490-891e-4d07-8b2a-c82ab61b3cf0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1245440e-5dfc-42f9-a460-fe077039d6bf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:42.814871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:42.818015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.837198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.848317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:42.849021 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:42.858205 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 4 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:42.870202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 615} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:42.885687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.891369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.892081 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Added segment 9cde5b4c-aa22-4f50-b85b-ab0f50339645 of type vlan for network 49a29a4b-79f1-424c-86bc-f30d02de7849 Nov 05 14:44:42.903859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:42.984723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.008896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=60470b16-3b43-4911-a550-37d5a2e7ea1f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:43.045008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.046389 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b0430181-ea6c-493b-8db5-de110b4a292b tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3905263 Nov 05 14:44:43.047685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.048771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:43.048907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.055938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.057494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.059841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.063209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38800) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:43.074834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:43.074834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:43.074834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:43.082482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:43.095247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'Port': ['ID=26349d09-e999-4803-9bc7-71ebfce01836,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:43.098591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:43.109229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:43.109667 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:43.130488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 5 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:43.132415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'security_group_rule': {'security_group_id': '1245440e-5dfc-42f9-a460-fe077039d6bf', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:43.147303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b3d7ca35-954b-4e27-a14d-43c86a3ecbb2 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1036 time: 3.4840610 Nov 05 14:44:43.148568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.155233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:43.161471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.13'}]}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:43.184103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=49a29a4b-79f1-424c-86bc-f30d02de7849,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:43.212579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-51e407c0-9f25-4e31-9e6f-3c49e735486c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.4353299 Nov 05 14:44:43.216524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 49a29a4b-79f1-424c-86bc-f30d02de7849 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:43.222308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38806) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:43.224687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.231886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:43.232290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:43.232712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:43.263593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:43.263850 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:43.284614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:41Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:43.313592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.333127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 6 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:43.337836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:43.341509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9c98c99-4709-4259-9986-7e58d39486ad None None] The sync data for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv is: [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:41Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:43.389721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:43.407221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=7bca28e5-d62a-433b-82a4-862e43fe8329,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:43.414497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:43.460348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:43.460756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:43.461205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:43.497716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:43.498488 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:43.500215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 7 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:43.503340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.608301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.609010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.647357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:43.647686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:43.648051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:43.650179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.729146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.730189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.741951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:43.742274 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:43.745763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2745265f-5ab9-4f99-97e9-59a95306fb88 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 2.7250850 Nov 05 14:44:43.754638 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 8 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:43.757177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:43.763854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Subnet': ['ID=ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:43.826915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] Provisioning complete for port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:43.830626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:43.846544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:43.846884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:43.847231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:43.859617 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5600654-5173-4b17-aeae-33c708175398 req-4905239a-7d2c-442a-bbe0-415b539fcc59 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.1407740 Nov 05 14:44:43.885581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.897601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.919598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.926939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.936754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:43.939061 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1e35fa6e-992b-44f4-b335-64ab88ea135e tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3056 time: 0.6823988 Nov 05 14:44:43.947965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38814) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:43.988234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.007675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:44.008031 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:44.009650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.011385 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 9 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:44.049220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.072837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] For port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:44.087783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.099845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Checking segment: {'id': 'fb41554e-4f67-4861-9fb0-f63c955cfbd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:44.100184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network hostable DHCP agents. Network: a86c0d03-9a76-4e86-b54e-4effb464c4ed, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:44:44.116968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:44.117300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:44.117645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:44.135902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.146143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:44.146287 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:44.146646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f9c7c59-d2c2-4488-a5bd-835d65b82198,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:44.150652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempt 10 to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 Nov 05 14:44:44.182197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:44:44.190485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20710a29-0ae1-44f8-9cc9-bc7edad47b03 None None] Pushing event updated for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:44.197321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:44.197664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:44.198019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempting to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:44.209123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a86c0d03-9a76-4e86-b54e-4effb464c4ed) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:44.212912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.224560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:44.224897 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Failed to bind port beaec8ab-c7b3-4074-9d81-b63457f226f5 on host hv-neutron-8168 for vnic_type normal using segments [{'id': '958e6343-c339-4da9-a5aa-728a69a20293', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '2f53417e-d426-4ec0-bf7b-34f4abd5fc13'}] Nov 05 14:44:44.225267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.226294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85cb79f7-77e9-48fa-a9e6-1859815707f8 None None] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:44.233405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:44.234001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.236883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Deleting port 7bca28e5-d62a-433b-82a4-862e43fe8329 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:44.237213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.244334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.256326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.257658 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fd722045-8aec-4835-bb74-657f4115fac4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1857960 Nov 05 14:44:44.261605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38818) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:44.268148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:44.284256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-080e3cb9-eecb-466e-9318-5ff917be6ef9 None None] Provisioning complete for port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:44.284745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-080e3cb9-eecb-466e-9318-5ff917be6ef9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.299748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-85cb79f7-77e9-48fa-a9e6-1859815707f8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:44.352055 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:44.354391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.371091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbd3ece9-95a4-4573-941d-2c471fe78312 None None] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:44:44.417592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.443432 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cadc43e1-7c2a-43f4-912a-b34ed482561c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7216949 Nov 05 14:44:44.454530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38820) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:44.460640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-141444300', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:44.486878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'Port': ['ID=26349d09-e999-4803-9bc7-71ebfce01836,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:44.506836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.523262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.538142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port beaec8ab-c7b3-4074-9d81-b63457f226f5, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:44.538588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attempted to set empty binding levels {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:44:44.539884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Calling delete_port for 7bca28e5-d62a-433b-82a4-862e43fe8329 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:44.548430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cbd3ece9-95a4-4573-941d-2c471fe78312 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:44:44.551111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:44:44.556138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.579015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-757a5a79-948f-4a30-925e-41dccd1dadea None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:44.605770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['49a29a4b-79f1-424c-86bc-f30d02de7849']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:44.623508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9cde5b4c-aa22-4f50-b85b-ab0f50339645') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:44.623772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.32', 61023) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:44.626161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9cde5b4c-aa22-4f50-b85b-ab0f50339645') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:44.639496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] In _notify_port_updated(), no bound segment for port beaec8ab-c7b3-4074-9d81-b63457f226f5 on network 2f53417e-d426-4ec0-bf7b-34f4abd5fc13 {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:44:44.640059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:44.640637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.644614 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "PUT /v2.0/ports/beaec8ab-c7b3-4074-9d81-b63457f226f5 HTTP/1.1" status: 200 len: 977 time: 3.8578320 Nov 05 14:44:44.644864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.645954 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5d2c1f40-47fc-46e9-b4ec-77b75c414bb5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.3658452 Nov 05 14:44:44.646779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.647785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.659484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38822) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:44.710934 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.744341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-757a5a79-948f-4a30-925e-41dccd1dadea None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:44.782182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2facc97e-bd4f-4bf5-98e3-1b11df5d3c1e tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event updated for resources: {'Port': ['ID=beaec8ab-c7b3-4074-9d81-b63457f226f5,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:44.791953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.900860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Releasing vlan 615 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:44.901253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:44.903044 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:45.010471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.032998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.098325 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c93ab6c-ad8f-4001-ad3f-771a6c49143d req-36f07076-0733-4c74-9b95-55c73f8b7669 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.0861654 Nov 05 14:44:45.109141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.120105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 49a29a4b-79f1-424c-86bc-f30d02de7849 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:44:45.138727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.142055 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/49a29a4b-79f1-424c-86bc-f30d02de7849 HTTP/1.1" status: 204 len: 168 time: 1.1917346 Nov 05 14:44:45.145863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38852) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:45.151438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Deleting port beaec8ab-c7b3-4074-9d81-b63457f226f5 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:45.151827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.153889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8683b889-e540-423b-9ab9-4dcc764fd37c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Network': ['ID=49a29a4b-79f1-424c-86bc-f30d02de7849,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:45.160572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'name': 'tempest-network--2136976985', 'router:external': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:45.240235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:45.241134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.242869 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e112c28f-3802-422e-873a-8ec306a4fb5f tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 714 time: 0.7873561 Nov 05 14:44:45.249747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38854) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:45.287953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.301243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f45d5395-1837-4b21-ba44-6c952c12649b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:45.305677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f45d5395-1837-4b21-ba44-6c952c12649b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "GET /v2.0/networks?id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 200 len: 812 time: 0.6780291 Nov 05 14:44:45.318423 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-ba78116b-cc9c-4ea0-abe8-6cef989e9947 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1303290866&fields=id&tenant_id=643f5fc30ebb419c9fb85748c2767795 HTTP/1.1" status: 200 len: 267 time: 0.2393076 Nov 05 14:44:45.319390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a86c0d03-9a76-4e86-b54e-4effb464c4ed', 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed', 'tenant_id': '6153fb48842c46b2b0fdaee6d13f5997', 'fixed_ips': [{'subnet_id': 'ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:44:45.320658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.394853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:45.396304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.458742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:45.461093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.483096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] For port beaec8ab-c7b3-4074-9d81-b63457f226f5, host hv-neutron-8168, got binding levels [] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:45.483464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.682208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-c7777db1-6d85-4132-828a-e357a46e5802 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:45.683846 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-c7777db1-6d85-4132-828a-e357a46e5802 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 811 time: 0.3564732 Nov 05 14:44:45.710078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.725335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-bc0140a3-1283-4b86-8622-a7f1f73ac7d6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/quotas/643f5fc30ebb419c9fb85748c2767795 HTTP/1.1" status: 200 len: 375 time: 0.0328612 Nov 05 14:44:45.792063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Port': ['ID=7bca28e5-d62a-433b-82a4-862e43fe8329,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:45.870696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Calling delete_port for beaec8ab-c7b3-4074-9d81-b63457f226f5 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:45.919858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Allocated IP 172.20.0.2 (a86c0d03-9a76-4e86-b54e-4effb464c4ed/ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03/bcffe010-15d0-4080-b8eb-0b2809b3cd7e) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:45.948392 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-285e6778-02ed-429d-9ade-6ea26ad2060d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1635783 Nov 05 14:44:45.956498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-19005e91-2317-4103-a9a4-211cb7e68445 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4 HTTP/1.1" status: 200 len: 379 time: 0.3958044 Nov 05 14:44:45.962742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:45.972384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0007d3f-525d-4eec-9ca5-0b7d8e4e5337 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/ports/7bca28e5-d62a-433b-82a4-862e43fe8329 HTTP/1.1" status: 204 len: 168 time: 2.2111449 Nov 05 14:44:45.978347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38872) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:45.994217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'port': {'device_id': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'admin_state_up': True, 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'security_groups': ['ca006447-f1ef-432d-8d17-18a36a16ac5b']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:46.011770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'external_fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10'}]}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:46.140388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.149659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.162329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.218419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:46.235187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:46.241868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:46.264173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Pushing event updated for resources: {'Port': ['ID=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:46.265282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.322823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.329428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.374024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Attempting to bind port bcffe010-15d0-4080-b8eb-0b2809b3cd7e on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:46.375099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Attempting to bind port bcffe010-15d0-4080-b8eb-0b2809b3cd7e by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'fb41554e-4f67-4861-9fb0-f63c955cfbd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:46.375620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Attempting to bind port bcffe010-15d0-4080-b8eb-0b2809b3cd7e on network a86c0d03-9a76-4e86-b54e-4effb464c4ed {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:46.383962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:46.385160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Checking segment: {'id': 'fb41554e-4f67-4861-9fb0-f63c955cfbd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:46.386071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.386719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Bound using segment: {'id': 'fb41554e-4f67-4861-9fb0-f63c955cfbd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:46.388005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Bound port: bcffe010-15d0-4080-b8eb-0b2809b3cd7e, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb41554e-4f67-4861-9fb0-f63c955cfbd9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:46.388444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Made reservation on behalf of b398cbd7c6d04e96b90e3a8bcfd826b4 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:46.388879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.393368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.421912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-4d3c8ea3-9666-412a-bf2a-397da2600fef service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:44:46.423225 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-4d3c8ea3-9666-412a-bf2a-397da2600fef service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1702185 Nov 05 14:44:46.504678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.531098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:46.543053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.556952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] For port bcffe010-15d0-4080-b8eb-0b2809b3cd7e, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:46.565360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] For port bcffe010-15d0-4080-b8eb-0b2809b3cd7e, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,segment=NetworkSegment(fb41554e-4f67-4861-9fb0-f63c955cfbd9),segment_id=fb41554e-4f67-4861-9fb0-f63c955cfbd9)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:46.585457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.605398 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b44d0948-b325-4b3c-9f81-29caf4ccc974 req-0d95c24e-647c-4cc2-94c2-265899123f58 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.3242817 Nov 05 14:44:46.668186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb155cfc-f54c-4f56-aff1-4d40ddfa90dc None None] Pushing event updated for resources: {'Port': ['ID=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:46.740657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.741249 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Added segment 98881bef-c78c-4b77-9142-3ec5c56aa794 of type vlan for network ee6ad969-cc4e-41cb-9726-441abfaf88f6 Nov 05 14:44:46.773093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-eb811004-d078-47f7-8fc2-85b594a36d15 service neutron] 10.222.0.30 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3387272 Nov 05 14:44:46.805354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.881164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Pushing event deleted for resources: {'Port': ['ID=beaec8ab-c7b3-4074-9d81-b63457f226f5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:46.886151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.890647 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d652a3f4-ae6d-4cf5-98cf-fa1f9bd938f9 tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "DELETE /v2.0/ports/beaec8ab-c7b3-4074-9d81-b63457f226f5 HTTP/1.1" status: 204 len: 168 time: 2.2276978 Nov 05 14:44:46.898192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.899159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:46.899743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:46.901754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:46.989520 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-5eb75645-f506-4a74-bcdc-36cc9aae4c97 service neutron] 10.222.0.30 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1984100 Nov 05 14:44:47.093214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.123022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=ee6ad969-cc4e-41cb-9726-441abfaf88f6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:47.136603 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-704e65ec-9dd4-46d7-8b36-135963f93c2a tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:44:47.143163 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-704e65ec-9dd4-46d7-8b36-135963f93c2a tempest-PortsAdminExtendedAttrsTestJSON-88541743 tempest-PortsAdminExtendedAttrsTestJSON-88541743-project-admin] 10.222.0.30 "GET /v2.0/ports/beaec8ab-c7b3-4074-9d81-b63457f226f5 HTTP/1.1" status: 404 len: 333 time: 0.1471591 Nov 05 14:44:47.149395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38884) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:47.177026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ee6ad969-cc4e-41cb-9726-441abfaf88f6 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:47.223695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-583fd1a3-2357-49e2-95ec-56d683d18cac tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 2.0744550 Nov 05 14:44:47.308626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38886) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:47.410849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bcffe010-15d0-4080-b8eb-0b2809b3cd7e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:47.426886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Allocated IP 172.20.0.14 (4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a/40981c52-1a1c-434c-b98f-d3a05d50d8a6/0d187a67-1569-490c-ba6b-54e4b6d47353) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:47.471724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bcffe010-15d0-4080-b8eb-0b2809b3cd7e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:47.472548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.518850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.546846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fede31c9-a4f1-4cf1-b715-620629dc768c tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:47.549343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fede31c9-a4f1-4cf1-b715-620629dc768c tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "GET /v2.0/networks/ee6ad969-cc4e-41cb-9726-441abfaf88f6 HTTP/1.1" status: 200 len: 757 time: 0.2389133 Nov 05 14:44:47.571758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38894) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:47.589110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.663686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.822143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port bcffe010-15d0-4080-b8eb-0b2809b3cd7e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,segment=NetworkSegment(fb41554e-4f67-4861-9fb0-f63c955cfbd9),segment_id=fb41554e-4f67-4861-9fb0-f63c955cfbd9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:47.836845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:47.997124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:48.117838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.120918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.158408 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a725734a-db36-40d7-9f1c-8e7ca812fd7c req-17153e16-68bf-48ad-a664-dd234e533bbc tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.1026106 Nov 05 14:44:48.192820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f53417e-d426-4ec0-bf7b-34f4abd5fc13']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:48.259702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '958e6343-c339-4da9-a5aa-728a69a20293') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:48.260001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '958e6343-c339-4da9-a5aa-728a69a20293') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:48.348649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Allocated IP 172.26.5.113 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:48.467626 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-93264875-fa97-4038-85d7-bab95bef2c84 req-38e99e3a-b401-4f5b-86ce-5e468eae5414 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.8990834 Nov 05 14:44:48.577129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.586615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1283771-1c4e-4981-860e-5a8526d79028 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:44:48.634951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.699659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-540d41ed-73fd-46fa-a3d3-a49e61da90d0 None None] Provisioning complete for port bcffe010-15d0-4080-b8eb-0b2809b3cd7e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:48.705015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-540d41ed-73fd-46fa-a3d3-a49e61da90d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.716908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.739363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Releasing vlan 631 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:48.739761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:48.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:48.799823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.835399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.849059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.862570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee7fb9cd-ce15-402e-be1b-4d4ad036bd05 tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:48.868964 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ee7fb9cd-ce15-402e-be1b-4d4ad036bd05 tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "GET /v2.0/networks/0ea324eb-5eb1-4a35-912d-f323d8496549 HTTP/1.1" status: 200 len: 767 time: 1.2966576 Nov 05 14:44:48.877288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38922) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:48.957931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.962429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:48.980852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] 10.222.0.30 "DELETE /v2.0/networks/2f53417e-d426-4ec0-bf7b-34f4abd5fc13 HTTP/1.1" status: 204 len: 168 time: 1.7984440 Nov 05 14:44:49.154307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:49.195334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa67e34-282b-4a27-a41a-aaf0dc94462e tempest-PortsAdminExtendedAttrsTestJSON-1508302941 tempest-PortsAdminExtendedAttrsTestJSON-1508302941-project] Pushing event deleted for resources: {'Network': ['ID=2f53417e-d426-4ec0-bf7b-34f4abd5fc13,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:49.252908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:49.273164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:49.275819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event updated for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:49.300722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.316635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.325653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Allocated IP 172.20.0.1 (a86c0d03-9a76-4e86-b54e-4effb464c4ed/ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03/6d7fd082-67a1-4d2a-8722-f2123e5d2acc) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:49.371598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bcffe010-15d0-4080-b8eb-0b2809b3cd7e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:49.448897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.462154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1283771-1c4e-4981-860e-5a8526d79028 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:44:49.472881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ee6ad969-cc4e-41cb-9726-441abfaf88f6']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:49.499374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '98881bef-c78c-4b77-9142-3ec5c56aa794') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:49.499811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '98881bef-c78c-4b77-9142-3ec5c56aa794') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:49.506805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:49.507630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.532366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.20.0.10 (6433e70e-3942-4d29-8fe3-33efce7027d9/4cd64ba4-2d2e-45d6-9348-34e5d3273d39/04856af5-4a5e-432c-b6ef-a2ac615f8c54) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:49.536510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.558724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d872efbf-22fe-4821-9361-b9e933de573f req-30158792-54b2-4c8e-8eee-daacd9e7f88d tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:49.561384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d872efbf-22fe-4821-9361-b9e933de573f req-30158792-54b2-4c8e-8eee-daacd9e7f88d tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 932 time: 0.2075644 Nov 05 14:44:49.568740 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-f8380006-16cc-4d60-99a9-5baf0b0fb97f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.5851352 Nov 05 14:44:49.575581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.644269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:49.644626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:49.646380 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:49.665844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bcffe010-15d0-4080-b8eb-0b2809b3cd7e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:49.667065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.698461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38938) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:49.815652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d872efbf-22fe-4821-9361-b9e933de573f req-aaeacffa-a2cc-4c18-a0c0-49a5f4624c48 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2457521 Nov 05 14:44:49.926020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:49.973191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6cf564a-a6bd-41b0-acf7-b958291e7718 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=cccec644420b4b0e8375c5fdb80b0cf6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2771709 Nov 05 14:44:49.975538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38942) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:50.012861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb720a93-019d-4b2e-9a2b-a7db58701a5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.037063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.073651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.087275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6433e70e-3942-4d29-8fe3-33efce7027d9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:50.095205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e23277d-263b-4132-bc08-8a61707c45dd req-d964b2c1-a235-4587-89d3-7762a3665ac5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.4540315 Nov 05 14:44:50.108124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:50.116602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:50.127161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.185469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.202247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.208654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=04856af5-4a5e-432c-b6ef-a2ac615f8c54,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:50.223782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network ee6ad969-cc4e-41cb-9726-441abfaf88f6 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:44:50.321847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.465416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.471686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.485309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/ee6ad969-cc4e-41cb-9726-441abfaf88f6 HTTP/1.1" status: 204 len: 168 time: 1.6050451 Nov 05 14:44:50.488701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.490236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3da11b90-b129-44c2-a082-4ad868fc6942 HTTP/1.1" status: 204 len: 168 time: 0.5135365 Nov 05 14:44:50.490709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'Port': ['ID=c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:50.492971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38944) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:50.550432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.552793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.624266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'name': 'tempest-network--1422914638'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:50.690251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de11ef0d-e7d0-496b-9f33-58cf7aed7891 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3da11b90-b129-44c2-a082-4ad868fc6942,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:50.877826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:50.894347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-211a3227-cc40-402f-a1eb-96ee63658005 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:44:50.896982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-211a3227-cc40-402f-a1eb-96ee63658005 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0250044 Nov 05 14:44:50.897822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:50.901685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=6d7fd082-67a1-4d2a-8722-f2123e5d2acc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:50.909760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Made reservation on behalf of 1bc8661f439647f682188b4b3b58f5d5 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:50.919249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:50.966967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:50.984240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:50.987621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48938f99-0131-4301-a1bf-4f090ce8a787 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Network': ['ID=ee6ad969-cc4e-41cb-9726-441abfaf88f6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:50.999515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:51.038883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:51.079202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.081193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 631} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:51.097463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e899573b-0c2b-417e-b78c-2d58617c1579 None None] Provisioning complete for port bcffe010-15d0-4080-b8eb-0b2809b3cd7e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:51.097981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e899573b-0c2b-417e-b78c-2d58617c1579 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.211489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.310672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.311276 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Added segment f0d74ffd-cd6e-4d3d-939c-203d629528c8 of type vlan for network 414bf769-cc57-4eba-9a22-953968bd8eca Nov 05 14:44:51.330584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38956) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:51.576334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0b219e4d-e716-449d-bad4-86716a465ae8 None None] Provisioning complete for port 0d187a67-1569-490c-ba6b-54e4b6d47353 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:51.576736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0b219e4d-e716-449d-bad4-86716a465ae8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.668053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0b219e4d-e716-449d-bad4-86716a465ae8 None None] Port 0d187a67-1569-490c-ba6b-54e4b6d47353 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:51.689625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.691813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.701742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.709293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Request body: {'port': {'device_id': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:51.720411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb72f1d-33e2-4480-9fad-2d293ae4c77d req-fd2b62da-6e71-4a41-a6df-01e0a8a1a060 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:51.726021 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7cb72f1d-33e2-4480-9fad-2d293ae4c77d req-fd2b62da-6e71-4a41-a6df-01e0a8a1a060 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 932 time: 0.6979015 Nov 05 14:44:51.796867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8350c881-c225-470e-bc3f-4016e8dc77f6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c00271e60e414c15bfdd60b4d8f95840&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4600408 Nov 05 14:44:51.798690 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfd8c2dd-d13f-454b-83e8-9c546b01b7a1 req-91dbbd42-e857-4e8d-9bf4-066eab3d7e75 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.3259380 Nov 05 14:44:51.798851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38960) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:51.833727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.834687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Fanout notify agent at l3_agent the message router_deleted on router e5494b8c-df3c-4b52-814c-644ecab367b4 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:44:51.861909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fa003a07-665b-4ffe-9532-332855267380 None None] Provisioning complete for port 6d7fd082-67a1-4d2a-8722-f2123e5d2acc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:51.862262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fa003a07-665b-4ffe-9532-332855267380 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.932402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.resource_extend [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:44:51.934343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:51.955520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fa003a07-665b-4ffe-9532-332855267380 None None] Port 6d7fd082-67a1-4d2a-8722-f2123e5d2acc cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:51.992293 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:44:51.996290 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9a8b4a48-1960-4491-8e1d-82c7631867c5 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 8.8400114 Nov 05 14:44:52.000079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 38962) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:52.029198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.030221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:52.030806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.096913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.120660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=414bf769-cc57-4eba-9a22-953968bd8eca,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:52.127640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.135607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 414bf769-cc57-4eba-9a22-953968bd8eca details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:52.177544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.234335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7cb72f1d-33e2-4480-9fad-2d293ae4c77d req-35a8222b-1f7f-4030-8884-f4741815ee19 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3728023 Nov 05 14:44:52.251969 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d908a4c9-0008-4977-8f94-9feb5eda8db9 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 1.6328671 Nov 05 14:44:52.293026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38964) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:52.303048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Request body: {'network': {'router:external': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:52.307129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.390748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6386fb95-7223-4831-ab51-ed04991b66e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.639086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.717350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.734720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Deleting port abeb67c3-e214-4e77-9f05-4de863dfd254 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:52.735107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.736903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:52.913373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.142673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2012d1b-a6f3-4653-9495-3105b759af2d req-9b645359-c7f6-4765-816c-23baa538dde5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.1073399 Nov 05 14:44:53.174401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.177742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.179166 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/52581cf1-30b1-490a-a97f-9d592c41bd72 HTTP/1.1" status: 204 len: 168 time: 1.3498683 Nov 05 14:44:53.191637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'Port': ['ID=c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:53.250240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8657f38e-45fb-4e33-b5e6-6e7a193ef3d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52581cf1-30b1-490a-a97f-9d592c41bd72,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:53.284062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.300998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.335872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.347114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Calling delete_port for abeb67c3-e214-4e77-9f05-4de863dfd254 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:53.360255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.375521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.398163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.407439 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3a56402-162d-449b-ab9c-f69701d7ef68 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 9.1436384 Nov 05 14:44:53.467822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.485500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Network 414bf769-cc57-4eba-9a22-953968bd8eca is not hosted by any dhcp agent {{(pid=113580) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 05 14:44:53.487117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:53.488042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.488889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.492249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "PUT /v2.0/networks/414bf769-cc57-4eba-9a22-953968bd8eca HTTP/1.1" status: 200 len: 858 time: 1.1940172 Nov 05 14:44:53.502861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 38974) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:53.587061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.613250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.623847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a40a6045-a74e-41a3-a99b-8fcb1971e02c tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event updated for resources: {'Network': ['ID=414bf769-cc57-4eba-9a22-953968bd8eca,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:53.628388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=6d7fd082-67a1-4d2a-8722-f2123e5d2acc,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:53.711335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ed4f73-fd0b-41c3-9cd5-87160404bc4b req-974536ee-3ae4-4e0c-882e-5a5308855c48 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:53.717372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f0ed4f73-fd0b-41c3-9cd5-87160404bc4b req-974536ee-3ae4-4e0c-882e-5a5308855c48 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 932 time: 0.3363743 Nov 05 14:44:53.831716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:53.832334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:53.846075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.853880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d187a67-1569-490c-ba6b-54e4b6d47353 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:44:53.887055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:53.942784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Transition to ACTIVE for port object 0d187a67-1569-490c-ba6b-54e4b6d47353 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:44:53.948787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:44:54.053653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Pushing event deleted for resources: {'Port': ['ID=abeb67c3-e214-4e77-9f05-4de863dfd254,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:54.153663 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-885f2c28-c2b3-4a05-a049-4a5e51e1ae03 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1497955808&fields=id&tenant_id=3cb2c9da66364ac18972da6a46b083c1 HTTP/1.1" status: 200 len: 267 time: 0.3354053 Nov 05 14:44:54.232813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:54.234487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.243347 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Sync routers for ids ['7e64b203-e2ff-45d8-add0-d2bd1211ddd4'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:54.270135 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Routers {'7e64b203-e2ff-45d8-add0-d2bd1211ddd4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:54.272657 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7e64b203-e2ff-45d8-add0-d2bd1211ddd4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:54.313313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5f56b8e3-4089-442d-9659-25c7082859a0 None None] Provisioning complete for port 6d7fd082-67a1-4d2a-8722-f2123e5d2acc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:54.313975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f56b8e3-4089-442d-9659-25c7082859a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.370259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5f56b8e3-4089-442d-9659-25c7082859a0 None None] Port 6d7fd082-67a1-4d2a-8722-f2123e5d2acc cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:54.393217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.394646 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fcb17d34-eda1-488d-bafe-02c43484c640 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 876 time: 8.3875535 Nov 05 14:44:54.408581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39004) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:54.411142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Pushing event updated for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:54.431074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.441418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-81678633-9d04-472b-a2b6-fc77d9b46171 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:54.447729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-81678633-9d04-472b-a2b6-fc77d9b46171 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/networks?id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542 HTTP/1.1" status: 200 len: 806 time: 0.2700968 Nov 05 14:44:54.480165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.502673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e72ddbce-9497-42d7-848c-a5c7605e7378 tempest-RoutersAdminNegativeIpV6Test-482005196 tempest-RoutersAdminNegativeIpV6Test-482005196-project-admin] 10.222.0.30 "DELETE /v2.0/ports/abeb67c3-e214-4e77-9f05-4de863dfd254 HTTP/1.1" status: 204 len: 168 time: 2.4894800 Nov 05 14:44:54.518009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-bd8459d9-d23c-482d-84c4-ef8a71eef6de tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/quotas/3cb2c9da66364ac18972da6a46b083c1 HTTP/1.1" status: 200 len: 375 time: 0.0603914 Nov 05 14:44:54.546992 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f0ed4f73-fd0b-41c3-9cd5-87160404bc4b req-49c155a3-0480-4e14-a878-8f05e0bb35a7 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.8159177 Nov 05 14:44:54.657157 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Set router 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:54.661120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Router a6f2a818-73c2-40a8-8783-f26e2159585c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:44:54.693775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['414bf769-cc57-4eba-9a22-953968bd8eca']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:54.751988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-9ce8d2e0-d99f-4b11-94d3-d739646ab9d7 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=3cb2c9da66364ac18972da6a46b083c1&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2035098 Nov 05 14:44:54.759215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:54.826264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:54.858104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f0d74ffd-cd6e-4d3d-939c-203d629528c8') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:54.858369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f0d74ffd-cd6e-4d3d-939c-203d629528c8') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.021083 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84fed05b-0a90-4faa-809d-6fb4b1e818f3 req-6ea5a99a-5eb9-414d-b456-562fb4858dba tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.2575068 Nov 05 14:44:55.025330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:44:55.034996 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b2c20763-7c3a-4209-bb88-5b2eb0955120 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "PUT /v2.0/routers/a6f2a818-73c2-40a8-8783-f26e2159585c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.7582154 Nov 05 14:44:55.037779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39016) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:55.046961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'port': {'network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed', 'name': 'tempest-FloatingIPNegativeTestJSON-412739459'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:55.048927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] Sync routers for ids ['a6f2a818-73c2-40a8-8783-f26e2159585c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:44:55.070778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] Routers {'a6f2a818-73c2-40a8-8783-f26e2159585c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:55.071496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a6f2a818-73c2-40a8-8783-f26e2159585c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.113561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-b88d307b-d26a-4e03-860d-aa0b4d27571c service neutron] 10.222.0.30 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2644377 Nov 05 14:44:55.115419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.117143 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'name': '', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'external_fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10'}], 'enable_snat': True}, 'gw_port_id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:46Z', 'updated_at': '2021-11-05T14:44:50Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'name': '', 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:47:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 198, 'fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:48Z', 'updated_at': '2021-11-05T14:44:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.159991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.166508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39020) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:55.167737 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Checking router: 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:44:55.168127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Updating router 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:44:55.189580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.201648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] Routers {'a6f2a818-73c2-40a8-8783-f26e2159585c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:55.202368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a6f2a818-73c2-40a8-8783-f26e2159585c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.248302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:55.249090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969de1e5-813a-44cc-8fc4-dd780f2f5515 None None] The sync data for ids ['a6f2a818-73c2-40a8-8783-f26e2159585c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:55.259214 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.310459 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-bfbc98f3-f7c9-4718-9140-875d3bb4c109 service neutron] 10.222.0.30 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1851823 Nov 05 14:44:55.373505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.388685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Made reservation on behalf of 6153fb48842c46b2b0fdaee6d13f5997 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:55.395424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Releasing vlan 631 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:55.395897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.397732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.446602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] device_id is not set on port 2ef56fb1-9990-483f-92a5-78def8776815 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:55.513087 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:55.557681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1140599738'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:55.567654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.576097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 414bf769-cc57-4eba-9a22-953968bd8eca {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:44:55.581979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.602110 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] 10.222.0.30 "DELETE /v2.0/networks/414bf769-cc57-4eba-9a22-953968bd8eca HTTP/1.1" status: 204 len: 168 time: 2.0923610 Nov 05 14:44:55.604132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Attempting to bind port 0d187a67-1569-490c-ba6b-54e4b6d47353 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:55.607125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Attempting to bind port 0d187a67-1569-490c-ba6b-54e4b6d47353 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:55.607527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Attempting to bind port 0d187a67-1569-490c-ba6b-54e4b6d47353 on network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:55.615327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39034) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:55.682833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.32', 61032) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:55.710897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19dbc0ba-664b-40d9-a19c-fcccbdd941af admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.729746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431261d2-e723-4061-848d-29491081c4e6 tempest-ExternalNetworksTestJSON-187654919 tempest-ExternalNetworksTestJSON-187654919-project-admin] Pushing event deleted for resources: {'Network': ['ID=414bf769-cc57-4eba-9a22-953968bd8eca,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:55.732029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Port 0d187a67-1569-490c-ba6b-54e4b6d47353 on network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:44:55.732360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Attempting to bind port 0d187a67-1569-490c-ba6b-54e4b6d47353 on network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:55.761061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:55.761588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Checking segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:55.762715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Bound using segment: {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:55.763230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Bound port: 0d187a67-1569-490c-ba6b-54e4b6d47353, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c509f189-e51f-483b-b35f-b9ea2b45ee7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:55.763645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.766254 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-cea3cf12-efb7-48f8-a295-494a3cbfa0c2 tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] DELETE failed (client error): The resource could not be found. Nov 05 14:44:55.766689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cea3cf12-efb7-48f8-a295-494a3cbfa0c2 tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:44:55.773030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cea3cf12-efb7-48f8-a295-494a3cbfa0c2 tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "DELETE /v2.0/subnets/ab68a5fd-d421-4f3a-bbcb-c915c2142d36 HTTP/1.1" status: 404 len: 337 time: 0.1504147 Nov 05 14:44:55.799577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39036) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:55.822088 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.832392 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.880387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.950863 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34db4af1-0c92-4c9c-87eb-812cb0f861fe None None] Pushing event updated for resources: {'Port': ['ID=04856af5-4a5e-432c-b6ef-a2ac615f8c54,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:55.982500 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Attempting to bind port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:44:55.983233 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Attempting to bind port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:44:55.983934 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Attempting to bind port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 on network 6433e70e-3942-4d29-8fe3-33efce7027d9 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:44:55.991348 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:44:55.992398 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Checking segment: {'id': '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:44:55.993056 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:55.993820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Bound using segment: {'id': '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:44:55.994467 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Bound port: 04856af5-4a5e-432c-b6ef-a2ac615f8c54, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:44:55.995609 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.083630 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] For port 04856af5-4a5e-432c-b6ef-a2ac615f8c54, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:56.091314 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] For port 04856af5-4a5e-432c-b6ef-a2ac615f8c54, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=04856af5-4a5e-432c-b6ef-a2ac615f8c54,segment=NetworkSegment(32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9),segment_id=32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:56.101630 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.112362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19dbc0ba-664b-40d9-a19c-fcccbdd941af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.159438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-e6a06465-1ebe-4bb6-876e-b80167e0f258 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:56.161519 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-e6a06465-1ebe-4bb6-876e-b80167e0f258 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 811 time: 0.4086339 Nov 05 14:44:56.176361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Allocated IP 172.20.0.13 (a86c0d03-9a76-4e86-b54e-4effb464c4ed/ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03/2ef56fb1-9990-483f-92a5-78def8776815) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:56.194871 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-272475e2-e24f-4ae7-b33f-d3860cc4fb8f req-26c6c1ea-13ff-4d96-8c91-7ca7a9f5fbf2 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 210 time: 0.4670599 Nov 05 14:44:56.216597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:56.224748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.226767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19dbc0ba-664b-40d9-a19c-fcccbdd941af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.254961 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34db4af1-0c92-4c9c-87eb-812cb0f861fe None None] Pushing event updated for resources: {'Port': ['ID=04856af5-4a5e-432c-b6ef-a2ac615f8c54,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:56.315890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Routers {'7e64b203-e2ff-45d8-add0-d2bd1211ddd4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:44:56.318688 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7e64b203-e2ff-45d8-add0-d2bd1211ddd4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:56.394892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.453647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.473905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.503584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:56.513548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:56.549416 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ec3235c-3afb-41bb-bcd8-de00f15dccb0 req-ea52e20b-acd0-4615-ab2b-8e8f819de810 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.1109891 Nov 05 14:44:56.554590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:56.637315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:56.638022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.638491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.641736 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] Set router 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:44:56.697753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-19dbc0ba-664b-40d9-a19c-fcccbdd941af admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6e96a022d08f4669aa7f49262933c3f6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3803744 Nov 05 14:44:56.699941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce302f5a-399b-4d34-bcd0-2ff47953df73 req-d1263ede-5859-4ddd-a883-6982f110fd9e tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:56.702132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39050) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:56.709745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce302f5a-399b-4d34-bcd0-2ff47953df73 req-d1263ede-5859-4ddd-a883-6982f110fd9e tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 944 time: 0.9038935 Nov 05 14:44:56.729511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.743971 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.7046921 Nov 05 14:44:56.749267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39052) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:56.777418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:56.814709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19dbc0ba-664b-40d9-a19c-fcccbdd941af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=207b3992-f7a6-47a3-bb11-23faeb68514a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:56.853840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:44:56.866885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0d187a67-1569-490c-ba6b-54e4b6d47353,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:44:56.930804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd629a9-ea52-49c8-9520-40a36e4ae305 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=2ef56fb1-9990-483f-92a5-78def8776815,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:56.965275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:56.978467 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-2918e3e7-88c2-49de-8c65-12710928e356 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=643f5fc30ebb419c9fb85748c2767795 HTTP/1.1" status: 200 len: 380 time: 0.5381136 Nov 05 14:44:56.982742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-774d1e3e-e125-428c-8098-6e8c275e4854 None None] Provisioning complete for port 2ef56fb1-9990-483f-92a5-78def8776815 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:44:56.987036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-774d1e3e-e125-428c-8098-6e8c275e4854 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.027205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce302f5a-399b-4d34-bcd0-2ff47953df73 req-e1659134-152b-48c2-818d-c2127fad7d82 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3163793 Nov 05 14:44:57.028796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.065656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Pushing event updated for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:57.105539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-774d1e3e-e125-428c-8098-6e8c275e4854 None None] Port 2ef56fb1-9990-483f-92a5-78def8776815 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:44:57.109249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Deleting port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:44:57.109249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.227618 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'name': '', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'external_fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10'}], 'enable_snat': True}, 'gw_port_id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:46Z', 'updated_at': '2021-11-05T14:44:50Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'name': '', 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:47:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 198, 'fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:48Z', 'updated_at': '2021-11-05T14:44:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:57.314504 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521b475c-5248-45ee-bc06-446ce3dc459c None None] The sync data for ids ['7e64b203-e2ff-45d8-add0-d2bd1211ddd4'] in dv-neutron-816850-1-hyperv is: [{'id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'name': '', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'external_fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10'}], 'enable_snat': True}, 'gw_port_id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:46Z', 'updated_at': '2021-11-05T14:44:50Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': '04856af5-4a5e-432c-b6ef-a2ac615f8c54', 'name': '', 'network_id': '6433e70e-3942-4d29-8fe3-33efce7027d9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:47:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e64b203-e2ff-45d8-add0-d2bd1211ddd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 198, 'fixed_ips': [{'subnet_id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'ip_address': '172.20.0.10', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:48Z', 'updated_at': '2021-11-05T14:44:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4cd64ba4-2d2e-45d6-9348-34e5d3273d39', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:44:57.402329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.434381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0ea324eb-5eb1-4a35-912d-f323d8496549']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:57.447095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e00069e-a01a-4b40-8d33-28919507761e') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:57.447392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e00069e-a01a-4b40-8d33-28919507761e') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:44:57.451248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:57.451862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.453512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-0cb6270e-f4f8-459d-aebe-2d99ac5b58e5 service neutron] 10.222.0.32 "PUT /v2.0/ports/0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 200 len: 1094 time: 6.0612612 Nov 05 14:44:57.453967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:44:57.461760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.486962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.499113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:44:57.499505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:44:57.502682 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:44:57.519037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.525023 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-326e4140-6d63-4292-b55d-a52f753f1bc2 req-f56fbd98-216f-4079-ae62-44e2aceea1df tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 210 time: 0.0810308 Nov 05 14:44:57.581178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.586612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.594094 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] 10.222.0.30 "DELETE /v2.0/networks/0ea324eb-5eb1-4a35-912d-f323d8496549 HTTP/1.1" status: 204 len: 168 time: 1.7811682 Nov 05 14:44:57.599628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.617822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d7e59c-0d01-458e-96e2-c07f53c41faa tempest-ExternalNetworksTestJSON-445927489 tempest-ExternalNetworksTestJSON-445927489-project] Pushing event deleted for resources: {'Network': ['ID=0ea324eb-5eb1-4a35-912d-f323d8496549,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:57.623920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.656893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.669000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55d02395-4772-4176-a525-aa1914fae7ad" -d '{"events": [{"name": "network-changed", "server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:44:57.702625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.705883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'port': {'device_id': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'admin_state_up': True, 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'security_groups': ['40e045d3-0c39-49ee-9afb-128e4a54e42c']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:57.821495 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e49100e-90d4-4a8b-b35e-02ca0b0448f3 req-9ad91c0b-dbe1-476d-bb14-00002b621a8d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.1250534 Nov 05 14:44:57.881273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 642} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:44:57.925424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Allocated IP 172.26.5.118 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/77ee9a84-bd95-4a9b-bfb1-847ead0deaeb) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:57.939752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] For port 04856af5-4a5e-432c-b6ef-a2ac615f8c54, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=04856af5-4a5e-432c-b6ef-a2ac615f8c54,segment=NetworkSegment(32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9),segment_id=32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:44:57.940374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.956249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8da17502-58a5-4737-8b7d-364f94e8de51,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:57.981976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:44:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-475e5c0d-6787-4621-b587-53d25fd8b29d x-openstack-request-id: req-475e5c0d-6787-4621-b587-53d25fd8b29d {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:44:57.982316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:44:57.982575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-475e5c0d-6787-4621-b587-53d25fd8b29d {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:44:57.983089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'status': 'completed', 'code': 200} Nov 05 14:44:57.997807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:57.998159 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment bf857bc1-edb8-455a-857c-22c038fef552 of type vlan for network 1bee866a-e915-49da-a1b2-52ca5394910c Nov 05 14:44:58.001423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Calling delete_port for 04856af5-4a5e-432c-b6ef-a2ac615f8c54 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:44:58.024328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-67ec4b79-472d-4828-a129-e7eed65ea7d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.026092 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-67ec4b79-472d-4828-a129-e7eed65ea7d7 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 1097 time: 0.3118343 Nov 05 14:44:58.107204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39076) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:58.108186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Made reservation on behalf of 643f5fc30ebb419c9fb85748c2767795 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:44:58.112617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.140296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.145156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-b20305fe-712f-4723-a926-8b5028614f50 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 200 len: 217 time: 0.0862055 Nov 05 14:44:58.172512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.197393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.202542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.207306 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/207b3992-f7a6-47a3-bb11-23faeb68514a HTTP/1.1" status: 204 len: 168 time: 1.4881134 Nov 05 14:44:58.264961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e163f8b8-3dbd-4022-9122-6cfccb49cc53 req-c233e99d-9ad5-49c1-8999-f5f44adfb784 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.266533 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e163f8b8-3dbd-4022-9122-6cfccb49cc53 req-c233e99d-9ad5-49c1-8999-f5f44adfb784 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 944 time: 0.1626325 Nov 05 14:44:58.296235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efed418f-95fe-4b65-960a-45e3423675c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=207b3992-f7a6-47a3-bb11-23faeb68514a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:58.368411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.374946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.375883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.390770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-5617747b-aa2d-473c-8b08-53b014dd33b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.392722 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-5617747b-aa2d-473c-8b08-53b014dd33b3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=40981c52-1a1c-434c-b98f-d3a05d50d8a6 HTTP/1.1" status: 200 len: 851 time: 0.1965871 Nov 05 14:44:58.413106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.32', 61036) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:58.420752 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b33f7275-2aff-4c05-8b62-c9855b0762f5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2d89a23b14c44ebcb4e3bbe7874e9e11&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3036759 Nov 05 14:44:58.423317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.430577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39082) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:58.580448 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e163f8b8-3dbd-4022-9122-6cfccb49cc53 req-6435c2d7-05b4-4a46-9bf2-f85898c4ddcc tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3067462 Nov 05 14:44:58.593290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:44:58.615503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Allocated IP 172.20.0.14 (fc36919c-2228-49a8-98f4-75664fee44eb/c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9/13d06243-5eeb-4ace-b456-59f332abe92e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:44:58.622107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:44:58.625244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:44:58.668826 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 3.8816419 Nov 05 14:44:58.668826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c783819e-1f0d-4e32-ab77-d03612112c0d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=1bee866a-e915-49da-a1b2-52ca5394910c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:58.677524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.695658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1bee866a-e915-49da-a1b2-52ca5394910c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:44:58.708478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.754703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7ed07fe-0c99-4d86-a912-4309b62302f7 req-23aa3441-1d3f-49ce-9b39-16cf8619ab3a tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 210 time: 0.1234145 Nov 05 14:44:58.782470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=77ee9a84-bd95-4a9b-bfb1-847ead0deaeb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:58.802733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.805710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:58.807008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8e82cf6e-3c09-4013-8608-f43ac40f9504 HTTP/1.1" status: 204 len: 168 time: 0.3637683 Nov 05 14:44:58.823103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-9e24261a-882c-4b40-9d66-7919073728b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.829787 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-9e24261a-882c-4b40-9d66-7919073728b2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3236754 Nov 05 14:44:58.858554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7c4a15-f8aa-4989-b538-5fbcd3596307 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e82cf6e-3c09-4013-8608-f43ac40f9504,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:58.920187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-ae47a49d-81e6-4df2-9a3e-8b5b89deac8d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:58.921837 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-ae47a49d-81e6-4df2-9a3e-8b5b89deac8d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.32 "GET /v2.0/networks?id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542 HTTP/1.1" status: 200 len: 806 time: 0.4999478 Nov 05 14:44:59.038270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39096) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.056899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d8d96fce-0d3e-4afe-8ede-afe8403d06ab req-9e787c29-4fca-42de-96dc-92575c532501 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.0438802 Nov 05 14:44:59.070175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.074795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.169774 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c677ac3c-8e7d-4a1d-938e-2f6fc630959e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ba93a2f5334e4d4f9e682494e3b32a23&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1283493 Nov 05 14:44:59.171469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39100) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.180523 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-aced283e-3362-4417-944e-d76c588d432f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3cb2c9da66364ac18972da6a46b083c1 HTTP/1.1" status: 200 len: 380 time: 0.2127240 Nov 05 14:44:59.191667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Port': ['ID=04856af5-4a5e-432c-b6ef-a2ac615f8c54,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:59.192157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'port': {'device_id': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'admin_state_up': True, 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'security_groups': ['1245440e-5dfc-42f9-a460-fe077039d6bf']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:59.207170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-5ffc4ca5-4f50-4871-9768-ea41ee3c026a service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3687031 Nov 05 14:44:59.216388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.320605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 04856af5-4a5e-432c-b6ef-a2ac615f8c54 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:44:59.322970 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eab9a8db-401e-4bf1-a627-b5af134c2616 req-a91dcb6f-7778-4d8c-b7ab-d952f2aced8b service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872633 Nov 05 14:44:59.357969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 04856af5-4a5e-432c-b6ef-a2ac615f8c54 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:44:59.360927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 04856af5-4a5e-432c-b6ef-a2ac615f8c54 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 05 14:44:59.399982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Port 04856af5-4a5e-432c-b6ef-a2ac615f8c54 not found, will not notify nova. {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 05 14:44:59.427133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.489459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.489739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.550670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.552310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=77ee9a84-bd95-4a9b-bfb1-847ead0deaeb,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:59.560250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39102) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.607288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.609917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.618625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.644608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.676978 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-05eff3b4-b895-42a2-9bf5-e0767891b5f5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1bc8661f439647f682188b4b3b58f5d5&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1077864 Nov 05 14:44:59.685159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39106) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.754007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.756362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.762004 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e5c436bf-0037-44cc-9db6-e6b10148636f HTTP/1.1" status: 204 len: 168 time: 0.5822029 Nov 05 14:44:59.763380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d02395-4772-4176-a525-aa1914fae7ad req-ed035a6c-76f6-4429-966b-a91464183b6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:44:59.765058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-ed035a6c-76f6-4429-966b-a91464183b6a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 1097 time: 0.3524320 Nov 05 14:44:59.767796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.797498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.798764 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-78131196-81f3-44b1-8873-347a24ee66ab tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.0254457 Nov 05 14:44:59.803999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.817020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39112) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.830022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-54e41545-814f-43df-bc15-24172221d895 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'floatingip': {'port_id': '2ef56fb1-9990-483f-92a5-78def8776815', 'fixed_ip_address': '172.20.0.13'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:44:59.856638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.860427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 7e64b203-e2ff-45d8-add0-d2bd1211ddd4 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:44:59.862283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005ac713-f8ae-404e-8c7b-978e8ab3e01c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5c436bf-0037-44cc-9db6-e6b10148636f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:44:59.931826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.933001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-36eb3b57-69f7-46ac-a62f-9f15beb622b3 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/routers/7e64b203-e2ff-45d8-add0-d2bd1211ddd4 HTTP/1.1" status: 204 len: 168 time: 5.5182517 Nov 05 14:44:59.937755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39114) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:44:59.951468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54e41545-814f-43df-bc15-24172221d895 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:44:59.996517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Deleting subnet 4cd64ba4-2d2e-45d6-9348-34e5d3273d39 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:00.006314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.113258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e23a21-df04-4212-b844-e2ab8738b0bb req-ffee0635-d90d-4fbf-8e13-45bff3e38196 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:00.114948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25e23a21-df04-4212-b844-e2ab8738b0bb req-ffee0635-d90d-4fbf-8e13-45bff3e38196 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 944 time: 0.3633535 Nov 05 14:45:00.117224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.132229 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-54e41545-814f-43df-bc15-24172221d895 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] update failed (client error): The resource could not be found. Nov 05 14:45:00.133334 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54e41545-814f-43df-bc15-24172221d895 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "PUT /v2.0/floatingips/c0440d09-fafa-4ea3-9eb2-41adbdb2819a HTTP/1.1" status: 404 len: 507 time: 0.3073828 Nov 05 14:45:00.134271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.160344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:00.160839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.441197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Network fc36919c-2228-49a8-98f4-75664fee44eb is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:00.450892 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf3a7b1e-9799-4e9e-8df7-da9785f07179 req-3ec520f9-30b7-4672-bd91-c4eca800b6e6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 210 time: 0.5146060 Nov 05 14:45:00.456187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:00.459037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:00.531836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:00.532601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.535185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.537872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.539091 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/36ca0be1-2739-40ee-86d4-4f45ea91af97 HTTP/1.1" status: 204 len: 168 time: 0.8508365 Nov 05 14:45:00.570000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Made reservation on behalf of 3cb2c9da66364ac18972da6a46b083c1 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:00.578811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:00.740870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeeb97f-d638-43be-b890-5709331ac99b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36ca0be1-2739-40ee-86d4-4f45ea91af97,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:00.749903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d02395-4772-4176-a525-aa1914fae7ad req-4720469d-5f6e-416a-a805-3176ef30ee19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:00.750687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event updated for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:00.751632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-4720469d-5f6e-416a-a805-3176ef30ee19 service neutron] 10.222.0.32 "GET /v2.0/networks?id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 200 len: 913 time: 0.9772732 Nov 05 14:45:00.891400 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-222a3f49-bef1-4455-8e47-9b830b16a965 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 200 len: 217 time: 0.1145203 Nov 05 14:45:00.957652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.017643 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-a0ede082-bfc7-4dda-af0f-e1c50251817d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3195188 Nov 05 14:45:01.025467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ef225a81-e3f2-401d-bda5-7f81bc38600f None None] Provisioning complete for port 13d06243-5eeb-4ace-b456-59f332abe92e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:01.031410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef225a81-e3f2-401d-bda5-7f81bc38600f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.063959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25e23a21-df04-4212-b844-e2ab8738b0bb req-f7a3caca-2838-4c47-bc60-f882bcd0dfa9 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.9025342 Nov 05 14:45:01.082773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Request body: {'port': {'device_id': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:01.141531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.144333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Allocated IP 172.20.0.13 (fd1ccb7c-d1e8-48e2-b784-b56a587e2542/84c193ea-9294-4fe7-b33c-753ea27f07be/2d0d74d9-94d0-42c7-be73-ebcc957f107f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:01.145323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ef225a81-e3f2-401d-bda5-7f81bc38600f None None] Port 13d06243-5eeb-4ace-b456-59f332abe92e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:01.175972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 04856af5-4a5e-432c-b6ef-a2ac615f8c54 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:01.205201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.209424 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/subnets/4cd64ba4-2d2e-45d6-9348-34e5d3273d39 HTTP/1.1" status: 204 len: 168 time: 1.2700913 Nov 05 14:45:01.212960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ea509b-caca-42f7-b053-03e5843f2f93 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=4cd64ba4-2d2e-45d6-9348-34e5d3273d39,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:01.216182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:01.225400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 04856af5-4a5e-432c-b6ef-a2ac615f8c54 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:01.225756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 04856af5-4a5e-432c-b6ef-a2ac615f8c54 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:01.255373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d02395-4772-4176-a525-aa1914fae7ad req-70b3b49e-39e3-498a-9827-b9bcf85025cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:01.257521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-70b3b49e-39e3-498a-9827-b9bcf85025cd service neutron] 10.222.0.32 "GET /v2.0/subnets?id=40981c52-1a1c-434c-b98f-d3a05d50d8a6 HTTP/1.1" status: 200 len: 851 time: 0.1889021 Nov 05 14:45:01.381045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting port 77ee9a84-bd95-4a9b-bfb1-847ead0deaeb {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:01.381463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.384997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.386469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.443161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.469902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396e7654-7d28-4c2a-a05b-d6e6f76fb068 req-9ab50b8f-3a35-4482-a94a-f072c4598bad tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:01.472492 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-396e7654-7d28-4c2a-a05b-d6e6f76fb068 req-9ab50b8f-3a35-4482-a94a-f072c4598bad tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 932 time: 0.8371549 Nov 05 14:45:01.500099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39150) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:01.529118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:01.538775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:01.554720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:01.597208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.600234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.627975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:01.628692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.633187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Calling delete_port for 77ee9a84-bd95-4a9b-bfb1-847ead0deaeb owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:01.686589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d02395-4772-4176-a525-aa1914fae7ad req-33c218dc-c766-4d4d-adfd-b383dbbe2785 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:01.691486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-33c218dc-c766-4d4d-adfd-b383dbbe2785 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4179056 Nov 05 14:45:01.742635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event updated for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:01.756430 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-396e7654-7d28-4c2a-a05b-d6e6f76fb068 req-7b382432-05e9-42f7-9281-8e20c42c1e5d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2550325 Nov 05 14:45:01.758942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:01.769384 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-ebbfd625-fd9d-4ca0-a780-954d965469a6 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.5812697 Nov 05 14:45:01.783701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Request body: {'port': {'device_id': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:01.982348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1a22d937-0b7f-4c45-afac-e9ce19104d09 None None] Provisioning complete for port 2d0d74d9-94d0-42c7-be73-ebcc957f107f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:01.983256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a22d937-0b7f-4c45-afac-e9ce19104d09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.074644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39168) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:02.078379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1a22d937-0b7f-4c45-afac-e9ce19104d09 None None] Port 2d0d74d9-94d0-42c7-be73-ebcc957f107f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:02.095134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:02.095968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-1262708894'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:02.106804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.124291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.202140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6433e70e-3942-4d29-8fe3-33efce7027d9']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:02.224824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c60fce-5e00-4b69-9094-15cfa2b4995a req-61777f38-9494-4cbb-b5ae-c4a0f254da12 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:02.226945 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a9c60fce-5e00-4b69-9094-15cfa2b4995a req-61777f38-9494-4cbb-b5ae-c4a0f254da12 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 932 time: 0.5713277 Nov 05 14:45:02.233903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-218dddf6-9316-44af-9ec0-865592e19b95 service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5035534 Nov 05 14:45:02.235583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:02.235978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '32fe78a5-efe8-4aaf-a5dd-c1167d9a33b9') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:02.266900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:02.270466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.271827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.294971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.341334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff2c4a8-f181-4af6-a4b7-14e90666c75b req-0a73de82-2a16-48c0-b238-5a9bd19ebf9d tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:02.342915 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eff2c4a8-f181-4af6-a4b7-14e90666c75b req-0a73de82-2a16-48c0-b238-5a9bd19ebf9d tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 944 time: 0.2084975 Nov 05 14:45:02.346265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.394888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Releasing vlan 646 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:02.395289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:02.403132 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:02.490303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a9c60fce-5e00-4b69-9094-15cfa2b4995a req-97816d9a-f4ee-45b2-acf3-e3a78af71767 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2336736 Nov 05 14:45:02.491106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eff2c4a8-f181-4af6-a4b7-14e90666c75b req-44eb755f-3194-45bb-bf6f-0cc4f9be0ff8 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1350954 Nov 05 14:45:02.511286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:02.516506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.526949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.603699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.608099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Port': ['ID=77ee9a84-bd95-4a9b-bfb1-847ead0deaeb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:02.627155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55d02395-4772-4176-a525-aa1914fae7ad req-550c655d-639c-43d7-a923-9616cbc3d5d7 service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3694391 Nov 05 14:45:02.632031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 6433e70e-3942-4d29-8fe3-33efce7027d9 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:45:02.634913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.638048 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/networks/6433e70e-3942-4d29-8fe3-33efce7027d9 HTTP/1.1" status: 204 len: 168 time: 1.4203303 Nov 05 14:45:02.661802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a6b6ad-c084-400b-9c5a-52c35755875f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Network': ['ID=6433e70e-3942-4d29-8fe3-33efce7027d9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:02.668128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0d187a67-1569-490c-ba6b-54e4b6d47353 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:45:02.717548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13d06243-5eeb-4ace-b456-59f332abe92e {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:45:02.769010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.777580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.780289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.781761 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7327a857-2af6-4ce3-bd44-295b55a07b6e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "DELETE /v2.0/floatingips/c0440d09-fafa-4ea3-9eb2-41adbdb2819a HTTP/1.1" status: 204 len: 168 time: 2.6084564 Nov 05 14:45:02.789806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39186) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:02.807044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c1473fe8-22d0-4603-b7bb-2c87b5f2d3b4 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'floatingip': {'floating_network_id': 'a86c0d03-9a76-4e86-b54e-4effb464c4ed', 'port_id': '2ef56fb1-9990-483f-92a5-78def8776815', 'fixed_ip_address': '172.20.0.13'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:02.909541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0d187a67-1569-490c-ba6b-54e4b6d47353,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:02.951880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'port_id': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'mac_address': 'fa:16:3e:f2:dd:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:45:02.952094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1473fe8-22d0-4603-b7bb-2c87b5f2d3b4 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.986801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:02.988612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39192) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:02.998721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2d0d74d9-94d0-42c7-be73-ebcc957f107f {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:45:03.007028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.007239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.017152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Transition to ACTIVE for port object 13d06243-5eeb-4ace-b456-59f332abe92e will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:45:03.022465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d187a67-1569-490c-ba6b-54e4b6d47353 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:45:03.046334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0d187a67-1569-490c-ba6b-54e4b6d47353,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:03.051552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.079942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.108866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.112225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Transition to ACTIVE for port object 2d0d74d9-94d0-42c7-be73-ebcc957f107f will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:45:03.133947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=5b5a7123-fc8c-4914-8963-1115ccdd52c4,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.163095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.171808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.175675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.177238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': 'bf857bc1-edb8-455a-857c-22c038fef552', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:03.177782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: 1bee866a-e915-49da-a1b2-52ca5394910c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:03.184912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 628} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:03.195389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.195745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Added segment ac4fde7b-bf77-4d29-85a8-0a85757b42f4 of type vlan for network 0d191e95-5fd7-4348-b056-51734fb90a4e Nov 05 14:45:03.225755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39200) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:03.226647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network 1bee866a-e915-49da-a1b2-52ca5394910c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:03.238800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'name': 'tempest-router--381436690', 'project_id': 'fb9151acf6b34c9b961e04993a2ea6c2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:03.263841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1bee866a-e915-49da-a1b2-52ca5394910c) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:03.273463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec2dd3b7-9abe-4291-89ab-558ae492045f None None] Network 1bee866a-e915-49da-a1b2-52ca5394910c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:03.278191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.281708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:03.282783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.329993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa769d5b-840e-432d-9548-61d02ead76d7 req-67b87696-71e5-49e9-abef-ab801794370c tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:03.331576 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fa769d5b-840e-432d-9548-61d02ead76d7 req-67b87696-71e5-49e9-abef-ab801794370c tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 932 time: 0.4407952 Nov 05 14:45:03.332403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.338214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:03.338825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.342141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.343274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.369529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2116d37c-7fb7-45a8-83f3-e7effb8730e1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2851677 Nov 05 14:45:03.374944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39202) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:03.392005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1392692432'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:03.413458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['0d187a67-1569-490c-ba6b-54e4b6d47353'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:45:03.421571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-c1473fe8-22d0-4603-b7bb-2c87b5f2d3b4 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:45:03.440557 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.9289205 Nov 05 14:45:03.442849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c1473fe8-22d0-4603-b7bb-2c87b5f2d3b4 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.6519511 Nov 05 14:45:03.469252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39204) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:03.495316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39206) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:03.499946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'subnet': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:03.539418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '2ef56fb1-9990-483f-92a5-78def8776815', 'fixed_ip_address': '172.20.0.13'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:03.549952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c9a4ca74-6e7a-41c9-acc6-994a8fad5404 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-877191235'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:03.550695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c9a4ca74-6e7a-41c9-acc6-994a8fad5404 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Unknown quota resources ['metering_label']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:03.586967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fa769d5b-840e-432d-9548-61d02ead76d7 req-9be79a70-95b0-4cd2-9930-34d750fdabe6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2108622 Nov 05 14:45:03.654898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9325291e-f338-498e-b079-3054be509995 service neutron] Pushing event updated for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.687550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'SecurityGroup': ['ID=453c09da-eea8-48bc-8d70-1f589eed6326,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ec2dd3b7-9abe-4291-89ab-558ae492045f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:03.740026 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:03.762012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b3d9723-f4bf-4095-9d89-5a5598081070 None None] Network 1bee866a-e915-49da-a1b2-52ca5394910c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:03.776817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c299e5f1-1f47-4694-a651-5a33a920f1a8 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Network': ['ID=0d191e95-5fd7-4348-b056-51734fb90a4e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.802888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0d191e95-5fd7-4348-b056-51734fb90a4e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:03.817176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Pushing event updated for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:03.836752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Attempting to bind port 13d06243-5eeb-4ace-b456-59f332abe92e on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:03.837119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Attempting to bind port 13d06243-5eeb-4ace-b456-59f332abe92e by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:03.837468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Attempting to bind port 13d06243-5eeb-4ace-b456-59f332abe92e on network fc36919c-2228-49a8-98f4-75664fee44eb {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:03.855537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b972b42-a3f6-4bd4-af65-d6f8274d3dd7 req-4272ec1f-c72c-4011-8821-2d0f8db80ee4 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:03.857178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b972b42-a3f6-4bd4-af65-d6f8274d3dd7 req-4272ec1f-c72c-4011-8821-2d0f8db80ee4 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 945 time: 0.1641588 Nov 05 14:45:03.858825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Attempting to bind port 2d0d74d9-94d0-42c7-be73-ebcc957f107f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:03.859153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Attempting to bind port 2d0d74d9-94d0-42c7-be73-ebcc957f107f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:03.859483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Attempting to bind port 2d0d74d9-94d0-42c7-be73-ebcc957f107f on network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:03.861604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Port 13d06243-5eeb-4ace-b456-59f332abe92e on network fc36919c-2228-49a8-98f4-75664fee44eb not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:45:03.861919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Attempting to bind port 13d06243-5eeb-4ace-b456-59f332abe92e on network fc36919c-2228-49a8-98f4-75664fee44eb {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:03.870746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Port 2d0d74d9-94d0-42c7-be73-ebcc957f107f on network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:45:03.871067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Attempting to bind port 2d0d74d9-94d0-42c7-be73-ebcc957f107f on network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:03.874482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:03.874829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Checking segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:03.875372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Bound using segment: {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:03.875862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Bound port: 13d06243-5eeb-4ace-b456-59f332abe92e, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b07b665e-5721-4aed-9413-b39d3361eee5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:03.877538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.903125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:03.903467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Checking segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:03.903854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Bound using segment: {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:03.904572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Bound port: 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:03.904722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5b3d9723-f4bf-4095-9d89-5a5598081070 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:03.934573 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:03.943326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-497ff049-4be8-4eed-8db7-b113f9101283 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:04.000265 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b972b42-a3f6-4bd4-af65-d6f8274d3dd7 req-3bf8108c-07c1-4b2a-8b25-2604b0e8b01e tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1314781 Nov 05 14:45:04.044732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:04.050107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.058897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-497ff049-4be8-4eed-8db7-b113f9101283 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:04.074297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:04.077941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=13d06243-5eeb-4ace-b456-59f332abe92e,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:04.078724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.082402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:04.088030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.103214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:04.103544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.106543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.140142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.242416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9a4ca74-6e7a-41c9-acc6-994a8fad5404 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.246561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c9a4ca74-6e7a-41c9-acc6-994a8fad5404 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 477 time: 1.2508693 Nov 05 14:45:04.249629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.250928 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61ceeb68-4723-48e2-b3e9-8b5c8f48a5ef tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 1.0192800 Nov 05 14:45:04.253470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39212) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:04.253997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39214) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:04.269292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9b88e9bc-51ab-4def-8db6-0e7973fc9c17 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': '79435f88-fd9c-4f36-8002-1f270eb79123'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:04.269909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9b88e9bc-51ab-4def-8db6-0e7973fc9c17 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:04.321264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:04.340431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b812f4ff-2558-408c-82e4-ee8a90d9b2ac req-5f7834f7-2630-4f0d-a18b-4dd124815c41 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:04.342042 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b812f4ff-2558-408c-82e4-ee8a90d9b2ac req-5f7834f7-2630-4f0d-a18b-4dd124815c41 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 944 time: 0.6137702 Nov 05 14:45:04.393450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:04.394066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.395440 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-9325291e-f338-498e-b079-3054be509995 service neutron] 10.222.0.32 "PUT /v2.0/ports/13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1094 time: 3.3290558 Nov 05 14:45:04.398484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:04.424368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.425183 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment 5c183f81-945f-4710-aa52-a4ce87072414 of type vlan for network 1fcf6ba3-3c19-4780-9bd4-c96004381730 Nov 05 14:45:04.425658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:04.426416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.427603 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] 10.222.0.32 "PUT /v2.0/ports/2d0d74d9-94d0-42c7-be73-ebcc957f107f HTTP/1.1" status: 200 len: 1094 time: 2.6488309 Nov 05 14:45:04.433239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9325291e-f338-498e-b079-3054be509995 service neutron] Pushing event updated for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:04.457132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1bee866a-e915-49da-a1b2-52ca5394910c', 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c', 'tenant_id': '5b43437541e445ee9cffdd31db12e7c8', 'fixed_ips': [{'subnet_id': '5b5a7123-fc8c-4914-8963-1115ccdd52c4'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:04.458243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.506210 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.services.metering.metering_plugin [None req-9b88e9bc-51ab-4def-8db6-0e7973fc9c17 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 05 14:45:04.508500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.510829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:04.515356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.617936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cebc86e9-ce54-4e9a-8718-26a7400fd978" -d '{"events": [{"name": "network-changed", "server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:04.620822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5945b3-a4c9-4afb-9a40-1fba76bbcd7d service neutron] Pushing event updated for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:04.643923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-20b67a0a-0e01-433d-86a4-c31d811acd77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:04.645475 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-20b67a0a-0e01-433d-86a4-c31d811acd77 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1097 time: 0.1668251 Nov 05 14:45:04.649223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-58457b56-2566-4234-8430-5bbaffae1740 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:04.650182 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-58457b56-2566-4234-8430-5bbaffae1740 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=3cb2c9da66364ac18972da6a46b083c1&device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 1097 time: 0.1318159 Nov 05 14:45:04.698485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0d187a67-1569-490c-ba6b-54e4b6d47353 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:04.729674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Allocated IP 2001:db8:0:ffff::2 (1bee866a-e915-49da-a1b2-52ca5394910c/5b5a7123-fc8c-4914-8963-1115ccdd52c4/196958ac-f56b-4622-b784-2399b7eae258) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:04.756179 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-607ca033-1f78-450e-bb22-8477f2077abf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 217 time: 0.0945582 Nov 05 14:45:04.757555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.770695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-4e06c82f-1ea7-46f3-920f-0fd1b8e83c87 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f HTTP/1.1" status: 200 len: 217 time: 0.1016941 Nov 05 14:45:04.789915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.806250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b88e9bc-51ab-4def-8db6-0e7973fc9c17 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.807475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b88e9bc-51ab-4def-8db6-0e7973fc9c17 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.5502608 Nov 05 14:45:04.828646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 0d187a67-1569-490c-ba6b-54e4b6d47353 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:45:04.841786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 0d187a67-1569-490c-ba6b-54e4b6d47353 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:04.842531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.844063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39224) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:04.869516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-80ffab1b-e349-4854-8004-7c50fa4ff923 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': '79435f88-fd9c-4f36-8002-1f270eb79123'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:04.870058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-80ffab1b-e349-4854-8004-7c50fa4ff923 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=113581) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:04.914729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.resource_extend [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:45:04.932306 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b812f4ff-2558-408c-82e4-ee8a90d9b2ac req-d6f19550-0636-4d2e-bbb6-9ecf445a56c4 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5509536 Nov 05 14:45:04.940538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.945651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:04.987017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.000487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.010999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.029569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-63c9914e-cf93-4953-9c16-aaa4cdf23eab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.031286 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-63c9914e-cf93-4953-9c16-aaa4cdf23eab service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.2622600 Nov 05 14:45:05.032556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-e888e894-1b31-40bc-afe0-5de501da77ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.033868 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-e888e894-1b31-40bc-afe0-5de501da77ba service neutron] 10.222.0.32 "GET /v2.0/subnets?id=84c193ea-9294-4fe7-b33c-753ea27f07be HTTP/1.1" status: 200 len: 845 time: 0.2383442 Nov 05 14:45:05.062262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Network 1bee866a-e915-49da-a1b2-52ca5394910c is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:05.064423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59125577-86d5-4a41-8aeb-6a9a9a813c4d req-0883b9fb-abd4-4e5b-a56e-96fe5953a471 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.065946 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-59125577-86d5-4a41-8aeb-6a9a9a813c4d req-0883b9fb-abd4-4e5b-a56e-96fe5953a471 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 944 time: 0.3719165 Nov 05 14:45:05.066792 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.services.metering.metering_plugin [None req-80ffab1b-e349-4854-8004-7c50fa4ff923 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 05 14:45:05.073931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:05.092519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.093030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 17e3e074-552b-4569-a8c5-6d5f46dc5e88 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:05.094358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.099933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.100543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.111992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0d187a67-1569-490c-ba6b-54e4b6d47353,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:05.115227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.115627 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Pushing event updated for resources: {'Port': ['ID=196958ac-f56b-4622-b784-2399b7eae258,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:05.119231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18b86b26-ba69-427e-a3e7-2cf73f473e95 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/routers/17e3e074-552b-4569-a8c5-6d5f46dc5e88 HTTP/1.1" status: 204 len: 168 time: 0.8608179 Nov 05 14:45:05.128042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4830fe48-69f2-4b56-8a16-7cedd9491092 x-openstack-request-id: req-4830fe48-69f2-4b56-8a16-7cedd9491092 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:05.128850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:05.128963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4830fe48-69f2-4b56-8a16-7cedd9491092 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:05.129393 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e', 'status': 'completed', 'code': 200} Nov 05 14:45:05.136344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:05.201093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.8232844 Nov 05 14:45:05.219820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39232) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:05.247015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:05.250392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:05.251324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.320815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:05.325653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39238) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:05.333524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3897729f-4cda-445d-82ff-351ebc6c8865 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=1fcf6ba3-3c19-4780-9bd4-c96004381730,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:05.343249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80ffab1b-e349-4854-8004-7c50fa4ff923 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.344647 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80ffab1b-e349-4854-8004-7c50fa4ff923 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.4973040 Nov 05 14:45:05.348332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Allocated IP 172.26.5.42 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/bf60e4f4-80e5-4ca1-a4fe-1b1ff2f23f0d) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:05.350644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39242) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:05.389552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Attempting to bind port 196958ac-f56b-4622-b784-2399b7eae258 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:05.389552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Attempting to bind port 196958ac-f56b-4622-b784-2399b7eae258 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'bf857bc1-edb8-455a-857c-22c038fef552', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:05.389907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Attempting to bind port 196958ac-f56b-4622-b784-2399b7eae258 on network 1bee866a-e915-49da-a1b2-52ca5394910c {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:05.396668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:05.397104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Checking segment: {'id': 'bf857bc1-edb8-455a-857c-22c038fef552', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:05.397515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.400871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-68e89115-e3fa-4389-ba35-849ef90f45c8 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=a1a86edc-6557-49d3-bcb2-aed862fe7dd6 HTTP/1.1" status: 200 len: 462 time: 0.0423312 Nov 05 14:45:05.401029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Bound using segment: {'id': 'bf857bc1-edb8-455a-857c-22c038fef552', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:05.401029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Bound port: 196958ac-f56b-4622-b784-2399b7eae258, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf857bc1-edb8-455a-857c-22c038fef552', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '1bee866a-e915-49da-a1b2-52ca5394910c'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:05.401029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.406645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df5409b-f58d-416a-942e-dc073efa502a req-af6901dc-3430-4151-b8ff-a60497cc10f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.408180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-af6901dc-3430-4151-b8ff-a60497cc10f0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3549845 Nov 05 14:45:05.408925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39244) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:05.414882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-cf82a221-9ad7-4170-8b3c-1819bbad4092 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.416969 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-cf82a221-9ad7-4170-8b3c-1819bbad4092 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3623774 Nov 05 14:45:05.424884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:05.443343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-59125577-86d5-4a41-8aeb-6a9a9a813c4d req-6b97427c-a93c-46ec-a5e5-7f0f2e339ef8 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3345735 Nov 05 14:45:05.488299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.505808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0189f903-1c91-42ff-93cf-85c028a704f7" -d '{"events": [{"server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "name": "network-vif-plugged", "status": "completed", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:05.554991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a71f3b-e209-4905-90f6-d7a7dda7ec66 req-2893c403-6a24-45eb-94fc-b5d8fac789c1 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.556095 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b1a71f3b-e209-4905-90f6-d7a7dda7ec66 req-2893c403-6a24-45eb-94fc-b5d8fac789c1 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.3626189 Nov 05 14:45:05.586009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] For port 196958ac-f56b-4622-b784-2399b7eae258, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:05.590597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] For port 196958ac-f56b-4622-b784-2399b7eae258, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=196958ac-f56b-4622-b784-2399b7eae258,segment=NetworkSegment(bf857bc1-edb8-455a-857c-22c038fef552),segment_id=bf857bc1-edb8-455a-857c-22c038fef552)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:05.598608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.625470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Subnet': ['ID=b2186818-b151-4a35-904c-62c9ef709258,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:05.643431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:05.646658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.707649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea440095-ebb5-4af6-8a37-ab3e08b9701a None None] Pushing event updated for resources: {'Port': ['ID=196958ac-f56b-4622-b784-2399b7eae258,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:05.716391 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b1a71f3b-e209-4905-90f6-d7a7dda7ec66 req-a7c48142-23a2-4216-a8ec-2b440f6c6b49 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1503825 Nov 05 14:45:05.719252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Checking segment: {'id': 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:05.719656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network hostable DHCP agents. Network: 0d191e95-5fd7-4348-b056-51734fb90a4e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:05.743065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-92e4c46a-814a-4788-bdc3-9fa6ac7d9df4 service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3192687 Nov 05 14:45:05.744823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:05.745034 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-0adb3460-b3a4-44cf-9b44-a06fecfb2c3a service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3075502 Nov 05 14:45:05.766902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0d191e95-5fd7-4348-b056-51734fb90a4e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:05.773847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-482599892', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:05.779102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:05.780183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:05.795023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-809f3e79-ee19-40fd-953b-e0a1ef6ec085 x-openstack-request-id: req-809f3e79-ee19-40fd-953b-e0a1ef6ec085 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:05.795881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "name": "network-vif-plugged", "status": "completed", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:05.796215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-809f3e79-ee19-40fd-953b-e0a1ef6ec085 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:05.798234 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'code': 200} Nov 05 14:45:05.809193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0a9fd695-3f59-4a52-ab3f-b21c05f789de tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3423543 Nov 05 14:45:05.809412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39252) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:05.817046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-831827379'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:06.200558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739dad23-b027-41a2-877e-f8381a641499 req-3002518a-ce90-4847-a371-a9358db70bf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:06.202067 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739dad23-b027-41a2-877e-f8381a641499 req-3002518a-ce90-4847-a371-a9358db70bf2 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 1099 time: 0.1912498 Nov 05 14:45:06.216997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb833f4-fee4-4cd8-9048-dda9183ec8c3 req-1e73ab63-e674-4299-989f-75ae240f1c4f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:06.218433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edb833f4-fee4-4cd8-9048-dda9183ec8c3 req-1e73ab63-e674-4299-989f-75ae240f1c4f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 944 time: 0.1475458 Nov 05 14:45:06.247324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-739dad23-b027-41a2-877e-f8381a641499 req-170bad96-292d-42a8-be82-274bca1956b6 service neutron] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.279022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16784017-0f71-4e10-837f-2e73868c92e2 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.280162 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-16784017-0f71-4e10-837f-2e73868c92e2 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-label-rules/a1a86edc-6557-49d3-bcb2-aed862fe7dd6 HTTP/1.1" status: 204 len: 168 time: 0.8676763 Nov 05 14:45:06.289603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39256) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:06.291886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.292443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:45:06.293066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.303544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.338751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.354799 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4245a55-6712-4a39-b5fd-a3a3f39b3117 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=a1a86edc-6557-49d3-bcb2-aed862fe7dd6 HTTP/1.1" status: 200 len: 221 time: 0.0578218 Nov 05 14:45:06.361974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39258) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:06.378774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9790fba2-5506-4cb2-8c85-d5edb9675b30 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--1055129409', 'description': 'label created by tempest'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:06.379238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9790fba2-5506-4cb2-8c85-d5edb9675b30 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Unknown quota resources ['metering_label']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:06.396753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:06.397358 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-02283cd6-cf2c-48f2-97fa-f74285c44c99 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6028180 Nov 05 14:45:06.400160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.412861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edb833f4-fee4-4cd8-9048-dda9183ec8c3 req-0620e0c9-b3fe-4b08-b8a4-2c834b94c4ff tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1851017 Nov 05 14:45:06.430795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.439938 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df5409b-f58d-416a-942e-dc073efa502a req-0be3fda5-623f-4bc4-bebe-d78885193371 service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6471243 Nov 05 14:45:06.479274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=7cfd84b3-9115-4e86-9638-e8d8223f4c72,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:06.546226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port 32af1864-84e4-446d-85bf-079aa2b5e501 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:06.597552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.683421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.724510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:06.753631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:06.756383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:06.769663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event updated for resources: {'Port': ['ID=bf60e4f4-80e5-4ca1-a4fe-1b1ff2f23f0d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:06.807783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': '5c183f81-945f-4710-aa52-a4ce87072414', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:06.808149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: 1fcf6ba3-3c19-4780-9bd4-c96004381730, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:06.829564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-715b100c-ed17-46b1-b851-828c9b897c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:06.831118 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-715b100c-ed17-46b1-b851-828c9b897c5f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1097 time: 0.3453438 Nov 05 14:45:06.860268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dc25df-6d6c-42eb-a764-c87e1dd0f4e0 req-0d04ba0b-b5a1-4fa9-9408-7c6f1f181114 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:06.861801 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2dc25df-6d6c-42eb-a764-c87e1dd0f4e0 req-0d04ba0b-b5a1-4fa9-9408-7c6f1f181114 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 944 time: 0.2660191 Nov 05 14:45:06.897777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67992510-287a-4df2-9b21-05b426e4ff2b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:06.926593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9790fba2-5506-4cb2-8c85-d5edb9675b30 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.927756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9790fba2-5506-4cb2-8c85-d5edb9675b30 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 470 time: 0.5600915 Nov 05 14:45:06.936015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-739dad23-b027-41a2-877e-f8381a641499 req-170bad96-292d-42a8-be82-274bca1956b6 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:06.940162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39264) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:06.956653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-739dad23-b027-41a2-877e-f8381a641499 req-170bad96-292d-42a8-be82-274bca1956b6 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.036220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] Provisioning complete for port 196958ac-f56b-4622-b784-2399b7eae258 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:07.036220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.067211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:07.081310 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-50933a39-3b6e-4bdd-9f5e-8f7cb74de2b9 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=02abc939-6f7f-44c3-a6ff-5acf560943fe HTTP/1.1" status: 200 len: 468 time: 0.1386008 Nov 05 14:45:07.089562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39266) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.109729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-170bad96-292d-42a8-be82-274bca1956b6 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=69cc5ec3-fb83-4c28-8749-e0640a9cc103,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:07.112048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1fcf6ba3-3c19-4780-9bd4-c96004381730) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:07.115437 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739dad23-b027-41a2-877e-f8381a641499 req-170bad96-292d-42a8-be82-274bca1956b6 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.8961005 Nov 05 14:45:07.131533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0924ad0-4d5f-42d8-8098-78fbec1243f5 req-ee167af5-853e-429e-b43e-923304b369e3 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.133040 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f0924ad0-4d5f-42d8-8098-78fbec1243f5 req-ee167af5-853e-429e-b43e-923304b369e3 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.3214667 Nov 05 14:45:07.136222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.137144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.143206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.4 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/32af1864-84e4-446d-85bf-079aa2b5e501) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:07.144436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:07.146986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e" -d '{"events": [{"name": "network-changed", "server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:07.162558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67992510-287a-4df2-9b21-05b426e4ff2b None None] Unable to find a vacant binding_index for network 1fcf6ba3-3c19-4780-9bd4-c96004381730 and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:45:07.171253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67992510-287a-4df2-9b21-05b426e4ff2b None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1fcf6ba3-3c19-4780-9bd4-c96004381730) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:07.185475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0bae794-a363-4403-b9b4-51a501734863 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.9632525 Nov 05 14:45:07.189175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39270) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.203536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'port': {'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730', 'name': 'tempest-NetworksIpV6TestAttrs-2067693327'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:07.249272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2dc25df-6d6c-42eb-a764-c87e1dd0f4e0 req-c413e662-e14e-4492-bca4-562ba8faaa08 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3729002 Nov 05 14:45:07.266625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-35ec5bc4-7cd9-44b1-9170-1737cb261bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.274282 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-35ec5bc4-7cd9-44b1-9170-1737cb261bd2 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.4349551 Nov 05 14:45:07.289160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f0924ad0-4d5f-42d8-8098-78fbec1243f5 req-210ab707-c8ac-4fbc-9465-c9273cf9ea4e tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1436970 Nov 05 14:45:07.295566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.320429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 196958ac-f56b-4622-b784-2399b7eae258 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:07.351391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31c01714-cd5d-4770-8b92-0cf65b645065 x-openstack-request-id: req-31c01714-cd5d-4770-8b92-0cf65b645065 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:07.352295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:07.352578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-31c01714-cd5d-4770-8b92-0cf65b645065 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:07.352965 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'status': 'completed', 'code': 200} Nov 05 14:45:07.418918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] For port 196958ac-f56b-4622-b784-2399b7eae258, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=196958ac-f56b-4622-b784-2399b7eae258,segment=NetworkSegment(bf857bc1-edb8-455a-857c-22c038fef552),segment_id=bf857bc1-edb8-455a-857c-22c038fef552)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:07.433556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.467742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.478265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-1f69311a-aec2-4cc9-bb86-3df37d7dfdbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.479773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-1f69311a-aec2-4cc9-bb86-3df37d7dfdbf service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=3cb2c9da66364ac18972da6a46b083c1&device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 1097 time: 0.0960805 Nov 05 14:45:07.503798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:07.507199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.514345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-f1ab687e-e0be-406b-afc4-d1963931c320 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 217 time: 0.1163864 Nov 05 14:45:07.541763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b97b3c02-3992-413b-a658-1583f765f7d8 None None] Pushing event updated for resources: {'Port': ['ID=196958ac-f56b-4622-b784-2399b7eae258,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:07.556859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 196958ac-f56b-4622-b784-2399b7eae258 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:07.557250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.589557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] device_id is not set on port 3479e0aa-18d0-4261-b97b-3281f2980be6 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:07.601262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96c5686c-787a-40c4-bc9e-7d6dc83e0bee tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.604995 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-96c5686c-787a-40c4-bc9e-7d6dc83e0bee tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-labels/02abc939-6f7f-44c3-a6ff-5acf560943fe HTTP/1.1" status: 204 len: 168 time: 0.5076399 Nov 05 14:45:07.606443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39274) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.672242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.698112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4266aecb-f505-46c5-8954-c6f36f894ffb tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=02abc939-6f7f-44c3-a6ff-5acf560943fe HTTP/1.1" status: 200 len: 216 time: 0.0889091 Nov 05 14:45:07.703489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39276) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.713998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-c5567107-0936-4e36-8fe2-e75f90227e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.716438 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-c5567107-0936-4e36-8fe2-e75f90227e26 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.1528299 Nov 05 14:45:07.734075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3825c29c-5354-4380-9727-c09ade26b0e6 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0258634 Nov 05 14:45:07.735969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39278) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.745082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8eaa660-2fd0-4688-ba61-c771c97ac204 req-8a3740b5-63c0-4ec1-8e98-91209bc65ee2 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.746687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0d191e95-5fd7-4348-b056-51734fb90a4e', 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'tenant_id': 'cc6949a83f804429a49a501b3e1538bb', 'fixed_ips': [{'subnet_id': 'b2186818-b151-4a35-904c-62c9ef709258'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:07.747952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.752556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1fcf6ba3-3c19-4780-9bd4-c96004381730', 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730', 'tenant_id': '5b43437541e445ee9cffdd31db12e7c8', 'fixed_ips': [{'subnet_id': '7cfd84b3-9115-4e86-9638-e8d8223f4c72'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:07.752879 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f8eaa660-2fd0-4688-ba61-c771c97ac204 req-8a3740b5-63c0-4ec1-8e98-91209bc65ee2 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 944 time: 0.1928718 Nov 05 14:45:07.753430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.755070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-a54f5c95-f9ec-40f5-a407-987c0552dd55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:07.756491 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-a54f5c95-f9ec-40f5-a407-987c0552dd55 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542 HTTP/1.1" status: 200 len: 907 time: 0.2614315 Nov 05 14:45:07.799431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:07.811481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting port bf60e4f4-80e5-4ca1-a4fe-1b1ff2f23f0d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:07.812227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.814345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.832902 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a1cd0918-c8b5-475e-acc1-d8678934aad4 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0956376 Nov 05 14:45:07.884938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:07.892427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:07.896912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:07.897966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=32af1864-84e4-446d-85bf-079aa2b5e501,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:07.904686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:07.908389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-9fb1f22c-ca18-4efa-97a5-cf001b6ed47d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f HTTP/1.1" status: 200 len: 217 time: 0.1412921 Nov 05 14:45:07.920338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Allocated IP 2001:db8::f816:3eff:fe78:87c7 (1fcf6ba3-3c19-4780-9bd4-c96004381730/7cfd84b3-9115-4e86-9638-e8d8223f4c72/3479e0aa-18d0-4261-b97b-3281f2980be6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:08.038494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.039118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.042817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-84899579-6a4c-43ff-ac17-68de8ca3632d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.045784 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-84899579-6a4c-43ff-ac17-68de8ca3632d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3170955 Nov 05 14:45:08.055352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f8eaa660-2fd0-4688-ba61-c771c97ac204 req-bd84a0c2-e852-4cf1-920b-dee18a0f2ee0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3005588 Nov 05 14:45:08.056252 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-177684f0-452c-4a90-a507-216eaf6cf03e tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels/79435f88-fd9c-4f36-8002-1f270eb79123 HTTP/1.1" status: 200 len: 472 time: 0.1678679 Nov 05 14:45:08.057368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39282) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:08.082582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-787a4ad1-e5b3-4d0c-856d-97bc43b409a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.084442 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-787a4ad1-e5b3-4d0c-856d-97bc43b409a2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=84c193ea-9294-4fe7-b33c-753ea27f07be HTTP/1.1" status: 200 len: 845 time: 0.1616435 Nov 05 14:45:08.096315 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c870364e-e0fc-4a24-9205-bf93c6d7a6e4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.2858939 Nov 05 14:45:08.103387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39284) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:08.121814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-72600739', 'allowed_address_pairs': [{'ip_address': '172.20.0.4', 'mac_address': 'fa:16:3e:d6:eb:91'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:08.196833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Allocated IP 172.20.0.2 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/75ec3e84-9dc0-4fc0-97fd-465feb912559) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:08.363267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.391074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-0e48d44b-c59f-4d66-b23b-681b46c8d910 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.392881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-0e48d44b-c59f-4d66-b23b-681b46c8d910 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2921846 Nov 05 14:45:08.403521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.416102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.429865 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b4944e6f-6a13-46f3-8dee-b9c7eba0326b tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules/20dadb37-51a2-4788-a11b-de4cafc6c60a HTTP/1.1" status: 200 len: 459 time: 0.3623960 Nov 05 14:45:08.433997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39290) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:08.468235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:08.481950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:08.484823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:08.491447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Pushing event updated for resources: {'Port': ['ID=75ec3e84-9dc0-4fc0-97fd-465feb912559,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:08.496641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2dff5f9e-3285-4e85-b572-914ad10513ec None None] Provisioning complete for port 196958ac-f56b-4622-b784-2399b7eae258 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:08.497010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2dff5f9e-3285-4e85-b572-914ad10513ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.536242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.536242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.572633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:08.581293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Calling delete_port for bf60e4f4-80e5-4ca1-a4fe-1b1ff2f23f0d owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:08.581688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.590616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d0be25-d528-42a8-8fc3-b34e25e035c8 req-f37c19df-db00-4d18-a2c5-ee7380dbedc4 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.592135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-87d0be25-d528-42a8-8fc3-b34e25e035c8 req-f37c19df-db00-4d18-a2c5-ee7380dbedc4 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.1902335 Nov 05 14:45:08.613654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Attempting to bind port 75ec3e84-9dc0-4fc0-97fd-465feb912559 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:08.613964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Attempting to bind port 75ec3e84-9dc0-4fc0-97fd-465feb912559 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:08.614628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Attempting to bind port 75ec3e84-9dc0-4fc0-97fd-465feb912559 on network 0d191e95-5fd7-4348-b056-51734fb90a4e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:08.635495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:08.635882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Checking segment: {'id': 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:08.636248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.636718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Bound using segment: {'id': 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:08.637188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Bound port: 75ec3e84-9dc0-4fc0-97fd-465feb912559, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:08.637557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.642502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Allocated IP 2001:db8::f816:3eff:fe36:929a (1fcf6ba3-3c19-4780-9bd4-c96004381730/7cfd84b3-9115-4e86-9638-e8d8223f4c72/cc11331d-697b-473f-b50b-e51cb739bd89) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:08.663675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca45d08-820a-4e68-a2b4-2e93a3a36e76 req-1a71fdb6-22e5-47cd-ba5f-275a47ec9ca3 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:08.664725 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8ca45d08-820a-4e68-a2b4-2e93a3a36e76 req-1a71fdb6-22e5-47cd-ba5f-275a47ec9ca3 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 944 time: 0.2289939 Nov 05 14:45:08.692698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Allocated IP 172.26.5.9 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/7ba8b7a4-968d-45a5-b7a9-5e1270034eb0) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:08.701741 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-eebb36ad-ad94-4f2d-a8ed-0eee4af027e0 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6355555 Nov 05 14:45:08.815718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] For port 75ec3e84-9dc0-4fc0-97fd-465feb912559, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:08.821631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] For port 75ec3e84-9dc0-4fc0-97fd-465feb912559, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75ec3e84-9dc0-4fc0-97fd-465feb912559,segment=NetworkSegment(ac4fde7b-bf77-4d29-85a8-0a85757b42f4),segment_id=ac4fde7b-bf77-4d29-85a8-0a85757b42f4)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:08.830019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.904868 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8ca45d08-820a-4e68-a2b4-2e93a3a36e76 req-d0255cd9-ca80-472b-98fe-2b4ff9cc0d73 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2217250 Nov 05 14:45:08.976045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:08.976699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3213225a-213c-44ba-9f6d-d63068b89773 None None] Pushing event updated for resources: {'Port': ['ID=75ec3e84-9dc0-4fc0-97fd-465feb912559,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:08.991782 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cebc86e9-ce54-4e9a-8718-26a7400fd978 req-a4f943cd-5b20-469c-9133-3f515ad49731 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2693458 Nov 05 14:45:08.991905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.000921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.033496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Port': ['ID=bf60e4f4-80e5-4ca1-a4fe-1b1ff2f23f0d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:09.040777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.081318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:09.088257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:09.096281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:09.108127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-8fc472ad-2a18-4b3d-bbbc-258552b9b98b service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7014098 Nov 05 14:45:09.110885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Pushing event updated for resources: {'Port': ['ID=cc11331d-697b-473f-b50b-e51cb739bd89,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:09.118667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a92f6f55-9eda-42a4-a255-a0f2d52a2912 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.119895 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a92f6f55-9eda-42a4-a255-a0f2d52a2912 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-label-rules/20dadb37-51a2-4788-a11b-de4cafc6c60a HTTP/1.1" status: 204 len: 168 time: 0.6605906 Nov 05 14:45:09.123325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39294) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:09.132999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:09.186927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Attempting to bind port cc11331d-697b-473f-b50b-e51cb739bd89 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:09.187288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Attempting to bind port cc11331d-697b-473f-b50b-e51cb739bd89 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '5c183f81-945f-4710-aa52-a4ce87072414', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:09.187645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Attempting to bind port cc11331d-697b-473f-b50b-e51cb739bd89 on network 1fcf6ba3-3c19-4780-9bd4-c96004381730 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:09.197246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:09.203466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:09.203988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Checking segment: {'id': '5c183f81-945f-4710-aa52-a4ce87072414', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:09.204221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.204628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Bound using segment: {'id': '5c183f81-945f-4710-aa52-a4ce87072414', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:09.205097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Bound port: cc11331d-697b-473f-b50b-e51cb739bd89, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c183f81-945f-4710-aa52-a4ce87072414', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '1fcf6ba3-3c19-4780-9bd4-c96004381730'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:09.205469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.207387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:09.213808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:09.214458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.292055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Port': ['ID=3479e0aa-18d0-4261-b97b-3281f2980be6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:09.296689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 196958ac-f56b-4622-b784-2399b7eae258 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:09.329327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.333284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] create failed (client error): The resource could not be found. Nov 05 14:45:09.338738 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c38e7e0a-74de-462d-a2d9-cbd9446c8cdc tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 5.8005536 Nov 05 14:45:09.338738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39296) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:09.364866 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-12ced48c-7a4c-49b0-80da-450b86c6591a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 2.1691499 Nov 05 14:45:09.368757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] For port cc11331d-697b-473f-b50b-e51cb739bd89, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:09.374036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39298) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:09.387697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] For port cc11331d-697b-473f-b50b-e51cb739bd89, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc11331d-697b-473f-b50b-e51cb739bd89,segment=NetworkSegment(5c183f81-945f-4710-aa52-a4ce87072414),segment_id=5c183f81-945f-4710-aa52-a4ce87072414)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:09.395157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-87d0be25-d528-42a8-8fc3-b34e25e035c8 req-948386ec-f5f4-4782-9fe5-b63941210ba6 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.7289040 Nov 05 14:45:09.395549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.436270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 196958ac-f56b-4622-b784-2399b7eae258 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:09.436734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.441476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.488252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:09.502661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02bb5ce4-29ac-4f12-bf3d-67b23b18a01e req-6b816d89-bb3d-43d2-aa34-552baebcc949 service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3726676 Nov 05 14:45:09.506960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port e1956ec8-c8a8-4cf7-b49d-958579a28288 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:09.507848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f2fffc-d19f-4893-8a9a-24b223411d75 None None] Pushing event updated for resources: {'Port': ['ID=cc11331d-697b-473f-b50b-e51cb739bd89,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:09.535271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting subnet 7cfd84b3-9115-4e86-9638-e8d8223f4c72 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:09.541663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.555329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:09.580496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event updated for resources: {'Port': ['ID=7ba8b7a4-968d-45a5-b7a9-5e1270034eb0,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:09.584050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:09.595049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c84db5-5c30-47a7-ac53-47e9bda279ce req-86e893be-c93f-4ed1-b116-8d8d8fa21743 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:09.602517 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d3c84db5-5c30-47a7-ac53-47e9bda279ce req-86e893be-c93f-4ed1-b116-8d8d8fa21743 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 944 time: 0.3765218 Nov 05 14:45:09.606752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2eeb1188-c29a-4a63-83e2-b1a5d1ded112 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.607860 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2eeb1188-c29a-4a63-83e2-b1a5d1ded112 tempest-MeteringIpV6TestJSON-435760030 tempest-MeteringIpV6TestJSON-435760030-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-labels/79435f88-fd9c-4f36-8002-1f270eb79123 HTTP/1.1" status: 204 len: 168 time: 0.4825013 Nov 05 14:45:09.649737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.711191 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d3c84db5-5c30-47a7-ac53-47e9bda279ce req-41c554b4-d890-4280-82b9-f3b80e8f6467 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1069689 Nov 05 14:45:09.805831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting port 2ef56fb1-9990-483f-92a5-78def8776815 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:09.806184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:09.823588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.7 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/e1956ec8-c8a8-4cf7-b49d-958579a28288) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:09.968767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.032845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.051994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Calling delete_port for 2ef56fb1-9990-483f-92a5-78def8776815 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:10.107700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39306) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.181748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1475dac5-6f0d-4dde-a3d5-4bbd9ab349d2 req-0feb739e-9a61-408e-9df9-4fc309b91e2f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:10.190204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1475dac5-6f0d-4dde-a3d5-4bbd9ab349d2 req-0feb739e-9a61-408e-9df9-4fc309b91e2f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 944 time: 0.1443431 Nov 05 14:45:10.203602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.257034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.262634 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/7cfd84b3-9115-4e86-9638-e8d8223f4c72 HTTP/1.1" status: 204 len: 168 time: 0.8639843 Nov 05 14:45:10.263863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39310) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.267783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdb9cf5-6ea2-401c-a1e9-7e89cf516b21 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=7cfd84b3-9115-4e86-9638-e8d8223f4c72,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:10.277563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.297188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-788c4df5-3c99-4cea-9516-66330a72d342 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.345167 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1475dac5-6f0d-4dde-a3d5-4bbd9ab349d2 req-deb5a4a6-f40e-42e9-a085-a7a14982911f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1537509 Nov 05 14:45:10.403656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.404599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.414528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:10.415622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.436547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:10.442474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:10.497890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:10.524881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.525081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a299fbc3-5465-488c-893e-0901763e269f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:10.528014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a299fbc3-5465-488c-893e-0901763e269f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:10.533269 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a299fbc3-5465-488c-893e-0901763e269f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.2658994 Nov 05 14:45:10.537767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39314) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.541770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.545820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-788c4df5-3c99-4cea-9516-66330a72d342 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.568800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] For port 75ec3e84-9dc0-4fc0-97fd-465feb912559, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75ec3e84-9dc0-4fc0-97fd-465feb912559,segment=NetworkSegment(ac4fde7b-bf77-4d29-85a8-0a85757b42f4),segment_id=ac4fde7b-bf77-4d29-85a8-0a85757b42f4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:10.578170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.582069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-788c4df5-3c99-4cea-9516-66330a72d342 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.622145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=e1956ec8-c8a8-4cf7-b49d-958579a28288,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:10.651369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6027c919-5229-4e30-aa41-7bf6225ee88d None None] Pushing event updated for resources: {'Port': ['ID=75ec3e84-9dc0-4fc0-97fd-465feb912559,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:10.677048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2d0d74d9-94d0-42c7-be73-ebcc957f107f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:45:10.678499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:10.679134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.696894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Port': ['ID=2ef56fb1-9990-483f-92a5-78def8776815,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:10.704572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-788c4df5-3c99-4cea-9516-66330a72d342 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a2e42b7-5b6a-47a2-9fe8-c95ca510e5de,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:10.714272 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-788c4df5-3c99-4cea-9516-66330a72d342 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=55fa8279298644f7b36f57e26349e66c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6020658 Nov 05 14:45:10.716342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39316) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.726066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-484138da-c1b1-45e7-95c2-5189e5be951a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:10.785537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8f9a47a0-3dc4-4128-84e8-f37c7b80865d tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 996 time: 2.6735508 Nov 05 14:45:10.793477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39320) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.826073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:10.837130 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-484138da-c1b1-45e7-95c2-5189e5be951a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 05 14:45:10.837609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-484138da-c1b1-45e7-95c2-5189e5be951a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:10.840935 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-484138da-c1b1-45e7-95c2-5189e5be951a tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/1fcf6ba3-3c19-4780-9bd4-c96004381730 HTTP/1.1" status: 409 len: 405 time: 0.2976255 Nov 05 14:45:10.847133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'port_id': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'mac_address': 'fa:16:3e:43:e0:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 636, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:45:10.859944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39322) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:10.878642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-587666635'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:10.887952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72e63d20-99e6-4913-b1c9-32ca650668bf None None] Network 0d191e95-5fd7-4348-b056-51734fb90a4e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:10.965894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-790a49ac-c80f-4683-a19b-4d0c3915086c None None] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:11.020533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.036488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b98f343-2c8b-4919-92be-33f63e83af5e tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-72e63d20-99e6-4913-b1c9-32ca650668bf None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:11.038127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:11.049381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b98f343-2c8b-4919-92be-33f63e83af5e tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.059384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b98f343-2c8b-4919-92be-33f63e83af5e tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.065997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3b98f343-2c8b-4919-92be-33f63e83af5e tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2463 time: 0.2663767 Nov 05 14:45:11.066780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39324) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:11.075008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.084234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d0d74d9-94d0-42c7-be73-ebcc957f107f {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:45:11.102879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:11.108685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.140767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.144443 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-07d652b8-8178-4179-bc65-91e2e466acf2 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "DELETE /v2.0/ports/2ef56fb1-9990-483f-92a5-78def8776815 HTTP/1.1" status: 204 len: 168 time: 1.8014028 Nov 05 14:45:11.167279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39326) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:11.177719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7baad56-8f60-419b-a33b-61b67c20df44 None None] Network 0d191e95-5fd7-4348-b056-51734fb90a4e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:11.254715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec99b552-1b40-4bac-9455-61e84afa9d9f req-156ea291-1071-419e-9d57-63c15593c39c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.262997 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ec99b552-1b40-4bac-9455-61e84afa9d9f req-156ea291-1071-419e-9d57-63c15593c39c tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.7446702 Nov 05 14:45:11.276919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead27c55-96c9-4ead-8503-9bc625099e0f req-b02bb97f-bdb1-451d-9d9b-ecfbc5e0d607 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.282701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ead27c55-96c9-4ead-8503-9bc625099e0f req-b02bb97f-bdb1-451d-9d9b-ecfbc5e0d607 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 944 time: 0.4403813 Nov 05 14:45:11.290383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.351275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Provisioning complete for port 196958ac-f56b-4622-b784-2399b7eae258 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:11.352082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.397050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdbe3f65-1a7f-4283-a228-6f15d33e2f35 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.398773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cdbe3f65-1a7f-4283-a228-6f15d33e2f35 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6f2a818-73c2-40a8-8783-f26e2159585c HTTP/1.1" status: 200 len: 913 time: 0.2280347 Nov 05 14:45:11.403762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 629} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:11.418613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39330) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c7baad56-8f60-419b-a33b-61b67c20df44 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:11.423032 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:11.425125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc11331d-697b-473f-b50b-e51cb739bd89 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:11.429414 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ec99b552-1b40-4bac-9455-61e84afa9d9f req-75925bd8-4a83-4021-9b6e-6212d46e79c7 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1643906 Nov 05 14:45:11.467753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.590259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.590597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment 2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc of type vlan for network 73817f48-752a-4b2b-8059-05e744d52c40 Nov 05 14:45:11.600370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port cc11331d-697b-473f-b50b-e51cb739bd89 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:11.601119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.647398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:11.664862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Provisioning complete for port cc11331d-697b-473f-b50b-e51cb739bd89 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:11.665261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.679178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f09cae-1a38-4700-a870-8321b7de085d req-1c5b005b-7e87-495a-ba1f-93f25bf1b5ff tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:11.687518 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-30f09cae-1a38-4700-a870-8321b7de085d req-1c5b005b-7e87-495a-ba1f-93f25bf1b5ff tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 944 time: 0.1467445 Nov 05 14:45:11.693255 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ead27c55-96c9-4ead-8503-9bc625099e0f req-b1c212ca-1c9d-4a7f-8c44-536e2492cbce tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3780599 Nov 05 14:45:11.697541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Router c855435c-4f84-40a7-a80a-24d0dc876dec is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:11.749132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.749796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 13d06243-5eeb-4ace-b456-59f332abe92e details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:45:11.792566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-30f09cae-1a38-4700-a870-8321b7de085d req-3270ebc7-2531-469b-9b7e-d0ee51817f0b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1020403 Nov 05 14:45:11.813412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.817392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port e1956ec8-c8a8-4cf7-b49d-958579a28288 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:11.817841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.914117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:11.925386 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] Sync routers for ids ['c855435c-4f84-40a7-a80a-24d0dc876dec'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:11.940717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:11.942519 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cffb4e0e-9019-41aa-aecd-ebe24b393028 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 6.6148911 Nov 05 14:45:11.947644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39334) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:11.948651 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] Routers {'c855435c-4f84-40a7-a80a-24d0dc876dec'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:11.949320 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c855435c-4f84-40a7-a80a-24d0dc876dec'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:12.005866 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:12.017536 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] Routers {'c855435c-4f84-40a7-a80a-24d0dc876dec'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:12.018397 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c855435c-4f84-40a7-a80a-24d0dc876dec'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:12.028865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.056096 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:12.057109 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaaa171d-8f73-4883-854f-1967754448ba None None] The sync data for ids ['c855435c-4f84-40a7-a80a-24d0dc876dec'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:12.083953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.099909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b15732d8-760c-4036-88fe-0e33a4985add tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/c855435c-4f84-40a7-a80a-24d0dc876dec HTTP/1.1" status: 200 len: 918 time: 0.1508503 Nov 05 14:45:12.102306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39336) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:12.109549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-793d9a8a-8723-4458-8faf-7cd498eec1ab None None] Network 1fcf6ba3-3c19-4780-9bd4-c96004381730 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:12.135543 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0073629f-8563-47a6-b5e9-d2598573122c tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=c855435c-4f84-40a7-a80a-24d0dc876dec HTTP/1.1" status: 200 len: 205 time: 0.0297353 Nov 05 14:45:12.135768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39338) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:12.194361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.196408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.197657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9a2e42b7-5b6a-47a2-9fe8-c95ca510e5de HTTP/1.1" status: 204 len: 168 time: 1.4785123 Nov 05 14:45:12.251101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e9bbf3-20a4-41f4-b7f7-24748360f27c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a2e42b7-5b6a-47a2-9fe8-c95ca510e5de,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.260338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.266120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:12.266747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.272221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.324566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.330506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=13d06243-5eeb-4ace-b456-59f332abe92e,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:12.364888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port cc11331d-697b-473f-b50b-e51cb739bd89, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc11331d-697b-473f-b50b-e51cb739bd89,segment=NetworkSegment(5c183f81-945f-4710-aa52-a4ce87072414),segment_id=5c183f81-945f-4710-aa52-a4ce87072414)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:12.384169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '13d06243-5eeb-4ace-b456-59f332abe92e', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'port_id': '13d06243-5eeb-4ace-b456-59f332abe92e', 'mac_address': 'fa:16:3e:b8:ac:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 641, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:45:12.385384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=73817f48-752a-4b2b-8059-05e744d52c40,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.389448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.390276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75ec3e84-9dc0-4fc0-97fd-465feb912559 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:12.411338 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d2ce5b36-ef33-438e-affd-aad080e6bece tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.5492773 Nov 05 14:45:12.416828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39344) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:12.422752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': '73817f48-752a-4b2b-8059-05e744d52c40', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:12.430855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.433067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2a6d9c8-2867-4582-ae55-d0bf86d5d504 req-e689c6d1-7551-454c-9de4-98fddd901201 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:12.435350 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e2a6d9c8-2867-4582-ae55-d0bf86d5d504 req-e689c6d1-7551-454c-9de4-98fddd901201 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.2428932 Nov 05 14:45:12.441350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.447701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39346) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:12.461316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 73817f48-752a-4b2b-8059-05e744d52c40 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:12.485502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for e1956ec8-c8a8-4cf7-b49d-958579a28288 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:12.498785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Request body: {'floatingip': {'port_id': '0d187a67-1569-490c-ba6b-54e4b6d47353'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:12.526895 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:45:12.626094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.651191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.657097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:45:12.657566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-27534c94-f6b6-4e97-a597-27503658363b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:45:12.667274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=cc11331d-697b-473f-b50b-e51cb739bd89,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.682071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13d06243-5eeb-4ace-b456-59f332abe92e {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:45:12.697942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39348) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:12.703947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:12.704322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.710145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=13d06243-5eeb-4ace-b456-59f332abe92e,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:12.729332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.745301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bd1910c1-c922-46e8-a0a1-1b82a58c768d admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.803637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] DHCP port deletion for 1fcf6ba3-3c19-4780-9bd4-c96004381730 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:12.816615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.821572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.861593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:12.863502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.870434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.900020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=e1956ec8-c8a8-4cf7-b49d-958579a28288,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:12.917415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Deleting port cc11331d-697b-473f-b50b-e51cb739bd89 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:12.917837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:12.969461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['13d06243-5eeb-4ace-b456-59f332abe92e'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:45:12.993656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port 7ba8b7a4-968d-45a5-b7a9-5e1270034eb0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:12.994282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.000177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['2d0d74d9-94d0-42c7-be73-ebcc957f107f'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:45:13.057427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] For port cc11331d-697b-473f-b50b-e51cb739bd89, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc11331d-697b-473f-b50b-e51cb739bd89,segment=NetworkSegment(5c183f81-945f-4710-aa52-a4ce87072414),segment_id=5c183f81-945f-4710-aa52-a4ce87072414)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:13.057832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.083911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Calling delete_port for cc11331d-697b-473f-b50b-e51cb739bd89 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:13.097767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.115700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for 7ba8b7a4-968d-45a5-b7a9-5e1270034eb0 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:13.204195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc11331d-697b-473f-b50b-e51cb739bd89 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:13.225510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-571d27f2-6e2b-41e6-923d-f9b80c757a46 req-5f2ec64e-8d15-4385-adca-83ad319ec6f0 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:13.227289 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-571d27f2-6e2b-41e6-923d-f9b80c757a46 req-5f2ec64e-8d15-4385-adca-83ad319ec6f0 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 945 time: 0.3251584 Nov 05 14:45:13.264363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bd1910c1-c922-46e8-a0a1-1b82a58c768d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.311440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9e8766-ddfe-440d-bcaf-d4b765cbf45b req-e09076c6-1bab-468c-a809-0f93ca7b42c5 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:13.311687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bd1910c1-c922-46e8-a0a1-1b82a58c768d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.319070 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de9e8766-ddfe-440d-bcaf-d4b765cbf45b req-e09076c6-1bab-468c-a809-0f93ca7b42c5 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 945 time: 0.3738787 Nov 05 14:45:13.405640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bd1910c1-c922-46e8-a0a1-1b82a58c768d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6d831a43e9e9446684f8f871143d95ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7033212 Nov 05 14:45:13.411977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39354) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:13.423266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1910c1-c922-46e8-a0a1-1b82a58c768d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfd873a1-1ff3-41d0-918e-b7dc8e58a3e4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:13.426026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.431650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7878cc63-5994-4202-a211-487eefbfa4da tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/e1956ec8-c8a8-4cf7-b49d-958579a28288 HTTP/1.1" status: 204 len: 168 time: 2.3557081 Nov 05 14:45:13.432250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39356) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:13.433135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-571d27f2-6e2b-41e6-923d-f9b80c757a46 req-4fdc754c-1771-4d82-bdd4-67bc26181174 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1675065 Nov 05 14:45:13.455882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.511821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] Pushing event deleted for resources: {'Port': ['ID=cc11331d-697b-473f-b50b-e51cb739bd89,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:13.518232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.521400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7173196b-b0a5-485a-88cd-2654ee9019df None None] No DVR routers for this DVR port cc11331d-697b-473f-b50b-e51cb739bd89 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:13.552835 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de9e8766-ddfe-440d-bcaf-d4b765cbf45b req-2f2a4555-2f11-46d9-815e-958eab09eecc tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2327547 Nov 05 14:45:13.568958 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-69360769-1791-4ff4-baf3-4386950d3ece tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] GET failed (client error): The resource could not be found. Nov 05 14:45:13.575334 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-69360769-1791-4ff4-baf3-4386950d3ece tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports/e1956ec8-c8a8-4cf7-b49d-958579a28288 HTTP/1.1" status: 404 len: 333 time: 0.1300197 Nov 05 14:45:13.579809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39358) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:13.599447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-577477102'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:13.616683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65260616-0171-4cdb-ad86-6b18d5c158bd None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:13.658363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f0b9ae87-e96d-4584-be28-950eca5cd5bd None None] Could not find standard attr ID for object e1956ec8-c8a8-4cf7-b49d-958579a28288. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:13.669709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting port 6d7fd082-67a1-4d2a-8722-f2123e5d2acc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:13.670290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.674709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.697121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f0b9ae87-e96d-4584-be28-950eca5cd5bd None None] Provisioning complete for port 32af1864-84e4-446d-85bf-079aa2b5e501 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:13.697571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0b9ae87-e96d-4584-be28-950eca5cd5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.761361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.761918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f0b9ae87-e96d-4584-be28-950eca5cd5bd None None] Port 32af1864-84e4-446d-85bf-079aa2b5e501 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:13.778086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65260616-0171-4cdb-ad86-6b18d5c158bd None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:13.793328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=7ba8b7a4-968d-45a5-b7a9-5e1270034eb0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:13.802078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.821021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Calling delete_port for 6d7fd082-67a1-4d2a-8722-f2123e5d2acc owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:13.830592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:13.834355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:13.882221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port ceb67d9b-4526-49c1-a893-67ccb3277f8e yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:14.053930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.10 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/ceb67d9b-4526-49c1-a893-67ccb3277f8e) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:14.146407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.187045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.217029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Port': ['ID=6d7fd082-67a1-4d2a-8722-f2123e5d2acc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:14.350141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.521748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:45:14.529882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.533862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.535833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.594731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c665d233-427e-4c92-ae65-85c666a0b288 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:14.634588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-80f44dea-4e02-4261-9907-6ea294c66021 None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:14.634958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-80f44dea-4e02-4261-9907-6ea294c66021 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.659060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.674412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.675272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.677873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.679022 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cfd873a1-1ff3-41d0-918e-b7dc8e58a3e4 HTTP/1.1" status: 204 len: 168 time: 1.2613142 Nov 05 14:45:14.696012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:45:14.766605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.767182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router c855435c-4f84-40a7-a80a-24d0dc876dec {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:14.779247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b6a2eb-b3bc-47e9-a1a5-597bf84c5c34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfd873a1-1ff3-41d0-918e-b7dc8e58a3e4,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:14.782907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc48e10a-4eb7-4b06-af99-13e86376e794 req-cfd8627e-46e1-4024-b4d7-c3108d59fba4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:14.784428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc48e10a-4eb7-4b06-af99-13e86376e794 req-cfd8627e-46e1-4024-b4d7-c3108d59fba4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 945 time: 0.1520112 Nov 05 14:45:14.794096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.798845 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5cbe3aed-b02b-4171-9325-75d950e04354 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/c855435c-4f84-40a7-a80a-24d0dc876dec HTTP/1.1" status: 204 len: 168 time: 2.6585650 Nov 05 14:45:14.798845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=385268cd-883b-4725-a415-8ef4476a1604,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:14.802881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39366) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:14.811018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1308981602', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:14.840841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2d0d74d9-94d0-42c7-be73-ebcc957f107f up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:14.853699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.858826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:14.859230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: 73817f48-752a-4b2b-8059-05e744d52c40, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:14.865379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.902619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.916315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b4b87f-cac1-4d12-a34f-c0df053e6862 req-400a8356-588d-459b-9ca4-3ca8d4179f8d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:14.918085 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a4b4b87f-cac1-4d12-a34f-c0df053e6862 req-400a8356-588d-459b-9ca4-3ca8d4179f8d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 945 time: 0.2293017 Nov 05 14:45:14.951879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network 73817f48-752a-4b2b-8059-05e744d52c40 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:14.965301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=ceb67d9b-4526-49c1-a893-67ccb3277f8e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:14.990378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Router a6f2a818-73c2-40a8-8783-f26e2159585c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:14.994240 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc48e10a-4eb7-4b06-af99-13e86376e794 req-cf8779c5-4566-4955-92d2-72ac576314e8 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2007649 Nov 05 14:45:14.995055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:14.996801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.000378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 73817f48-752a-4b2b-8059-05e744d52c40) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:15.016128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:15.016763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.060484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.062221 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a4b4b87f-cac1-4d12-a34f-c0df053e6862 req-dc849189-fd08-40ff-9e3d-ebbd7e7ebac3 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1317434 Nov 05 14:45:15.067785 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e0055524-8bd1-4135-b06a-920507532482 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6498568 Nov 05 14:45:15.069673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Floating IP e4a89932-d04a-4e6c-a958-a534d91ecac8 associated. External IP: 172.26.5.142, port: 0d187a67-1569-490c-ba6b-54e4b6d47353. Nov 05 14:45:15.071754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39370) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:15.078416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'port': {'network_id': '73817f48-752a-4b2b-8059-05e744d52c40', 'name': 'tempest-NetworksIpV6TestAttrs-717053940'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:15.081012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:15.114407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:15.118174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:15.291166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c665d233-427e-4c92-ae65-85c666a0b288 None None] Unable to find a vacant binding_index for network 73817f48-752a-4b2b-8059-05e744d52c40 and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:45:15.300492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 2d0d74d9-94d0-42c7-be73-ebcc957f107f completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:45:15.321071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c665d233-427e-4c92-ae65-85c666a0b288 None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 73817f48-752a-4b2b-8059-05e744d52c40) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:15.321656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:15.334152 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e32b71e-8f67-4d5e-8b72-0e1fdad7a88e tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "PUT /v2.0/routers/a6f2a818-73c2-40a8-8783-f26e2159585c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9143674 Nov 05 14:45:15.336624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.339896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39380) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:15.345449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] Sync routers for ids ['a6f2a818-73c2-40a8-8783-f26e2159585c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:15.352944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 2d0d74d9-94d0-42c7-be73-ebcc957f107f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:15.353335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.372991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:15.380628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.412301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] Routers {'a6f2a818-73c2-40a8-8783-f26e2159585c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:15.412986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a6f2a818-73c2-40a8-8783-f26e2159585c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:15.424451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.431769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:15.432843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.440359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] device_id is not set on port fa7c1cdd-aed7-4166-9a72-10ada71c5474 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:15.474811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:15.508340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Router 04a38fc5-d67e-4be6-a52e-5b36bc22986d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:15.538123 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d8545a06-a81e-4821-a4c1-1d2b7d305364 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.9498556 Nov 05 14:45:15.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] Routers {'a6f2a818-73c2-40a8-8783-f26e2159585c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:15.558937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a6f2a818-73c2-40a8-8783-f26e2159585c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:15.564033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39388) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:15.572973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.4', 'mac_address': 'fa:16:3e:d6:eb:91'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:15.601338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:15.602224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb08ac8c-4d1b-41c7-8929-946ccfbb29c5 None None] The sync data for ids ['a6f2a818-73c2-40a8-8783-f26e2159585c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:15.620667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-80f44dea-4e02-4261-9907-6ea294c66021 None None] Provisioning complete for port 32af1864-84e4-446d-85bf-079aa2b5e501 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:15.621071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-80f44dea-4e02-4261-9907-6ea294c66021 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.660826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-80f44dea-4e02-4261-9907-6ea294c66021 None None] Port 32af1864-84e4-446d-85bf-079aa2b5e501 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:15.693028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:15.703819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.708330 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Sync routers for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:15.721713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:15.722320 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:15.751844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Allocated IP 2001:db8::f816:3eff:feaa:a92a (73817f48-752a-4b2b-8059-05e744d52c40/385268cd-883b-4725-a415-8ef4476a1604/fa7c1cdd-aed7-4166-9a72-10ada71c5474) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:15.759168 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e8a41b33-5f64-435d-92cd-85518e67634a tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "PUT /v2.0/floatingips/e4a89932-d04a-4e6c-a958-a534d91ecac8 HTTP/1.1" status: 200 len: 992 time: 3.3085222 Nov 05 14:45:15.763306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:15.767090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f104ff98-704a-4b4d-9f0b-57add2e95792" -d '{"events": [{"name": "network-changed", "server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:15.811724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.826683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.839283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.850485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d375ed9a-8c36-4b88-b7e7-4d28b7976192 x-openstack-request-id: req-d375ed9a-8c36-4b88-b7e7-4d28b7976192 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:15.851729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:15.853006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d375ed9a-8c36-4b88-b7e7-4d28b7976192 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:15.853592 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'status': 'completed', 'code': 200} Nov 05 14:45:15.899391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-93e1319a-4e08-4152-be35-15aaf0d020a3 None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:15.899759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-93e1319a-4e08-4152-be35-15aaf0d020a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.920847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:15.947670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:15.951708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef258626-794b-45a6-857e-b3590e22ff9c" -d '{"events": [{"server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "name": "network-vif-plugged", "status": "completed", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:16.012022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:16.022418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.026174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.027022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 13d06243-5eeb-4ace-b456-59f332abe92e up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:16.066602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.068029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Fanout notify agent at l3_agent the message router_deleted on router a6f2a818-73c2-40a8-8783-f26e2159585c {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:16.079643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.085363 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18d6325f-4d5b-4a84-b308-294393e96353 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "DELETE /v2.0/routers/a6f2a818-73c2-40a8-8783-f26e2159585c HTTP/1.1" status: 204 len: 168 time: 0.7425816 Nov 05 14:45:16.085769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39408) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:16.104219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-b64c25ca-908a-4a8f-bc1c-cdf33932b511 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.106027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-b64c25ca-908a-4a8f-bc1c-cdf33932b511 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 1099 time: 0.1971433 Nov 05 14:45:16.193646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6e63516-c4f5-4e56-8acf-1a6b3bd62dc2 x-openstack-request-id: req-b6e63516-c4f5-4e56-8acf-1a6b3bd62dc2 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:16.193971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "name": "network-vif-plugged", "status": "completed", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:16.194227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b6e63516-c4f5-4e56-8acf-1a6b3bd62dc2 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:16.194628 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'code': 200} Nov 05 14:45:16.216093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting subnet ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:16.225800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.265068 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:16.283778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:16.289538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.420818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network 73817f48-752a-4b2b-8059-05e744d52c40 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:16.428845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:16.436914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:16.447214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-73817f48-752a-4b2b-8059-05e744d52c40', 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40', 'tenant_id': '5b43437541e445ee9cffdd31db12e7c8', 'fixed_ips': [{'subnet_id': '385268cd-883b-4725-a415-8ef4476a1604'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:16.448648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.451609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.451897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.470534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.502342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 13d06243-5eeb-4ace-b456-59f332abe92e completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:45:16.538348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ac122f-75f8-4149-9f6f-1d270bf477e2 req-d74d727c-fcca-427a-b31a-de3473028eba tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.539891 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e5ac122f-75f8-4149-9f6f-1d270bf477e2 req-d74d727c-fcca-427a-b31a-de3473028eba tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.2863827 Nov 05 14:45:16.566848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Port': ['ID=fa7c1cdd-aed7-4166-9a72-10ada71c5474,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:16.569744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a6532-638f-429b-932e-b39640077169 req-761168db-5c72-45c2-a31a-8ca37ffe0f99 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.572878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b512f9e-c465-4664-977b-565f7631430f req-e5eb5cb0-d3ea-44bc-893b-be0bff5ae422 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.574913 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b512f9e-c465-4664-977b-565f7631430f req-e5eb5cb0-d3ea-44bc-893b-be0bff5ae422 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 1099 time: 0.2756045 Nov 05 14:45:16.588598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 13d06243-5eeb-4ace-b456-59f332abe92e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:16.588966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.593997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa1a6532-638f-429b-932e-b39640077169 req-761168db-5c72-45c2-a31a-8ca37ffe0f99 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 945 time: 0.4139009 Nov 05 14:45:16.640243 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-81bd5c45-291f-4dd2-973d-54da31124414 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 1.5668771 Nov 05 14:45:16.648534 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e5ac122f-75f8-4149-9f6f-1d270bf477e2 req-712807e1-aed3-4967-8926-16b7059e781a tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0849175 Nov 05 14:45:16.656853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39420) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:16.678694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-93e1319a-4e08-4152-be35-15aaf0d020a3 None None] Provisioning complete for port 32af1864-84e4-446d-85bf-079aa2b5e501 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:16.679581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-93e1319a-4e08-4152-be35-15aaf0d020a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.746748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39422) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:16.795458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-35918dc4-ffbd-4090-9404-94d7d8e1f0ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:16.795817 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e4a89932-d04a-4e6c-a958-a534d91ecac8', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'floating_ip_address': '172.26.5.142', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'port_id': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 143, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'mac_address': 'fa:16:3e:f2:dd:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:35Z', 'updated_at': '2021-11-05T14:45:14Z', 'revision_number': 1, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:16.801103 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-35918dc4-ffbd-4090-9404-94d7d8e1f0ce service neutron] 10.222.0.32 "GET /v2.0/networks?id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 200 len: 913 time: 0.6852386 Nov 05 14:45:16.802217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.834532 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Checking router: 04a38fc5-d67e-4be6-a52e-5b36bc22986d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:16.844798 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:16.845754 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:16.851126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-93e1319a-4e08-4152-be35-15aaf0d020a3 None None] Port 32af1864-84e4-446d-85bf-079aa2b5e501 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:16.852648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.870086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Allocated IP 2001:db8::f816:3eff:fec5:ad72 (73817f48-752a-4b2b-8059-05e744d52c40/385268cd-883b-4725-a415-8ef4476a1604/babddbfc-e1e5-43dc-ae83-0f4dce7a662b) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:16.896178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:16.937828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=13d06243-5eeb-4ace-b456-59f332abe92e,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:16.945343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.096978 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:17.240064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.264755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.278488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.312036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-807fd725-ff2b-41b9-ac61-b39461186e27 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1617084731'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:17.312651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-807fd725-ff2b-41b9-ac61-b39461186e27 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Unknown quota resources ['metering_label']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:17.339071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Network 73817f48-752a-4b2b-8059-05e744d52c40 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:17.344486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:17.349157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:17.352604 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa1a6532-638f-429b-932e-b39640077169 req-6eea7b0f-1620-497a-ac52-46b1c5b7578b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7513433 Nov 05 14:45:17.381295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.387435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting subnet 385268cd-883b-4725-a415-8ef4476a1604 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:17.408412 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b512f9e-c465-4664-977b-565f7631430f req-d9881d4d-a73a-4bde-9b24-ead86d12b7f3 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7646003 Nov 05 14:45:17.412709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.420250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.437734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Attempting to bind port babddbfc-e1e5-43dc-ae83-0f4dce7a662b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:17.437963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Attempting to bind port babddbfc-e1e5-43dc-ae83-0f4dce7a662b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:17.438295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Attempting to bind port babddbfc-e1e5-43dc-ae83-0f4dce7a662b on network 73817f48-752a-4b2b-8059-05e744d52c40 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:17.440233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Pushing event updated for resources: {'Port': ['ID=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.453170 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e4a89932-d04a-4e6c-a958-a534d91ecac8', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'floating_ip_address': '172.26.5.142', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'port_id': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 143, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'mac_address': 'fa:16:3e:f2:dd:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:35Z', 'updated_at': '2021-11-05T14:45:14Z', 'revision_number': 1, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:17.461384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:17.461880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Checking segment: {'id': '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:17.462466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.462961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Bound using segment: {'id': '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:17.463624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Bound port: babddbfc-e1e5-43dc-ae83-0f4dce7a662b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '73817f48-752a-4b2b-8059-05e744d52c40'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:17.464129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.466877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.474584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.479554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Provisioning complete for port ceb67d9b-4526-49c1-a893-67ccb3277f8e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:17.480784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.501209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fc2091-a793-4a5d-ab14-bfd36761f9a5 None None] The sync data for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv is: [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e4a89932-d04a-4e6c-a958-a534d91ecac8', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'floating_ip_address': '172.26.5.142', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'port_id': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 143, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'mac_address': 'fa:16:3e:f2:dd:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:35Z', 'updated_at': '2021-11-05T14:45:14Z', 'revision_number': 1, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:17.529259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.550258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.553125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Port ceb67d9b-4526-49c1-a893-67ccb3277f8e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:17.554614 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "DELETE /v2.0/subnets/ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03 HTTP/1.1" status: 204 len: 168 time: 1.4670095 Nov 05 14:45:17.559744 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-77b42e54-7f36-441f-ac5d-1817ae5cf783 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 200 len: 1000 time: 0.7484026 Nov 05 14:45:17.567460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39430) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:17.587287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:17.587648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.604101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96bcd97-6315-494b-8ab8-fd88eba15a3c tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Subnet': ['ID=ca9a7f7f-b6e9-4da1-acfd-0b369ac04f03,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.628438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] For port babddbfc-e1e5-43dc-ae83-0f4dce7a662b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:17.646253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] For port babddbfc-e1e5-43dc-ae83-0f4dce7a662b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,segment=NetworkSegment(2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc),segment_id=2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:17.654909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.673352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.782063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7323d3-c301-4eb8-9b18-880eefe41ba3 None None] Pushing event updated for resources: {'Port': ['ID=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.784188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.798626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-6dfdb21d-4458-4920-b872-d3ac0161acd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:17.800497 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-6dfdb21d-4458-4920-b872-d3ac0161acd3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=40981c52-1a1c-434c-b98f-d3a05d50d8a6 HTTP/1.1" status: 200 len: 851 time: 0.0696166 Nov 05 14:45:17.809872 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Provisioning complete for port 32af1864-84e4-446d-85bf-079aa2b5e501 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:17.810356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.856784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=385268cd-883b-4725-a415-8ef4476a1604,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.861838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.866107 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a7e578f-305b-4bf9-9c84-aa83002a25a0 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/385268cd-883b-4725-a415-8ef4476a1604 HTTP/1.1" status: 204 len: 168 time: 1.2084444 Nov 05 14:45:17.871671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39434) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:17.878181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-57fdb1fe-176a-4d24-84d5-5ae63010b2aa None None] Port 32af1864-84e4-446d-85bf-079aa2b5e501 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:17.884193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c2d1575-2d31-41c3-bfab-582bda981b81 None None] New status for floating IP e4a89932-d04a-4e6c-a958-a534d91ecac8: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:45:17.907293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.26.5.15 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/cc93ff32-e8e6-47cb-bc17-92f7290a5d5d) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:17.927985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-807fd725-ff2b-41b9-ac61-b39461186e27 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:17.929624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac96010f-296c-4091-ac66-4d1d75748cb1 req-77c48c7f-c9de-45d4-a0b7-caa94ee94687 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:17.932000 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-807fd725-ff2b-41b9-ac61-b39461186e27 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 1.1783440 Nov 05 14:45:17.937085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39436) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:17.937253 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ac96010f-296c-4091-ac66-4d1d75748cb1 req-77c48c7f-c9de-45d4-a0b7-caa94ee94687 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.1826394 Nov 05 14:45:17.954427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a847bcaf-4179-4779-a127-16edd3ba46a9 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': 'ae4fb9c3-7b2a-4d1d-b965-0b7f13cdb893'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:17.955698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a847bcaf-4179-4779-a127-16edd3ba46a9 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:17.966544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=ceb67d9b-4526-49c1-a893-67ccb3277f8e,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:17.972362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23fd53d1-2570-4c96-81bf-032acdaf53d1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:17.973906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23fd53d1-2570-4c96-81bf-032acdaf53d1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:17.975555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23fd53d1-2570-4c96-81bf-032acdaf53d1 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1027608 Nov 05 14:45:17.984516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39438) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.025552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] In _notify_port_updated(), no bound segment for port ceb67d9b-4526-49c1-a893-67ccb3277f8e on network 0d191e95-5fd7-4348-b056-51734fb90a4e {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:45:18.034146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:18.034806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.036576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9bccea13-36ab-480d-8c70-fc70fae95651 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "PUT /v2.0/ports/ceb67d9b-4526-49c1-a893-67ccb3277f8e HTTP/1.1" status: 200 len: 993 time: 2.4675338 Nov 05 14:45:18.047377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39440) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.073601 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ac96010f-296c-4091-ac66-4d1d75748cb1 req-b65d4922-8457-466c-8b8e-adc56d711e91 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1355457 Nov 05 14:45:18.124288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-de6e1593-118c-432b-8bae-999ffdd0d299 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.139360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-de6e1593-118c-432b-8bae-999ffdd0d299 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 05 14:45:18.140329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de6e1593-118c-432b-8bae-999ffdd0d299 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:18.144730 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-de6e1593-118c-432b-8bae-999ffdd0d299 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/73817f48-752a-4b2b-8059-05e744d52c40 HTTP/1.1" status: 409 len: 405 time: 0.1591663 Nov 05 14:45:18.151097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39442) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.158043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1202462685'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:18.191230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:18.195378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.224957 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.services.metering.metering_plugin [None req-a847bcaf-4179-4779-a127-16edd3ba46a9 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 05 14:45:18.236162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 643} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:18.241065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:18.243319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5667511-31b4-44bb-8f79-692bc259745c" -d '{"events": [{"server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "name": "network-vif-plugged", "status": "completed", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:18.253743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.254416 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment 00fe19ba-37fa-428b-abec-deb40130c6ad of type vlan for network d4751683-2627-4f86-86dc-fbf718cea1dc Nov 05 14:45:18.262229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.320379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.327004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54ccf791-f3bf-405b-a009-d670fc8cca20 x-openstack-request-id: req-54ccf791-f3bf-405b-a009-d670fc8cca20 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:18.327619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "name": "network-vif-plugged", "status": "completed", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:18.327818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-54ccf791-f3bf-405b-a009-d670fc8cca20 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:18.328373 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e', 'code': 200} Nov 05 14:45:18.333691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.358635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-6fd4826a-dbe4-43e1-840f-f5fb97efe50b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:18.360269 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-6fd4826a-dbe4-43e1-840f-f5fb97efe50b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4546127 Nov 05 14:45:18.377882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.386239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:18.387872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.422830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a847bcaf-4179-4779-a127-16edd3ba46a9 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.428676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a847bcaf-4179-4779-a127-16edd3ba46a9 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.4807003 Nov 05 14:45:18.430861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39450) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.445915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d8cb1542-4597-4a1e-bd09-3d5c8c2bd569 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': 'ae4fb9c3-7b2a-4d1d-b965-0b7f13cdb893'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:18.446748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d8cb1542-4597-4a1e-bd09-3d5c8c2bd569 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=113580) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:18.511937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.3558145 Nov 05 14:45:18.526727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39452) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.544094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': 'd4751683-2627-4f86-86dc-fbf718cea1dc', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:18.664633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=d4751683-2627-4f86-86dc-fbf718cea1dc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:18.666782 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.services.metering.metering_plugin [None req-d8cb1542-4597-4a1e-bd09-3d5c8c2bd569 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Nov 05 14:45:18.674091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.679480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port ceb67d9b-4526-49c1-a893-67ccb3277f8e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:18.679814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.693673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018186a8-bf77-40d3-8dd2-83cc4710a123 req-47f09354-18cb-4c59-abee-5d38c597a240 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:18.695963 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-018186a8-bf77-40d3-8dd2-83cc4710a123 req-47f09354-18cb-4c59-abee-5d38c597a240 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2083557 Nov 05 14:45:18.703666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.704022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.704364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.704735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.705069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.705400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.705731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.706063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.706390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.706708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.708177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.708177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4281112-ce44-4944-91ce-781dcff40b91 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:18.722410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d4751683-2627-4f86-86dc-fbf718cea1dc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:18.762511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:18.765939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.774309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69fb78af-8a99-4e85-8e34-4fa276364bf2 req-b4455f36-e60b-40cb-a63e-56f086800765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:18.775823 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-69fb78af-8a99-4e85-8e34-4fa276364bf2 req-b4455f36-e60b-40cb-a63e-56f086800765 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.2110856 Nov 05 14:45:18.838074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8cb1542-4597-4a1e-bd09-3d5c8c2bd569 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:18.840449 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d8cb1542-4597-4a1e-bd09-3d5c8c2bd569 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.3988841 Nov 05 14:45:18.844740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39454) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.851667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-b9c24ca7-d1f9-44d2-bd68-927aeb60857b service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4341619 Nov 05 14:45:18.901541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-36160c13-063a-4e78-a66d-92e441d7d08c tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=f25dc29e-bd41-4f4e-b8dd-282fccfa803b HTTP/1.1" status: 200 len: 464 time: 0.0487311 Nov 05 14:45:18.905714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-69fb78af-8a99-4e85-8e34-4fa276364bf2 req-d76b0665-2c2e-45f5-9983-e09980045669 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1182392 Nov 05 14:45:18.912328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39456) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:18.925982 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-018186a8-bf77-40d3-8dd2-83cc4710a123 req-d388734d-d47a-423e-ade6-da7744a65298 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2151649 Nov 05 14:45:18.944491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Deleting port bcffe010-15d0-4080-b8eb-0b2809b3cd7e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:18.945024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.013596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.030902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91e894b0-98a1-45aa-bd82-1d98c4bfd049 None None] Network 73817f48-752a-4b2b-8059-05e744d52c40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:19.041008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.057624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for ceb67d9b-4526-49c1-a893-67ccb3277f8e owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:19.076202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-13a102a2-3456-4d95-850e-3e11102ab5ff tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.077962 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-13a102a2-3456-4d95-850e-3e11102ab5ff tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-label-rules/f25dc29e-bd41-4f4e-b8dd-282fccfa803b HTTP/1.1" status: 204 len: 168 time: 0.1646543 Nov 05 14:45:19.087757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39458) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.128562 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-04659813-8856-41c8-bb05-c32614939a40 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=f25dc29e-bd41-4f4e-b8dd-282fccfa803b HTTP/1.1" status: 200 len: 221 time: 0.0388491 Nov 05 14:45:19.138748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39462) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.142882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-50e089ae-33c4-44de-9c49-cfa137aab1f8 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--836578968', 'description': 'label created by tempest'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:19.143577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-50e089ae-33c4-44de-9c49-cfa137aab1f8 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Unknown quota resources ['metering_label']. {{(pid=113581) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Nov 05 14:45:19.171495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:19.222461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Provisioning complete for port ceb67d9b-4526-49c1-a893-67ccb3277f8e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:19.223259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.243786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:19.251090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:19.255740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] For port bcffe010-15d0-4080-b8eb-0b2809b3cd7e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,segment=NetworkSegment(fb41554e-4f67-4861-9fb0-f63c955cfbd9),segment_id=fb41554e-4f67-4861-9fb0-f63c955cfbd9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:19.256363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.270153 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f104ff98-704a-4b4d-9f0b-57add2e95792 req-1ea63269-42e1-449b-95be-dacc6ba97f6b service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3982570 Nov 05 14:45:19.301917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Calling delete_port for bcffe010-15d0-4080-b8eb-0b2809b3cd7e owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:19.310823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Port ceb67d9b-4526-49c1-a893-67ccb3277f8e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:19.316284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device babddbfc-e1e5-43dc-ae83-0f4dce7a662b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:19.383450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Provisioning complete for port 75ec3e84-9dc0-4fc0-97fd-465feb912559 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:19.383803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.457489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbcaa0cf-ce40-4ef8-aed0-ebabadf2803a None None] Network 73817f48-752a-4b2b-8059-05e744d52c40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:19.463249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27460a87-b33b-4e86-ace9-c628ec4c8fa2 None None] Network a86c0d03-9a76-4e86-b54e-4effb464c4ed requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:19.482777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-50e089ae-33c4-44de-9c49-cfa137aab1f8 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.489574 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-50e089ae-33c4-44de-9c49-cfa137aab1f8 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.3476229 Nov 05 14:45:19.493159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39466) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.499761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:19.516798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.517141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.517472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.517802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.518122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.518446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.518766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.519082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.519399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.519713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.520029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.520401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:19.534768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.574746 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-40d6910a-73c4-4369-9c6e-dd6db778e2f6 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=8e8a72b8-3118-483d-868a-7976207a53f9 HTTP/1.1" status: 200 len: 467 time: 0.0755484 Nov 05 14:45:19.575290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.609897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port babddbfc-e1e5-43dc-ae83-0f4dce7a662b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:19.610288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.613604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Port': ['ID=bcffe010-15d0-4080-b8eb-0b2809b3cd7e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:19.619296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] No DVR routers for this DVR port bcffe010-15d0-4080-b8eb-0b2809b3cd7e on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:19.659187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:45:19.666818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.723113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.747682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a86c0d03-9a76-4e86-b54e-4effb464c4ed']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:19.749998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Provisioning complete for port babddbfc-e1e5-43dc-ae83-0f4dce7a662b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:19.750438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.766331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb41554e-4f67-4861-9fb0-f63c955cfbd9') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:19.766695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb41554e-4f67-4861-9fb0-f63c955cfbd9') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:19.777526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.810939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-767d4999-c05b-41e0-be54-63b37623d94d None None] DHCP port deletion for a86c0d03-9a76-4e86-b54e-4effb464c4ed request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:19.840727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.846708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=65743a36-7db8-4a8b-abc3-6aae6168fcbf,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:19.856025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88558a8a-13cc-4f8a-8fec-b3caa918ac8c req-f39b9ad4-eccd-46c2-9bd6-0350ef073fee tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:19.857806 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88558a8a-13cc-4f8a-8fec-b3caa918ac8c req-f39b9ad4-eccd-46c2-9bd6-0350ef073fee tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.6167278 Nov 05 14:45:19.858157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c877316-c7eb-46c9-9a70-f5251abbc78a tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.859388 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0c877316-c7eb-46c9-9a70-f5251abbc78a tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-labels/8e8a72b8-3118-483d-868a-7976207a53f9 HTTP/1.1" status: 204 len: 168 time: 0.2833345 Nov 05 14:45:19.862093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39470) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.866596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] DHCP port deletion for 73817f48-752a-4b2b-8059-05e744d52c40 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:19.879926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.897742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f69fccbb-abf3-48f6-8671-fab6a3a983ee tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=8e8a72b8-3118-483d-868a-7976207a53f9 HTTP/1.1" status: 200 len: 216 time: 0.0344360 Nov 05 14:45:19.901661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39472) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.909078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Releasing vlan 600 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:19.909616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:19.912732 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:19.925247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': '00fe19ba-37fa-428b-abec-deb40130c6ad', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': 'd4751683-2627-4f86-86dc-fbf718cea1dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:19.925615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: d4751683-2627-4f86-86dc-fbf718cea1dc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:19.930996 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-65ed824f-0f6f-4fa2-b9ea-d010fe6a4257 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0225043 Nov 05 14:45:19.937796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39474) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.946070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port babddbfc-e1e5-43dc-ae83-0f4dce7a662b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,segment=NetworkSegment(2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc),segment_id=2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:19.957284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:19.959266 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55d82297-b515-42b1-a94c-df0b10d18f49 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0204337 Nov 05 14:45:19.965150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39478) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:19.971040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network d4751683-2627-4f86-86dc-fbf718cea1dc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:19.984065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d4751683-2627-4f86-86dc-fbf718cea1dc) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:19.988688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:19.989468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.019672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.048081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa12b44f-33c5-4f0a-b7b0-75ec6ad2427b None None] Network d4751683-2627-4f86-86dc-fbf718cea1dc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:20.057142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-34822121-00a0-42bb-9da4-6d01872e6794 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-labels/ae4fb9c3-7b2a-4d1d-b965-0b7f13cdb893 HTTP/1.1" status: 200 len: 473 time: 0.0907080 Nov 05 14:45:20.063422 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ba8e0b89-7406-4a31-b7aa-4c52ad7a2ed5 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 1.5348425 Nov 05 14:45:20.066182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39480) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:20.066715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39482) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:20.103213 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8f94009c-4bda-4ac9-b0f8-091166513675 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "GET /v2.0/metering/metering-label-rules/717d1509-c23a-431e-8a0b-e0ead942bc67 HTTP/1.1" status: 200 len: 461 time: 0.0209866 Nov 05 14:45:20.126644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39484) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:20.169568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb8cfe1a-95ee-418c-a7cf-7a94561df869 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.216326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:20.221928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db94bb4f-7d7b-46f7-8342-3f78a63594fb req-88717fd3-cbae-4cac-8c3f-3914919e01d2 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:20.223491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-db94bb4f-7d7b-46f7-8342-3f78a63594fb req-88717fd3-cbae-4cac-8c3f-3914919e01d2 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1555560 Nov 05 14:45:20.233223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Deleting port babddbfc-e1e5-43dc-ae83-0f4dce7a662b {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:20.233601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.254817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.255178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.255507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.255841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.256174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.256528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.256862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.257209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.257540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.257863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.258186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.258506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-aa12b44f-33c5-4f0a-b7b0-75ec6ad2427b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:20.289680 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:20.300974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:45:20.301255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:45:20.307121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0d9ff3c-9ff3-4846-92e8-ecad4822045e None None] Network d4751683-2627-4f86-86dc-fbf718cea1dc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:20.333025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.340184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d14698f-9233-480a-8f0a-835a7590b3b6 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.343663 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7d14698f-9233-480a-8f0a-835a7590b3b6 tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-label-rules/717d1509-c23a-431e-8a0b-e0ead942bc67 HTTP/1.1" status: 204 len: 168 time: 0.2137172 Nov 05 14:45:20.345575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39486) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:20.369018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] For port babddbfc-e1e5-43dc-ae83-0f4dce7a662b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,segment=NetworkSegment(2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc),segment_id=2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:20.369419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.387271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Calling delete_port for babddbfc-e1e5-43dc-ae83-0f4dce7a662b owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:20.426095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.440332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88558a8a-13cc-4f8a-8fec-b3caa918ac8c req-66dfb550-a701-4f4a-b689-b4ec2188a4ff tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5532341 Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f0d9ff3c-9ff3-4846-92e8-ecad4822045e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:20.454536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:20.460692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-db94bb4f-7d7b-46f7-8342-3f78a63594fb req-fec34005-e96b-4973-8ed5-01f753dd0d55 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2207534 Nov 05 14:45:20.477860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.484915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] 10.222.0.30 "DELETE /v2.0/networks/a86c0d03-9a76-4e86-b54e-4effb464c4ed HTTP/1.1" status: 204 len: 168 time: 2.9164703 Nov 05 14:45:20.517053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.586140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d129c29-715e-4de1-84e0-900b2ce6a690 tempest-FloatingIPNegativeTestJSON-959351680 tempest-FloatingIPNegativeTestJSON-959351680-project] Pushing event deleted for resources: {'Network': ['ID=a86c0d03-9a76-4e86-b54e-4effb464c4ed,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:20.587364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] Pushing event deleted for resources: {'Port': ['ID=babddbfc-e1e5-43dc-ae83-0f4dce7a662b,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:20.606858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e73398-450e-4969-85c4-78f7b94436a1 None None] No DVR routers for this DVR port babddbfc-e1e5-43dc-ae83-0f4dce7a662b on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:20.614655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.620045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.640261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.657498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dac1af33-105f-4c9f-8293-a082a6f0e124 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:20.713237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=ceb67d9b-4526-49c1-a893-67ccb3277f8e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:20.718494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d85c0a-5b5f-4fc0-9a0a-fa9048cca5cb tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.721904 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-34d85c0a-5b5f-4fc0-9a0a-fa9048cca5cb tempest-MeteringTestJSON-996046637 tempest-MeteringTestJSON-996046637-project-admin] 10.222.0.30 "DELETE /v2.0/metering/metering-labels/ae4fb9c3-7b2a-4d1d-b965-0b7f13cdb893 HTTP/1.1" status: 204 len: 168 time: 0.3739715 Nov 05 14:45:20.758847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03bf6a3-ebaa-479c-aea2-25c86a4d4842 req-fa82d48f-fbbc-4e96-8843-2464923e4081 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:20.760568 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c03bf6a3-ebaa-479c-aea2-25c86a4d4842 req-fa82d48f-fbbc-4e96-8843-2464923e4081 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.1668732 Nov 05 14:45:20.776186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39496) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:20.781151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Request body: {'floatingip': {'port_id': '2d0d74d9-94d0-42c7-be73-ebcc957f107f'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:20.833579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Port babddbfc-e1e5-43dc-ae83-0f4dce7a662b update to ACTIVE by agent not found {{(pid=113582) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 05 14:45:20.855595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dac1af33-105f-4c9f-8293-a082a6f0e124 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:20.861451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Provisioning complete for port 32af1864-84e4-446d-85bf-079aa2b5e501 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:20.861854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.887176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.895277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:20.954584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-930df112-73b7-4473-acd3-004847ca5aed None None] Port 32af1864-84e4-446d-85bf-079aa2b5e501 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:20.987856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.000092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.003942 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5487ccf1-734e-47bf-bb62-fabd2527ad1a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/ceb67d9b-4526-49c1-a893-67ccb3277f8e HTTP/1.1" status: 204 len: 168 time: 2.9537535 Nov 05 14:45:21.007045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39506) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.052400 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-5b6c1d85-8a56-46f4-8fdb-7ee9cbe161f3 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] GET failed (client error): The resource could not be found. Nov 05 14:45:21.054249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b6c1d85-8a56-46f4-8fdb-7ee9cbe161f3 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports/ceb67d9b-4526-49c1-a893-67ccb3277f8e HTTP/1.1" status: 404 len: 333 time: 0.0462341 Nov 05 14:45:21.066878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39508) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.076967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-504767021'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:21.080248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39510) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.161248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a716d6cc-a574-4a11-9d9b-02c43ebcc15d None None] Could not find standard attr ID for object ceb67d9b-4526-49c1-a893-67ccb3277f8e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:21.209357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device babddbfc-e1e5-43dc-ae83-0f4dce7a662b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:21.214066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.243315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: babddbfc-e1e5-43dc-ae83-0f4dce7a662b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:21.243658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device babddbfc-e1e5-43dc-ae83-0f4dce7a662b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:21.244076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bcffe010-15d0-4080-b8eb-0b2809b3cd7e no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:21.268224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: bcffe010-15d0-4080-b8eb-0b2809b3cd7e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:21.268595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bcffe010-15d0-4080-b8eb-0b2809b3cd7e not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:21.379870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5022aed-3a58-4922-84fd-0a9b9efea8a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.386089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5d4f37c-1d99-4447-9751-6b11e1d5623c None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:21.413264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:21.416684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.439544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=65743a36-7db8-4a8b-abc3-6aae6168fcbf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:21.466756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.469812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-583fc06b-3392-425f-adbe-d49c153d2eea admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6153fb48842c46b2b0fdaee6d13f5997&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4767632 Nov 05 14:45:21.470781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39514) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.473483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port 9464c173-4e4c-46fd-ab08-81c095d35562 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:21.546114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d4751683-2627-4f86-86dc-fbf718cea1dc']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:21.569521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00fe19ba-37fa-428b-abec-deb40130c6ad') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:21.570115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00fe19ba-37fa-428b-abec-deb40130c6ad') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:21.598042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.627735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:21.654096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.671109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 643 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:21.671519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:21.676320 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:21.695381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5022aed-3a58-4922-84fd-0a9b9efea8a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.707787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.7 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/9464c173-4e4c-46fd-ab08-81c095d35562) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:21.711107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5d4f37c-1d99-4447-9751-6b11e1d5623c None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:21.716769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.739720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5022aed-3a58-4922-84fd-0a9b9efea8a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.771957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c39e87c-43ab-4299-a50f-30b55229c872 req-ecbf635b-3bf1-4a70-91ac-ac95462b5549 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:21.773498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3c39e87c-43ab-4299-a50f-30b55229c872 req-ecbf635b-3bf1-4a70-91ac-ac95462b5549 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1934671 Nov 05 14:45:21.790945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.809117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.833557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d5022aed-3a58-4922-84fd-0a9b9efea8a9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c62133d89bde4cebb6c2deb911617ea4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7497694 Nov 05 14:45:21.858965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:21.865893 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/d4751683-2627-4f86-86dc-fbf718cea1dc HTTP/1.1" status: 204 len: 168 time: 1.7783625 Nov 05 14:45:21.868941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39520) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.869282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39522) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:21.885669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1215042250'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:21.888683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5022aed-3a58-4922-84fd-0a9b9efea8a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff52938a-8e2f-4cea-9e0f-86dc55e02394,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:21.898968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ce827d-ddeb-4641-bd6b-5b74db5a7d0b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=d4751683-2627-4f86-86dc-fbf718cea1dc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:22.010200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.013362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.017701 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/db324925-669d-456a-8b16-49cf79925111 HTTP/1.1" status: 204 len: 168 time: 0.5427299 Nov 05 14:45:22.027791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:22.031251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.034836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d71df4a-6529-4046-b06a-17f56edd8b1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db324925-669d-456a-8b16-49cf79925111,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:22.041222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:22.053859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3c39e87c-43ab-4299-a50f-30b55229c872 req-8e02ddbf-4be1-42fa-8d3b-3015f9981f8b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2587745 Nov 05 14:45:22.063321 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Sync routers for ids ['d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:22.102281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.106745 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b8b54df-1217-436e-8ec4-d65bd97ecf74 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 7.3009808 Nov 05 14:45:22.113565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39526) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:22.114831 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Routers {'d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:22.115475 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:44:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:22.125666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 631} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:22.131319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.159403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.159743 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment 4c38b193-dfcd-4dca-8a38-6d70bb7cc8d8 of type vlan for network c4b690b0-0945-4977-bf09-6a746f744547 Nov 05 14:45:22.188790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.195871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.261183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.276173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:45:22.307659 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Set router d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:22.330604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.389947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e594d09d-5379-4e62-a236-5db2fd435a53 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.392503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.396164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.402021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:22.402662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.404540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1b8467-d44a-4233-839b-7e8831fdce50 req-1c128575-0d7e-4757-86b9-ce46bffb0383 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:22.410511 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1e1b8467-d44a-4233-839b-7e8831fdce50 req-1c128575-0d7e-4757-86b9-ce46bffb0383 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1788263 Nov 05 14:45:22.415142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cb389558-a56a-4bfc-bfb7-12db0f2c779c tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa HTTP/1.1" status: 200 len: 908 time: 0.2981648 Nov 05 14:45:22.415900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39532) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:22.421824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Request body: {'floatingip': {'port_id': '13d06243-5eeb-4ace-b456-59f332abe92e'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:22.424573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.426147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:22.438044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.440588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.441701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ff52938a-8e2f-4cea-9e0f-86dc55e02394 HTTP/1.1" status: 204 len: 168 time: 0.5689847 Nov 05 14:45:22.526190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1308981602', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': True}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:22.569503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:22.576229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.7022910 Nov 05 14:45:22.577654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f32647fa-6068-468e-94c0-c0e26102286d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff52938a-8e2f-4cea-9e0f-86dc55e02394,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:22.579461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39544) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:22.596826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': 'c4b690b0-0945-4977-bf09-6a746f744547', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:22.600672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:22.610177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:22.629146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=9464c173-4e4c-46fd-ab08-81c095d35562,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:22.680929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-442b0183-c0cb-42e5-8530-098dbb1cd4dc tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=c4b690b0-0945-4977-bf09-6a746f744547,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:22.702576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network c4b690b0-0945-4977-bf09-6a746f744547 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:22.723856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.735365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:22.736030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.766018 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15'}], 'enable_snat': False}, 'gw_port_id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:15Z', 'updated_at': '2021-11-05T14:45:20Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9b:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 263, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:17Z', 'updated_at': '2021-11-05T14:45:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:22.847089 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Checking router: d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:22.847447 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Updating router d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:45:22.901667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a2f3db74-38f4-4e9e-974e-a5df5384bf97 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.8280442 Nov 05 14:45:22.903033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39550) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:22.914387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:d6:eb:91'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:22.932793 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.956136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.957238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:22.989536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:23.005449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.075930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.220220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39554) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:23.232998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.275204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f96c64d9-6ea0-4615-a642-55b97ab92ce0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.351308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.420313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=1b0618f1-3601-4486-95e3-caa653e40e0b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:23.446756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': '4c38b193-dfcd-4dca-8a38-6d70bb7cc8d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': 'c4b690b0-0945-4977-bf09-6a746f744547'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:23.447430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: c4b690b0-0945-4977-bf09-6a746f744547, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:23.513822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.530035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.542599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network c4b690b0-0945-4977-bf09-6a746f744547 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:23.563566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.578468 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.585870 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.623727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, c4b690b0-0945-4977-bf09-6a746f744547) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:23.628078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f96c64d9-6ea0-4615-a642-55b97ab92ce0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.634463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f9e0b2f-ff9f-4323-8392-4d15a8e1bf36 None None] Network c4b690b0-0945-4977-bf09-6a746f744547 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:23.639855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:23.640296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.645509 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Floating IP e20e306b-6add-4c1d-90d2-15473667deca associated. External IP: 172.26.5.113, port: 2d0d74d9-94d0-42c7-be73-ebcc957f107f. Nov 05 14:45:23.649024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f96c64d9-6ea0-4615-a642-55b97ab92ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.667688 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Pushing event updated for resources: {'Port': ['ID=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:23.678165 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.678514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.678850 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.679404 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.679732 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.680059 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.680381 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.680793 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.681257 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.681731 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.682061 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.682462 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:45:23.689857 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39564) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:23.712451 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Attempting to bind port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:23.712849 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Attempting to bind port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:23.713207 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Attempting to bind port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:23.719708 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 44, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:23.720193 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:23.720669 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.721054 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:23.721512 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Bound port: cc93ff32-e8e6-47cb-bc17-92f7290a5d5d, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:23.722036 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.759991 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-51a02dff-22f5-41c3-aa99-af18aa10c100 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1737039 Nov 05 14:45:23.769321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39568) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1f9e0b2f-ff9f-4323-8392-4d15a8e1bf36 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:23.770813 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:23.781409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-718bbbe3-6cfa-47b5-824f-43c25a377ee5 None None] Network c4b690b0-0945-4977-bf09-6a746f744547 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:23.782733 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f96c64d9-6ea0-4615-a642-55b97ab92ce0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bd76fc6badcb47a086bbbe39720993a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5578823 Nov 05 14:45:23.788298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96c64d9-6ea0-4615-a642-55b97ab92ce0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe025792-9100-4f68-9a0c-3b5e1f7cce5b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:23.790596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39570) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:23.865127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] For port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:23.869439 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] For port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:23.879795 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-718bbbe3-6cfa-47b5-824f-43c25a377ee5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:23.942260 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:23.981968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1617946542'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:23.991515 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Routers {'d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:23.992141 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:24.068621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.086401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:24.092803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.120669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.129657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.140584 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75985a71-ee24-4e75-94f9-e9a4119750d2 None None] Pushing event updated for resources: {'Port': ['ID=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:24.187698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.220915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] Set router d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:24.280552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.284589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.285935 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fe025792-9100-4f68-9a0c-3b5e1f7cce5b HTTP/1.1" status: 204 len: 168 time: 0.4825704 Nov 05 14:45:24.309374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.371397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.384483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.413151 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Floating IP 1d474aed-25dd-44fe-aa9b-abe75b9570eb associated. External IP: 172.26.5.23, port: 13d06243-5eeb-4ace-b456-59f332abe92e. Nov 05 14:45:24.441728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.463301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500b0246-d10e-4d73-84aa-f72d8f3798b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe025792-9100-4f68-9a0c-3b5e1f7cce5b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:24.550848 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15'}], 'enable_snat': False}, 'gw_port_id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:15Z', 'updated_at': '2021-11-05T14:45:20Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9b:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 263, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:17Z', 'updated_at': '2021-11-05T14:45:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:24.584652 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b155727e-acd4-4e1a-869a-fd2218c9904f None None] The sync data for ids ['d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15'}], 'enable_snat': False}, 'gw_port_id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:15Z', 'updated_at': '2021-11-05T14:45:20Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'cc93ff32-e8e6-47cb-bc17-92f7290a5d5d', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:9b:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 263, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.15', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:17Z', 'updated_at': '2021-11-05T14:45:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:24.607313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=9464c173-4e4c-46fd-ab08-81c095d35562,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:24.642069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] In _notify_port_updated(), no bound segment for port 9464c173-4e4c-46fd-ab08-81c095d35562 on network 0d191e95-5fd7-4348-b056-51734fb90a4e {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:45:24.647859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:24.648661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.652494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d682da3b-5798-4c73-9e9e-b48dc2a89599 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "PUT /v2.0/ports/9464c173-4e4c-46fd-ab08-81c095d35562 HTTP/1.1" status: 200 len: 995 time: 1.7467012 Nov 05 14:45:24.657035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39580) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:24.703761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.765320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=1b0618f1-3601-4486-95e3-caa653e40e0b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:24.765486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:24.783818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.818700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.843136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.863991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:24.891615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 625} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:25.199811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Router 51c9704a-323f-4947-9153-8af2348f332c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:25.209388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.243370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.254159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:25.262166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.265794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Sync routers for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:25.294018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:25.295137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:25.299354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc93ff32-e8e6-47cb-bc17-92f7290a5d5d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:25.322918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c4b690b0-0945-4977-bf09-6a746f744547']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:25.339052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.339857 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment e1e6022b-2d0c-4deb-90db-cc726ac76c14 of type vlan for network e4e7ee94-7b77-41bd-be61-713ba68086da Nov 05 14:45:25.350065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c38b193-dfcd-4dca-8a38-6d70bb7cc8d8') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:25.350349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c38b193-dfcd-4dca-8a38-6d70bb7cc8d8') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:25.359836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f6f3c741-3496-4ab9-b584-938513edf569,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:25.392624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.429389 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b0ff892a-caab-4803-b5bf-13b71950b6ad tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "PUT /v2.0/floatingips/e20e306b-6add-4c1d-90d2-15473667deca HTTP/1.1" status: 200 len: 992 time: 4.6518278 Nov 05 14:45:25.451682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:25.461991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59b100fb-8448-42d8-81aa-549587297f06" -d '{"events": [{"name": "network-changed", "server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:25.491590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port 9464c173-4e4c-46fd-ab08-81c095d35562 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:25.492861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.526184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.530091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.615069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-480ba34e-3c6c-45b8-a081-b2268acb3694 x-openstack-request-id: req-480ba34e-3c6c-45b8-a081-b2268acb3694 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:25.615691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:25.616342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-480ba34e-3c6c-45b8-a081-b2268acb3694 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:25.617125 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'status': 'completed', 'code': 200} Nov 05 14:45:25.639270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:25.663774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.26.5.228 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/f17f9172-8c78-4ebb-a28a-b5e015ff0201) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:25.669367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:25.680756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.681697 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Sync routers for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:25.689723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 631 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:25.690702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.693915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:25.694526 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:25.702478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:25.702849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.741429 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-139d5027-c599-4be0-b18e-5dd8595caad4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "PUT /v2.0/floatingips/1d474aed-25dd-44fe-aa9b-abe75b9570eb HTTP/1.1" status: 200 len: 991 time: 3.3193166 Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:25.759357 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:25.891040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.resource_extend [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] It took 0.24 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:45:25.939577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.983445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.989458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:25.990271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:25.991527 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:26.019267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.028961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.032157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b100fb-8448-42d8-81aa-549587297f06 req-082e9aca-33a1-4077-bce6-e2b3e806920a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:26.034769 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-082e9aca-33a1-4077-bce6-e2b3e806920a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=3cb2c9da66364ac18972da6a46b083c1&device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 1099 time: 0.4252779 Nov 05 14:45:26.070726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.075567 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/c4b690b0-0945-4977-bf09-6a746f744547 HTTP/1.1" status: 204 len: 168 time: 2.3040359 Nov 05 14:45:26.086109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:26.106955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1816371331'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:26.123141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.154902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:26.181095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:26.183885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:26.230582 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 2.5064826 Nov 05 14:45:26.233866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39618) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:26.239468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=f17f9172-8c78-4ebb-a28a-b5e015ff0201,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:26.241970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for 9464c173-4e4c-46fd-ab08-81c095d35562 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:26.243808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cc30bb-50cb-4f61-9fc3-ed1026303333 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=e4e7ee94-7b77-41bd-be61-713ba68086da,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:26.249219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-321114839'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:26.249394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63c4593d-8d1d-47aa-a1d8-e8ff69b8a32b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:26.269238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:26.272985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.289221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9071f100-6f56-499c-b766-7f8fdf53344e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=c4b690b0-0945-4977-bf09-6a746f744547,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:26.330788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:26.336728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.389642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network e4e7ee94-7b77-41bd-be61-713ba68086da details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:26.394011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.413791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b100fb-8448-42d8-81aa-549587297f06 req-eae5b791-8703-4861-9287-0880f3fb6194 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:26.415785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-eae5b791-8703-4861-9287-0880f3fb6194 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542 HTTP/1.1" status: 200 len: 907 time: 0.2986672 Nov 05 14:45:26.466963 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1d474aed-25dd-44fe-aa9b-abe75b9570eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'floating_ip_address': '172.26.5.23', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '51c9704a-323f-4947-9153-8af2348f332c', 'port_id': '13d06243-5eeb-4ace-b456-59f332abe92e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'mac_address': 'fa:16:3e:b8:ac:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:43Z', 'updated_at': '2021-11-05T14:45:23Z', 'revision_number': 1, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:26.478427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 601} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:26.502585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:26.507955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-01c522e4-a355-4e47-8080-f45512b2162c None None] Provisioning complete for port 9464c173-4e4c-46fd-ab08-81c095d35562 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:26.509734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-01c522e4-a355-4e47-8080-f45512b2162c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.510600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.511289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Added segment a1da802b-296e-49df-8fc0-ad61b4f25215 of type vlan for network a5773a46-76ab-400d-9dcb-871ccab13545 Nov 05 14:45:26.543416 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Checking router: 51c9704a-323f-4947-9153-8af2348f332c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:26.556896 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:26.558423 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:26.611755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.612752 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 40b58e38-ba48-47ad-a158-2282ed35efb9 of type vlan for network 41a5a26c-e696-4176-b284-27a9f00c9967 Nov 05 14:45:26.621389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-7ad2ff8a-ca0c-440b-a189-5781031e1289 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f HTTP/1.1" status: 200 len: 1000 time: 0.1929066 Nov 05 14:45:26.653849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-01c522e4-a355-4e47-8080-f45512b2162c None None] Port 9464c173-4e4c-46fd-ab08-81c095d35562 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:26.676839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.702621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.707562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39626) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:26.745242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:26.749246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63c4593d-8d1d-47aa-a1d8-e8ff69b8a32b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:26.754144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e20e306b-6add-4c1d-90d2-15473667deca', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'floating_ip_address': '172.26.5.113', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'port_id': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 201, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'mac_address': 'fa:16:3e:43:e0:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:51Z', 'updated_at': '2021-11-05T14:45:22Z', 'revision_number': 1, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:26.759941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.760514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.791407 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:26.810428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b100fb-8448-42d8-81aa-549587297f06 req-38d2745f-4160-4f91-820f-9ace9c22bd98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:26.814458 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-38d2745f-4160-4f91-820f-9ace9c22bd98 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=84c193ea-9294-4fe7-b33c-753ea27f07be HTTP/1.1" status: 200 len: 845 time: 0.1785755 Nov 05 14:45:26.815497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=9464c173-4e4c-46fd-ab08-81c095d35562,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:26.837997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.880540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.886595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:26.887218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.965001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.8711910 Nov 05 14:45:26.968076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:26.974239 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-33de5d47-fb1f-4642-8047-c903df27271a tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/9464c173-4e4c-46fd-ab08-81c095d35562 HTTP/1.1" status: 204 len: 168 time: 2.3154609 Nov 05 14:45:26.976154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39632) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:26.976267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39634) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:26.985764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:26.991748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Request body: {'subnet': {'network_id': 'a5773a46-76ab-400d-9dcb-871ccab13545', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:27.006553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-1694723739', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:27.012029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-268ea9ef-87ed-4862-ae8f-24a4e8378b66 None None] Could not find standard attr ID for object 9464c173-4e4c-46fd-ab08-81c095d35562. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:27.014835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Checking router: 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:27.029232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.035842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:27.036478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.039107 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c4b3ec06-6bf5-4dab-bd8a-0b1e127ff322 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] GET failed (client error): The resource could not be found. Nov 05 14:45:27.040698 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4b3ec06-6bf5-4dab-bd8a-0b1e127ff322 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports/9464c173-4e4c-46fd-ab08-81c095d35562 HTTP/1.1" status: 404 len: 333 time: 0.0600233 Nov 05 14:45:27.045555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272827c8-0029-4837-b2e0-36a7f2826407 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Network': ['ID=a5773a46-76ab-400d-9dcb-871ccab13545,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:27.049588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39636) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:27.061070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.108926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-739982520'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:27.159305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.9213152 Nov 05 14:45:27.165931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39638) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:27.187138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:27.210493 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1d474aed-25dd-44fe-aa9b-abe75b9570eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'floating_ip_address': '172.26.5.23', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '51c9704a-323f-4947-9153-8af2348f332c', 'port_id': '13d06243-5eeb-4ace-b456-59f332abe92e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'mac_address': 'fa:16:3e:b8:ac:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:43Z', 'updated_at': '2021-11-05T14:45:23Z', 'revision_number': 1, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:27.242388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a5773a46-76ab-400d-9dcb-871ccab13545 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:27.242956 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0920e140-f21d-48e5-8848-5f94141e13a6 None None] The sync data for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv is: [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1d474aed-25dd-44fe-aa9b-abe75b9570eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'floating_ip_address': '172.26.5.23', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '51c9704a-323f-4947-9153-8af2348f332c', 'port_id': '13d06243-5eeb-4ace-b456-59f332abe92e', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 186, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'mac_address': 'fa:16:3e:b8:ac:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:43Z', 'updated_at': '2021-11-05T14:45:23Z', 'revision_number': 1, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:27.250109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc93ff32-e8e6-47cb-bc17-92f7290a5d5d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:27.274642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b100fb-8448-42d8-81aa-549587297f06 req-058aebb0-f270-4521-8688-e03e59d99e09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:27.276253 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-058aebb0-f270-4521-8688-e03e59d99e09 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fd1ccb7c-d1e8-48e2-b784-b56a587e2542&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4276719 Nov 05 14:45:27.288566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd19628-5910-4c32-83a5-e7d27f5f6008 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=41a5a26c-e696-4176-b284-27a9f00c9967,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:27.342010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:27.342791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:27.345198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 41a5a26c-e696-4176-b284-27a9f00c9967 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:27.382012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Made reservation on behalf of 02d15007c4e145c197e904b48ab86d99 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:27.384567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.415852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.434085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.api [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 05 14:45:27.434085 dv-neutron-816850-1-hyperv neutron-server[113581]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 05 14:45:27.434085 dv-neutron-816850-1-hyperv neutron-server[113581]: [parameters: {'project_id_1': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'expiration_1': datetime.datetime(2021, 11, 5, 14, 45, 7, 338429)}] Nov 05 14:45:27.434085 dv-neutron-816850-1-hyperv neutron-server[113581]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=113581) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:45:27.434544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG oslo_db.api [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:45:27.455808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.481756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:27.485614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.516049 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-9d5f0f32-b1ec-43bd-a58b-9cb390146b23 service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2246990 Nov 05 14:45:27.551460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port d948f5f1-9fe0-4fdc-b886-89288ee6a32b yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:27.570467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Made reservation on behalf of 5b43437541e445ee9cffdd31db12e7c8 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:27.576183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.618814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:27.620670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5dde4adf-03df-4a80-b1e7-7c22044267c9" -d '{"events": [{"name": "network-changed", "server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:27.633074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router 428c3c1e-23d2-43dd-8513-24855c7c5e71 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:27.646651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c14732c5-d6b3-419e-9837-84bbe6b321a0 None None] New status for floating IP 1d474aed-25dd-44fe-aa9b-abe75b9570eb: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:45:27.683275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2473792e-2a72-44aa-a2ba-345eab0b2f96 x-openstack-request-id: req-2473792e-2a72-44aa-a2ba-345eab0b2f96 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:27.683275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:27.683589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2473792e-2a72-44aa-a2ba-345eab0b2f96 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:27.683800 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e', 'status': 'completed', 'code': 200} Nov 05 14:45:27.717162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:27.718229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.803849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-7c9efd70-ce67-4c02-b5aa-36d1557566df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:27.805561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-7c9efd70-ce67-4c02-b5aa-36d1557566df service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.1047916 Nov 05 14:45:27.808834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:27.828612 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Sync routers for ids ['428c3c1e-23d2-43dd-8513-24855c7c5e71'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:27.843214 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Routers {'428c3c1e-23d2-43dd-8513-24855c7c5e71'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:27.845358 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['428c3c1e-23d2-43dd-8513-24855c7c5e71'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:27.886941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.890605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6552c179-c454-41e4-8c62-45b26e5becac tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 5.3667533 Nov 05 14:45:27.890744 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b100fb-8448-42d8-81aa-549587297f06 req-a19b46ab-1dcd-4f16-b421-c193b0973e57 service neutron] 10.222.0.32 "GET /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3633492 Nov 05 14:45:27.893011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39646) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:27.920318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.927499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.7 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/d948f5f1-9fe0-4fdc-b886-89288ee6a32b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:27.930301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:27.960927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] device_id is not set on port 525a4164-d5fe-440d-8da9-4065d46dd6bc yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:27.976022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:27.980715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80fb4e50-bc52-41d6-9adf-d8cf0829c414,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:28.035700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:28.041454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.119604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Allocated IP 172.26.5.135 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/525a4164-d5fe-440d-8da9-4065d46dd6bc) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:28.119826 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Set router 428c3c1e-23d2-43dd-8513-24855c7c5e71 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:28.122127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c5eaac8-ddac-40e3-8a72-aa4e4f0e9b4a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:28.298216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.338424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.402172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c5eaac8-ddac-40e3-8a72-aa4e4f0e9b4a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:28.413553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-e4911dc7-4342-4277-a491-dfd51b3e8ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:28.415133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-e4911dc7-4342-4277-a491-dfd51b3e8ef6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.6010013 Nov 05 14:45:28.457723 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228'}], 'enable_snat': True}, 'gw_port_id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:22Z', 'updated_at': '2021-11-05T14:45:26Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:65:ef:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'device_owner': 'network:router_gateway', 'standard_attr_id': 289, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:25Z', 'updated_at': '2021-11-05T14:45:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:28.488260 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Checking router: 428c3c1e-23d2-43dd-8513-24855c7c5e71 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:28.488798 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Updating router 428c3c1e-23d2-43dd-8513-24855c7c5e71 port f17f9172-8c78-4ebb-a28a-b5e015ff0201 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:45:28.522483 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.546047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:28.573317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:28.586949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:28.594211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e20e306b-6add-4c1d-90d2-15473667deca', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'floating_ip_address': '172.26.5.113', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'port_id': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 201, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'mac_address': 'fa:16:3e:43:e0:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:51Z', 'updated_at': '2021-11-05T14:45:22Z', 'revision_number': 1, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:28.631847 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4c1ff425-f424-4b31-a782-7b4779b1cbc8 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/428c3c1e-23d2-43dd-8513-24855c7c5e71 HTTP/1.1" status: 200 len: 908 time: 0.7377024 Nov 05 14:45:28.633288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Pushing event updated for resources: {'Port': ['ID=525a4164-d5fe-440d-8da9-4065d46dd6bc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:28.638592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39652) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:28.656903 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-9bc95c25-e70d-484c-9c65-62736fd214cf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.2135837 Nov 05 14:45:28.675994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d15bbe-9163-4555-9a72-e7db001b7f04 None None] The sync data for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv is: [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e20e306b-6add-4c1d-90d2-15473667deca', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'floating_ip_address': '172.26.5.113', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'port_id': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 201, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'mac_address': 'fa:16:3e:43:e0:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:44:51Z', 'updated_at': '2021-11-05T14:45:22Z', 'revision_number': 1, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:28.725975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.750861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:28.751471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.801431 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-21a02ee8-829b-4ff2-adfe-e6e9f4d90719 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 2.0797541 Nov 05 14:45:28.807028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39654) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:28.813148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.135'}]}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:28.850449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-15e57f9c-f3bf-417a-a925-10cdb1a6aa67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:28.851840 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-15e57f9c-f3bf-417a-a925-10cdb1a6aa67 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.1511383 Nov 05 14:45:28.902224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:45:28.912103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.920143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.936126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.941662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:28.942663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.048935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:29.051414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbf8fb98-9d08-4d0e-a835-e25790f03586 None None] New status for floating IP e20e306b-6add-4c1d-90d2-15473667deca: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:45:29.066382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-2cbfb1df-bd73-4d3d-9186-b35f7f222096 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:29.068536 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-2cbfb1df-bd73-4d3d-9186-b35f7f222096 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2044220 Nov 05 14:45:29.077594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.085033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:29.093255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:29.098972 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.106759 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.133494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=d948f5f1-9fe0-4fdc-b886-89288ee6a32b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:29.135739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event updated for resources: {'Subnet': ['ID=77fb08aa-badb-44c1-8a86-d1122e64b16b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:29.185672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ac4e2c-275e-41e3-9a8b-219b27062f41 None None] Pushing event updated for resources: {'Port': ['ID=f17f9172-8c78-4ebb-a28a-b5e015ff0201,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:29.196069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Checking segment: {'id': 'a1da802b-296e-49df-8fc0-ad61b4f25215', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'a5773a46-76ab-400d-9dcb-871ccab13545'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:29.196427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network hostable DHCP agents. Network: a5773a46-76ab-400d-9dcb-871ccab13545, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:29.220432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:29.221134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.222166 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Attempting to bind port f17f9172-8c78-4ebb-a28a-b5e015ff0201 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:29.222683 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Attempting to bind port f17f9172-8c78-4ebb-a28a-b5e015ff0201 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:29.223416 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Attempting to bind port f17f9172-8c78-4ebb-a28a-b5e015ff0201 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:29.232604 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:29.233320 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:29.234013 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.234667 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:29.235327 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Bound port: f17f9172-8c78-4ebb-a28a-b5e015ff0201, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:29.236166 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.265381 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-11a28976-82c6-45ef-84de-23fbddeb240b tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 2.1738114 Nov 05 14:45:29.267876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39662) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:29.273166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'network_id': '0d191e95-5fd7-4348-b056-51734fb90a4e', 'name': 'tempest-AllowedAddressPairTestJSON-1312017949'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:29.282005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Network a5773a46-76ab-400d-9dcb-871ccab13545 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:29.289133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.334145 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] For port f17f9172-8c78-4ebb-a28a-b5e015ff0201, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:29.340001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] For port f17f9172-8c78-4ebb-a28a-b5e015ff0201, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17f9172-8c78-4ebb-a28a-b5e015ff0201,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:29.365815 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.379793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a5773a46-76ab-400d-9dcb-871ccab13545) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:29.388306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07569659-713a-40c3-8eea-866939ebf688 None None] Network a5773a46-76ab-400d-9dcb-871ccab13545 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:29.392085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:29.392913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.418282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9d5afd8f-2214-43a2-91c6-a78c864e222e tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 2.4392986 Nov 05 14:45:29.421115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39664) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:29.483494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=7dee6b6a-2a7c-408b-be07-1f6a83055699,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:29.518423 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ac4e2c-275e-41e3-9a8b-219b27062f41 None None] Pushing event updated for resources: {'Port': ['ID=f17f9172-8c78-4ebb-a28a-b5e015ff0201,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:29.522724 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Routers {'428c3c1e-23d2-43dd-8513-24855c7c5e71'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:29.523345 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['428c3c1e-23d2-43dd-8513-24855c7c5e71'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-07569659-713a-40c3-8eea-866939ebf688 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:29.538762 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:29.550453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fde49011-645b-4ed8-9054-a9937b85544d None None] Network a5773a46-76ab-400d-9dcb-871ccab13545 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:29.567297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Made reservation on behalf of cc6949a83f804429a49a501b3e1538bb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:29.571266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.600714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] device_id is not set on port e1a751d8-ee0c-4437-bd1c-3468c1251ccd yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:29.632353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fde49011-645b-4ed8-9054-a9937b85544d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:29.635974 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:29.643560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.646266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ee7a651-8dbe-450d-9e12-8601159bf24f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:29.653424 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-66194792-c2ab-4dcd-a700-e72a574f6591 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5735378 Nov 05 14:45:29.669421 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] Set router 428c3c1e-23d2-43dd-8513-24855c7c5e71 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:29.741668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0db1218a-32f3-48cf-9c0c-4aab2acb3ae7 None None] Provisioning complete for port d948f5f1-9fe0-4fdc-b886-89288ee6a32b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:29.742109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0db1218a-32f3-48cf-9c0c-4aab2acb3ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.748047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Allocated IP 172.20.0.8 (0d191e95-5fd7-4348-b056-51734fb90a4e/b2186818-b151-4a35-904c-62c9ef709258/e1a751d8-ee0c-4437-bd1c-3468c1251ccd) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:29.750201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': 'e1e6022b-2d0c-4deb-90db-cc726ac76c14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:29.750761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: e4e7ee94-7b77-41bd-be61-713ba68086da, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:29.804885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0db1218a-32f3-48cf-9c0c-4aab2acb3ae7 None None] Port d948f5f1-9fe0-4fdc-b886-89288ee6a32b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:29.869852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.895536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network e4e7ee94-7b77-41bd-be61-713ba68086da is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:29.914117 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228'}], 'enable_snat': True}, 'gw_port_id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:22Z', 'updated_at': '2021-11-05T14:45:26Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:65:ef:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'device_owner': 'network:router_gateway', 'standard_attr_id': 289, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:25Z', 'updated_at': '2021-11-05T14:45:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:29.928146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, e4e7ee94-7b77-41bd-be61-713ba68086da) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:29.935015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:29.935819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.939671 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5dde4adf-03df-4a80-b1e7-7c22044267c9 req-5d0cfde9-1811-404c-b2e3-0c95c67f63b2 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2652507 Nov 05 14:45:29.947494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Deleting port f17f9172-8c78-4ebb-a28a-b5e015ff0201 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:29.948053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.953415 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-182c220f-c14e-4e24-9055-0ab9b27583df None None] The sync data for ids ['428c3c1e-23d2-43dd-8513-24855c7c5e71'] in dv-neutron-816850-1-hyperv is: [{'id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'name': 'tempest-snat-router-1308981602', 'tenant_id': '958d110f5740449b9e7fb352ead488b2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228'}], 'enable_snat': True}, 'gw_port_id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:45:22Z', 'updated_at': '2021-11-05T14:45:26Z', 'revision_number': 3, 'project_id': '958d110f5740449b9e7fb352ead488b2', 'gw_port': {'id': 'f17f9172-8c78-4ebb-a28a-b5e015ff0201', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:65:ef:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '428c3c1e-23d2-43dd-8513-24855c7c5e71', 'device_owner': 'network:router_gateway', 'standard_attr_id': 289, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:45:25Z', 'updated_at': '2021-11-05T14:45:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:29.980572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:29.989412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ee7a651-8dbe-450d-9e12-8601159bf24f None None] Unable to find a vacant binding_index for network e4e7ee94-7b77-41bd-be61-713ba68086da and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:45:30.010201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ee7a651-8dbe-450d-9e12-8601159bf24f None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, e4e7ee94-7b77-41bd-be61-713ba68086da) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:30.010418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9ea921f1-e604-4c68-b1c7-fc058a1f05cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.8434629 Nov 05 14:45:30.015888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39670) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:30.021834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:30.034797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.087940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.121414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=77fb08aa-badb-44c1-8a86-d1122e64b16b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:30.127591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.165432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] For port f17f9172-8c78-4ebb-a28a-b5e015ff0201, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17f9172-8c78-4ebb-a28a-b5e015ff0201,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:30.165882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.238111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.252607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Calling delete_port for f17f9172-8c78-4ebb-a28a-b5e015ff0201 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:30.272406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Network 0d191e95-5fd7-4348-b056-51734fb90a4e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:30.286704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:30.289803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:30.293528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.296070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:30.301832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a5773a46-76ab-400d-9dcb-871ccab13545']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:30.304382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=e1a751d8-ee0c-4437-bd1c-3468c1251ccd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:30.385252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a1da802b-296e-49df-8fc0-ad61b4f25215') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:30.385554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a1da802b-296e-49df-8fc0-ad61b4f25215') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:30.394973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:30.395637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.428401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1a8b3039-2c09-43f9-9d8e-3ff46ea99f82 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.1594326 Nov 05 14:45:30.431219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39674) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:30.439419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.4', 'mac_address': 'fa:16:3e:d6:eb:91'}, {'ip_address': '172.20.0.7', 'mac_address': 'fa:16:3e:2c:58:35'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:30.445528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.452552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.481032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.506950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.537185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 601 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:30.537597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:30.540744 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:30.609647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-e4e7ee94-7b77-41bd-be61-713ba68086da', 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '7dee6b6a-2a7c-408b-be07-1f6a83055699'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:30.610596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.747217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.791847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Allocated IP 2001:db8::2 (e4e7ee94-7b77-41bd-be61-713ba68086da/7dee6b6a-2a7c-408b-be07-1f6a83055699/6d758bd7-e381-4209-a680-de95751c63af) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:30.809247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Port': ['ID=f17f9172-8c78-4ebb-a28a-b5e015ff0201,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:30.920271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.981570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.986230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:30.989579 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/a5773a46-76ab-400d-9dcb-871ccab13545 HTTP/1.1" status: 204 len: 168 time: 1.5670054 Nov 05 14:45:30.999804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39678) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.004103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.013200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.042667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-dd8591b0-471f-4dff-b304-32f663bb1b5b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.043135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dd8591b0-471f-4dff-b304-32f663bb1b5b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.046312 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd8591b0-471f-4dff-b304-32f663bb1b5b tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/77fb08aa-badb-44c1-8a86-d1122e64b16b HTTP/1.1" status: 404 len: 337 time: 0.0454872 Nov 05 14:45:31.052895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39680) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.053711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5a13ab-1b7b-4834-9f84-d881d25cc4ee tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=a5773a46-76ab-400d-9dcb-871ccab13545,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:31.080024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Network e4e7ee94-7b77-41bd-be61-713ba68086da is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:31.083176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:31.090014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:31.101956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Pushing event updated for resources: {'Port': ['ID=6d758bd7-e381-4209-a680-de95751c63af,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:31.146095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.149845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee0f482b-e1df-4112-8efc-8faba5f65969 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.150437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ee0f482b-e1df-4112-8efc-8faba5f65969 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.166746 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee0f482b-e1df-4112-8efc-8faba5f65969 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/a5773a46-76ab-400d-9dcb-871ccab13545 HTTP/1.1" status: 404 len: 339 time: 0.1097341 Nov 05 14:45:31.170099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39684) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.174753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Attempting to bind port 6d758bd7-e381-4209-a680-de95751c63af on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:31.175295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Attempting to bind port 6d758bd7-e381-4209-a680-de95751c63af by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'e1e6022b-2d0c-4deb-90db-cc726ac76c14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:31.175766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Attempting to bind port 6d758bd7-e381-4209-a680-de95751c63af on network e4e7ee94-7b77-41bd-be61-713ba68086da {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:31.181890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:31.182483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Checking segment: {'id': 'e1e6022b-2d0c-4deb-90db-cc726ac76c14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:31.183019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.183644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Bound using segment: {'id': 'e1e6022b-2d0c-4deb-90db-cc726ac76c14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:31.184228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Bound port: 6d758bd7-e381-4209-a680-de95751c63af, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e1e6022b-2d0c-4deb-90db-cc726ac76c14', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'e4e7ee94-7b77-41bd-be61-713ba68086da'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:31.184764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.243127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-040748bd-f79c-4df7-aa72-3db16b75e49d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.243588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-040748bd-f79c-4df7-aa72-3db16b75e49d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.249135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-040748bd-f79c-4df7-aa72-3db16b75e49d tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/1b0618f1-3601-4486-95e3-caa653e40e0b HTTP/1.1" status: 404 len: 337 time: 0.0650587 Nov 05 14:45:31.250191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39686) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.261800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] For port 6d758bd7-e381-4209-a680-de95751c63af, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:31.265533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] For port 6d758bd7-e381-4209-a680-de95751c63af, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6d758bd7-e381-4209-a680-de95751c63af,segment=NetworkSegment(e1e6022b-2d0c-4deb-90db-cc726ac76c14),segment_id=e1e6022b-2d0c-4deb-90db-cc726ac76c14)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:31.271403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.277821 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b1e3237-62ec-479c-833d-5146f907e454 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.278271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b1e3237-62ec-479c-833d-5146f907e454 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.283682 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1b1e3237-62ec-479c-833d-5146f907e454 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/c4b690b0-0945-4977-bf09-6a746f744547 HTTP/1.1" status: 404 len: 339 time: 0.0300846 Nov 05 14:45:31.285993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39688) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.322377 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-6c11e9ae-fafc-4a52-bfea-fecb1ad9bca4 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.322838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6c11e9ae-fafc-4a52-bfea-fecb1ad9bca4 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.326631 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6c11e9ae-fafc-4a52-bfea-fecb1ad9bca4 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/65743a36-7db8-4a8b-abc3-6aae6168fcbf HTTP/1.1" status: 404 len: 337 time: 0.0390756 Nov 05 14:45:31.326801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.330259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39690) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.342403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8fe28f-8e12-47e5-ad0f-78f26f05c1a2 None None] Pushing event updated for resources: {'Port': ['ID=6d758bd7-e381-4209-a680-de95751c63af,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:31.362170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-e59a5a21-4bd0-4c8c-bbbc-88f80d0b5c7f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:31.362753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e59a5a21-4bd0-4c8c-bbbc-88f80d0b5c7f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:31.365916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e59a5a21-4bd0-4c8c-bbbc-88f80d0b5c7f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/d4751683-2627-4f86-86dc-fbf718cea1dc HTTP/1.1" status: 404 len: 339 time: 0.0345447 Nov 05 14:45:31.376413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39692) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.449712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.455693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.564291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting port fa7c1cdd-aed7-4166-9a72-10ada71c5474 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:31.564653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.631044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.636863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.637415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 428c3c1e-23d2-43dd-8513-24855c7c5e71 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:31.641358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.645109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.646265 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc34afb0-795c-4284-9129-8fdec6661464 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/routers/428c3c1e-23d2-43dd-8513-24855c7c5e71 HTTP/1.1" status: 204 len: 168 time: 3.0067086 Nov 05 14:45:31.649799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39696) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.684776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.703927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Calling delete_port for fa7c1cdd-aed7-4166-9a72-10ada71c5474 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:31.723034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.730481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.775429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.776000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 647a2a99-a866-4b70-a79d-71a1bbcfbb78 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:31.820334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.858115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event updated for resources: {'Port': ['ID=e1a751d8-ee0c-4437-bd1c-3468c1251ccd,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:31.868575 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:45:31.869507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e56ab3f-c8a4-4f39-94de-d1de9bf2115b tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 3.0604506 Nov 05 14:45:31.874924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39698) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.895595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] In _notify_port_updated(), no bound segment for port e1a751d8-ee0c-4437-bd1c-3468c1251ccd on network 0d191e95-5fd7-4348-b056-51734fb90a4e {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:45:31.897716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.901126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:31.902276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:31.903558 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2534bbf9-9f79-4f9e-a8d4-e2968639afc0 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "PUT /v2.0/ports/e1a751d8-ee0c-4437-bd1c-3468c1251ccd HTTP/1.1" status: 200 len: 1055 time: 1.4707923 Nov 05 14:45:31.919920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39700) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:31.934200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=e9ae4875-a339-4982-9aaa-18acc17e2b5d,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:31.960113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '40b58e38-ba48-47ad-a158-2282ed35efb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:31.960502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 41a5a26c-e696-4176-b284-27a9f00c9967, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:31.962238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.023492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 41a5a26c-e696-4176-b284-27a9f00c9967 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:32.036682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 41a5a26c-e696-4176-b284-27a9f00c9967) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:32.038847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.044905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Port': ['ID=fa7c1cdd-aed7-4166-9a72-10ada71c5474,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:32.045379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:32.045510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.058338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.059192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c32c4c96-073c-4e85-8bd6-69a55b0fd326 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/ports/fa7c1cdd-aed7-4166-9a72-10ada71c5474 HTTP/1.1" status: 204 len: 168 time: 0.6818178 Nov 05 14:45:32.062007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39704) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:32.077462 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b37864f8-801a-4156-aaf5-512c78f3670f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.0577023 Nov 05 14:45:32.081189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:32.086301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-167140135', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:32.113989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Deleting port 525a4164-d5fe-440d-8da9-4065d46dd6bc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:32.114413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.119478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-cff743cb-611c-4ca4-aa24-b64a24a68265 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:32.120059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cff743cb-611c-4ca4-aa24-b64a24a68265 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:32.126054 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cff743cb-611c-4ca4-aa24-b64a24a68265 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/385268cd-883b-4725-a415-8ef4476a1604 HTTP/1.1" status: 404 len: 337 time: 0.0626335 Nov 05 14:45:32.128375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39708) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:32.169221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port e1a751d8-ee0c-4437-bd1c-3468c1251ccd {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:32.169427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.173851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.174858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.234614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Deleting port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:32.235050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.281495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.346061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.347994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.360685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.375882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Calling delete_port for 525a4164-d5fe-440d-8da9-4065d46dd6bc owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:32.391152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.409508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.413392 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4bf974bf-969f-49fc-af56-3580fe6fcc02 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.3279574 Nov 05 14:45:32.414233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:32.421741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] For port cc93ff32-e8e6-47cb-bc17-92f7290a5d5d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:32.422103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.426020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for e1a751d8-ee0c-4437-bd1c-3468c1251ccd owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:32.438553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.454445 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Calling delete_port for cc93ff32-e8e6-47cb-bc17-92f7290a5d5d owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:32.469332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73817f48-752a-4b2b-8059-05e744d52c40']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:32.487186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:32.487538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2e4f7bde-7bc9-4e8f-9ca3-c0f10fcb55fc') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:32.491868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7ced834-4639-4879-aa7a-00e066e0245b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:32.527722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.558684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.579366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 629 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:32.580104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:32.584973 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:32.622729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] Provisioning complete for port 6d758bd7-e381-4209-a680-de95751c63af triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:32.623194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.709631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.714978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7ced834-4639-4879-aa7a-00e066e0245b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:32.715822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.719547 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/73817f48-752a-4b2b-8059-05e744d52c40 HTTP/1.1" status: 204 len: 168 time: 0.5910418 Nov 05 14:45:32.742853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:32.781991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e526e2d2-e231-41a1-9280-b1ab45bf2676 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=73817f48-752a-4b2b-8059-05e744d52c40,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:32.810636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.868051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] For port 6d758bd7-e381-4209-a680-de95751c63af, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6d758bd7-e381-4209-a680-de95751c63af,segment=NetworkSegment(e1e6022b-2d0c-4deb-90db-cc726ac76c14),segment_id=e1e6022b-2d0c-4deb-90db-cc726ac76c14)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:32.875610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.876157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.913119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event deleted for resources: {'Port': ['ID=cc93ff32-e8e6-47cb-bc17-92f7290a5d5d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:32.920024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.941116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting port 3479e0aa-18d0-4261-b97b-3281f2980be6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:32.941456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:32.985381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Pushing event deleted for resources: {'Port': ['ID=525a4164-d5fe-440d-8da9-4065d46dd6bc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:32.987256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be77f9da-c62d-4511-a2b4-01d3ae4ebb9c None None] Pushing event updated for resources: {'Port': ['ID=6d758bd7-e381-4209-a680-de95751c63af,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:33.042697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.048244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.059015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.070074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Calling delete_port for 3479e0aa-18d0-4261-b97b-3281f2980be6 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:33.109277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.122062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-41a5a26c-e696-4176-b284-27a9f00c9967', 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': 'e9ae4875-a339-4982-9aaa-18acc17e2b5d'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:33.123313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.159299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=e1a751d8-ee0c-4437-bd1c-3468c1251ccd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:33.200001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.213425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.221332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf5be5ca-191f-4762-8c57-e76cbb187203 tempest-RoutersAdminNegativeTest-2052636617 tempest-RoutersAdminNegativeTest-2052636617-project-admin] 10.222.0.30 "DELETE /v2.0/ports/525a4164-d5fe-440d-8da9-4065d46dd6bc HTTP/1.1" status: 204 len: 168 time: 1.3388145 Nov 05 14:45:33.320335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Port': ['ID=3479e0aa-18d0-4261-b97b-3281f2980be6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:33.355560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.363860 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8c638658-1c5a-4d59-8737-a86aacba61b9 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/ports/3479e0aa-18d0-4261-b97b-3281f2980be6 HTTP/1.1" status: 204 len: 168 time: 0.6216617 Nov 05 14:45:33.369540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39722) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.374440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.382172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Allocated IP 2001:db8:1::2 (41a5a26c-e696-4176-b284-27a9f00c9967/e9ae4875-a339-4982-9aaa-18acc17e2b5d/f9a4eedb-efcd-43bd-a70e-b2b3f1f69301) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:33.383621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.388766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6d758bd7-e381-4209-a680-de95751c63af up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:33.403702 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-d0283e7e-b1f1-4444-aec9-41147e3d1c18 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:33.404181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d0283e7e-b1f1-4444-aec9-41147e3d1c18 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:33.409700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d0283e7e-b1f1-4444-aec9-41147e3d1c18 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/7cfd84b3-9115-4e86-9638-e8d8223f4c72 HTTP/1.1" status: 404 len: 337 time: 0.0362346 Nov 05 14:45:33.410423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39726) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.551944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.552588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Fanout notify agent at l3_agent the message router_deleted on router d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:33.565905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.571434 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9da59d8-02da-4cfd-852e-4417c8943ad5 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "DELETE /v2.0/routers/d8796d6d-a1ed-4a46-8b9e-dbe3e0d69aaa HTTP/1.1" status: 204 len: 168 time: 1.9150555 Nov 05 14:45:33.571668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39730) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.582673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.588872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1308630858', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:33.600792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 6d758bd7-e381-4209-a680-de95751c63af triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:33.601285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.706687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.718786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39732) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.718981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.723848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8::1 (e4e7ee94-7b77-41bd-be61-713ba68086da/7dee6b6a-2a7c-408b-be07-1f6a83055699/92094a4b-da7e-4994-8fdf-fe92041657da) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:33.743463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.744715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.773583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.814506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1fcf6ba3-3c19-4780-9bd4-c96004381730']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:33.815957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.819517 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8999172c-faab-46a3-90e4-1335b04b77ff tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/e1a751d8-ee0c-4437-bd1c-3468c1251ccd HTTP/1.1" status: 204 len: 168 time: 1.8980451 Nov 05 14:45:33.823965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.829902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c183f81-945f-4710-aa52-a4ce87072414') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:33.830203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c183f81-945f-4710-aa52-a4ce87072414') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:33.843860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.870476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.871169 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-804e2bff-1e36-4da7-86f5-8ac71dc3841f tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] GET failed (client error): The resource could not be found. Nov 05 14:45:33.875220 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-804e2bff-1e36-4da7-86f5-8ac71dc3841f tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports/e1a751d8-ee0c-4437-bd1c-3468c1251ccd HTTP/1.1" status: 404 len: 333 time: 0.0480533 Nov 05 14:45:33.879161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39740) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:33.882765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Pushing event updated for resources: {'Port': ['ID=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:33.893253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:33.893659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.918229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17f9172-8c78-4ebb-a28a-b5e015ff0201 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:33.950649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c778d481-ce87-45a4-9916-202ea490b877 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:33.952261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Network 41a5a26c-e696-4176-b284-27a9f00c9967 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:33.953799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f17f9172-8c78-4ebb-a28a-b5e015ff0201 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:33.954142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17f9172-8c78-4ebb-a28a-b5e015ff0201 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:33.956551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:33.961402 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:33.963231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:34.016973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.022487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Attempting to bind port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:34.022709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.023192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Attempting to bind port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '40b58e38-ba48-47ad-a158-2282ed35efb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:34.023192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Attempting to bind port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 on network 41a5a26c-e696-4176-b284-27a9f00c9967 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:34.024783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.029887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:34.030282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Checking segment: {'id': '40b58e38-ba48-47ad-a158-2282ed35efb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:34.030988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.031382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Bound using segment: {'id': '40b58e38-ba48-47ad-a158-2282ed35efb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:34.031857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Bound port: f9a4eedb-efcd-43bd-a70e-b2b3f1f69301, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '40b58e38-ba48-47ad-a158-2282ed35efb9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '41a5a26c-e696-4176-b284-27a9f00c9967'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:34.032230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.041911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.048019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/1fcf6ba3-3c19-4780-9bd4-c96004381730 HTTP/1.1" status: 204 len: 168 time: 0.6368947 Nov 05 14:45:34.050323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39742) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:34.065713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b634a8-1157-478a-8cbd-3d6a1be4b15f tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=1fcf6ba3-3c19-4780-9bd4-c96004381730,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:34.099594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] For port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:34.107209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] For port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,segment=NetworkSegment(40b58e38-ba48-47ad-a158-2282ed35efb9),segment_id=40b58e38-ba48-47ad-a158-2282ed35efb9)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:34.111708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.146828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port d948f5f1-9fe0-4fdc-b886-89288ee6a32b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:34.147396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.169638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.180834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b9f255-14e3-4078-9be9-a2f6bd0a7a7b None None] Pushing event updated for resources: {'Port': ['ID=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:34.214987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting subnet 5b5a7123-fc8c-4914-8963-1115ccdd52c4 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:34.243178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.252093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.303510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c778d481-ce87-45a4-9916-202ea490b877 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.316858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network e4e7ee94-7b77-41bd-be61-713ba68086da is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:34.327748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c778d481-ce87-45a4-9916-202ea490b877 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.341004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:34.349248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:34.349795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.363399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=92094a4b-da7e-4994-8fdf-fe92041657da,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:34.369448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.530971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.551393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.664686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Allocated IP 172.26.5.21 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/698d2648-f213-4c7b-9e78-d3743b35eab8) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:34.734647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.738753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c778d481-ce87-45a4-9916-202ea490b877 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e77a44d-de61-4eba-93e2-1eb4d1ad1c21,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:34.756901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c778d481-ce87-45a4-9916-202ea490b877 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=946a1949789548598d22c3a1765b6a64&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0345194 Nov 05 14:45:34.760741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39748) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:34.778004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.780413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for d948f5f1-9fe0-4fdc-b886-89288ee6a32b owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:34.845901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.872358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.875686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.927995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.931997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:34.933128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:34.950492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:34.954611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:34.988754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event updated for resources: {'Port': ['ID=698d2648-f213-4c7b-9e78-d3743b35eab8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:35.066614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.069679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.074004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2e77a44d-de61-4eba-93e2-1eb4d1ad1c21 HTTP/1.1" status: 204 len: 168 time: 0.3089936 Nov 05 14:45:35.111392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39bf026e-96b5-44e2-a23e-4e2e718c4186 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e77a44d-de61-4eba-93e2-1eb4d1ad1c21,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:35.204169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.241637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Subnet': ['ID=5b5a7123-fc8c-4914-8963-1115ccdd52c4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:35.243877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.274034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:35.288412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.294875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ef47c9bc-3557-459b-973f-cf7daa22f9c2 tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/subnets/5b5a7123-fc8c-4914-8963-1115ccdd52c4 HTTP/1.1" status: 204 len: 168 time: 1.2406597 Nov 05 14:45:35.295669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39756) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:35.297501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=d948f5f1-9fe0-4fdc-b886-89288ee6a32b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:35.390209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.396177 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c62d72ab-ea90-4f7b-8de8-c7248bc49da5 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/d948f5f1-9fe0-4fdc-b886-89288ee6a32b HTTP/1.1" status: 204 len: 168 time: 1.5136740 Nov 05 14:45:35.398088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14b5eb65-ce30-4407-a775-666cd4511c6b None None] Network e4e7ee94-7b77-41bd-be61-713ba68086da requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:35.401071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-117eed60-ff38-4403-b638-dea3944e54f8 None None] Network 41a5a26c-e696-4176-b284-27a9f00c9967 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:35.404738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39760) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:35.408599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-384ce5c1-6763-48aa-ac40-0bf368c1b011 None None] Network 1bee866a-e915-49da-a1b2-52ca5394910c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:35.485181 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-920c513a-6e91-4490-836c-28ed9e2a62b4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] GET failed (client error): The resource could not be found. Nov 05 14:45:35.487101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-920c513a-6e91-4490-836c-28ed9e2a62b4 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "GET /v2.0/ports/d948f5f1-9fe0-4fdc-b886-89288ee6a32b HTTP/1.1" status: 404 len: 333 time: 0.0811131 Nov 05 14:45:35.492492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:35.650023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:35.690071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:35.690851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.721316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.725184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0674f951-4ada-4dcb-a5f7-92037a42c59d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=02d15007c4e145c197e904b48ab86d99&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0701175 Nov 05 14:45:35.727605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port 32af1864-84e4-446d-85bf-079aa2b5e501 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:35.728017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.731570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39768) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:35.739595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.740490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.827255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:35.827536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.828681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-117eed60-ff38-4403-b638-dea3944e54f8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:35.831231 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-14b5eb65-ce30-4407-a775-666cd4511c6b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:35.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:35.843497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:35.981118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network e4e7ee94-7b77-41bd-be61-713ba68086da is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:35.996185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:36.008600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Deleting port 196958ac-f56b-4622-b784-2399b7eae258 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:36.009217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.010010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=92094a4b-da7e-4994-8fdf-fe92041657da,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:36.026485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62712d2d-1b45-4180-8c70-f7442b62176d None None] Network 41a5a26c-e696-4176-b284-27a9f00c9967 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:36.028693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-128380b4-56f0-4a41-b09a-97af1821b738 None None] Network e4e7ee94-7b77-41bd-be61-713ba68086da requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:36.043917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.084250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] For port 196958ac-f56b-4622-b784-2399b7eae258, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=196958ac-f56b-4622-b784-2399b7eae258,segment=NetworkSegment(bf857bc1-edb8-455a-857c-22c038fef552),segment_id=bf857bc1-edb8-455a-857c-22c038fef552)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:36.084644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.102711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Calling delete_port for 196958ac-f56b-4622-b784-2399b7eae258 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:36.152536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.165244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.188128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for 32af1864-84e4-446d-85bf-079aa2b5e501 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:36.240402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-62712d2d-1b45-4180-8c70-f7442b62176d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:36.283352 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-128380b4-56f0-4a41-b09a-97af1821b738 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:36.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:36.298928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.322589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.325359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.326506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/80fb4e50-bc52-41d6-9adf-d8cf0829c414 HTTP/1.1" status: 204 len: 168 time: 0.5933957 Nov 05 14:45:36.365955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b92ce97-b6f1-4aac-92b9-0730200edbfe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80fb4e50-bc52-41d6-9adf-d8cf0829c414,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:36.366341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] DHCP port deletion for 1bee866a-e915-49da-a1b2-52ca5394910c request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:36.459704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.464449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] For port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,segment=NetworkSegment(40b58e38-ba48-47ad-a158-2282ed35efb9),segment_id=40b58e38-ba48-47ad-a158-2282ed35efb9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:36.506570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.512992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.515101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 6bb16647-87d4-4381-abac-0ff972c8608b is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:36.545961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.613804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=32af1864-84e4-446d-85bf-079aa2b5e501,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:36.619362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Port': ['ID=196958ac-f56b-4622-b784-2399b7eae258,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:36.628246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] No DVR routers for this DVR port 196958ac-f56b-4622-b784-2399b7eae258 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:36.688366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2cebb1dc-8d88-45c6-bcdb-ccf8bb8354c8 None None] Could not find standard attr ID for object e1a751d8-ee0c-4437-bd1c-3468c1251ccd. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:36.705916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-451a4376-6e8c-46d9-8c76-91ad460ec893 None None] Pushing event updated for resources: {'Port': ['ID=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:36.709161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:45:36.712842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:45:36.735008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Deleting port 196958ac-f56b-4622-b784-2399b7eae258 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:36.735551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.836511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.842177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Router 486c0616-e971-4b8e-aee1-2337dcde59df is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:36.847911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.853927 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6c9c659-d36e-4da7-8694-05723a1e78ab tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/ports/32af1864-84e4-446d-85bf-079aa2b5e501 HTTP/1.1" status: 204 len: 168 time: 1.3578374 Nov 05 14:45:36.853927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:36.863903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39780) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:36.864768 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] Sync routers for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:36.876498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] For port 196958ac-f56b-4622-b784-2399b7eae258, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:36.877066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.877898 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f57912e5-944f-4b9e-a219-78ee6701615f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4623852 Nov 05 14:45:36.882634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:36.883267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:36.883930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39782) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:36.896190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8aa70334-4eed-48d6-b11c-7a9fc274e64b None None] Provisioning complete for port 92094a4b-da7e-4994-8fdf-fe92041657da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:36.896594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8aa70334-4eed-48d6-b11c-7a9fc274e64b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.935315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bee866a-e915-49da-a1b2-52ca5394910c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:36.957442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-8aa70334-4eed-48d6-b11c-7a9fc274e64b None None] Port 92094a4b-da7e-4994-8fdf-fe92041657da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:36.969214 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:36.970238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Calling delete_port for 196958ac-f56b-4622-b784-2399b7eae258 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:36.975845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.ipam_backend_mixin [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Port 196958ac-f56b-4622-b784-2399b7eae258 was not found and therefore no delete operation was performed {{(pid=113582) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:45:36.978247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:36.980695 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:36.981476 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.010936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dc586fb-d4b1-4e03-a2b1-c055e3194e65 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:37.012431 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6dc586fb-d4b1-4e03-a2b1-c055e3194e65 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports/92094a4b-da7e-4994-8fdf-fe92041657da HTTP/1.1" status: 200 len: 911 time: 0.1273115 Nov 05 14:45:37.020364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:37.025653 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.026842 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82fc1489-9a69-4e76-9142-443571864b7e None None] The sync data for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:37.036868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] Pushing event deleted for resources: {'Port': ['ID=196958ac-f56b-4622-b784-2399b7eae258,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:37.042791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f53528e-d08f-4f27-bc03-7ee787258c9b None None] No DVR routers for this DVR port 196958ac-f56b-4622-b784-2399b7eae258 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:37.072990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bf857bc1-edb8-455a-857c-22c038fef552') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.074075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bf857bc1-edb8-455a-857c-22c038fef552') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.081230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting subnet b2186818-b151-4a35-904c-62c9ef709258 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:37.100897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.106413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.149701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.190476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Releasing vlan 642 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:37.192090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.193548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bb345ceb-fd15-4d83-adf9-069e911153c1 None None] Provisioning complete for port 92094a4b-da7e-4994-8fdf-fe92041657da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:37.194167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb345ceb-fd15-4d83-adf9-069e911153c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:37.203003 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:37.274372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.327295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:37.337509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.350146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] Sync routers for ids ['486c0616-e971-4b8e-aee1-2337dcde59df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:37.379997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.388911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] 10.222.0.30 "DELETE /v2.0/networks/1bee866a-e915-49da-a1b2-52ca5394910c HTTP/1.1" status: 204 len: 168 time: 2.0920224 Nov 05 14:45:37.395922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] Routers {'486c0616-e971-4b8e-aee1-2337dcde59df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:37.396584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['486c0616-e971-4b8e-aee1-2337dcde59df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.418138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c4ccea-e7c2-4cea-9c48-38df168a7efa tempest-NetworksIpV6TestAttrs-1518799758 tempest-NetworksIpV6TestAttrs-1518799758-project] Pushing event deleted for resources: {'Network': ['ID=1bee866a-e915-49da-a1b2-52ca5394910c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:37.441531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-bb345ceb-fd15-4d83-adf9-069e911153c1 None None] Port 92094a4b-da7e-4994-8fdf-fe92041657da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:37.446804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.455644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc93ff32-e8e6-47cb-bc17-92f7290a5d5d no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:37.481392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: cc93ff32-e8e6-47cb-bc17-92f7290a5d5d {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:37.482096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cc93ff32-e8e6-47cb-bc17-92f7290a5d5d not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:37.488655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] Routers {'486c0616-e971-4b8e-aee1-2337dcde59df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:37.489470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['486c0616-e971-4b8e-aee1-2337dcde59df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.493768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5881e049-6641-4e4b-8866-10bae3d0412c None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:37.517718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.519073 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f59240a-cfb4-4c6a-8ebe-d4494dcab479 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 3.9458094 Nov 05 14:45:37.521811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:37.527138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:37.571784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:37.572473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2af9b6cc-e404-4f14-bcad-a58c53166263 None None] The sync data for ids ['486c0616-e971-4b8e-aee1-2337dcde59df'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:37.620987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.623864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.671149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:37.762888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39812) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:37.788683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.789725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5881e049-6641-4e4b-8866-10bae3d0412c None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:37.862727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39816) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:37.874022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Subnet': ['ID=b2186818-b151-4a35-904c-62c9ef709258,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:37.876119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:37.884963 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ae5ab836-efab-43c2-a641-c9daf54e06ae tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/subnets/b2186818-b151-4a35-904c-62c9ef709258 HTTP/1.1" status: 204 len: 168 time: 1.0162332 Nov 05 14:45:37.887351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39820) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:37.967557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:37.968231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.019013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8:1::1 (41a5a26c-e696-4176-b284-27a9f00c9967/e9ae4875-a339-4982-9aaa-18acc17e2b5d/24bae6ef-8308-4082-b6c3-87e06c6669e1) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:38.144788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-1727900335'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:38.172989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.186784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:38.192893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.201557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.217362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.221549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.258877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 41a5a26c-e696-4176-b284-27a9f00c9967 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:38.262104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:38.266114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:38.266515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.332514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=24bae6ef-8308-4082-b6c3-87e06c6669e1,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:38.342631 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-290cff14-e94c-400f-a132-8cf3ea152376 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5b43437541e445ee9cffdd31db12e7c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4698274 Nov 05 14:45:38.347795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39824) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:38.374302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.376763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 196958ac-f56b-4622-b784-2399b7eae258 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:38.421224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 196958ac-f56b-4622-b784-2399b7eae258 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:38.421819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 196958ac-f56b-4622-b784-2399b7eae258 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:38.479800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.492033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Deleting port 75ec3e84-9dc0-4fc0-97fd-465feb912559 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:38.492239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.592185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] For port 75ec3e84-9dc0-4fc0-97fd-465feb912559, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75ec3e84-9dc0-4fc0-97fd-465feb912559,segment=NetworkSegment(ac4fde7b-bf77-4d29-85a8-0a85757b42f4),segment_id=ac4fde7b-bf77-4d29-85a8-0a85757b42f4)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:38.592585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.608037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Calling delete_port for 75ec3e84-9dc0-4fc0-97fd-465feb912559 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:38.690773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.727977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.743619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.793049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.795382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'SecurityGroup': ['ID=88dda8f4-7ece-44f1-a88c-082f6122acd5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:38.824397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 614} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:38.878074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.901727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:38.902652 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Added segment a8d37fa5-e1d8-46ef-8ec0-51d99f69f16c of type vlan for network 1557b5a0-960f-471e-a237-a6a5b7dcc894 Nov 05 14:45:38.927058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] No DVR routers for this DVR port 75ec3e84-9dc0-4fc0-97fd-465feb912559 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:38.961283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Port': ['ID=75ec3e84-9dc0-4fc0-97fd-465feb912559,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:39.005108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.079202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.081979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.085492 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8da17502-58a5-4737-8b7d-364f94e8de51 HTTP/1.1" status: 204 len: 168 time: 0.7324989 Nov 05 14:45:39.099035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.105731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.106517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.118630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca8939af-ad45-41cd-b525-0b53dab81ef0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8da17502-58a5-4737-8b7d-364f94e8de51,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:39.121659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.164138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.169523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:39.170056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.185687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6d5aabfe-1ee5-4b46-a5dc-b3253f8911d2 None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:39.186618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6d5aabfe-1ee5-4b46-a5dc-b3253f8911d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.294503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=24bae6ef-8308-4082-b6c3-87e06c6669e1,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:39.298309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a333486-afc3-4679-b8cc-41a251b10f29 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:39.306730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 41a5a26c-e696-4176-b284-27a9f00c9967 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:39.309079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:39.425361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a333486-afc3-4679-b8cc-41a251b10f29 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:39.436630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 6bb16647-87d4-4381-abac-0ff972c8608b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:39.595347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:39.610218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] Sync routers for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:39.615621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-26bea5a6-43dc-49a5-88a6-c18ea6929de5 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5940340 Nov 05 14:45:39.620028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39846) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:39.621608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d191e95-5fd7-4348-b056-51734fb90a4e']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.630488 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:39.633232 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.660615 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.8884468 Nov 05 14:45:39.661688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39848) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:39.661816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:39.662138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.675097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b309ab3-0228-4758-8770-f403c81ffaa0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:39.679937 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b309ab3-0228-4758-8770-f403c81ffaa0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports/24bae6ef-8308-4082-b6c3-87e06c6669e1 HTTP/1.1" status: 200 len: 913 time: 0.0583138 Nov 05 14:45:39.680749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39850) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:39.684145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'subnet': {'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:39.711349 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.730801 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:39.731658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.770125 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.770839 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98bff5b1-2630-4122-851f-4835ffd9dc0f None None] The sync data for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:39.801299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.802309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ac4fde7b-bf77-4d29-85a8-0a85757b42f4') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:39.824209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee5f71b-8c32-4592-b25c-af5d1197f487 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Network': ['ID=1557b5a0-960f-471e-a237-a6a5b7dcc894,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:39.827862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.842337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:39.867369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.881046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Releasing vlan 628 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:39.881456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:39.884767 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:40.006375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:40.010493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.052696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.101170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.104470 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] 10.222.0.30 "DELETE /v2.0/networks/0d191e95-5fd7-4348-b056-51734fb90a4e HTTP/1.1" status: 204 len: 168 time: 2.2155793 Nov 05 14:45:40.110233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.140089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5302c995-f603-4f4c-85a2-6983b0e44cd6 tempest-AllowedAddressPairTestJSON-1490596009 tempest-AllowedAddressPairTestJSON-1490596009-project] Pushing event deleted for resources: {'Network': ['ID=0d191e95-5fd7-4348-b056-51734fb90a4e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:40.148066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39864) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.202366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Provisioning complete for port 92094a4b-da7e-4994-8fdf-fe92041657da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:40.203192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.262821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Port 92094a4b-da7e-4994-8fdf-fe92041657da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:40.283286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Provisioning complete for port 6d758bd7-e381-4209-a680-de95751c63af triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:40.284054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8d2ec57a-2ded-4478-b398-ec442f1d056c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.425707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.443581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-53ddf217-7a17-4d61-8f26-4693276bec9d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] Request body: {'port': {'network_id': 'bfbc7764-260e-4683-8dda-a465527630b1', 'name': 'tempest-NetworksNegativeTestJSON-1370403664'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:40.462631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.471224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-53ddf217-7a17-4d61-8f26-4693276bec9d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] POST failed (client error): The resource could not be found. Nov 05 14:45:40.471846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-53ddf217-7a17-4d61-8f26-4693276bec9d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.473070 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53ddf217-7a17-4d61-8f26-4693276bec9d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.3236916 Nov 05 14:45:40.479001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39870) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.525404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 24bae6ef-8308-4082-b6c3-87e06c6669e1 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:40.526019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.538114 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-771b599a-414b-45bc-b98c-572a2b3301f9 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:40.538832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-771b599a-414b-45bc-b98c-572a2b3301f9 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.546869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-771b599a-414b-45bc-b98c-572a2b3301f9 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "DELETE /v2.0/networks/4f1b10d1-315d-4252-b650-166e6d0fe5d0 HTTP/1.1" status: 404 len: 339 time: 0.0680864 Nov 05 14:45:40.552427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39874) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.611046 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-80e5ec82-1c2c-4599-8563-19014d701e8d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:40.611733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-80e5ec82-1c2c-4599-8563-19014d701e8d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.619841 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-80e5ec82-1c2c-4599-8563-19014d701e8d tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "DELETE /v2.0/ports/05d6fb9e-f051-4eac-a253-3693eac7feb8 HTTP/1.1" status: 404 len: 333 time: 0.0622070 Nov 05 14:45:40.621263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39876) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.625157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.683561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-f93654cc-19fe-4013-9cd4-733f4d4001f2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] DELETE failed (client error): The resource could not be found. Nov 05 14:45:40.684023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f93654cc-19fe-4013-9cd4-733f4d4001f2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.699063 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f93654cc-19fe-4013-9cd4-733f4d4001f2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "DELETE /v2.0/subnets/a94a0d0c-621d-4f0f-ab63-e29c21b181a6 HTTP/1.1" status: 404 len: 337 time: 0.0727830 Nov 05 14:45:40.699596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39880) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.718024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39882) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.746394 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd41880c-37e9-4c87-a66c-97168a22862e tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] GET failed (client error): The resource could not be found. Nov 05 14:45:40.747867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fd41880c-37e9-4c87-a66c-97168a22862e tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "GET /v2.0/networks/c217d9a9-298c-4f38-8c97-1a99a097235c HTTP/1.1" status: 404 len: 339 time: 0.0399249 Nov 05 14:45:40.752732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39886) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.785275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Subnet': ['ID=797dfb34-cf8a-436e-96e5-05a94bb2f935,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:40.809547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router 486c0616-e971-4b8e-aee1-2337dcde59df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:40.811060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Checking segment: {'id': 'a8d37fa5-e1d8-46ef-8ec0-51d99f69f16c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:40.811418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network hostable DHCP agents. Network: 1557b5a0-960f-471e-a237-a6a5b7dcc894, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:40.812173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-eee35583-9886-4a4e-a439-a904307d0e73 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] GET failed (client error): The resource could not be found. Nov 05 14:45:40.820626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39888) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.821655 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eee35583-9886-4a4e-a439-a904307d0e73 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "GET /v2.0/ports/8459d9ca-5a2f-4d90-94ed-15bd1967283b HTTP/1.1" status: 404 len: 333 time: 0.0672719 Nov 05 14:45:40.834649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:40.850676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 24bae6ef-8308-4082-b6c3-87e06c6669e1 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:40.863812 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-cc5a4853-2fb4-45bb-876b-efb2f5992b23 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] GET failed (client error): The resource could not be found. Nov 05 14:45:40.865193 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cc5a4853-2fb4-45bb-876b-efb2f5992b23 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "GET /v2.0/subnets/7022943d-14ad-4560-a9c7-c629fb4f1ab8 HTTP/1.1" status: 404 len: 337 time: 0.0423357 Nov 05 14:45:40.868979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39890) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.876335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2eafa934-904a-4c39-a808-085e158c48f3 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] Request body: {'network': {'name': 'new_name'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:40.936192 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2eafa934-904a-4c39-a808-085e158c48f3 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] PUT failed (client error): The resource could not be found. Nov 05 14:45:40.936902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2eafa934-904a-4c39-a808-085e158c48f3 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.942574 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2eafa934-904a-4c39-a808-085e158c48f3 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "PUT /v2.0/networks/6dc2a797-5963-45e1-a2c8-26c2af15efc8 HTTP/1.1" status: 404 len: 339 time: 0.0723913 Nov 05 14:45:40.945232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39892) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.947157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:40.962653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2e41cc92-432a-45f0-b882-0e4e4bdfd5d5 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] Request body: {'port': {'name': 'new_name'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:40.981859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-22d9cef4-22ec-49b6-a1dc-c136dae561e4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=cc6949a83f804429a49a501b3e1538bb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2626951 Nov 05 14:45:40.991662 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2e41cc92-432a-45f0-b882-0e4e4bdfd5d5 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] PUT failed (client error): The resource could not be found. Nov 05 14:45:40.992319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2e41cc92-432a-45f0-b882-0e4e4bdfd5d5 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:40.997200 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2e41cc92-432a-45f0-b882-0e4e4bdfd5d5 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "PUT /v2.0/ports/ead51ee7-c0cd-4758-9649-6812801fdd49 HTTP/1.1" status: 404 len: 333 time: 0.0473332 Nov 05 14:45:40.997200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39894) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:40.999744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1557b5a0-960f-471e-a237-a6a5b7dcc894) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:41.004318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:41.004948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.012828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39896) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.019720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d68b5a59-8cc0-4d0d-99b7-5aa94d6391e2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:41.051474 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-d68b5a59-8cc0-4d0d-99b7-5aa94d6391e2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] PUT failed (client error): The resource could not be found. Nov 05 14:45:41.052114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d68b5a59-8cc0-4d0d-99b7-5aa94d6391e2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:45:41.053334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d68b5a59-8cc0-4d0d-99b7-5aa94d6391e2 tempest-NetworksNegativeTestJSON-1505749835 tempest-NetworksNegativeTestJSON-1505749835-project] 10.222.0.30 "PUT /v2.0/subnets/47ac3700-d1a5-4e39-97cd-6e6a251482c3 HTTP/1.1" status: 404 len: 337 time: 0.0394495 Nov 05 14:45:41.081552 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-12915cdb-8aa9-498a-becc-2f9a55cf0d6a tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 1.4044089 Nov 05 14:45:41.082843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.091062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-470446279', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:41.116728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:41.121407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.122598 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9aef745e-848e-4052-acfd-cfa3f8626110 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "PUT /v2.0/routers/486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 200 len: 921 time: 3.5997686 Nov 05 14:45:41.125323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.130401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] Sync routers for ids ['486c0616-e971-4b8e-aee1-2337dcde59df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:41.159541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.160783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.170315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.173951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] Routers {'486c0616-e971-4b8e-aee1-2337dcde59df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:41.174865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['486c0616-e971-4b8e-aee1-2337dcde59df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:41.237810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=24bae6ef-8308-4082-b6c3-87e06c6669e1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:41.251715 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-09894438-6a06-4096-831b-b8616d3acb1e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 200 len: 921 time: 0.1253204 Nov 05 14:45:41.253400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.255335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:41.274137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39906) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.294011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aab3010a-8cdc-4950-80dd-827fdd69b852 None None] Network 0d191e95-5fd7-4348-b056-51734fb90a4e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:41.299395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] Routers {'486c0616-e971-4b8e-aee1-2337dcde59df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:41.300029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['486c0616-e971-4b8e-aee1-2337dcde59df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:41.334683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.350631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:41.353529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd18417-1583-4e6f-a8f4-5d8783f5ed58 None None] The sync data for ids ['486c0616-e971-4b8e-aee1-2337dcde59df'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:41.357555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93bd0fd0-27d9-4a2b-a92d-e26893f111e3 None None] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:41.368099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-aab3010a-8cdc-4950-80dd-827fdd69b852 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:45:41.368852 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:41.425340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.446794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39910) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.473514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d527cbbc-0cc6-4aca-95a4-edbb7e5b76f4 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:41.478724 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d527cbbc-0cc6-4aca-95a4-edbb7e5b76f4 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=486c0616-e971-4b8e-aee1-2337dcde59df&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.2030365 Nov 05 14:45:41.479444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39914) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.494252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d975da3b-ab79-4fb0-9f5d-ddb452cb8621 None None] Provisioning complete for port 92094a4b-da7e-4994-8fdf-fe92041657da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:41.495625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d975da3b-ab79-4fb0-9f5d-ddb452cb8621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.567035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-279da113-71de-4fe9-b5b9-e9426c53253f None None] DHCP port deletion for 0d191e95-5fd7-4348-b056-51734fb90a4e request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:41.577634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75ec3e84-9dc0-4fc0-97fd-465feb912559 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:41.650731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 75ec3e84-9dc0-4fc0-97fd-465feb912559 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:41.651746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75ec3e84-9dc0-4fc0-97fd-465feb912559 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:41.670569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81262f25-9b3e-4976-ab1a-99fe4fced946 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:41.672617 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-81262f25-9b3e-4976-ab1a-99fe4fced946 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.1847305 Nov 05 14:45:41.674156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.678584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.679083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d975da3b-ab79-4fb0-9f5d-ddb452cb8621 None None] Port 92094a4b-da7e-4994-8fdf-fe92041657da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-93bd0fd0-27d9-4a2b-a92d-e26893f111e3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:41.681673 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:41.685056 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/453c09da-eea8-48bc-8d70-1f589eed6326 HTTP/1.1" status: 204 len: 168 time: 0.6861928 Nov 05 14:45:41.688354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39918) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.717553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-840f2cf0-55d9-41f9-806a-a2847ae184ca None None] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:41.737062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.743600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c36b8f8-2586-436e-816f-889de403b54b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=453c09da-eea8-48bc-8d70-1f589eed6326,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:41.754373 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fd5de7fc-7065-4bc3-88ea-c1906a7b316d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 200 len: 205 time: 0.0618219 Nov 05 14:45:41.755642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d1ac17d-5230-4aa5-a7e0-7e67e36d93dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.762516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39924) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-840f2cf0-55d9-41f9-806a-a2847ae184ca None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:41.808401 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:41.816128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d975da3b-ab79-4fb0-9f5d-ddb452cb8621 None None] Provisioning complete for port 6d758bd7-e381-4209-a680-de95751c63af triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:41.816683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d975da3b-ab79-4fb0-9f5d-ddb452cb8621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:41.998394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 6bb16647-87d4-4381-abac-0ff972c8608b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:42.000085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.074044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Could not find standard attr ID for object 24bae6ef-8308-4082-b6c3-87e06c6669e1. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:42.077494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d1ac17d-5230-4aa5-a7e0-7e67e36d93dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.089110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d1ac17d-5230-4aa5-a7e0-7e67e36d93dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.091268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Provisioning complete for port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:42.091640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.125929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:42.134874 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-369bb6d9-a77d-4db5-98ef-ab7380c75b61 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4529030 Nov 05 14:45:42.139422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39932) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:42.141672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] Sync routers for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:42.163501 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:42.164252 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:42.192012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.229827 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:42.239379 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:42.240274 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:42.296450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8d1ac17d-5230-4aa5-a7e0-7e67e36d93dc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9a79b59e3c81461f99a05f78ada6e1e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8478925 Nov 05 14:45:42.297494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1ac17d-5230-4aa5-a7e0-7e67e36d93dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96e05f27-18d7-449b-bea4-66dad32c0440,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:42.298197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:42.300167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39938) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:42.302671 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2980bbe-2401-4fa0-a6e2-eb4d0fd22c8b None None] The sync data for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:42.347232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bf146d9-1ec7-4743-9864-21a5eaead83a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:42.375599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port 698d2648-f213-4c7b-9e78-d3743b35eab8 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:42.375931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.381777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.393006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Provisioning complete for port 92094a4b-da7e-4994-8fdf-fe92041657da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:42.394375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.417465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.420994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.442824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.471078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Port 92094a4b-da7e-4994-8fdf-fe92041657da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:42.528185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Provisioning complete for port 6d758bd7-e381-4209-a680-de95751c63af triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:42.528588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9355a01d-45a7-4948-a394-657f6e1a4fcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.555109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.559543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.563034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.565899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/96e05f27-18d7-449b-bea4-66dad32c0440 HTTP/1.1" status: 204 len: 168 time: 0.2615118 Nov 05 14:45:42.587708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbdb516-bf28-43df-85d4-36cbae2b6ae8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96e05f27-18d7-449b-bea4-66dad32c0440,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:42.595981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for 698d2648-f213-4c7b-9e78-d3743b35eab8 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:42.682621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bf146d9-1ec7-4743-9864-21a5eaead83a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:42.819252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39954) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:42.822391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.44 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/09fe48c0-01a9-4fc4-920e-2ba25aa12ee1) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:42.855292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:42.896071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=698d2648-f213-4c7b-9e78-d3743b35eab8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:42.985427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.052997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e2b0738-d43a-416e-9073-212f0ae470a0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:43.092050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.094174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.147855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.160418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-498070648'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:43.190009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.191024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router 486c0616-e971-4b8e-aee1-2337dcde59df {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:43.191167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e2b0738-d43a-416e-9073-212f0ae470a0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:43.196855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.201638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.207178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e6c2825-f19a-4d76-982a-a4a28923c052 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 204 len: 168 time: 1.4430726 Nov 05 14:45:43.208785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39970) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:43.213360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1529693519', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:43.221695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Made reservation on behalf of 7204d82b2b764e0cadbc376ceb84e255 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:43.225202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.240161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.283444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.284412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.388613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.398713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.423842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.430362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.447056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.449029 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-52264ca1-b3b7-49b8-b092-18ec8a74fa6f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2392049 Nov 05 14:45:43.452592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39980) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:43.464022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:43.635408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.681650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:43.683118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39984) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:43.695739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:43.705566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:43.733042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=09fe48c0-01a9-4fc4-920e-2ba25aa12ee1,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:43.820898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-379593705'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:43.858507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 600} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:43.871831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe2573fd-42c4-4497-95f5-f4bac59006a7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:43.881487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.882815 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Added segment 54ec1d54-5cee-4638-8644-84a4a21c0075 of type vlan for network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d Nov 05 14:45:43.926778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:43.930345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.954101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:43.995789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.011621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 92094a4b-da7e-4994-8fdf-fe92041657da {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:44.011956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.077619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.088904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.094360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:44.094965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.196579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.199963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.203719 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.3832638 Nov 05 14:45:44.211222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 39992) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:44.217630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41cd083-1782-4a85-a4cb-9f9aad138e7b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'Network': ['ID=cdc64d7c-a62a-4d63-be32-f83d9dcfe66d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:44.220269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Request body: {'subnet': {'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:44.232163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:44.259216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 92094a4b-da7e-4994-8fdf-fe92041657da owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:44.346944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.368824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.387941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.411818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.471375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:44.494382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'SecurityGroup': ['ID=50f23811-a493-49d4-9fd2-80f166253d4a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:44.495839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Allocated IP 172.26.5.93 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d40fce32-174c-464b-9ec9-c54b9a5f1dd6) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:44.501748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.502087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment a1867726-142d-427e-8d69-809bf110a754 of type vlan for network 368b908d-d707-44c5-ba9a-168716fe2f61 Nov 05 14:45:44.590174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Made reservation on behalf of 7204d82b2b764e0cadbc376ceb84e255 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:44.593682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.607206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.645893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.682628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:44.688281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:44.694404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:44.716114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.720011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event updated for resources: {'Port': ['ID=d40fce32-174c-464b-9ec9-c54b9a5f1dd6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:44.808548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.818783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.824373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:44.824980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.946076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:44.953695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.2643056 Nov 05 14:45:44.954871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 39996) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:44.961268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-1001819170'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:44.986207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.005591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=92094a4b-da7e-4994-8fdf-fe92041657da,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:45.017815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb0aa87-57e1-413d-9761-e0ee4d8b34a2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=368b908d-d707-44c5-ba9a-168716fe2f61,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:45.030575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 368b908d-d707-44c5-ba9a-168716fe2f61 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:45.061940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:45.066158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.136129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 610} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:45.152051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.152500 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment df409475-436a-4244-8ab4-6714ff2112f0 of type vlan for network 1216238d-0e6e-4e75-af15-fd91bae24352 Nov 05 14:45:45.186586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.223304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.279418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.312919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.317666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.322712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.328674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:45.329281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.362924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'Subnet': ['ID=ef83c757-6a1d-4ae7-9afe-8353d54df127,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:45.429304 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4733534 Nov 05 14:45:45.434154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:45.442828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:45.465045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b85be097-3b2d-4594-a790-e60f5bb739b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=1216238d-0e6e-4e75-af15-fd91bae24352,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:45.479438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1216238d-0e6e-4e75-af15-fd91bae24352 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:45.605646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:45.609157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.654569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Router dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:45.706488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:45.714588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Checking segment: {'id': '54ec1d54-5cee-4638-8644-84a4a21c0075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:45.714952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Network hostable DHCP agents. Network: cdc64d7c-a62a-4d63-be32-f83d9dcfe66d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:45.723887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 6bb16647-87d4-4381-abac-0ff972c8608b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:45.783855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:45.809981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:45.817372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.820915 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c674deda-4a95-4f51-b23d-48796001cc28 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "PUT /v2.0/routers/dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 200 len: 879 time: 2.3596139 Nov 05 14:45:45.825861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] Sync routers for ids ['dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:45.827044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40006) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:45.836634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] Routers {'dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:45.837261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:45.873505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:45.882306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] Routers {'dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:45.882942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:45.893122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, cdc64d7c-a62a-4d63-be32-f83d9dcfe66d) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:45.911916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.921129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8887075e-6a12-42d3-82fc-bc636714a221 None None] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:45.923436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:45.924033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c3b9f50-1b3f-4bb4-94fe-9b1553bc9d9f None None] The sync data for ids ['dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:45.940342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:45.942196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:45.946208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:45.957144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fb06014d-f94e-45f3-a582-4bb93c40481e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8173263 Nov 05 14:45:45.961582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40008) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:45.970824 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] Sync routers for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:45.973455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:45.984809 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:45.985737 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.013509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cebfcc7e-e051-4ac4-a3c2-f045d66b420b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.7983594 Nov 05 14:45:46.018258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.028103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:46.028709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Request body: {'port': {'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1351977431'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:46.030678 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.030937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-613639cc-8a1a-4748-8443-cb9b72e8fdca tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=6bb16647-87d4-4381-abac-0ff972c8608b HTTP/1.1" status: 200 len: 205 time: 0.0682526 Nov 05 14:45:46.031565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40012) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.035694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=ed286e7f-a02b-4e69-b788-bed1ea0ec76a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:46.044164 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] Routers {'6bb16647-87d4-4381-abac-0ff972c8608b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8887075e-6a12-42d3-82fc-bc636714a221 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:46.044667 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:46.047052 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6bb16647-87d4-4381-abac-0ff972c8608b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.059281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:46.059910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.079657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.080878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7286b5d3-145e-4581-a0a0-0c5988abcca4 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 4.9970655 Nov 05 14:45:46.085210 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.086192 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25ae6733-7a38-4355-ac81-6c1ced2b2de9 None None] The sync data for ids ['6bb16647-87d4-4381-abac-0ff972c8608b'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:46.086801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40014) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.110771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11e2c0ba-2b8d-408d-bb9c-061905863018 None None] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:46.122684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': 'a1867726-142d-427e-8d69-809bf110a754', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:46.123357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 368b908d-d707-44c5-ba9a-168716fe2f61, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:46.126888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.140848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.141640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8e86e2c5-e71d-4a3d-ba46-176be345d7d8 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 200 len: 920 time: 0.3134930 Nov 05 14:45:46.147445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40018) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.196545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:46.197185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.207320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 368b908d-d707-44c5-ba9a-168716fe2f61 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:46.223119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 368b908d-d707-44c5-ba9a-168716fe2f61) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:46.227777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:46.228767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.242840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c93fccb7-0ba8-41c2-a7fd-77019bd2b753 None None] Network 368b908d-d707-44c5-ba9a-168716fe2f61 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:46.249589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:46.250227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a600f46b-0590-4c5b-8478-4a45759413d4 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:46.303918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d838499-7e7f-44b2-b2d2-02e008bd7eed tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:46.308415 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2d838499-7e7f-44b2-b2d2-02e008bd7eed tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1569629 Nov 05 14:45:46.318343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40020) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-11e2c0ba-2b8d-408d-bb9c-061905863018 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:46.320581 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:46.337279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.340845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c93fccb7-0ba8-41c2-a7fd-77019bd2b753 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:46.369818 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:46.381159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9840a7ba-27c4-4f57-8bfb-e0b1969d536b None None] Network 368b908d-d707-44c5-ba9a-168716fe2f61 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:46.400228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-95359437-2be7-4e45-9eea-ed5f8f327ef9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9587080 Nov 05 14:45:46.400775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40024) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.406070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:46.408693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Made reservation on behalf of 7204d82b2b764e0cadbc376ceb84e255 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:46.409576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.410101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 6bb16647-87d4-4381-abac-0ff972c8608b {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:46.412106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.417420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.421227 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71b3b468-5683-4b54-8d88-7ffe61b7b664 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b HTTP/1.1" status: 204 len: 168 time: 0.3870540 Nov 05 14:45:46.423570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40026) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9840a7ba-27c4-4f57-8bfb-e0b1969d536b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:46.474336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:46.485191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] device_id is not set on port a0ac12f8-0068-435d-9e0c-2afa37b93bde yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:46.500748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c43814f-c3a4-4eb9-be3c-ea2e6fc47988 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:46.542769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet e9ae4875-a339-4982-9aaa-18acc17e2b5d {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:46.547250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.549546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72afef9e-a232-4b63-bcde-831b704eb252 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:46.551159 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-72afef9e-a232-4b63-bcde-831b704eb252 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.2310789 Nov 05 14:45:46.557511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40028) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.594818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:46.597312 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-daf53cfe-fb8b-414c-adc5-de9ac17e9216 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 200 len: 205 time: 0.0364323 Nov 05 14:45:46.598713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.603747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40030) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:46.606405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.631349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c43814f-c3a4-4eb9-be3c-ea2e6fc47988 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:46.716807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Allocated IP 172.20.0.3 (cdc64d7c-a62a-4d63-be32-f83d9dcfe66d/ef83c757-6a1d-4ae7-9afe-8353d54df127/a0ac12f8-0068-435d-9e0c-2afa37b93bde) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:46.985706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:46.991490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.079712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-368b908d-d707-44c5-ba9a-168716fe2f61', 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': 'ed286e7f-a02b-4e69-b788-bed1ea0ec76a'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:47.080747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.101400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-cdc64d7c-a62a-4d63-be32-f83d9dcfe66d', 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d', 'tenant_id': '7204d82b2b764e0cadbc376ceb84e255', 'fixed_ips': [{'subnet_id': 'ef83c757-6a1d-4ae7-9afe-8353d54df127'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:47.102479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.105280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.176208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:47.185366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:47.186297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.190096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:47.209508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.218062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'Port': ['ID=a0ac12f8-0068-435d-9e0c-2afa37b93bde,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.303884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:47.304833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.336128 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-580f33c8-f914-4f83-a2ae-1d1891328d2b tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 1.3139958 Nov 05 14:45:47.340762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40036) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:47.347952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Request body: {'port': {'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1248182195', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:47.348544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] bootfile-name is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:47.349072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] tftp-server is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:47.349254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] server-ip-address is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:47.352123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Allocated IP 172.20.0.2 (368b908d-d707-44c5-ba9a-168716fe2f61/ed286e7f-a02b-4e69-b788-bed1ea0ec76a/3a448037-1369-460d-adf7-a51d573fd844) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:47.355206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Allocated IP 172.20.0.2 (cdc64d7c-a62a-4d63-be32-f83d9dcfe66d/ef83c757-6a1d-4ae7-9afe-8353d54df127/130720c5-a66f-4040-90f7-455d63ef75e6) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:47.402065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.451218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.457503 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/e9ae4875-a339-4982-9aaa-18acc17e2b5d HTTP/1.1" status: 204 len: 168 time: 1.0323613 Nov 05 14:45:47.458390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8f7ab6-1de0-4610-aa59-0c6235224739 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=e9ae4875-a339-4982-9aaa-18acc17e2b5d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.460263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40040) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:47.465082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.482755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.1 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:47.517128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.576211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=8b92d01e-3e77-4037-8c4e-09b9e3932ed7,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.606785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': 'df409475-436a-4244-8ab4-6714ff2112f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:47.606985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 1216238d-0e6e-4e75-af15-fd91bae24352, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:47.625953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port d40fce32-174c-464b-9ec9-c54b9a5f1dd6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:47.626285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.659286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.671740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1216238d-0e6e-4e75-af15-fd91bae24352 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:47.688318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1216238d-0e6e-4e75-af15-fd91bae24352) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:47.693096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:47.693805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.699917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.701580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.704592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 7dee6b6a-2a7c-408b-be07-1f6a83055699 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:47.707619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.712495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.718372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.720152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.737073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.749358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for d40fce32-174c-464b-9ec9-c54b9a5f1dd6 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:47.769347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Network 368b908d-d707-44c5-ba9a-168716fe2f61 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:47.771458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:47.774201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:47.780958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:47.785126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:47.787994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:47.792261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Made reservation on behalf of 7204d82b2b764e0cadbc376ceb84e255 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:47.796256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.797059 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Pushing event updated for resources: {'Port': ['ID=3a448037-1369-460d-adf7-a51d573fd844,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.801835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:47.818418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:47.821852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-750d7815-cc96-4daf-9d57-8de0114a08e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4172752 Nov 05 14:45:47.823241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40042) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:47.823963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.830583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:47.830780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-362113511', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:47.883931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.887446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.902992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.904049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.920844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Pushing event updated for resources: {'Port': ['ID=130720c5-a66f-4040-90f7-455d63ef75e6,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:47.926008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Attempting to bind port 3a448037-1369-460d-adf7-a51d573fd844 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:47.926442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Attempting to bind port 3a448037-1369-460d-adf7-a51d573fd844 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'a1867726-142d-427e-8d69-809bf110a754', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:47.926867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Attempting to bind port 3a448037-1369-460d-adf7-a51d573fd844 on network 368b908d-d707-44c5-ba9a-168716fe2f61 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:47.929340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Attempting to bind port 130720c5-a66f-4040-90f7-455d63ef75e6 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:47.929766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Attempting to bind port 130720c5-a66f-4040-90f7-455d63ef75e6 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '54ec1d54-5cee-4638-8644-84a4a21c0075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:47.930178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Attempting to bind port 130720c5-a66f-4040-90f7-455d63ef75e6 on network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:47.937797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:47.938262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Checking segment: {'id': 'a1867726-142d-427e-8d69-809bf110a754', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:47.938732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.939192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Bound using segment: {'id': 'a1867726-142d-427e-8d69-809bf110a754', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:47.939727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Bound port: 3a448037-1369-460d-adf7-a51d573fd844, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1867726-142d-427e-8d69-809bf110a754', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '368b908d-d707-44c5-ba9a-168716fe2f61'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:47.940172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.943359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:47.943810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Checking segment: {'id': '54ec1d54-5cee-4638-8644-84a4a21c0075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:47.944277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:47.944763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Bound using segment: {'id': '54ec1d54-5cee-4638-8644-84a4a21c0075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:47.945331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Bound port: 130720c5-a66f-4040-90f7-455d63ef75e6, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '54ec1d54-5cee-4638-8644-84a4a21c0075', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': 'cdc64d7c-a62a-4d63-be32-f83d9dcfe66d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:47.946346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.008261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.015251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.047127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.048152 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3d2f4df3-b2bc-4676-b4a6-1d24a1ad99f1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2238219 Nov 05 14:45:48.050821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40046) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:48.059589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.068392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] For port 3a448037-1369-460d-adf7-a51d573fd844, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:48.073977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] For port 3a448037-1369-460d-adf7-a51d573fd844, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3a448037-1369-460d-adf7-a51d573fd844,segment=NetworkSegment(a1867726-142d-427e-8d69-809bf110a754),segment_id=a1867726-142d-427e-8d69-809bf110a754)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:48.080376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] For port 130720c5-a66f-4040-90f7-455d63ef75e6, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:48.087298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.106058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] For port 130720c5-a66f-4040-90f7-455d63ef75e6, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=130720c5-a66f-4040-90f7-455d63ef75e6,segment=NetworkSegment(54ec1d54-5cee-4638-8644-84a4a21c0075),segment_id=54ec1d54-5cee-4638-8644-84a4a21c0075)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:48.138587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.153559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.163197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=d40fce32-174c-464b-9ec9-c54b9a5f1dd6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:48.185849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca22f4b-e7b6-4e14-bf77-50579df74f97 None None] Pushing event updated for resources: {'Port': ['ID=3a448037-1369-460d-adf7-a51d573fd844,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:48.265666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c37b29-dac4-45ef-94b3-318d2b77816a None None] Pushing event updated for resources: {'Port': ['ID=130720c5-a66f-4040-90f7-455d63ef75e6,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:48.326967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] device_id is not set on port 19f4d047-7063-439f-9e4d-1c02a268fbda yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:48.391943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.579270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.583326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.671175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.671596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.720862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.721523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:45:48.732962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.734011 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da7844ea-88e1-4068-a67e-91fb7db555ba tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 204 len: 168 time: 2.1248784 Nov 05 14:45:48.744033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40052) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:48.748745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1699804017', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:48.799202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Allocated IP 172.20.0.12 (cdc64d7c-a62a-4d63-be32-f83d9dcfe66d/ef83c757-6a1d-4ae7-9afe-8353d54df127/19f4d047-7063-439f-9e4d-1c02a268fbda) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:48.850471 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-b2c717ba-8932-4f31-94df-d69afd41cd9d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1810105 Nov 05 14:45:48.873284 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.874492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.877556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.894350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.971911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=7dee6b6a-2a7c-408b-be07-1f6a83055699,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:48.978713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:48.982161 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6dc8cbc7-1445-4b42-bd20-be07b866d96e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/7dee6b6a-2a7c-408b-be07-1f6a83055699 HTTP/1.1" status: 204 len: 168 time: 1.5168724 Nov 05 14:45:48.988368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40054) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:49.065647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.107048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.159189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.163324 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da792208-ccb4-40e4-8171-dfec816c621d tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.4181714 Nov 05 14:45:49.165672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40058) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:49.193900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-59b84f7d-3c1b-4573-a3aa-6deebc96f9ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.195625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-59b84f7d-3c1b-4573-a3aa-6deebc96f9ae service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 1099 time: 0.2701128 Nov 05 14:45:49.198373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.203527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': True}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:49.211562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.308520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.340055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.20.0.1 (368b908d-d707-44c5-ba9a-168716fe2f61/ed286e7f-a02b-4e69-b788-bed1ea0ec76a/7dfeaaba-0731-4559-82f0-4b9961babc02) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:49.372876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:49.380622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:49.392144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:49.396174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.399054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'Port': ['ID=19f4d047-7063-439f-9e4d-1c02a268fbda,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:49.426494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.512519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.513151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.530538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:45:49.535321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:49.538728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.555369 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2072467-21f8-4138-86c5-cfb9264d56ea tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1153 time: 2.2143786 Nov 05 14:45:49.561357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-f251e725-f69c-4196-bf9a-068e49dbca95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.562193 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-f251e725-f69c-4196-bf9a-068e49dbca95 service neutron] 10.222.0.32 "GET /v2.0/networks?id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 200 len: 913 time: 0.3164020 Nov 05 14:45:49.579348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40060) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:49.641270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] Provisioning complete for port 3a448037-1369-460d-adf7-a51d573fd844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:49.642455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.743940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3a448037-1369-460d-adf7-a51d573fd844 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:49.759500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.825292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.846729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9c87f26-2782-44de-9c2c-215b5bf2e0b0 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.855393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9c87f26-2782-44de-9c2c-215b5bf2e0b0 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.863052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9c87f26-2782-44de-9c2c-215b5bf2e0b0 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:49.867347 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d9c87f26-2782-44de-9c2c-215b5bf2e0b0 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2617 time: 0.2843761 Nov 05 14:45:49.867347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:49.867669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40066) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:49.870453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.899495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3a448037-1369-460d-adf7-a51d573fd844 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:49.899868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:49.924212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:49.963121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] For port 3a448037-1369-460d-adf7-a51d573fd844, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3a448037-1369-460d-adf7-a51d573fd844,segment=NetworkSegment(a1867726-142d-427e-8d69-809bf110a754),segment_id=a1867726-142d-427e-8d69-809bf110a754)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:49.976141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.056198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2edfa9f8-03ec-42e9-83eb-35cee55049cc None None] Pushing event updated for resources: {'Port': ['ID=3a448037-1369-460d-adf7-a51d573fd844,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:50.064260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Deleting port 19f4d047-7063-439f-9e4d-1c02a268fbda {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:50.064627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.076563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de038a0e-1a2e-4ff0-8763-746a23993a60 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:50.147434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:50.148861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 130720c5-a66f-4040-90f7-455d63ef75e6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:50.154164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] Provisioning complete for port 130720c5-a66f-4040-90f7-455d63ef75e6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:50.155035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.202634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-933c6e5d-1cdc-4fbf-9daf-c808f2eaabd3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.285594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:50.288373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.295823 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-75c6129a-b226-44db-ab72-efa89662cbb6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/routers/53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2079859 Nov 05 14:45:50.298161 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:50.302039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40070) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:50.309393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'port': {'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894', 'name': 'tempest-FloatingIPTestJSON-1320199537'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:50.318180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Calling delete_port for 19f4d047-7063-439f-9e4d-1c02a268fbda owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:50.320409 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:50.321108 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:50.321819 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-4d1da32a-fe91-4847-99bd-e83dbc7e0f7e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 200 len: 1002 time: 0.7278140 Nov 05 14:45:50.329722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:50.330382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.392313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-63452912-8f5b-4955-9363-cc91308c5744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:50.394331 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-63452912-8f5b-4955-9363-cc91308c5744 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=40981c52-1a1c-434c-b98f-d3a05d50d8a6 HTTP/1.1" status: 200 len: 851 time: 0.0598612 Nov 05 14:45:50.395961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.400604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 130720c5-a66f-4040-90f7-455d63ef75e6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:50.401004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.408518 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:50.418424 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:50.419256 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:50.488183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] For port 130720c5-a66f-4040-90f7-455d63ef75e6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=130720c5-a66f-4040-90f7-455d63ef75e6,segment=NetworkSegment(54ec1d54-5cee-4638-8644-84a4a21c0075),segment_id=54ec1d54-5cee-4638-8644-84a4a21c0075)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:50.491487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de038a0e-1a2e-4ff0-8763-746a23993a60 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:50.500311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.502712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:50.506883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.509537 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:50.510921 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-984aa9d2-30aa-4d96-8512-5be9ba53f81b None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:50.528188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] device_id is not set on port c9c433fd-a471-45c2-8f0a-e09334e2fdc6 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:50.584594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-49490942-01f8-42b1-aacb-8f3ceb87179a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:50.586326 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-49490942-01f8-42b1-aacb-8f3ceb87179a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1484735 Nov 05 14:45:50.605805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,segment=NetworkSegment(40b58e38-ba48-47ad-a158-2282ed35efb9),segment_id=40b58e38-ba48-47ad-a158-2282ed35efb9)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:50.606310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.649725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343fedac-e5a6-4c58-8c98-f5125fed5daa None None] Pushing event updated for resources: {'Port': ['ID=130720c5-a66f-4040-90f7-455d63ef75e6,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:50.699856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.711894 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-7f91d89b-0ec9-458a-8879-60b8e248514a service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022556 Nov 05 14:45:50.758615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:50.771397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event deleted for resources: {'Port': ['ID=19f4d047-7063-439f-9e4d-1c02a268fbda,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:50.800023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.855719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:50.858996 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-34fa5d7a-668b-4bf9-8b0d-639efe596207 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "DELETE /v2.0/ports/19f4d047-7063-439f-9e4d-1c02a268fbda HTTP/1.1" status: 204 len: 168 time: 0.9904475 Nov 05 14:45:50.864751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40074) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:50.873322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Request body: {'port': {'name': 'tempest-new-port-name-1529453810', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:50.873719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] bootfile-name is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:50.874061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] tftp-server is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:50.874390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] server-ip-address is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:45:50.906808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1216238d-0e6e-4e75-af15-fd91bae24352', 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '8b92d01e-3e77-4037-8c4e-09b9e3932ed7'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:50.907374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.9 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/c9c433fd-a471-45c2-8f0a-e09334e2fdc6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:50.907572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.026398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.097983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 368b908d-d707-44c5-ba9a-168716fe2f61 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:51.100958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=7dfeaaba-0731-4559-82f0-4b9961babc02,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:51.156750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:51.162849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:51.207848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Allocated IP 172.21.0.2 (1216238d-0e6e-4e75-af15-fd91bae24352/8b92d01e-3e77-4037-8c4e-09b9e3932ed7/0df27e9b-ddd1-4f92-bc2c-4ae629e35162) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:51.326598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.396541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.398450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.404712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.441862 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01d66d9d-034d-490c-8940-ee5b475530a5 req-53a70d80-5c9d-496d-9d47-92819fce66b3 service neutron] 10.222.0.32 "GET /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7171783 Nov 05 14:45:51.559274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.575234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.575744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:51.598311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=f9a4eedb-efcd-43bd-a70e-b2b3f1f69301,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:51.614893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.674608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3a448037-1369-460d-adf7-a51d573fd844 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:51.703253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Network 1216238d-0e6e-4e75-af15-fd91bae24352 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:51.738910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.753504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.768249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:51.783046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:51.796579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Pushing event updated for resources: {'Port': ['ID=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:51.845706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.887542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:51.889608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Attempting to bind port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:45:51.889972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Attempting to bind port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'df409475-436a-4244-8ab4-6714ff2112f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:45:51.890319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Attempting to bind port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 on network 1216238d-0e6e-4e75-af15-fd91bae24352 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:45:51.898163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:45:51.898602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Checking segment: {'id': 'df409475-436a-4244-8ab4-6714ff2112f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:51.899429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.899429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Bound using segment: {'id': 'df409475-436a-4244-8ab4-6714ff2112f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:45:51.899832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:51.899958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Bound port: 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df409475-436a-4244-8ab4-6714ff2112f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '1216238d-0e6e-4e75-af15-fd91bae24352'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:45:51.900222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.902701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:51.922575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.925520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3a448037-1369-460d-adf7-a51d573fd844 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:51.925899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:51.950262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138d68ed-df61-4ddd-a099-fea0116e7f47 req-84e6f41c-a33a-4575-b8f5-e020642b0ee3 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:51.958370 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-138d68ed-df61-4ddd-a099-fea0116e7f47 req-84e6f41c-a33a-4575-b8f5-e020642b0ee3 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.4033377 Nov 05 14:45:51.979786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:51.980820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.018923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.7151251 Nov 05 14:45:52.020840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] In _notify_port_updated(), no bound segment for port a0ac12f8-0068-435d-9e0c-2afa37b93bde on network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:45:52.028582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:52.029533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.031805 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "PUT /v2.0/ports/a0ac12f8-0068-435d-9e0c-2afa37b93bde HTTP/1.1" status: 200 len: 1136 time: 1.1631725 Nov 05 14:45:52.033517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40084) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:52.041028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.26.5.254 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d6f5f5bc-d45d-446f-8588-bc3296d66047) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:52.041240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'port': {'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894', 'name': 'tempest-FloatingIPTestJSON-118193830'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:52.051826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40086) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:52.072663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41a5a26c-e696-4176-b284-27a9f00c9967']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:52.103487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4161396e-5098-4a84-a9f1-3e0297e40b74 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event updated for resources: {'Port': ['ID=a0ac12f8-0068-435d-9e0c-2afa37b93bde,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:52.130513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '40b58e38-ba48-47ad-a158-2282ed35efb9') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:52.130750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '40b58e38-ba48-47ad-a158-2282ed35efb9') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:52.145691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.178220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.206183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fc94a26-ae79-44c3-b2b4-72cc8e6bd519 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:52.207696 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2fc94a26-ae79-44c3-b2b4-72cc8e6bd519 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "GET /v2.0/ports/a0ac12f8-0068-435d-9e0c-2afa37b93bde HTTP/1.1" status: 200 len: 1136 time: 0.1510096 Nov 05 14:45:52.218452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40090) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:52.229138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2569f077-1a39-4138-afa2-342008d49dcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=c9c433fd-a471-45c2-8f0a-e09334e2fdc6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:52.280501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-eb577104-71a2-4520-96fc-e56857aa9978 None None] Provisioning complete for port 7dfeaaba-0731-4559-82f0-4b9961babc02 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:52.288818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.289172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eb577104-71a2-4520-96fc-e56857aa9978 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.302501 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-138d68ed-df61-4ddd-a099-fea0116e7f47 req-d09a624e-e625-4235-8b37-c1cadee652d4 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3426254 Nov 05 14:45:52.313753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 605 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:52.314168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:52.317822 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:52.349189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] For port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:45:52.390962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:52.390962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.391430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] For port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,segment=NetworkSegment(df409475-436a-4244-8ab4-6714ff2112f0),segment_id=df409475-436a-4244-8ab4-6714ff2112f0)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:45:52.411747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] device_id is not set on port 847bc79e-f772-436e-8b2b-a881706bd85f yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:52.444213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.458693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-eb577104-71a2-4520-96fc-e56857aa9978 None None] Port 7dfeaaba-0731-4559-82f0-4b9961babc02 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:52.465079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3a18ebdf-162a-45ef-89a6-e545ecd35f3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.486754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.492027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.502175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 130720c5-a66f-4040-90f7-455d63ef75e6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:52.513548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.516772 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/41a5a26c-e696-4176-b284-27a9f00c9967 HTTP/1.1" status: 204 len: 168 time: 3.4999897 Nov 05 14:45:52.528930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40096) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:52.535683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ef421f-cd97-467b-8df3-4c1ea8f689bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=41a5a26c-e696-4176-b284-27a9f00c9967,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:52.558513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-eb577104-71a2-4520-96fc-e56857aa9978 None None] Provisioning complete for port 3a448037-1369-460d-adf7-a51d573fd844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:52.559046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eb577104-71a2-4520-96fc-e56857aa9978 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.578131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Deleting port a0ac12f8-0068-435d-9e0c-2afa37b93bde {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:52.578470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.596834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f665c7-4fd9-46c1-a842-14e264ee166c None None] Pushing event updated for resources: {'Port': ['ID=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:52.629150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.7 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/847bc79e-f772-436e-8b2b-a881706bd85f) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:52.688553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 130720c5-a66f-4040-90f7-455d63ef75e6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:52.690085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.703865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.712914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.717431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.773741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Calling delete_port for a0ac12f8-0068-435d-9e0c-2afa37b93bde owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:52.850727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:52.867287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-26a8e364-a8f9-4e29-9936-b2adfed4b661 None None] Provisioning complete for port 130720c5-a66f-4040-90f7-455d63ef75e6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:52.867867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-26a8e364-a8f9-4e29-9936-b2adfed4b661 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.884055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:52.892441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:52.895873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=d6f5f5bc-d45d-446f-8588-bc3296d66047,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:52.899515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.924254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:52.927182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.011376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.042672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-26a8e364-a8f9-4e29-9936-b2adfed4b661 None None] Provisioning complete for port a0ac12f8-0068-435d-9e0c-2afa37b93bde triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:53.043128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-26a8e364-a8f9-4e29-9936-b2adfed4b661 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.085158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:53.087121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=847bc79e-f772-436e-8b2b-a881706bd85f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:53.092715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:53.093248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-26a8e364-a8f9-4e29-9936-b2adfed4b661 None None] Port a0ac12f8-0068-435d-9e0c-2afa37b93bde cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:53.095187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:53.100115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.155195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event deleted for resources: {'Port': ['ID=a0ac12f8-0068-435d-9e0c-2afa37b93bde,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:53.183448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.192476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 6d758bd7-e381-4209-a680-de95751c63af {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:53.192822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.228428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=7dfeaaba-0731-4559-82f0-4b9961babc02,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:53.356365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 6d758bd7-e381-4209-a680-de95751c63af, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6d758bd7-e381-4209-a680-de95751c63af,segment=NetworkSegment(e1e6022b-2d0c-4deb-90db-cc726ac76c14),segment_id=e1e6022b-2d0c-4deb-90db-cc726ac76c14)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:53.356817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.375328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.416054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 6d758bd7-e381-4209-a680-de95751c63af owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:53.570057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.573529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ac3fff5a-295d-4fbe-bf81-ccba7c530cb8 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "DELETE /v2.0/ports/a0ac12f8-0068-435d-9e0c-2afa37b93bde HTTP/1.1" status: 204 len: 168 time: 1.3541100 Nov 05 14:45:53.581124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:53.581660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.586129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40106) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:53.592877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 368b908d-d707-44c5-ba9a-168716fe2f61 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:53.596205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:53.599632 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.676662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Deleting subnet ef83c757-6a1d-4ae7-9afe-8353d54df127 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:45:53.680043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.722557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.725442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:53.732793 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-547e5601-1895-44bc-846d-4d768562cf43 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.6948137 Nov 05 14:45:53.787603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:53.787980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.821277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40108) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:53.831539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-931cfe43-75fe-499a-b814-1cf5e16361dc req-577ec70e-dab3-4b7d-8f85-c0738a019d2b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:53.833079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-931cfe43-75fe-499a-b814-1cf5e16361dc req-577ec70e-dab3-4b7d-8f85-c0738a019d2b tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.5963953 Nov 05 14:45:53.839189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '847bc79e-f772-436e-8b2b-a881706bd85f', 'fixed_ip_address': '172.20.0.7'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:53.892509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.909412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.919577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57ff6615-03e0-4ea8-98d0-315f056a3e38 None None] Network 41a5a26c-e696-4176-b284-27a9f00c9967 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:53.922831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:53.923649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eed054c5-4820-4925-8bcd-84ac2cbd0bac None None] Network 1216238d-0e6e-4e75-af15-fd91bae24352 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:54.026073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b54baaff-4929-4da4-bc33-7075bf9194cc None None] Network e4e7ee94-7b77-41bd-be61-713ba68086da requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-57ff6615-03e0-4ea8-98d0-315f056a3e38 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:45:54.028326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:54.061117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-931cfe43-75fe-499a-b814-1cf5e16361dc req-34e852ca-1b63-4f3d-83a3-ec4a775eda22 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2171152 Nov 05 14:45:54.063583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.091999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 6d758bd7-e381-4209-a680-de95751c63af on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:54.141816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.162916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.172199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=6d758bd7-e381-4209-a680-de95751c63af,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:54.179670 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "DELETE /v2.0/subnets/ef83c757-6a1d-4ae7-9afe-8353d54df127 HTTP/1.1" status: 204 len: 168 time: 0.5896006 Nov 05 14:45:54.189150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40112) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:54.203194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22d77851-23bd-4b44-8430-6acfee29a499 None None] DHCP port deletion for 41a5a26c-e696-4176-b284-27a9f00c9967 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:54.227367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,segment=NetworkSegment(df409475-436a-4244-8ab4-6714ff2112f0),segment_id=df409475-436a-4244-8ab4-6714ff2112f0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:54.236694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa92726-38d2-4798-8ab5-16e4d073c4c6 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event deleted for resources: {'Subnet': ['ID=ef83c757-6a1d-4ae7-9afe-8353d54df127,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:54.260014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.268496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Provisioning complete for port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:54.268896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.288808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.370194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:54.379756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b36ca2ec-9277-4a74-9cf2-4fbf8b2d66cf None None] Network cdc64d7c-a62a-4d63-be32-f83d9dcfe66d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:54.384173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-eed054c5-4820-4925-8bcd-84ac2cbd0bac None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:54.459267 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:54.461884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.473678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e4e7ee94-7b77-41bd-be61-713ba68086da']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.495758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.30 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/3955ceb2-96fb-434a-8057-751d66a3b5c3) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:54.521791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f579d519-6bf9-4347-8f1e-a291654813bc None None] Network 1216238d-0e6e-4e75-af15-fd91bae24352 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:54.530461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f13ed12-408d-4b0a-a005-43a32bd52ce4 None None] DHCP port deletion for e4e7ee94-7b77-41bd-be61-713ba68086da request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:54.580601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:54.589702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e1e6022b-2d0c-4deb-90db-cc726ac76c14') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.590153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e1e6022b-2d0c-4deb-90db-cc726ac76c14') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.651954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.678476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.694039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f579d519-6bf9-4347-8f1e-a291654813bc None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:54.714417 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:54.717283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Provisioning complete for port 130720c5-a66f-4040-90f7-455d63ef75e6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:54.717727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.747203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.769558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=3955ceb2-96fb-434a-8057-751d66a3b5c3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:54.780228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 625 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:54.780758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:54.781361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.782597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:54.787691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.789171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:54.789313 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:54.802092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:54.807967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9c337d8-06ee-436f-a764-61a80d3e0fe9 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7559605 Nov 05 14:45:54.812414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] DHCP port deletion for cdc64d7c-a62a-4d63-be32-f83d9dcfe66d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:45:54.823219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] Sync routers for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:54.828148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:54.837302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.882697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.883178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f5ac526-9c70-4206-9fa3-9561227cb84e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:54.886605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:54.887334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.887990 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1f5ac526-9c70-4206-9fa3-9561227cb84e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports/7dfeaaba-0731-4559-82f0-4b9961babc02 HTTP/1.1" status: 200 len: 910 time: 0.0588210 Nov 05 14:45:54.888603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40120) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:54.921280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-63c2b33d-c318-49eb-952d-df64e5320299 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:54.922995 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-63c2b33d-c318-49eb-952d-df64e5320299 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.2003949 Nov 05 14:45:54.927916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.929402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.940894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Provisioning complete for port 7dfeaaba-0731-4559-82f0-4b9961babc02 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:54.941350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.953896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.957492 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/e4e7ee94-7b77-41bd-be61-713ba68086da HTTP/1.1" status: 204 len: 168 time: 2.4259861 Nov 05 14:45:54.961551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40122) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:54.966702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2001612868'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:54.972573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:54.973275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:54.989526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Deleting port 130720c5-a66f-4040-90f7-455d63ef75e6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:54.990108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:54.996682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6440e1-7280-4492-bbc0-9102f7f8ebb4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=e4e7ee94-7b77-41bd-be61-713ba68086da,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:55.020305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.021112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330cc784-f16e-4f59-9f7f-c9c140ed7629 None None] The sync data for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:55.028091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Deleting port 130720c5-a66f-4040-90f7-455d63ef75e6 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:55.028730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.030641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Port 7dfeaaba-0731-4559-82f0-4b9961babc02 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:55.043583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Could not find standard attr ID for object a0ac12f8-0068-435d-9e0c-2afa37b93bde. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:55.096112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:55.099564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.122589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] For port 130720c5-a66f-4040-90f7-455d63ef75e6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=130720c5-a66f-4040-90f7-455d63ef75e6,segment=NetworkSegment(54ec1d54-5cee-4638-8644-84a4a21c0075),segment_id=54ec1d54-5cee-4638-8644-84a4a21c0075)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:55.123281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.126015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Provisioning complete for port 3a448037-1369-460d-adf7-a51d573fd844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:55.126529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbff1f21-2c96-4ac6-9c39-3ceceb3ef51c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.142743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] For port 130720c5-a66f-4040-90f7-455d63ef75e6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=130720c5-a66f-4040-90f7-455d63ef75e6,segment=NetworkSegment(54ec1d54-5cee-4638-8644-84a4a21c0075),segment_id=54ec1d54-5cee-4638-8644-84a4a21c0075)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:55.143340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.160142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Calling delete_port for 130720c5-a66f-4040-90f7-455d63ef75e6 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:55.206904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:45:55.261195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.261551 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 2b1a79e6-e721-4435-baa0-86a0d86805ba of type vlan for network ccb0be27-d23e-486c-a8a4-9713f84ef48c Nov 05 14:45:55.276309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Deleting port 0d187a67-1569-490c-ba6b-54e4b6d47353 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:55.276309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.315472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Calling delete_port for 130720c5-a66f-4040-90f7-455d63ef75e6 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:55.348365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router bcd107c5-207b-4c10-8db9-04f186647dc0 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:45:55.371188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29fac81-aaa3-441e-b44e-c98f842e4daf req-f5c2a2a3-50e2-4a32-87f7-03bd2376e101 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:55.372844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d29fac81-aaa3-441e-b44e-c98f842e4daf req-f5c2a2a3-50e2-4a32-87f7-03bd2376e101 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 946 time: 0.1542678 Nov 05 14:45:55.384063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.413685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.450432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.476267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.482487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:55.483091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.487110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] Pushing event deleted for resources: {'Port': ['ID=130720c5-a66f-4040-90f7-455d63ef75e6,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:55.489272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-697ccd37-a050-4422-8fc4-3f592d042d54 None None] No DVR routers for this DVR port 130720c5-a66f-4040-90f7-455d63ef75e6 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:55.513225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da11243a-0680-4424-81c8-72fde0e787d0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:55.524972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event deleted for resources: {'Port': ['ID=130720c5-a66f-4040-90f7-455d63ef75e6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:55.535198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] No DVR routers for this DVR port 130720c5-a66f-4040-90f7-455d63ef75e6 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:55.628231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0443a828-fbac-46f0-837e-990e491aa721 None None] Could not find standard attr ID for object a0ac12f8-0068-435d-9e0c-2afa37b93bde. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:45:55.631495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] For port 0d187a67-1569-490c-ba6b-54e4b6d47353, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0d187a67-1569-490c-ba6b-54e4b6d47353,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:45:55.632011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.657757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da11243a-0680-4424-81c8-72fde0e787d0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:55.683709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0443a828-fbac-46f0-837e-990e491aa721 None None] Provisioning complete for port 7dfeaaba-0731-4559-82f0-4b9961babc02 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:55.684091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0443a828-fbac-46f0-837e-990e491aa721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.706423 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d29fac81-aaa3-441e-b44e-c98f842e4daf req-c2b4b29a-d08e-4c73-bc7a-ef4ad107addd tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups?id=ca006447-f1ef-432d-8d17-18a36a16ac5b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3006787 Nov 05 14:45:55.715357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:45:55.767082 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.8042231 Nov 05 14:45:55.779007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40130) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:55.789357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf19d80-fec9-441a-bc90-25d6f4f10b0e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=ccb0be27-d23e-486c-a8a4-9713f84ef48c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:55.796568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.801909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:55.816288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:45:55.839021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.878823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.889491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0443a828-fbac-46f0-837e-990e491aa721 None None] Port 7dfeaaba-0731-4559-82f0-4b9961babc02 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:55.897010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:55.912307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:55.913714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-446507f4-7f7d-4df2-b06f-458173a7e586 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "PUT /v2.0/routers/bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 200 len: 915 time: 6.7171526 Nov 05 14:45:55.917740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cdc64d7c-a62a-4d63-be32-f83d9dcfe66d']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.918090 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] Sync routers for ids ['bcd107c5-207b-4c10-8db9-04f186647dc0'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:55.920266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40132) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:55.928063 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] Routers {'bcd107c5-207b-4c10-8db9-04f186647dc0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:55.928721 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['bcd107c5-207b-4c10-8db9-04f186647dc0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.959559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54ec1d54-5cee-4638-8644-84a4a21c0075') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.960139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54ec1d54-5cee-4638-8644-84a4a21c0075') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.968322 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.977487 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] Routers {'bcd107c5-207b-4c10-8db9-04f186647dc0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:55.978092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['bcd107c5-207b-4c10-8db9-04f186647dc0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:55.983197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.012110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.058635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Releasing vlan 600 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:45:56.059294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:45:56.062699 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:45:56.111831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.118597 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:56.119842 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fdb1514-28ec-43c5-83a9-5faf7e76d496 None None] The sync data for ids ['bcd107c5-207b-4c10-8db9-04f186647dc0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:56.134763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:56.134763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.141777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:56.145740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.206673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.216993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.216993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.216993 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Floating IP e4a89932-d04a-4e6c-a958-a534d91ecac8 disassociated. External IP: 172.26.5.142, port: 0d187a67-1569-490c-ba6b-54e4b6d47353. Nov 05 14:45:56.217668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Calling delete_port for 0d187a67-1569-490c-ba6b-54e4b6d47353 owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:56.231011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.236780 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] 10.222.0.30 "DELETE /v2.0/networks/cdc64d7c-a62a-4d63-be32-f83d9dcfe66d HTTP/1.1" status: 204 len: 168 time: 2.0411115 Nov 05 14:45:56.255550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb75bcb-b9d0-4ce6-bacb-ce1bce82ce96 tempest-ExtraDHCPOptionsTestJSON-586410690 tempest-ExtraDHCPOptionsTestJSON-586410690-project] Pushing event deleted for resources: {'Network': ['ID=cdc64d7c-a62a-4d63-be32-f83d9dcfe66d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:56.387635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.402146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25f015c8-a469-44fd-89db-4ffccc11b247 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:56.497917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-37c9de2c-f297-4651-a963-c4049328e0e4 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 200 len: 921 time: 0.5435233 Nov 05 14:45:56.501526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40136) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:56.518696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.521197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6d758bd7-e381-4209-a680-de95751c63af no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:56.526573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.555427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 6d758bd7-e381-4209-a680-de95751c63af {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:56.555778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6d758bd7-e381-4209-a680-de95751c63af not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:56.556229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 130720c5-a66f-4040-90f7-455d63ef75e6 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:56.595186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 130720c5-a66f-4040-90f7-455d63ef75e6 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:56.595546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 130720c5-a66f-4040-90f7-455d63ef75e6 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:56.595967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:56.633189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:56.633549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f9a4eedb-efcd-43bd-a70e-b2b3f1f69301 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:56.636977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event deleted for resources: {'Port': ['ID=0d187a67-1569-490c-ba6b-54e4b6d47353,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:56.695419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40142) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:56.706774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25f015c8-a469-44fd-89db-4ffccc11b247 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:56.780778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.824939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16156acf-ceb5-4954-832b-98641097280f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:56.828097 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-16156acf-ceb5-4954-832b-98641097280f tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=bcd107c5-207b-4c10-8db9-04f186647dc0&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.3255758 Nov 05 14:45:56.837709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:56.855594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40150) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:56.878778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-26fce27f-80dd-48bb-8cf3-7ebdea3c75f4 req-0c303516-1bbf-4b51-8f05-e64f454db600 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.0936441 Nov 05 14:45:56.913078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.21.0.1 (1216238d-0e6e-4e75-af15-fd91bae24352/8b92d01e-3e77-4037-8c4e-09b9e3932ed7/609ae968-7346-4133-9b45-4590d36ec9a7) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:57.036022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=16a9f494-fa90-4233-81bc-22127660c9b3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:57.082569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '2b1a79e6-e721-4435-baa0-86a0d86805ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:45:57.082989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: ccb0be27-d23e-486c-a8a4-9713f84ef48c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:45:57.088957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=3955ceb2-96fb-434a-8057-751d66a3b5c3,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:57.128377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:45:57.131371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Router 04a38fc5-d67e-4be6-a52e-5b36bc22986d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:57.137795 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9cf67ce4-3bf2-4ff5-a421-7e64a76423ea admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7204d82b2b764e0cadbc376ceb84e255&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4341843 Nov 05 14:45:57.137795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.138449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:57.154235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, ccb0be27-d23e-486c-a8a4-9713f84ef48c) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:57.169432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:57.172816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.214737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0309536a-64e9-4cb7-9b4b-3c717685d3d9 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:57.218655 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0309536a-64e9-4cb7-9b4b-3c717685d3d9 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.3530593 Nov 05 14:45:57.222181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40154) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:57.246150 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8bb1bf4b-cbee-4645-95c4-bb18d099202f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4599674 Nov 05 14:45:57.262992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40156) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:57.288570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dffe66e7-016e-4078-a5aa-cbb855d537e4 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 200 len: 205 time: 0.0650933 Nov 05 14:45:57.297394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40158) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:57.304133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-867116655', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:57.317942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.355767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.366881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.376396 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP c4583725-2169-4ac6-ac96-7790a3b1f973 associated. External IP: 172.26.5.30, port: 847bc79e-f772-436e-8b2b-a881706bd85f. Nov 05 14:45:57.379500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:57.391832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.392993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.394561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Sync routers for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:57.409582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:57.410704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:57.443090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] No DVR routers for this DVR port 0d187a67-1569-490c-ba6b-54e4b6d47353 on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:45:57.447929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.451411 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c148bee4-9ba7-4ac9-ab8b-18e0a915d910 req-61e05e26-a313-412e-ab19-f2a488d3ae35 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.32 "DELETE /v2.0/ports/0d187a67-1569-490c-ba6b-54e4b6d47353 HTTP/1.1" status: 204 len: 173 time: 2.5176578 Nov 05 14:45:57.452237 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'name': 'network-vif-deleted', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:45:57.454689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-670e5c8c-8649-44e3-86c2-d83dc8a45e48" -d '{"events": [{"server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "name": "network-vif-deleted", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:45:57.566922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:45:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fd39e3f-bb6d-412f-9cbe-14b272e7ee30 x-openstack-request-id: req-7fd39e3f-bb6d-412f-9cbe-14b272e7ee30 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:45:57.567451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b304c597-e72d-4666-aef9-ac35e3d32d91", "name": "network-vif-deleted", "tag": "0d187a67-1569-490c-ba6b-54e4b6d47353", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:45:57.567857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7fd39e3f-bb6d-412f-9cbe-14b272e7ee30 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:45:57.568406 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b304c597-e72d-4666-aef9-ac35e3d32d91', 'name': 'network-vif-deleted', 'tag': '0d187a67-1569-490c-ba6b-54e4b6d47353', 'status': 'completed', 'code': 200} Nov 05 14:45:57.573994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.575386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.576141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.579719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.587274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.596789 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fe2573fd-42c4-4497-95f5-f4bac59006a7 HTTP/1.1" status: 204 len: 168 time: 0.4571671 Nov 05 14:45:57.617928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0db615-19e6-4e47-a0d0-236b26724672 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe2573fd-42c4-4497-95f5-f4bac59006a7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:57.621408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.673534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.676013 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7b3aec51-b1b1-4077-9acc-a8066d776854 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4116323 Nov 05 14:45:57.678645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40164) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:57.685981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'port': {'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c', 'name': 'tempest-RoutersIpV6Test-436934559'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:57.702697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b43bf36-d499-4cde-81f8-d50dc504a81c None None] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:57.710347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:57.717551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1216238d-0e6e-4e75-af15-fd91bae24352 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:57.733580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:57.736728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:57.905980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:57.911830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:57.948085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] device_id is not set on port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:45:57.979603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=609ae968-7346-4133-9b45-4590d36ec9a7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:58.022510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:45:58.082735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.138571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c8ade3bc-1d5c-4236-9a86-8e70f120a6fc None None] Provisioning complete for port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:58.138944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8ade3bc-1d5c-4236-9a86-8e70f120a6fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7b43bf36-d499-4cde-81f8-d50dc504a81c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:58.170375 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:58.191292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8de446d0-248d-48cc-8489-69cda99d9fce None None] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:45:58.195619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8::e (ccb0be27-d23e-486c-a8a4-9713f84ef48c/16a9f494-fa90-4233-81bc-22127660c9b3/0af4d6f9-1170-4d4e-9869-14f4779c23d8) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:58.205597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.289954 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b8a0093-4059-409d-b6ae-18f39a28b9b9 req-9f6abb9b-3014-4ceb-a59b-34132f98871f tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/ports?device_id=b304c597-e72d-4666-aef9-ac35e3d32d91 HTTP/1.1" status: 200 len: 210 time: 0.1164708 Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8de446d0-248d-48cc-8489-69cda99d9fce None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:45:58.346607 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:45:58.487350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.535905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.537799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:45:58.550342 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:45:58.561780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port d6f5f5bc-d45d-446f-8588-bc3296d66047 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:45:58.562178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.564068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.566295 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:58.568603 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.570478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.614634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac7974bb-905b-4b9c-bdef-c3e6944da09a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:45:58.617766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=0af4d6f9-1170-4d4e-9869-14f4779c23d8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:58.644316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:45:58.647905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:45:58.655081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:45:58.663642 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.669702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:45:58.671096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.675873 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:58.676852 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.689685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-00337804-575f-4ac2-aaf5-60ec910db437 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 4.8643899 Nov 05 14:45:58.691178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40192) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:58.703086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:58.711133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-62fd5e9f-5c9f-429a-ac37-f7072591de37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 926 time: 1.0311165 Nov 05 14:45:58.714583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40194) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:58.739775 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.740832 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f5ae9bb-76fa-48e8-937e-374b6960700f None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:58.741917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.816383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Checking router: 04a38fc5-d67e-4be6-a52e-5b36bc22986d for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:45:58.819268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40196) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:58.830608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-87cb5efc-8862-4db9-9d35-f5da6325ae75 None None] Provisioning complete for port 609ae968-7346-4133-9b45-4590d36ec9a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:45:58.831223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-87cb5efc-8862-4db9-9d35-f5da6325ae75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:58.875089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:45:58.875734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:58.996867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0d187a67-1569-490c-ba6b-54e4b6d47353 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:45:58.999316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac7974bb-905b-4b9c-bdef-c3e6944da09a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:45:59.008798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-810686123', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:59.042798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 0d187a67-1569-490c-ba6b-54e4b6d47353 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:45:59.043148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0d187a67-1569-490c-ba6b-54e4b6d47353 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:45:59.051087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-87cb5efc-8862-4db9-9d35-f5da6325ae75 None None] Port 609ae968-7346-4133-9b45-4590d36ec9a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:45:59.063152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:45:59.078434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.079393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.188618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.191196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.199272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.201176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.205772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.215702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for d6f5f5bc-d45d-446f-8588-bc3296d66047 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:45:59.232872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.236530 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-365b1c87-4824-4833-823e-cdccc97b33f8 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.4138198 Nov 05 14:45:59.246377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40204) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:59.258001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1632142159'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:45:59.346849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:45:59.350919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.403510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40210) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:59.450419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.498632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:45:59.521500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.536917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5b54430-c9c6-438d-869a-05f7694157be None None] The sync data for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv is: [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'f46cb97e-7afd-4657-be56-0eaeb5e7ad6d', 'name': '', 'network_id': '4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'mac_address': 'fa:16:3e:31:af:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_interface', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'subnets': [{'id': '40981c52-1a1c-434c-b98f-d3a05d50d8a6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:45:59.548500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.559610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.587505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.598342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-ccb0be27-d23e-486c-a8a4-9713f84ef48c', 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '16a9f494-fa90-4233-81bc-22127660c9b3'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:45:59.599453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.623490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.642749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.643224 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP c4583725-2169-4ac6-ac96-7790a3b1f973 disassociated. External IP: 172.26.5.30, port: 847bc79e-f772-436e-8b2b-a881706bd85f. Nov 05 14:45:59.722138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=0af4d6f9-1170-4d4e-9869-14f4779c23d8,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:59.769781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.772274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Allocated IP 2001:db8::2 (ccb0be27-d23e-486c-a8a4-9713f84ef48c/16a9f494-fa90-4233-81bc-22127660c9b3/89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:45:59.781105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.827375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.830527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.832156 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "DELETE /v2.0/security-groups/ca006447-f1ef-432d-8d17-18a36a16ac5b HTTP/1.1" status: 204 len: 168 time: 0.4275231 Nov 05 14:45:59.841871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40212) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:59.886687 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-58348b15-de71-41b0-924a-c11bf0b09976 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] show failed (client error): The resource could not be found. Nov 05 14:45:59.889863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea82d62-6c89-481b-8cf7-2024b2bcd302 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca006447-f1ef-432d-8d17-18a36a16ac5b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:59.890779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58348b15-de71-41b0-924a-c11bf0b09976 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "GET /v2.0/security-groups/ca006447-f1ef-432d-8d17-18a36a16ac5b HTTP/1.1" status: 404 len: 347 time: 0.0426531 Nov 05 14:45:59.893418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40214) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:45:59.903797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.907672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.920862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=609ae968-7346-4133-9b45-4590d36ec9a7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:45:59.952042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e725c4ca-8ec3-462f-8b23-8b6d32627197 None None] New status for floating IP e4a89932-d04a-4e6c-a958-a534d91ecac8: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:45:59.960117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:45:59.994354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.001540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=d6f5f5bc-d45d-446f-8588-bc3296d66047,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:00.034312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.121404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:00.123533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:00.125372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Pushing event updated for resources: {'Port': ['ID=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:00.127612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:00.163791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.180651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.189784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Attempting to bind port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:00.190155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Attempting to bind port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2b1a79e6-e721-4435-baa0-86a0d86805ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:00.190515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Attempting to bind port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 on network ccb0be27-d23e-486c-a8a4-9713f84ef48c {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:00.196624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:00.197000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Checking segment: {'id': '2b1a79e6-e721-4435-baa0-86a0d86805ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:00.197961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.198821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Bound using segment: {'id': '2b1a79e6-e721-4435-baa0-86a0d86805ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:00.198821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Bound port: 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b1a79e6-e721-4435-baa0-86a0d86805ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'ccb0be27-d23e-486c-a8a4-9713f84ef48c'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:00.199178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.216253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Deleting port e67ade8d-82e3-4146-b9ba-d9da0956006e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:00.216253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.256403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.264355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.266510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 623} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:00.271052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:00.280317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] For port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:00.284219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] For port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,segment=NetworkSegment(2b1a79e6-e721-4435-baa0-86a0d86805ba),segment_id=2b1a79e6-e721-4435-baa0-86a0d86805ba)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:00.290352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.303218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'SecurityGroup': ['ID=77d9b60d-aab6-48cd-8a15-e0d895621195,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:00.366765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172af9d2-cb92-4705-a299-578290c073e4 None None] Pushing event updated for resources: {'Port': ['ID=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:00.383486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.383833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Added segment 950362af-88db-4447-a5bd-4867cf3898be of type vlan for network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 Nov 05 14:46:00.386240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1216238d-0e6e-4e75-af15-fd91bae24352 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:00.399088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:00.404513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.427165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.433203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.433678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.461040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Calling delete_port for e67ade8d-82e3-4146-b9ba-d9da0956006e owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:00.487488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.626273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.627031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router bcd107c5-207b-4c10-8db9-04f186647dc0 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:00.643155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.644406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5095d58c-45e8-4f32-9848-1831617af89e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 204 len: 168 time: 3.3460767 Nov 05 14:46:00.677513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40220) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:00.684863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-395747455', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:00.716874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.722768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:00.723388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.788704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.789731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.810569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:00.815591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:00.825738 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 1.5749180 Nov 05 14:46:00.829268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:00.830648 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:00.837580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40222) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:00.850099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:00.851192 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:00.863064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'subnet': {'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:00.876590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95aa61a7-4bbe-4713-899b-09f95ab4beb9 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Network': ['ID=c978ac01-0f0b-46ac-bbdb-ac6b7f142966,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:00.889370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:00.903143 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:00.914197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:00.915817 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:00.946034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5c29d12a-aec6-452a-9335-9cc61af024ae tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/c4583725-2169-4ac6-ac96-7790a3b1f973 HTTP/1.1" status: 200 len: 687 time: 2.2522309 Nov 05 14:46:00.963199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40224) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:00.967666 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:00.968317 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2af9ad1-8eca-4177-8cd6-3fef33ca09d7 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:01.044806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.055045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.096092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:01.105057 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc579cd1-44ec-4f13-aec5-123630d1a6b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2111621 Nov 05 14:46:01.106506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40226) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.113980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.115251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] Sync routers for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:01.138040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:01.138386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.138669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.139944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.152663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:01.156322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.166484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.170208 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-43f809ec-f101-4147-95a0-e947dc849899 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4864063 Nov 05 14:46:01.181239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40230) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.189260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.202162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:01.205527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.224700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:01.249581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.250269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a783af7b-81d5-4350-99e2-4a9ea6eb065f None None] The sync data for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:01.279585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.290438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=0af4d6f9-1170-4d4e-9869-14f4779c23d8,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:01.369898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Pushing event deleted for resources: {'Port': ['ID=e67ade8d-82e3-4146-b9ba-d9da0956006e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:01.403987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network ccb0be27-d23e-486c-a8a4-9713f84ef48c is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:01.430557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:01.436304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 3955ceb2-96fb-434a-8057-751d66a3b5c3 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:01.436919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.586233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.589330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.593278 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5109dbd2-dc75-483d-8f8e-25aa570c0211 tempest-ServersTestManualDisk-1632006170 tempest-ServersTestManualDisk-1632006170-project] 10.222.0.30 "DELETE /v2.0/floatingips/e4a89932-d04a-4e6c-a958-a534d91ecac8 HTTP/1.1" status: 204 len: 168 time: 1.6959083 Nov 05 14:46:01.595649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.606669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4906a8d2-a5db-4f77-af0e-e48a6e2b6874 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:01.611082 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4906a8d2-a5db-4f77-af0e-e48a6e2b6874 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports/609ae968-7346-4133-9b45-4590d36ec9a7 HTTP/1.1" status: 200 len: 910 time: 0.5036087 Nov 05 14:46:01.611683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40236) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.636996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47b6bf5b-0cec-46fa-8cb9-e47e5771bf0f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:01.645606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.645981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.669598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:01.677268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 3955ceb2-96fb-434a-8057-751d66a3b5c3 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:01.749563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router a4654b06-cabf-40ce-83c0-bb6280355252 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:01.877169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:01.880094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Provisioning complete for port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:01.880691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:01.883655 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a793fa1b-1c2b-47b4-891c-d30bd8ddc679 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/a4654b06-cabf-40ce-83c0-bb6280355252/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1673422 Nov 05 14:46:01.893046 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954962e1-752f-484e-a941-725c3513a242 None None] Sync routers for ids ['a4654b06-cabf-40ce-83c0-bb6280355252'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:01.901926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40238) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.905185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] Routers {'a4654b06-cabf-40ce-83c0-bb6280355252'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:01.905983 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a4654b06-cabf-40ce-83c0-bb6280355252'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.919934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:01.939886 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.949183 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] Routers {'a4654b06-cabf-40ce-83c0-bb6280355252'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:01.950330 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a4654b06-cabf-40ce-83c0-bb6280355252'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.957652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be6c8da9-4b1c-4baf-9d24-8fbc68837e40 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:01.959053 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-be6c8da9-4b1c-4baf-9d24-8fbc68837e40 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports/0af4d6f9-1170-4d4e-9869-14f4779c23d8 HTTP/1.1" status: 200 len: 981 time: 0.0561683 Nov 05 14:46:01.961825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40240) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:01.990482 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-954962e1-752f-484e-a941-725c3513a242 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:01.991408 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954962e1-752f-484e-a941-725c3513a242 None None] The sync data for ids ['a4654b06-cabf-40ce-83c0-bb6280355252'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:01.999518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:01.999889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.001731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Provisioning complete for port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:02.002081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.025994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.042905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.073104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47b6bf5b-0cec-46fa-8cb9-e47e5771bf0f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:02.080304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=3955ceb2-96fb-434a-8057-751d66a3b5c3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:02.218816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.221869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.227760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9baea766-13c7-42cb-867e-5feceace03b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/c4583725-2169-4ac6-ac96-7790a3b1f973 HTTP/1.1" status: 204 len: 168 time: 1.2622840 Nov 05 14:46:02.229335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40242) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:02.237832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'c9c433fd-a471-45c2-8f0a-e09334e2fdc6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:02.256789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.284792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.307390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.336872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.349122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,segment=NetworkSegment(2b1a79e6-e721-4435-baa0-86a0d86805ba),segment_id=2b1a79e6-e721-4435-baa0-86a0d86805ba)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:02.376081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.440217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:46:02.440760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-259c4152-d7c7-4613-acb7-c74760781512 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:46:02.529022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Subnet': ['ID=bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:02.581005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Checking segment: {'id': '950362af-88db-4447-a5bd-4867cf3898be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:02.581367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network hostable DHCP agents. Network: c978ac01-0f0b-46ac-bbdb-ac6b7f142966, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:02.582830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:02.602122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.610937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.633406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06eccb31-2b2a-4d44-8fd3-1cb7586e922f req-ada4d4dc-9e22-48e7-8652-9317e1d4e885 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:02.634969 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-06eccb31-2b2a-4d44-8fd3-1cb7586e922f req-ada4d4dc-9e22-48e7-8652-9317e1d4e885 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.1650689 Nov 05 14:46:02.679334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:02.761349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, c978ac01-0f0b-46ac-bbdb-ac6b7f142966) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:02.804176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:02.804884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.835755 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a23bb058-d209-4ecf-a875-bec712ff168e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9921746 Nov 05 14:46:02.842183 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-06eccb31-2b2a-4d44-8fd3-1cb7586e922f req-d98881d2-e056-4470-a002-84894d094332 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1970639 Nov 05 14:46:02.843708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:02.853159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'network': {'name': 'tempest-router-network01--397713935'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:02.896595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.186 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/604128d1-fc1f-4eb5-86a9-338516cb74d7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:02.966839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.971401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:02.975424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:02.997333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.011006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.144532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 647} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:03.180382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.180753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Added segment 04290a8b-8896-41e5-a400-e582166aa816 of type vlan for network de4ff29f-65bd-41ea-b5af-181876db3316 Nov 05 14:46:03.263585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.273696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5fdcabb-2c3b-4769-abcf-ca0bfcfc0fd0 None None] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:03.340402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.378708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9db1a964-0f84-4b90-9c7a-082a3678bd34 None None] Provisioning complete for port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:03.379179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9db1a964-0f84-4b90-9c7a-082a3678bd34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.407462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.414700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:03.415028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.449419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.456603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:03.456603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.458204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9db1a964-0f84-4b90-9c7a-082a3678bd34 None None] Port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f5fdcabb-2c3b-4769-abcf-ca0bfcfc0fd0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:03.460842 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:03.476582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-248d071f-742c-4692-a3be-40e1b48f59ff None None] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:03.542985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9db1a964-0f84-4b90-9c7a-082a3678bd34 None None] Provisioning complete for port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:03.543353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9db1a964-0f84-4b90-9c7a-082a3678bd34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.546475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.6980977 Nov 05 14:46:03.552748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40258) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:03.561606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'network': {'name': 'tempest-router-network02--1004619401'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:03.608823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:03.612741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.665651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.717308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:03.765200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.801254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 619} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-248d071f-742c-4692-a3be-40e1b48f59ff None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:03.834017 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:03.835490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:03.838476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 0af4d6f9-1170-4d4e-9869-14f4779c23d8 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:03.859790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:03.878354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:03.878798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.879854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:03.882291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:03.882632 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Added segment 4a67fd41-849b-4a30-a532-ffa04bc15769 of type vlan for network 10f71e1e-c5ad-43b0-9378-480fe23658d1 Nov 05 14:46:03.924102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=604128d1-fc1f-4eb5-86a9-338516cb74d7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:04.024380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Provisioning complete for port 609ae968-7346-4133-9b45-4590d36ec9a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:04.024732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.044803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.060982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-857f20ab-6439-4b3e-b63e-ea6c32540348 req-ef7e8dcf-6806-417b-97f8-dde166c4ec27 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:04.069760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-857f20ab-6439-4b3e-b63e-ea6c32540348 req-ef7e8dcf-6806-417b-97f8-dde166c4ec27 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2291713 Nov 05 14:46:04.078753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Port 609ae968-7346-4133-9b45-4590d36ec9a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:04.094549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Provisioning complete for port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:04.095215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.134105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6ecc6e61-727a-4899-91a6-84a17ad2767e None None] Port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:04.234615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8703f1f2-df6c-49bf-a9d0-1f61ebc61ec5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Network': ['ID=de4ff29f-65bd-41ea-b5af-181876db3316,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:04.254873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.260647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:04.261173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.262377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network de4ff29f-65bd-41ea-b5af-181876db3316 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:04.296558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Allocated IP 172.26.5.2 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/e3dd2207-ec25-4c7b-b7e1-51157261870b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:04.298521 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-857f20ab-6439-4b3e-b63e-ea6c32540348 req-0c7e1b4c-1fa3-4bb1-896e-b10e7959f649 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2227004 Nov 05 14:46:04.350475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3ceb60b-fd71-46b0-a2ec-bdcd7c43ccae None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:04.353981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f53f5a-3c46-4b16-8ab5-b1c9bf3b1325 req-0024ce3b-8656-40a7-8b78-5c28fa1068f0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:04.355395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7bc43865-7f70-48ab-b087-c3b7f462ec11 None None] Provisioning complete for port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:04.355694 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64f53f5a-3c46-4b16-8ab5-b1c9bf3b1325 req-0024ce3b-8656-40a7-8b78-5c28fa1068f0 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.2560203 Nov 05 14:46:04.355808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7bc43865-7f70-48ab-b087-c3b7f462ec11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.444063 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.8891711 Nov 05 14:46:04.445249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7bc43865-7f70-48ab-b087-c3b7f462ec11 None None] Port 0af4d6f9-1170-4d4e-9869-14f4779c23d8 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:04.456682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40268) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:04.466989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'subnet': {'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:04.492284 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0f0ff3-c03f-4e7f-baae-81a86f3eed0e tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Network': ['ID=10f71e1e-c5ad-43b0-9378-480fe23658d1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:04.521491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:04.555915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64f53f5a-3c46-4b16-8ab5-b1c9bf3b1325 req-69f5743f-ebf1-4a6b-9c54-aec2b18c3d48 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1882157 Nov 05 14:46:04.559972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.593912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 609ae968-7346-4133-9b45-4590d36ec9a7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:04.594347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.613705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-87802a15-4467-4c99-950b-f94cd511784e None None] Could not find standard attr ID for object 0af4d6f9-1170-4d4e-9869-14f4779c23d8. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:46:04.625889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=0af4d6f9-1170-4d4e-9869-14f4779c23d8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:04.664739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3ceb60b-fd71-46b0-a2ec-bdcd7c43ccae None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:04.716210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.797389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.800916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:04.804551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.807984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e237a15-75f7-4eb0-ab77-7742250eab10 req-91401fbd-4b18-4ec1-b1cf-cc3dd7307980 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:04.809479 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e237a15-75f7-4eb0-ab77-7742250eab10 req-91401fbd-4b18-4ec1-b1cf-cc3dd7307980 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2200761 Nov 05 14:46:04.819225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.840626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 609ae968-7346-4133-9b45-4590d36ec9a7 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:04.953172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:04.979250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-c978ac01-0f0b-46ac-bbdb-ac6b7f142966', 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966', 'tenant_id': '5a98ebc5362e4966a5581cb2ea2ccf1b', 'fixed_ips': [{'subnet_id': 'bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:04.982887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.001773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.006397 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e237a15-75f7-4eb0-ab77-7742250eab10 req-f4f48fe8-7a73-4669-8dd5-d49918c6b806 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1804519 Nov 05 14:46:05.022888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Deleting port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:05.023236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.032235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:05.052952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:05.085773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:05.093465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Pushing event updated for resources: {'Port': ['ID=e3dd2207-ec25-4c7b-b7e1-51157261870b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:05.152491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router a4654b06-cabf-40ce-83c0-bb6280355252 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:05.200829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-e1ebddb6-d381-4278-ad45-dbed4b2e2515 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:05.203120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-e1ebddb6-d381-4278-ad45-dbed4b2e2515 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.32 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.1091192 Nov 05 14:46:05.205863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.274029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Allocated IP 172.20.0.2 (c978ac01-0f0b-46ac-bbdb-ac6b7f142966/bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1/45fd6ccb-3dd0-4b9f-b992-0b92198cb659) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:05.310675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] For port f46cb97e-7afd-4657-be56-0eaeb5e7ad6d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:05.311281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.378476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Calling delete_port for f46cb97e-7afd-4657-be56-0eaeb5e7ad6d owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:05.402383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:05.411209 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-68e3a491-f982-4680-b25d-15e58748affe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/a4654b06-cabf-40ce-83c0-bb6280355252/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4483910 Nov 05 14:46:05.417255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:05.456800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.458690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] Sync routers for ids ['a4654b06-cabf-40ce-83c0-bb6280355252'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:05.502737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] Routers {'a4654b06-cabf-40ce-83c0-bb6280355252'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:05.504347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a4654b06-cabf-40ce-83c0-bb6280355252'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:05.599437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:05.602937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.620131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.645327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.656112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] Routers {'a4654b06-cabf-40ce-83c0-bb6280355252'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:05.656776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a4654b06-cabf-40ce-83c0-bb6280355252'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:05.675701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=609ae968-7346-4133-9b45-4590d36ec9a7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:05.678756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Subnet': ['ID=469d5c06-41c4-4193-8652-d2da584eb272,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:05.752907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:05.753565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a408df9e-6dae-42fe-934d-386e2e634502 None None] The sync data for ids ['a4654b06-cabf-40ce-83c0-bb6280355252'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:05.768973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:05.773505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:05.794732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Deleting port 2d0d74d9-94d0-42c7-be73-ebcc957f107f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:05.795387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.797298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:05.830117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Checking segment: {'id': '04290a8b-8896-41e5-a400-e582166aa816', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:05.830341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network hostable DHCP agents. Network: de4ff29f-65bd-41ea-b5af-181876db3316, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:05.854519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Pushing event updated for resources: {'Port': ['ID=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:05.890513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Attempting to bind port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:05.891279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Attempting to bind port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '950362af-88db-4447-a5bd-4867cf3898be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:05.891780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Attempting to bind port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 on network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:05.900206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:05.901444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Checking segment: {'id': '950362af-88db-4447-a5bd-4867cf3898be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:05.902033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.902226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Bound using segment: {'id': '950362af-88db-4447-a5bd-4867cf3898be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:05.902802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Bound port: 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '950362af-88db-4447-a5bd-4867cf3898be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'c978ac01-0f0b-46ac-bbdb-ac6b7f142966'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:05.903275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.926392 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-49bef0e3-8238-483e-8ea7-f1caeba9a967 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] remove_router_interface failed (client error): The resource could not be found. Nov 05 14:46:05.932377 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-49bef0e3-8238-483e-8ea7-f1caeba9a967 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/a4654b06-cabf-40ce-83c0-bb6280355252/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.5100768 Nov 05 14:46:05.939339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40284) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:05.974119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.981817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] For port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:05.985811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] For port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,segment=NetworkSegment(950362af-88db-4447-a5bd-4867cf3898be),segment_id=950362af-88db-4447-a5bd-4867cf3898be)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:05.991301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:05.998750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e330d26a-d67d-47cf-a332-e2910f4469c2 req-b160660a-e428-4e99-84c8-c30d4bfbfb62 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:06.004967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e330d26a-d67d-47cf-a332-e2910f4469c2 req-b160660a-e428-4e99-84c8-c30d4bfbfb62 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2818937 Nov 05 14:46:06.010697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.016604 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-951b8db7-2cce-41a0-8148-66b68b75fac9 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=a4654b06-cabf-40ce-83c0-bb6280355252 HTTP/1.1" status: 200 len: 205 time: 0.0699930 Nov 05 14:46:06.027541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network de4ff29f-65bd-41ea-b5af-181876db3316 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:06.028857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40286) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:06.034780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.062901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ba18c3-e56d-48e3-a876-512fc6e9ff3c None None] Pushing event updated for resources: {'Port': ['ID=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:06.113597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1b47b3-b43c-4318-a2b7-a26f2f602eba req-b0e26428-0c29-4cbc-a4cc-2a1bbc367264 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:06.115296 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff1b47b3-b43c-4318-a2b7-a26f2f602eba req-b0e26428-0c29-4cbc-a4cc-2a1bbc367264 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 946 time: 0.2499237 Nov 05 14:46:06.138372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, de4ff29f-65bd-41ea-b5af-181876db3316) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:06.156694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:06.157216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.180043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.285212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c0ac1427-9b64-42ce-89a1-c332aa75b9d5 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8155255 Nov 05 14:46:06.338576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40288) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:06.377432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'subnet': {'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:06.388383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.467475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff1b47b3-b43c-4318-a2b7-a26f2f602eba req-d276d303-96d9-4448-9342-dda0f122239d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3227196 Nov 05 14:46:06.468247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Pushing event deleted for resources: {'Port': ['ID=f46cb97e-7afd-4657-be56-0eaeb5e7ad6d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:06.526933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.570926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=604128d1-fc1f-4eb5-86a9-338516cb74d7,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:06.623724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] For port 2d0d74d9-94d0-42c7-be73-ebcc957f107f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2d0d74d9-94d0-42c7-be73-ebcc957f107f,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:06.624093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.648814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.721690 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e330d26a-d67d-47cf-a332-e2910f4469c2 req-d3df0e01-2cea-4e26-8000-70f98d758a25 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7063682 Nov 05 14:46:06.841079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.847816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.983501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.984160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router a4654b06-cabf-40ce-83c0-bb6280355252 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:06.992133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:06.995039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-273c61de-e113-41e6-81b9-d09d3501f06b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/a4654b06-cabf-40ce-83c0-bb6280355252 HTTP/1.1" status: 204 len: 168 time: 0.9609466 Nov 05 14:46:07.002860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40290) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:07.042883 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP be71f7e3-cf2d-42ac-a128-fb0c2fcae438 associated. External IP: 172.26.5.186, port: c9c433fd-a471-45c2-8f0a-e09334e2fdc6. Nov 05 14:46:07.059665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Made reservation on behalf of 5a98ebc5362e4966a5581cb2ea2ccf1b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:07.066187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.094322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9872cacd-c2e3-48ae-b47d-f5c02b28389e None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:07.149046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 16a9f494-fa90-4233-81bc-22127660c9b3 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:07.151318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.153721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.154085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.154396 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Floating IP e20e306b-6add-4c1d-90d2-15473667deca disassociated. External IP: 172.26.5.113, port: 2d0d74d9-94d0-42c7-be73-ebcc957f107f. Nov 05 14:46:07.154733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Calling delete_port for 2d0d74d9-94d0-42c7-be73-ebcc957f107f owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:07.183378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.191657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.203546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] Provisioning complete for port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:07.203826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.204311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:07.268289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9872cacd-c2e3-48ae-b47d-f5c02b28389e None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:07.287519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.296465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.486596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.534239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.568196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:07.578857 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] Sync routers for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:07.582111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c2a1cca7-2102-459d-b589-4100bc4bf64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9303081 Nov 05 14:46:07.593481 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:07.602673 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:07.606801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40294) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:07.628102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] For port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,segment=NetworkSegment(950362af-88db-4447-a5bd-4867cf3898be),segment_id=950362af-88db-4447-a5bd-4867cf3898be)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:07.637144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.678802 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:07.720059 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:07.722265 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:07.748988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.753066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:07.772283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.806236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4063ac56-555c-4399-bad6-56ed1835644d req-5306c035-145b-4d2e-a9e8-ba363e4dad63 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:07.808421 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4063ac56-555c-4399-bad6-56ed1835644d req-5306c035-145b-4d2e-a9e8-ba363e4dad63 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 867 time: 0.2566390 Nov 05 14:46:07.827314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event deleted for resources: {'Port': ['ID=2d0d74d9-94d0-42c7-be73-ebcc957f107f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:07.835760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.892588 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:07.893685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da679fe3-04db-47ca-8870-9857675137d0 None None] Pushing event updated for resources: {'Port': ['ID=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:07.895967 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-090576bd-12db-4f3e-ab0b-0b810ee6c3e6 None None] The sync data for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:07.901866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Router 623c2fc2-17ff-49b2-b598-2087b28b02c8 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:07.903749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Subnet': ['ID=eb5b7c8c-d840-4e7e-8a01-002398f824ca,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:07.962469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:07.963740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:07.969875 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/16a9f494-fa90-4233-81bc-22127660c9b3 HTTP/1.1" status: 204 len: 168 time: 0.9623876 Nov 05 14:46:07.969875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8766331a-2de2-4827-ac4f-17f94cbf9714 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=16a9f494-fa90-4233-81bc-22127660c9b3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:07.969875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40298) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:07.994691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Checking segment: {'id': '4a67fd41-849b-4a30-a532-ffa04bc15769', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:07.995165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network hostable DHCP agents. Network: 10f71e1e-c5ad-43b0-9378-480fe23658d1, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:08.003943 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4063ac56-555c-4399-bad6-56ed1835644d req-567fcff3-ee12-4b94-bd2f-5fda44d23e4d tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups?id=1245440e-5dfc-42f9-a460-fe077039d6bf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1852379 Nov 05 14:46:08.038708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-de4ff29f-65bd-41ea-b5af-181876db3316', 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316', 'tenant_id': '5a98ebc5362e4966a5581cb2ea2ccf1b', 'fixed_ips': [{'subnet_id': '469d5c06-41c4-4193-8652-d2da584eb272'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:08.039768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.118978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:08.128088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Router 04a38fc5-d67e-4be6-a52e-5b36bc22986d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:08.155841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:08.156486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.175860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 10f71e1e-c5ad-43b0-9378-480fe23658d1) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:08.185913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:08.186653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.258843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Allocated IP 172.20.0.2 (de4ff29f-65bd-41ea-b5af-181876db3316/469d5c06-41c4-4193-8652-d2da584eb272/af9c0163-df97-4e25-a644-4f21c724e670) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:08.315205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b102b50a-a520-40e6-9433-872668eefc25 req-6ba7a6f7-5fc1-4477-becb-526a0d9a3bc6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:08.316925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b102b50a-a520-40e6-9433-872668eefc25 req-6ba7a6f7-5fc1-4477-becb-526a0d9a3bc6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.4361565 Nov 05 14:46:08.327017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.375853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:08.395201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:08.405711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:08.435484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:08.435748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:08.436246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.442914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:08.447814 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Sync routers for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:08.462272 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:08.467266 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.467883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fc5adaed-5cd7-43e3-b9e8-c1e8fbb97d08 admin admin] 10.222.0.30 "PUT /v2.0/routers/04a38fc5-d67e-4be6-a52e-5b36bc22986d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.8689332 Nov 05 14:46:08.473421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.477733 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5e559821-a923-4917-be6b-a65c50d8db6e tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "PUT /v2.0/routers/623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 200 len: 913 time: 7.2603669 Nov 05 14:46:08.477733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40300) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:08.490537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a90015bf-b510-4e4d-8391-563e0a4b7a60 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1480014 Nov 05 14:46:08.490759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40302) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:08.490858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] Sync routers for ids ['623c2fc2-17ff-49b2-b598-2087b28b02c8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:08.490948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40304) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:08.497394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.502288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.569801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] Routers {'623c2fc2-17ff-49b2-b598-2087b28b02c8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:08.570441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['623c2fc2-17ff-49b2-b598-2087b28b02c8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.622861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:08.623512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.637621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.670144 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:08.689540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.694507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.695220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78fc5ac4-b584-49d5-baa7-08240a439040 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:08.707273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.712399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] Routers {'623c2fc2-17ff-49b2-b598-2087b28b02c8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:08.713612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['623c2fc2-17ff-49b2-b598-2087b28b02c8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.808530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:08.809093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb1db864-ab4c-426d-bb53-d47d3ca1996c None None] The sync data for ids ['623c2fc2-17ff-49b2-b598-2087b28b02c8'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:08.836728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Network de4ff29f-65bd-41ea-b5af-181876db3316 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:08.836978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.841134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Pushing event updated for resources: {'Port': ['ID=af9c0163-df97-4e25-a644-4f21c724e670,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:08.844125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:08.846268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:08.905229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Attempting to bind port af9c0163-df97-4e25-a644-4f21c724e670 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:08.905881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Attempting to bind port af9c0163-df97-4e25-a644-4f21c724e670 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '04290a8b-8896-41e5-a400-e582166aa816', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:08.906416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Attempting to bind port af9c0163-df97-4e25-a644-4f21c724e670 on network de4ff29f-65bd-41ea-b5af-181876db3316 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:08.912639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:08.913322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Checking segment: {'id': '04290a8b-8896-41e5-a400-e582166aa816', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:08.914121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.914671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Bound using segment: {'id': '04290a8b-8896-41e5-a400-e582166aa816', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:08.915313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Bound port: af9c0163-df97-4e25-a644-4f21c724e670, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04290a8b-8896-41e5-a400-e582166aa816', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': 'de4ff29f-65bd-41ea-b5af-181876db3316'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:08.916415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:08.955272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b102b50a-a520-40e6-9433-872668eefc25 req-8f764bbf-8a30-441c-a0c9-61fbd9acde54 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6186264 Nov 05 14:46:08.976659 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d153cf55-600c-4472-974e-810e9186a93f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 6.7421312 Nov 05 14:46:09.008755 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:46:06Z', 'revision_number': 5, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port': {'id': '501824c9-0f88-46c0-b875-0a1fb46eb708', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:03:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:19Z', 'updated_at': '2021-11-05T14:44:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:09.009868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] For port af9c0163-df97-4e25-a644-4f21c724e670, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:09.012117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40306) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:09.013490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] For port af9c0163-df97-4e25-a644-4f21c724e670, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=af9c0163-df97-4e25-a644-4f21c724e670,segment=NetworkSegment(04290a8b-8896-41e5-a400-e582166aa816),segment_id=04290a8b-8896-41e5-a400-e582166aa816)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:09.018010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2d0d74d9-94d0-42c7-be73-ebcc957f107f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:09.026001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.053826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.055573 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Checking router: 04a38fc5-d67e-4be6-a52e-5b36bc22986d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:46:09.066484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Routers {'04a38fc5-d67e-4be6-a52e-5b36bc22986d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:09.067229 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:09.103755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 2d0d74d9-94d0-42c7-be73-ebcc957f107f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:09.104325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2d0d74d9-94d0-42c7-be73-ebcc957f107f not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:09.121306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9057b778-ca3f-4e02-8e85-462956764a12 None None] Provisioning complete for port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:09.122771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9057b778-ca3f-4e02-8e85-462956764a12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.161911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Deleting port 501824c9-0f88-46c0-b875-0a1fb46eb708 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:09.162225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.206418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45341783-03ec-4261-9cb3-baeabec3962f None None] Pushing event updated for resources: {'Port': ['ID=af9c0163-df97-4e25-a644-4f21c724e670,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:09.253292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:09.253721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.261347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] For port 501824c9-0f88-46c0-b875-0a1fb46eb708, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=501824c9-0f88-46c0-b875-0a1fb46eb708,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:09.261743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.276466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Calling delete_port for 501824c9-0f88-46c0-b875-0a1fb46eb708 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:09.278450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] Set router 04a38fc5-d67e-4be6-a52e-5b36bc22986d gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:09.349315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2bfee939-a592-49c9-b506-03900ca0d334 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/floatingips/be71f7e3-cf2d-42ac-a128-fb0c2fcae438 HTTP/1.1" status: 200 len: 978 time: 0.3300149 Nov 05 14:46:09.349578 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-628d22da-3ffc-4348-9621-007de05df318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:46:09Z', 'revision_number': 6, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:09.357581 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-727ede3d-81a7-4ab5-b2aa-2078c2a0f7c4 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 200 len: 919 time: 0.8611028 Nov 05 14:46:09.357581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40310) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:09.362249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40312) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:09.389925 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-628d22da-3ffc-4348-9621-007de05df318 None None] The sync data for ids ['04a38fc5-d67e-4be6-a52e-5b36bc22986d'] in dv-neutron-816850-1-hyperv is: [{'id': '04a38fc5-d67e-4be6-a52e-5b36bc22986d', 'name': 'tempest-ServersTestManualDisk-1091836873-router', 'tenant_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:18Z', 'updated_at': '2021-11-05T14:46:09Z', 'revision_number': 6, 'project_id': 'b398cbd7c6d04e96b90e3a8bcfd826b4', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:09.489468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:09.515652 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Sync routers for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:09.528809 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:09.529435 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:09.558819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,segment=NetworkSegment(2b1a79e6-e721-4435-baa0-86a0d86805ba),segment_id=2b1a79e6-e721-4435-baa0-86a0d86805ba)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:09.559266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.600376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] No DVR routers for this DVR port 2d0d74d9-94d0-42c7-be73-ebcc957f107f on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:09.603270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.607040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4eeabc3b-4c99-430e-b7e0-f711a351e59c req-d73f86f0-a998-430e-ad0f-f1d29dd7d174 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.32 "DELETE /v2.0/ports/2d0d74d9-94d0-42c7-be73-ebcc957f107f HTTP/1.1" status: 204 len: 173 time: 4.3915751 Nov 05 14:46:09.619324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'name': 'network-vif-deleted', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:46:09.621696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec87c0e3-f310-41bd-a093-8725f06bb30d" -d '{"events": [{"server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "name": "network-vif-deleted", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:46:09.624789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:09.671600 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:09.678336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80d38840-6763-4f47-9b39-9ad37735d0c5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 981 time: 0.3167734 Nov 05 14:46:09.680567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40316) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:09.688792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': '847bc79e-f772-436e-8b2b-a881706bd85f'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:09.689835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.702412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b75ef50d-7b5e-4f9b-bbb3-44a0bd6a0b33 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:09.704021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b75ef50d-7b5e-4f9b-bbb3-44a0bd6a0b33 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=623c2fc2-17ff-49b2-b598-2087b28b02c8&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 943 time: 0.3323190 Nov 05 14:46:09.764946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:46:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40847b6d-e24a-453f-919e-93b9b0d8a325 x-openstack-request-id: req-40847b6d-e24a-453f-919e-93b9b0d8a325 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:46:09.765216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4fbd012-2282-41cc-a79d-feeffc7cf07d", "name": "network-vif-deleted", "tag": "2d0d74d9-94d0-42c7-be73-ebcc957f107f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:46:09.765583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-40847b6d-e24a-453f-919e-93b9b0d8a325 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:46:09.766056 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4fbd012-2282-41cc-a79d-feeffc7cf07d', 'name': 'network-vif-deleted', 'tag': '2d0d74d9-94d0-42c7-be73-ebcc957f107f', 'status': 'completed', 'code': 200} Nov 05 14:46:09.767873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:09.775541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-23826dca-c218-4687-8e7e-f0d0136410c0 req-336af148-4c58-4651-a30c-a2c0734e40be tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/ports?device_id=f4fbd012-2282-41cc-a79d-feeffc7cf07d HTTP/1.1" status: 200 len: 210 time: 0.4968653 Nov 05 14:46:09.814972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:09.987204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.067094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.159854 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.162936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:10.182651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:10.187632 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74cef8e8-3c66-476f-87f1-372d582ed8eb tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:10.191678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-74cef8e8-3c66-476f-87f1-372d582ed8eb tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.4161713 Nov 05 14:46:10.193556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40322) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:10.204413 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Checking router: 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:46:10.237004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:10.237775 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.288690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b106d36c-af93-419d-9c0a-e79eb5df99f2 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 200 len: 205 time: 0.0931318 Nov 05 14:46:10.293728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40324) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:10.415229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device af9c0163-df97-4e25-a644-4f21c724e670 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:10.454488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1403a6e1-d48c-487f-979b-8a2d3c727def req-5b021818-087a-4b78-9a54-868f4c83a248 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:10.456070 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1403a6e1-d48c-487f-979b-8a2d3c727def req-5b021818-087a-4b78-9a54-868f4c83a248 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2992423 Nov 05 14:46:10.481215 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:10.496803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.523215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Allocated IP 172.20.0.1 (de4ff29f-65bd-41ea-b5af-181876db3316/469d5c06-41c4-4193-8652-d2da584eb272/fd22bacb-77ba-422c-b0e6-b1304e8fb730) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:10.548844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port af9c0163-df97-4e25-a644-4f21c724e670 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:10.549372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.554683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ccb0be27-d23e-486c-a8a4-9713f84ef48c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.600248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.637997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b1a79e6-e721-4435-baa0-86a0d86805ba') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.638297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b1a79e6-e721-4435-baa0-86a0d86805ba') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.667998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.674455 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1403a6e1-d48c-487f-979b-8a2d3c727def req-ef455c44-30ed-45d0-a8f1-feb342192b73 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1748745 Nov 05 14:46:10.703363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.726215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Pushing event deleted for resources: {'Port': ['ID=501824c9-0f88-46c0-b875-0a1fb46eb708,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:10.760228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.776891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port af9c0163-df97-4e25-a644-4f21c724e670, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=af9c0163-df97-4e25-a644-4f21c724e670,segment=NetworkSegment(04290a8b-8896-41e5-a400-e582166aa816),segment_id=04290a8b-8896-41e5-a400-e582166aa816)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:10.778062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1bfb286-c7d7-4d85-acc3-bf41ffe415fb None None] Network de4ff29f-65bd-41ea-b5af-181876db3316 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:10.797156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:10.797614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.799314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.800090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:10.800728 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:10.857158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:10.886323 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:10.968872 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e04299b-c2a1-4241-a919-a0838b00a7cd None None] The sync data for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv is: [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:44:35Z', 'revision_number': 4, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a', 'name': '', 'network_id': 'fd1ccb7c-d1e8-48e2-b784-b56a587e2542', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'mac_address': 'fa:16:3e:34:9e:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 128, 'fixed_ips': [{'subnet_id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:32Z', 'updated_at': '2021-11-05T14:44:44Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'subnets': [{'id': '84c193ea-9294-4fe7-b33c-753ea27f07be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:10.980798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40330) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:11.010408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.015379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.022444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/ccb0be27-d23e-486c-a8a4-9713f84ef48c HTTP/1.1" status: 204 len: 168 time: 3.0079346 Nov 05 14:46:11.030416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40332) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:11.035681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-122852644'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:11.051702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=af9c0163-df97-4e25-a644-4f21c724e670,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:11.063736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e0d3c13-2a47-4c69-b123-cd3fe2b6b469 None None] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:11.094112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea7974e-c43e-4be8-b802-623a8606965e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=ccb0be27-d23e-486c-a8a4-9713f84ef48c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:11.195916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.206241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 7dfeaaba-0731-4559-82f0-4b9961babc02 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:11.206636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.268546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d846be85-19a0-4642-8db1-629c6dddcabd None None] Provisioning complete for port af9c0163-df97-4e25-a644-4f21c724e670 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:11.273948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d846be85-19a0-4642-8db1-629c6dddcabd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1e0d3c13-2a47-4c69-b123-cd3fe2b6b469 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:11.347714 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f1bfb286-c7d7-4d85-acc3-bf41ffe415fb None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:11.355051 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:11.372287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca93156d-1e30-475c-9c84-08b6e3dbd1c1 None None] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:11.419139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ed53e48-64ef-44a6-b06f-01aa2fc71a78 None None] Network de4ff29f-65bd-41ea-b5af-181876db3316 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:11.423349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.436494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-241584de-d704-4a09-8779-01dbc88924d7 None None] DHCP port deletion for ccb0be27-d23e-486c-a8a4-9713f84ef48c request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:11.508197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05a15aac-4e5d-4ecf-81ff-653c7838abfc None None] New status for floating IP e20e306b-6add-4c1d-90d2-15473667deca: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:46:11.532591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.535755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.537537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.547739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.617315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:11.617685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.650235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.666586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.667250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 04a38fc5-d67e-4be6-a52e-5b36bc22986d {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:11.677757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network de4ff29f-65bd-41ea-b5af-181876db3316 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:11.681762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.683083 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c928c812-af60-4e30-b738-6e6584303cc9 admin admin] 10.222.0.30 "DELETE /v2.0/routers/04a38fc5-d67e-4be6-a52e-5b36bc22986d HTTP/1.1" status: 204 len: 168 time: 3.1942360 Nov 05 14:46:11.683979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:11.687545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.693271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40334) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:11.710608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:11.724254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:11.730063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Port': ['ID=fd22bacb-77ba-422c-b0e6-b1304e8fb730,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:11.763834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.816014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.854663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:11.859123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Deleting subnet 40981c52-1a1c-434c-b98f-d3a05d50d8a6 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:11.867964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.873515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.877351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ca93156d-1e30-475c-9c84-08b6e3dbd1c1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:11.907539 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6ed53e48-64ef-44a6-b06f-01aa2fc71a78 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:11.921965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:11.937869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.942043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:11.943349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "DELETE /v2.0/security-groups/1245440e-5dfc-42f9-a460-fe077039d6bf HTTP/1.1" status: 204 len: 168 time: 0.9555273 Nov 05 14:46:11.947781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40338) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:11.999606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 7dfeaaba-0731-4559-82f0-4b9961babc02 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:12.002769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.003115 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 8fd33dd0-953c-4cde-84c3-a97fc01acf39 of type vlan for network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 Nov 05 14:46:12.011795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d846be85-19a0-4642-8db1-629c6dddcabd None None] Provisioning complete for port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:12.012071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9acaa5cd-2b2f-4ab1-bd58-159a51d55e14 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1245440e-5dfc-42f9-a460-fe077039d6bf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:12.015399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d846be85-19a0-4642-8db1-629c6dddcabd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.018631 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-b38d35c6-e6d0-477f-97c5-61f0ad8d1e34 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] show failed (client error): The resource could not be found. Nov 05 14:46:12.023909 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b38d35c6-e6d0-477f-97c5-61f0ad8d1e34 tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "GET /v2.0/security-groups/1245440e-5dfc-42f9-a460-fe077039d6bf HTTP/1.1" status: 404 len: 347 time: 0.0641561 Nov 05 14:46:12.035732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40340) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:12.038890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.068121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f46cb97e-7afd-4657-be56-0eaeb5e7ad6d no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:12.086680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port e3dd2207-ec25-4c7b-b7e1-51157261870b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:12.087018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.105252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f46cb97e-7afd-4657-be56-0eaeb5e7ad6d {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:12.105707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f46cb97e-7afd-4657-be56-0eaeb5e7ad6d not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:12.128249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.144887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.185434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b3c6f3-78cd-4d16-83a0-df97f1d3710c req-13e40dac-3a0d-4c75-87d7-5fe8a84c7095 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:12.193564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64b3c6f3-78cd-4d16-83a0-df97f1d3710c req-13e40dac-3a0d-4c75-87d7-5fe8a84c7095 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3044610 Nov 05 14:46:12.217112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device af9c0163-df97-4e25-a644-4f21c724e670 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:12.245924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-171a803e-4ba2-41c1-84ba-220c3856def6 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:12.325595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.346650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3d9bbe27-fe4d-4c7e-b905-e53bb4f86802 None None] Provisioning complete for port fd22bacb-77ba-422c-b0e6-b1304e8fb730 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:12.347120 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3d9bbe27-fe4d-4c7e-b905-e53bb4f86802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.370282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.385681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port af9c0163-df97-4e25-a644-4f21c724e670 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:12.385681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.401737 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64b3c6f3-78cd-4d16-83a0-df97f1d3710c req-2e36863c-89a4-4538-8d33-2389ef90a0eb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2016795 Nov 05 14:46:12.403783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.403963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.447033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for e3dd2207-ec25-4c7b-b7e1-51157261870b owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:12.456081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3d9bbe27-fe4d-4c7e-b905-e53bb4f86802 None None] Port fd22bacb-77ba-422c-b0e6-b1304e8fb730 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:12.500428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-171a803e-4ba2-41c1-84ba-220c3856def6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:12.514887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.520573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:12.521294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.530023 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP be71f7e3-cf2d-42ac-a128-fb0c2fcae438 associated. External IP: 172.26.5.186, port: c9c433fd-a471-45c2-8f0a-e09334e2fdc6. Nov 05 14:46:12.554015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Deleting port c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:12.554488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.679924 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.6482222 Nov 05 14:46:12.684807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40342) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:12.686993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.689279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:12.692592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:12.699816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baaca7a5-e1ea-4aa9-83a0-f5b392fea938 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=0959dfb7-dbc6-47f6-80c5-75159edeaaf8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:12.730766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:12.736215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:12.736582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89f0dcf1-81dd-4471-bd9f-ad0d5b7e4a20 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:12.737000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 501824c9-0f88-46c0-b875-0a1fb46eb708 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:12.766712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=40981c52-1a1c-434c-b98f-d3a05d50d8a6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:12.776168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.779644 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-05612d6f-9508-41d1-bf0e-d83e5638ac58 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/40981c52-1a1c-434c-b98f-d3a05d50d8a6 HTTP/1.1" status: 204 len: 168 time: 1.0844300 Nov 05 14:46:12.785520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40344) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:12.828226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 501824c9-0f88-46c0-b875-0a1fb46eb708 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:12.828592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 501824c9-0f88-46c0-b875-0a1fb46eb708 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:12.840763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.841213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.841522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.882126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Calling delete_port for c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:12.888139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=7dfeaaba-0731-4559-82f0-4b9961babc02,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:12.967100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:12.972333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-10f71e1e-c5ad-43b0-9378-480fe23658d1', 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1', 'tenant_id': '5a98ebc5362e4966a5581cb2ea2ccf1b', 'fixed_ips': [{'subnet_id': 'eb5b7c8c-d840-4e7e-8a01-002398f824ca'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:12.973427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.040280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:13.043859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.128149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Allocated IP 172.20.0.2 (10f71e1e-c5ad-43b0-9378-480fe23658d1/eb5b7c8c-d840-4e7e-8a01-002398f824ca/0842f932-b853-4524-b67e-bc1accc84862) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:13.163860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.183428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:13.271084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Deleting port 75e751a9-0e74-46fd-a4fb-738311e1dc68 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:13.271315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.290407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.296959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.345570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:13.349649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:13.354884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:13.358012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Pushing event updated for resources: {'Port': ['ID=0842f932-b853-4524-b67e-bc1accc84862,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:13.408983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.417828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Attempting to bind port 0842f932-b853-4524-b67e-bc1accc84862 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:13.417828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Attempting to bind port 0842f932-b853-4524-b67e-bc1accc84862 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '4a67fd41-849b-4a30-a532-ffa04bc15769', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:13.418701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Attempting to bind port 0842f932-b853-4524-b67e-bc1accc84862 on network 10f71e1e-c5ad-43b0-9378-480fe23658d1 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:13.423867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:13.424385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Checking segment: {'id': '4a67fd41-849b-4a30-a532-ffa04bc15769', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:13.424921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.425449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Bound using segment: {'id': '4a67fd41-849b-4a30-a532-ffa04bc15769', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:13.426025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Bound port: 0842f932-b853-4524-b67e-bc1accc84862, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4a67fd41-849b-4a30-a532-ffa04bc15769', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '10f71e1e-c5ad-43b0-9378-480fe23658d1'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:13.426509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.450254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] For port 75e751a9-0e74-46fd-a4fb-738311e1dc68, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=75e751a9-0e74-46fd-a4fb-738311e1dc68,segment=NetworkSegment(c509f189-e51f-483b-b35f-b9ea2b45ee7d),segment_id=c509f189-e51f-483b-b35f-b9ea2b45ee7d)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:13.450254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.486723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.492282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=e3dd2207-ec25-4c7b-b7e1-51157261870b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:13.526435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Calling delete_port for 75e751a9-0e74-46fd-a4fb-738311e1dc68 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:13.527646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.531424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] For port 0842f932-b853-4524-b67e-bc1accc84862, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:13.536586 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] For port 0842f932-b853-4524-b67e-bc1accc84862, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0842f932-b853-4524-b67e-bc1accc84862,segment=NetworkSegment(4a67fd41-849b-4a30-a532-ffa04bc15769),segment_id=4a67fd41-849b-4a30-a532-ffa04bc15769)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:13.543426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.549203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:13.564761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:13.579178 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:13.594198 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:13.595694 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.602800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5387f62c-b796-4737-af59-702ccc5db5cd None None] Pushing event updated for resources: {'Port': ['ID=0842f932-b853-4524-b67e-bc1accc84862,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:13.615948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20be35f-415b-4175-8687-535c4effb6e7 req-22b84d7f-d69c-44d8-85e8-fa7d69063089 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:13.623922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f20be35f-415b-4175-8687-535c4effb6e7 req-22b84d7f-d69c-44d8-85e8-fa7d69063089 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1410851 Nov 05 14:46:13.678272 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.691058 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:13.691827 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.724716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Port': ['ID=fd22bacb-77ba-422c-b0e6-b1304e8fb730,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:13.733055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.735528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.738366 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.740351 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a815556-2bb1-40e3-8f4c-a867f7a12294 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:13.767925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.857714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f20be35f-415b-4175-8687-535c4effb6e7 req-19dffc9a-4679-4e35-b9e0-ba78b218de2e tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2326210 Nov 05 14:46:13.858604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:13.873282 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da4d1221-04e7-44b1-9acc-dea49554291c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2604690 Nov 05 14:46:13.875108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Pushing event deleted for resources: {'Port': ['ID=c83b661f-9fbc-41ac-9f1f-2a1cc1127ceb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:13.877544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40348) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:13.897644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] Sync routers for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:13.905955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:13.906599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.911456 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d45eafc4-0625-422c-b7b9-9b52447cd63d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 HTTP/1.1" status: 200 len: 205 time: 0.0325952 Nov 05 14:46:13.913706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.916541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40350) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:13.953655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.976173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] Routers {'9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:13.976838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:13.987331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:13.993139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Pushing event deleted for resources: {'Port': ['ID=75e751a9-0e74-46fd-a4fb-738311e1dc68,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:14.009108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.015340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.015995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9a12807-e98b-4858-bbdf-96b23449c1d0 None None] The sync data for ids ['9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:14.033867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] No DVR routers for this DVR port 75e751a9-0e74-46fd-a4fb-738311e1dc68 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:14.106056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.150261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.150791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router 623c2fc2-17ff-49b2-b598-2087b28b02c8 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:14.156252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.174184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.175317 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e620a5d9-cd60-46d9-97e7-13ce52f85cce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 204 len: 168 time: 3.8787169 Nov 05 14:46:14.184577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40352) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:14.203023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.205620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.206778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3fd0293d-f6f8-446d-a56d-52132804340f tempest-ServersTestJSON-1134412318 tempest-ServersTestJSON-1134412318-project] 10.222.0.30 "DELETE /v2.0/floatingips/e20e306b-6add-4c1d-90d2-15473667deca HTTP/1.1" status: 204 len: 168 time: 2.1724584 Nov 05 14:46:14.212805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40354) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:14.223974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-394049638', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:14.256923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.287338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network de4ff29f-65bd-41ea-b5af-181876db3316 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:14.288250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=fb35e709-9cba-47ef-a2f1-ae86ed17df14,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:14.305321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:14.347898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0842f932-b853-4524-b67e-bc1accc84862 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:14.351875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '8fd33dd0-953c-4cde-84c3-a97fc01acf39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:14.352237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 0959dfb7-dbc6-47f6-80c5-75159edeaaf8, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:14.403774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0842f932-b853-4524-b67e-bc1accc84862 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:14.404147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.505478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.506932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:14.533420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0959dfb7-dbc6-47f6-80c5-75159edeaaf8) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:14.544434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:14.545126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.568783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 0842f932-b853-4524-b67e-bc1accc84862, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0842f932-b853-4524-b67e-bc1accc84862,segment=NetworkSegment(4a67fd41-849b-4a30-a532-ffa04bc15769),segment_id=4a67fd41-849b-4a30-a532-ffa04bc15769)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:14.575052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.643451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=0842f932-b853-4524-b67e-bc1accc84862,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:14.678024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Router 44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:14.761918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.770453 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.777387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.778429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.786923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.793397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c509f189-e51f-483b-b35f-b9ea2b45ee7d') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.793718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c509f189-e51f-483b-b35f-b9ea2b45ee7d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.808751 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c8db0d0d-f39b-423b-baa1-bc38a11a3289 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.1215198 Nov 05 14:46:14.812838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40356) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:14.814364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.817804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-210242761', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:14.850677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7e1eb3c-8b1a-4443-b627-d6e2140e578b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:14.856405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:14.863578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dcf07ee6-1ec4-4700-b45d-4caac72cc9e3 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3717744 Nov 05 14:46:14.867191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40358) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:14.873138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:14.875924 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] Sync routers for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:14.881811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.890694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.891178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router 9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:14.909478 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:14.910105 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.917425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.918589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.960352 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.973766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.974887 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f971b25b-f251-4376-95db-c3c33f18cd7b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 HTTP/1.1" status: 204 len: 168 time: 1.0561247 Nov 05 14:46:14.976043 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:14.976168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:14.976509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.977396 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:14.981278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40362) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:14.984521 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:14.987626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25fa2acb-167f-48e9-92a6-c0c18a0cec2e None None] Provisioning complete for port 0842f932-b853-4524-b67e-bc1accc84862 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:14.988016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25fa2acb-167f-48e9-92a6-c0c18a0cec2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:14.994739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.032503 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:15.035799 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4941a8d-acb8-4476-8dce-a4cc96a8e65c None None] The sync data for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:15.074671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7e1eb3c-8b1a-4443-b627-d6e2140e578b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:15.113842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.159555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.184423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.212081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 8b92d01e-3e77-4037-8c4e-09b9e3932ed7 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:15.218232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.223897 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] 10.222.0.30 "DELETE /v2.0/networks/4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a HTTP/1.1" status: 204 len: 168 time: 2.4348309 Nov 05 14:46:15.236161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.237540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.254128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8026f3-bb1a-452c-9aed-05854cd65fbf admin admin] Pushing event deleted for resources: {'Network': ['ID=4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:15.283269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.287106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-91c50e54-541c-4d3a-817f-a33698d37bfd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.4701667 Nov 05 14:46:15.296521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5bd192-e8cc-4719-a274-e156c2ce72fd req-ef87d8ae-ab13-4c3b-984e-0534f41d466d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:15.298109 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7f5bd192-e8cc-4719-a274-e156c2ce72fd req-ef87d8ae-ab13-4c3b-984e-0534f41d466d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3084795 Nov 05 14:46:15.300304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40366) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:15.320173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.471991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0959dfb7-dbc6-47f6-80c5-75159edeaaf8', 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': 'fb35e709-9cba-47ef-a2f1-ae86ed17df14'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:15.477612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.519717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40368) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:15.522402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:15.528120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.629241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:15.667416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:15.667515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:15.718266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:15.763291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:15.765554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:15.802149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1caf67cb-121e-45dc-83d7-4172282c4e69 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b398cbd7c6d04e96b90e3a8bcfd826b4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2776959 Nov 05 14:46:15.806494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40370) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:15.814876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:15.815926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa377b79-efb4-4cec-ab7d-6ab23666b446 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:15.828186 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24c72a26-0bc4-4dba-9783-8fe69c8017a7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/be71f7e3-cf2d-42ac-a128-fb0c2fcae438 HTTP/1.1" status: 200 len: 977 time: 6.1435785 Nov 05 14:46:15.832604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40372) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:15.837365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Allocated IP 2001:db8::2 (0959dfb7-dbc6-47f6-80c5-75159edeaaf8/fb35e709-9cba-47ef-a2f1-ae86ed17df14/816203d4-23d2-48b4-a8cd-5ee4011a1c51) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:15.843569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:15.960688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:15.960905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.083235 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7f5bd192-e8cc-4719-a274-e156c2ce72fd req-9d7739f9-4ed4-4551-94c7-2f91a0a6063d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7745559 Nov 05 14:46:16.094375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.115063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.197350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:16.208226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.232325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:16.235738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0842f932-b853-4524-b67e-bc1accc84862 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:16.237762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:16.240015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Pushing event updated for resources: {'Port': ['ID=816203d4-23d2-48b4-a8cd-5ee4011a1c51,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:16.270641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.296417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.306881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-b6d3fc85-33fe-45e8-b809-28e71a664e4a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:46:16.309481 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b6d3fc85-33fe-45e8-b809-28e71a664e4a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.4411697 Nov 05 14:46:16.329530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40374) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:16.331532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.346831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Attempting to bind port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:16.347066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Attempting to bind port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '8fd33dd0-953c-4cde-84c3-a97fc01acf39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:16.347296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Attempting to bind port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 on network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:16.355847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 45, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:16.356255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Checking segment: {'id': '8fd33dd0-953c-4cde-84c3-a97fc01acf39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:16.356647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.357053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Bound using segment: {'id': '8fd33dd0-953c-4cde-84c3-a97fc01acf39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:16.357535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Bound port: 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8fd33dd0-953c-4cde-84c3-a97fc01acf39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '0959dfb7-dbc6-47f6-80c5-75159edeaaf8'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:16.357915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.372014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0842f932-b853-4524-b67e-bc1accc84862 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:16.372203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.403930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.426131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.457337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-53eeb1f1-193b-40be-bbf5-af473c37f6d0 None None] Provisioning complete for port 0842f932-b853-4524-b67e-bc1accc84862 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:16.457691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-53eeb1f1-193b-40be-bbf5-af473c37f6d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.516319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.524102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] For port 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:16.561863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] For port 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=816203d4-23d2-48b4-a8cd-5ee4011a1c51,segment=NetworkSegment(8fd33dd0-953c-4cde-84c3-a97fc01acf39),segment_id=8fd33dd0-953c-4cde-84c3-a97fc01acf39)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:16.577620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=8b92d01e-3e77-4037-8c4e-09b9e3932ed7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:16.582409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.589004 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4db90d7-45a9-4412-8292-05eef7659e03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/8b92d01e-3e77-4037-8c4e-09b9e3932ed7 HTTP/1.1" status: 204 len: 168 time: 1.5984185 Nov 05 14:46:16.592369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.606016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40376) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:16.706450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.709405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.710874 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/132f4b8d-4ff7-4c3a-a13d-cf06b6275393 HTTP/1.1" status: 204 len: 168 time: 0.8333004 Nov 05 14:46:16.718809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.734261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.734599 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP be71f7e3-cf2d-42ac-a128-fb0c2fcae438 disassociated. External IP: 172.26.5.186, port: 847bc79e-f772-436e-8b2b-a881706bd85f. Nov 05 14:46:16.748251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8270e368-0b06-40fe-8fda-cefa56a35dff None None] Pushing event updated for resources: {'Port': ['ID=816203d4-23d2-48b4-a8cd-5ee4011a1c51,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:16.752675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441fe31b-b3c0-403b-91e8-c4d1baad9878 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=132f4b8d-4ff7-4c3a-a13d-cf06b6275393,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:16.797544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8::1 (0959dfb7-dbc6-47f6-80c5-75159edeaaf8/fb35e709-9cba-47ef-a2f1-ae86ed17df14/dc202498-f916-4c98-aac0-194eb3d7fe3f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:16.824500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet ed286e7f-a02b-4e69-b788-bed1ea0ec76a {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:16.842890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.846088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Allocated IP 172.26.5.101 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b627e7dd-21a7-45e7-a688-3a6630c6ea23) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:16.857153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-94ddd6da-86d2-4379-9e5f-ef1ea9ff4841 None None] Provisioning complete for port af9c0163-df97-4e25-a644-4f21c724e670 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:16.857526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-94ddd6da-86d2-4379-9e5f-ef1ea9ff4841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:16.950865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Deleting port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:16.951628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.026075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-94ddd6da-86d2-4379-9e5f-ef1ea9ff4841 None None] Provisioning complete for port fd22bacb-77ba-422c-b0e6-b1304e8fb730 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:17.026426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-94ddd6da-86d2-4379-9e5f-ef1ea9ff4841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.084681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-94ddd6da-86d2-4379-9e5f-ef1ea9ff4841 None None] Port fd22bacb-77ba-422c-b0e6-b1304e8fb730 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:17.147520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] For port e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:17.147912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.177377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Calling delete_port for e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:17.190981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.419352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.595887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.643178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting port fd22bacb-77ba-422c-b0e6-b1304e8fb730 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:17.643629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.654503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Pushing event deleted for resources: {'Port': ['ID=e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:17.661788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2099617-b2d6-4ff1-a7b1-908c3702c7d2 req-99c56252-2d91-458f-aca3-a8b855119e35 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:17.663097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2099617-b2d6-4ff1-a7b1-908c3702c7d2 req-99c56252-2d91-458f-aca3-a8b855119e35 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3093064 Nov 05 14:46:17.678423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.702715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.740848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.801825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.844290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Calling delete_port for fd22bacb-77ba-422c-b0e6-b1304e8fb730 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:17.900930 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2099617-b2d6-4ff1-a7b1-908c3702c7d2 req-cfa55472-8350-4b6a-8f66-bb2e405f8d05 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2141249 Nov 05 14:46:17.908086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:17.924013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.934579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:17.979017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.038366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cd5a534-3286-4a77-bbee-bfc4525f8900 None None] Network 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:18.075791 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:18.078508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:18.091435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=ed286e7f-a02b-4e69-b788-bed1ea0ec76a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:18.101697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:18.105763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:18.117341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.123666 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-516dbf15-84dd-41ce-ac2b-b150a391033f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/ed286e7f-a02b-4e69-b788-bed1ea0ec76a HTTP/1.1" status: 204 len: 168 time: 1.5126693 Nov 05 14:46:18.125315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f56cd1e8-58c6-4921-b4a8-a14e5af2854e None None] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:18.125732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:18.128071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f665420-6d6f-478d-8f02-5bd996bfa6a8 None None] Network 1216238d-0e6e-4e75-af15-fd91bae24352 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:18.130433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40408) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:18.134501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=dc202498-f916-4c98-aac0-194eb3d7fe3f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:18.320105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.607243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8cd5a534-3286-4a77-bbee-bfc4525f8900 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:18.624655 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:18.653734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 816203d4-23d2-48b4-a8cd-5ee4011a1c51 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:18.695400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Port': ['ID=fd22bacb-77ba-422c-b0e6-b1304e8fb730,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:18.726222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:18.726801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.739076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event updated for resources: {'Port': ['ID=b627e7dd-21a7-45e7-a688-3a6630c6ea23,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:18.787345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9de09cc-057c-40bb-9280-dc7684ad357a None None] DHCP port deletion for 4c42bfe2-8d6e-40ef-a2dd-e000f33e3b0a request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:18.808689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.809042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.809382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.809906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.810412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.810909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.811398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.811887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.812378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.812896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.813381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.813850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:18.815780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Provisioning complete for port af9c0163-df97-4e25-a644-4f21c724e670 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:18.816958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.819460 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.919733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d31b6a9-5da5-49ff-b154-ec49f2b679de None None] Network 368b908d-d707-44c5-ba9a-168716fe2f61 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:18.930703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:18.983780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:18.994583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.004987 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:19.025614 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:19.027521 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f56cd1e8-58c6-4921-b4a8-a14e5af2854e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:19.090280 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:19.093226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8bbb9f5-3e61-487e-a492-580b7df663b1 req-a80a84aa-b555-4392-872c-3e7bcd597537 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:19.095200 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b8bbb9f5-3e61-487e-a492-580b7df663b1 req-a80a84aa-b555-4392-872c-3e7bcd597537 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.7671599 Nov 05 14:46:19.102639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:19.103319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.112703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40424) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:19.114340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1ea48ff-a18f-4f24-99e7-c717682a04e6 None None] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:19.120132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ba1134-753a-425b-aa0a-40615f266748 req-a8c13401-e795-4029-a938-7ccb12b4bf65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:19.123992 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-a8c13401-e795-4029-a938-7ccb12b4bf65 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.4729960 Nov 05 14:46:19.125881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.185333 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:19.209744 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:19.210700 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:19.260171 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:19.260870 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-090ce6da-3168-42c3-ac86-4afcbf76d902 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/be71f7e3-cf2d-42ac-a128-fb0c2fcae438 HTTP/1.1" status: 200 len: 688 time: 3.4231176 Nov 05 14:46:19.261335 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d214d677-0685-415d-8a82-55da4ab1f857 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:19.301471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40428) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b1ea48ff-a18f-4f24-99e7-c717682a04e6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:19.331740 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:19.364229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] DHCP port deletion for 1216238d-0e6e-4e75-af15-fd91bae24352 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:19.415482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.506323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-249973568'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:19.508431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.614272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b8bbb9f5-3e61-487e-a492-580b7df663b1 req-61ad056e-040e-45c9-b513-a829063011e4 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4857116 Nov 05 14:46:19.631929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=816203d4-23d2-48b4-a8cd-5ee4011a1c51,segment=NetworkSegment(8fd33dd0-953c-4cde-84c3-a97fc01acf39),segment_id=8fd33dd0-953c-4cde-84c3-a97fc01acf39)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:19.640280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.661944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:19.672329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Deleting port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:19.672729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.675725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ba1134-753a-425b-aa0a-40615f266748 req-6f720d1a-7c55-4cab-a1fe-cf975e64c4d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:19.677264 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-6f720d1a-7c55-4cab-a1fe-cf975e64c4d3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.5140040 Nov 05 14:46:19.678213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] DHCP port deletion for 368b908d-d707-44c5-ba9a-168716fe2f61 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:19.682476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Made reservation on behalf of aa1dbf0a760f4b908147f8b9122343c5 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:19.683927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Router 44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:19.686034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.686846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Provisioning complete for port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:19.687217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.700071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 604128d1-fc1f-4eb5-86a9-338516cb74d7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:19.700417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.724565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:19.724901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.782535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.814289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=816203d4-23d2-48b4-a8cd-5ee4011a1c51,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:19.825723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] For port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,segment=NetworkSegment(df409475-436a-4244-8ab4-6714ff2112f0),segment_id=df409475-436a-4244-8ab4-6714ff2112f0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:19.825723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.843647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Calling delete_port for 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:19.878074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.930606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Deleting port 3a448037-1369-460d-adf7-a51d573fd844 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:19.931565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:19.967374 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-eb68d4b1-4d23-474e-8063-01dd8bea81ac service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.2690535 Nov 05 14:46:20.047128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Could not find standard attr ID for object fd22bacb-77ba-422c-b0e6-b1304e8fb730. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:46:20.049882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] For port 3a448037-1369-460d-adf7-a51d573fd844, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3a448037-1369-460d-adf7-a51d573fd844,segment=NetworkSegment(a1867726-142d-427e-8d69-809bf110a754),segment_id=a1867726-142d-427e-8d69-809bf110a754)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:20.050303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.057774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bcd89c1b-319c-4ea0-87c2-0430d19c4d28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.076582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Calling delete_port for 3a448037-1369-460d-adf7-a51d573fd844 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:20.092537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.095135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Provisioning complete for port 0842f932-b853-4524-b67e-bc1accc84862 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:20.095135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f4f15d85-05d7-4c66-87f8-0762f421a2d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.182936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] Pushing event deleted for resources: {'Port': ['ID=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:20.190986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eac2cde-1682-4cc6-bce0-a29f09d940fa None None] No DVR routers for this DVR port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:20.192544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:20.239443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ff602df-c207-44df-b9f0-7e49d9dac93a tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9040899 Nov 05 14:46:20.242787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40430) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:20.244975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] Sync routers for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:20.262654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.263034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.292539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.294418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:20.295039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.314216 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-7f59895f-be6d-4db5-81bd-48dac453e256 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] delete failed (client error): The resource could not be found. Nov 05 14:46:20.315541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7f59895f-be6d-4db5-81bd-48dac453e256 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/routers/tempest-non_exist_router-882426606 HTTP/1.1" status: 404 len: 334 time: 0.0660825 Nov 05 14:46:20.318151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40432) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:20.325113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7d445c1e-4794-4213-bd46-f336bff854d4 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'router': {'external_gateway_info': {'network_id': '44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:20.361730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.367789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Pushing event deleted for resources: {'Port': ['ID=3a448037-1369-460d-adf7-a51d573fd844,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:20.378239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] No DVR routers for this DVR port 3a448037-1369-460d-adf7-a51d573fd844 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:20.383749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.384147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.384532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.384870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.385198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.385541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.385871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.386214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.386542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.386874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.387185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.387506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e0dd576-6183-4f04-a770-95a9c79c17ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:20.393318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 816203d4-23d2-48b4-a8cd-5ee4011a1c51 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:20.399620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:20.400267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.419228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,segment=NetworkSegment(df409475-436a-4244-8ab4-6714ff2112f0),segment_id=df409475-436a-4244-8ab4-6714ff2112f0)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:20.419871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.423960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 604128d1-fc1f-4eb5-86a9-338516cb74d7 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:20.459639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9915e90-31de-4433-bf1f-bb4f86273b44 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:20.465929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:20.466601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.467251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1bf980f-595d-43f8-b665-94166a8f0f7b None None] The sync data for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:20.490612 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Sync routers for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:20.507689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:20.515118 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:20.515732 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.550484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b154cd8e-c6cc-49f6-841c-0dfff587c421 None None] Provisioning complete for port dc202498-f916-4c98-aac0-194eb3d7fe3f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:20.550858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b154cd8e-c6cc-49f6-841c-0dfff587c421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.551905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ba1134-753a-425b-aa0a-40615f266748 req-e1224900-78be-4881-8e4c-c290b814d81e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:20.553655 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-e1224900-78be-4881-8e4c-c290b814d81e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.5771568 Nov 05 14:46:20.626764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:20.627134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.629604 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:20.712726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.744507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.825458 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:46:17Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.840924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:20.854603 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Checking router: 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:46:20.865281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Routers {'29e22c11-bb69-42c5-9ed8-f394e0cf82c3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:20.866164 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:45:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:20.880142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f87e246b-75bd-4e25-8a12-5700bb428e1c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:20.884477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ba1134-753a-425b-aa0a-40615f266748 req-0211528d-8bbc-494e-8459-532afdd858a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:20.886226 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-0211528d-8bbc-494e-8459-532afdd858a1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3202720 Nov 05 14:46:20.891213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b154cd8e-c6cc-49f6-841c-0dfff587c421 None None] Port dc202498-f916-4c98-aac0-194eb3d7fe3f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:20.892570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.893147 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Added segment aad24a7e-a0ac-41fa-811f-c770bd5429ab of type vlan for network b13b759a-7518-4b98-a1b4-fcd147613815 Nov 05 14:46:20.895171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.908797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9915e90-31de-4433-bf1f-bb4f86273b44 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:20.910647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b154cd8e-c6cc-49f6-841c-0dfff587c421 None None] Could not find standard attr ID for object fd22bacb-77ba-422c-b0e6-b1304e8fb730. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:46:20.933573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.940770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:20.959603 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0adc4330-e5bd-4542-9926-f8d47080d221 admin admin] 10.222.0.30 "PUT /v2.0/routers/29e22c11-bb69-42c5-9ed8-f394e0cf82c3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7425358 Nov 05 14:46:20.974524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40436) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.023602 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] Set router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:46:21.025496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.026753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.030901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=0df27e9b-ddd1-4f92-bc2c-4ae629e35162,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:21.034555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:21.070505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d445c1e-4794-4213-bd46-f336bff854d4 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.091531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.131951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75e751a9-0e74-46fd-a4fb-738311e1dc68 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:21.155366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=604128d1-fc1f-4eb5-86a9-338516cb74d7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:21.159761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 75e751a9-0e74-46fd-a4fb-738311e1dc68 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:21.160415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 75e751a9-0e74-46fd-a4fb-738311e1dc68 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:21.161077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:21.165070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.171821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.173222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.173578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.174998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.174998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.175471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.176463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.176850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.177615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.177963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.178305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.178632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:46:21.190826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:21.191174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0df27e9b-ddd1-4f92-bc2c-4ae629e35162 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:21.191592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3a448037-1369-460d-adf7-a51d573fd844 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:21.210264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-7d445c1e-4794-4213-bd46-f336bff854d4 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] update failed (client error): The resource could not be found. Nov 05 14:46:21.217086 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7d445c1e-4794-4213-bd46-f336bff854d4 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 HTTP/1.1" status: 404 len: 339 time: 0.8902202 Nov 05 14:46:21.221106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 3a448037-1369-460d-adf7-a51d573fd844 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:21.223528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3a448037-1369-460d-adf7-a51d573fd844 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:21.266890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40438) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.321504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960b4bf8-758f-4557-b7cd-cdd1187780ae req-2f728d50-7746-4bed-8db2-6c27908896c6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.324836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-960b4bf8-758f-4557-b7cd-cdd1187780ae req-2f728d50-7746-4bed-8db2-6c27908896c6 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3724446 Nov 05 14:46:21.346603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca43e30b-9350-43a1-9004-7f8d06447103 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:21.381341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:46:21.387043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.391168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.392731 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6657538-595c-4599-8567-1901d5314607 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/be71f7e3-cf2d-42ac-a128-fb0c2fcae438 HTTP/1.1" status: 204 len: 168 time: 2.0251670 Nov 05 14:46:21.396890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:46:17Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:21.403367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40442) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.424411 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b777977-7daa-4248-abf1-38b2a170a0e9 None None] The sync data for ids ['29e22c11-bb69-42c5-9ed8-f394e0cf82c3'] in dv-neutron-816850-1-hyperv is: [{'id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'name': 'tempest-ServersTestJSON-1377752248-router', 'tenant_id': '3cb2c9da66364ac18972da6a46b083c1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28'}], 'enable_snat': True}, 'gw_port_id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:21Z', 'updated_at': '2021-11-05T14:46:17Z', 'revision_number': 5, 'project_id': '3cb2c9da66364ac18972da6a46b083c1', 'gw_port': {'id': '661b4be0-a8d2-427f-9d57-e89bc540536b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:31:8b:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e22c11-bb69-42c5-9ed8-f394e0cf82c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 73, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:21.453932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f6582ac6-e293-41bb-b768-4a459e27e6b2 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] delete failed (client error): The resource could not be found. Nov 05 14:46:21.455012 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f6582ac6-e293-41bb-b768-4a459e27e6b2 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/be71f7e3-cf2d-42ac-a128-fb0c2fcae438 HTTP/1.1" status: 404 len: 345 time: 0.0507004 Nov 05 14:46:21.459201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-960b4bf8-758f-4557-b7cd-cdd1187780ae req-038d6f9c-191d-459a-8957-39bff2fb6dba tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1230502 Nov 05 14:46:21.459658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40444) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.506209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca43e30b-9350-43a1-9004-7f8d06447103 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:21.542434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf1d4c3d-99a4-4a5d-8a65-d5ac20a02c00 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.548987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf1d4c3d-99a4-4a5d-8a65-d5ac20a02c00 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.554919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf1d4c3d-99a4-4a5d-8a65-d5ac20a02c00 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.557233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf1d4c3d-99a4-4a5d-8a65-d5ac20a02c00 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/ports?network_id=1557b5a0-960f-471e-a237-a6a5b7dcc894 HTTP/1.1" status: 200 len: 2357 time: 0.0966587 Nov 05 14:46:21.559829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40446) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.611813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5bcdd2c-d122-4fac-91c5-a4f6392f689e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.613409 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e5bcdd2c-d122-4fac-91c5-a4f6392f689e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/subnets/797dfb34-cf8a-436e-96e5-05a94bb2f935 HTTP/1.1" status: 200 len: 797 time: 0.0525231 Nov 05 14:46:21.618986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40448) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:21.625928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=dc202498-f916-4c98-aac0-194eb3d7fe3f,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:21.626112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'port': {'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894', 'name': 'tempest-FloatingIPTestJSON-941641737', 'fixed_ips': [{'ip_address': '172.20.0.14'}, {'ip_address': '172.20.0.13'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:21.658450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.717724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.723246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:21.723763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.748925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:21.782447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-ffff6219-f5ae-497c-a9e8-4cfc2aa56dce service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8845305 Nov 05 14:46:21.812129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1216238d-0e6e-4e75-af15-fd91bae24352']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:21.816574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.852186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:21.874117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] device_id is not set on port fb6206ba-3f42-47d3-ade2-52410eea44ff yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:21.933630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'df409475-436a-4244-8ab4-6714ff2112f0') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:21.934227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'df409475-436a-4244-8ab4-6714ff2112f0') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:21.938630 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 802 time: 2.8114181 Nov 05 14:46:22.037765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.117447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:22.172921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d04ceb-d665-42f3-9b47-9253f0c41257 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Pushing event updated for resources: {'Network': ['ID=b13b759a-7518-4b98-a1b4-fcd147613815,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:22.174524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:22.175599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:22.178031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40454) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:22.181689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.183385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815', 'binding:host_id': 'hv-neutron-8168', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-354223223'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:22.224119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 610 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:22.224564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.225192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network b13b759a-7518-4b98-a1b4-fcd147613815 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:22.230561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:22.231259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e1f0a6a2-e8d6-4627-9bf7-33f3cb416e1a not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:22.239050 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:22.252286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Made reservation on behalf of 43d4035d66c84aaab60dcbe13e774ce5 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:22.254936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.268229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.274121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.14 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/fb6206ba-3f42-47d3-ade2-52410eea44ff) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:22.288686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Router b0aeb21d-d62d-4243-a921-eb51f69ad2fb is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:22.290278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.13 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/fb6206ba-3f42-47d3-ade2-52410eea44ff) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:22.385473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b39ca0c5-6961-44f5-ac9d-72e0c1dd5afc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.400320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.426026 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ba1134-753a-425b-aa0a-40615f266748 req-8e8c56fb-df5c-4dec-abc5-71eb5a89071f service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6110041 Nov 05 14:46:22.427165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.449104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.464256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.474844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.485154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port b4ce3c87-cb71-40ef-be9a-57c9e09e010c yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:22.554684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.558135 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/1216238d-0e6e-4e75-af15-fd91bae24352 HTTP/1.1" status: 204 len: 168 time: 4.4246969 Nov 05 14:46:22.598798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40458) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:22.610721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc371bc-7fce-4d14-b285-fd89759a7da5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=1216238d-0e6e-4e75-af15-fd91bae24352,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:22.653459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-18875c40-83b7-4dc8-85ad-2cc626d77c19 None None] Provisioning complete for port dc202498-f916-4c98-aac0-194eb3d7fe3f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:22.653829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18875c40-83b7-4dc8-85ad-2cc626d77c19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.677603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.701818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-18875c40-83b7-4dc8-85ad-2cc626d77c19 None None] Port dc202498-f916-4c98-aac0-194eb3d7fe3f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:22.714165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7eb2ddf-e6e6-4df5-9107-edcc1331bbf4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:22.725065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-18875c40-83b7-4dc8-85ad-2cc626d77c19 None None] Provisioning complete for port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:22.725895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18875c40-83b7-4dc8-85ad-2cc626d77c19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.796191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad7e045-23e2-4ad2-8778-3e26bfb011c6 req-6d93ed26-37f0-4bd1-84cd-9712c2ac1319 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:22.797837 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7ad7e045-23e2-4ad2-8778-3e26bfb011c6 req-6d93ed26-37f0-4bd1-84cd-9712c2ac1319 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1971242 Nov 05 14:46:22.855196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.942387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7ad7e045-23e2-4ad2-8778-3e26bfb011c6 req-6c9ef9b9-767e-4071-990a-0f6e8e80b862 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1294887 Nov 05 14:46:22.951554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:22.964224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-185dc7eb-4e6f-405c-8b2d-90556ceedc72 None None] Provisioning complete for port dc202498-f916-4c98-aac0-194eb3d7fe3f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:22.964663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-185dc7eb-4e6f-405c-8b2d-90556ceedc72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.017956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-185dc7eb-4e6f-405c-8b2d-90556ceedc72 None None] Port dc202498-f916-4c98-aac0-194eb3d7fe3f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:23.077865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:23.112664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:23.120856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:23.133948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=fb6206ba-3f42-47d3-ade2-52410eea44ff,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:23.165828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.170979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port b4ce3c87-cb71-40ef-be9a-57c9e09e010c yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:23.184241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:23.195143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] Sync routers for ids ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:23.203205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.206589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] Routers {'b0aeb21d-d62d-4243-a921-eb51f69ad2fb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:23.207321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.209693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['368b908d-d707-44c5-ba9a-168716fe2f61']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.219584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.223964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 5ae99c97-8514-42fa-92de-7eeebe3dfbcb is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:23.228952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:23.229579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.235215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a1867726-142d-427e-8d69-809bf110a754') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.235513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a1867726-142d-427e-8d69-809bf110a754') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.240050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Deleting port 661b4be0-a8d2-427f-9d57-e89bc540536b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:23.240614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.244994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.254824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.255421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] Routers {'b0aeb21d-d62d-4243-a921-eb51f69ad2fb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:23.256181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.295217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.296229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e6da368-a402-4b6a-ae26-f8dc41242991 None None] The sync data for ids ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:23.298304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.302873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e9466416-e67a-4e1c-9b0f-91090e226442 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 9.1078193 Nov 05 14:46:23.302965 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fc8c5bf0-f26e-4647-b81b-8f57adce55b5 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1009 time: 1.6807566 Nov 05 14:46:23.307208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40462) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.309824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.310907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.322299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'fb6206ba-3f42-47d3-ade2-52410eea44ff', 'fixed_ip_address': '172.20.0.14'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:23.323179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:23.344927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:23.345328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:23.354827 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:23.359408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.395389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=b4ce3c87-cb71-40ef-be9a-57c9e09e010c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:23.427709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.447047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Checking segment: {'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:23.447387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Network hostable DHCP agents. Network: b13b759a-7518-4b98-a1b4-fcd147613815, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:23.473075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.488019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.494536 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/368b908d-d707-44c5-ba9a-168716fe2f61 HTTP/1.1" status: 204 len: 168 time: 0.8924942 Nov 05 14:46:23.500577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40464) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.518062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-776701848'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:23.526383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3bd2cd6-a61b-4809-aa42-4e77528da5ef tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=368b908d-d707-44c5-ba9a-168716fe2f61,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:23.541584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Network b13b759a-7518-4b98-a1b4-fcd147613815 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:23.562189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, b13b759a-7518-4b98-a1b4-fcd147613815) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:23.567789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:23.572617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:23.575859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.578792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6017d74c-9151-4c7f-9129-9e5aa0db8a63 None None] Network b13b759a-7518-4b98-a1b4-fcd147613815 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:23.582726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:23.585722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Allocated IP 172.20.0.1 (c978ac01-0f0b-46ac-bbdb-ac6b7f142966/bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1/705eef91-0052-4950-93bb-f88e7c2125fb) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:23.597854 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] Sync routers for ids ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:23.600739 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1d76964b-58fb-4775-b484-a226f3fa42aa tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/5ae99c97-8514-42fa-92de-7eeebe3dfbcb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2897208 Nov 05 14:46:23.603524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40466) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.610959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] For port 661b4be0-a8d2-427f-9d57-e89bc540536b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=661b4be0-a8d2-427f-9d57-e89bc540536b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:23.611498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.620005 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] Routers {'5ae99c97-8514-42fa-92de-7eeebe3dfbcb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:23.620979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:23.621316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:23.621659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:23.622550 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.645951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:23.646279 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:23.646958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:23.650914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 2 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:23.680212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.680582 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.681391 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 9dc8ec3f-ae70-4dcc-ad0d-472103764521 of type vlan for network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c Nov 05 14:46:23.693039 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] Routers {'5ae99c97-8514-42fa-92de-7eeebe3dfbcb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:23.693416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:23.693759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:23.694097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:23.694520 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.721748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:23.721948 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:23.724932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 3 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:23.731392 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:23.731709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.732043 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8fe132f-c1d3-418c-867e-964b211be74e None None] The sync data for ids ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:23.742257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Calling delete_port for 661b4be0-a8d2-427f-9d57-e89bc540536b owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:23.750649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccdfeb32-9526-48ba-ad52-777a74557967 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:23.752064 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ccdfeb32-9526-48ba-ad52-777a74557967 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports/dc202498-f916-4c98-aac0-194eb3d7fe3f HTTP/1.1" status: 200 len: 911 time: 0.1444259 Nov 05 14:46:23.761411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.762315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.792502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:23.792833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:23.793167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:23.808427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:23.808777 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:23.815112 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 4 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:23.845535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:23.845875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:23.846248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:23.866660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.872726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:23.873296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:23.886463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:23.886789 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:23.898843 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 5 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:23.956765 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.4542861 Nov 05 14:46:23.963665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40470) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:23.973856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.97 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/aa22a1ea-cbd8-4195-b211-0c30db9f6fbe) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:23.980218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:23.983728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:23.983875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:23.984222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.042376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.300396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330539de-6c8d-4faf-97d2-82d83d051d95 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=cfd0ae34-8401-40a9-aa98-7ce5914cdd4c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:24.302408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.302726 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.311884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58a08e1-e0dc-420d-8905-79bb79ca6130 req-79f4fe94-8454-4e53-91d4-554f8c944f3e tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:24.313421 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e58a08e1-e0dc-420d-8905-79bb79ca6130 req-79f4fe94-8454-4e53-91d4-554f8c944f3e tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2758846 Nov 05 14:46:24.314016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:24.330848 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 6 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:24.394277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:24.394607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:24.394943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.397053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.414418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.414737 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.418431 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 7 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:24.447752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:24.448082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:24.448415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.461939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.462277 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.465837 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 8 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:24.481932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:24.484207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:24.487782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.512414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:24.538009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.543460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:24.543793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:24.544124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.546311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:24.555267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Port': ['ID=705eef91-0052-4950-93bb-f88e7c2125fb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:24.555470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.561119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.561447 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.565191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 9 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:24.583060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.592136 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e58a08e1-e0dc-420d-8905-79bb79ca6130 req-5650ed5e-d4e0-4e53-9e56-9c751b2de63c tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2537940 Nov 05 14:46:24.596954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:24.597293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:24.597636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.624844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.636631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Pushing event deleted for resources: {'Port': ['ID=661b4be0-a8d2-427f-9d57-e89bc540536b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:24.648048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.648551 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.655823 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.plugins.ml2.plugin [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 10 to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c Nov 05 14:46:24.666261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.696123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.728165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:24.733186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:24.733741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:24.734088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:24.757703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:24.761010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:24.816954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:24.817273 dv-neutron-816850-1-hyperv neutron-server[113580]: ERROR neutron.plugins.ml2.managers [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port b4ce3c87-cb71-40ef-be9a-57c9e09e010c on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:24.817614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.820540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.840830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=aa22a1ea-cbd8-4195-b211-0c30db9f6fbe,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:24.855414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.863316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcce3cbc-acbd-4c7a-a209-61e931164556 None None] Provisioning complete for port 705eef91-0052-4950-93bb-f88e7c2125fb triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:24.863972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcce3cbc-acbd-4c7a-a209-61e931164556 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:24.882917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b0c57d-3bac-4aba-ae2f-e555c33a62b5 req-01ef8c61-d9fb-4b3c-8b2a-b1ad77b91f47 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:24.884497 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25b0c57d-3bac-4aba-ae2f-e555c33a62b5 req-01ef8c61-d9fb-4b3c-8b2a-b1ad77b91f47 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1965528 Nov 05 14:46:24.906283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dcce3cbc-acbd-4c7a-a209-61e931164556 None None] Port 705eef91-0052-4950-93bb-f88e7c2125fb cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:25.000439 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.005704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.029516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Deleting port b627e7dd-21a7-45e7-a688-3a6630c6ea23 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:25.029808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.049501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.066136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.069219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port b4ce3c87-cb71-40ef-be9a-57c9e09e010c, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:25.069531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempted to set empty binding levels {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:46:25.109033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.121809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.126671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.127215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 29e22c11-bb69-42c5-9ed8-f394e0cf82c3 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:25.133175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25b0c57d-3bac-4aba-ae2f-e555c33a62b5 req-d7735cc7-0c60-4d4d-b712-7bdf2e76354c tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2247179 Nov 05 14:46:25.213247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.214702 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-46bccc33-85f2-4bc7-947f-d72c908c693f admin admin] 10.222.0.30 "DELETE /v2.0/routers/29e22c11-bb69-42c5-9ed8-f394e0cf82c3 HTTP/1.1" status: 204 len: 168 time: 4.1985362 Nov 05 14:46:25.217659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40478) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:25.296031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:25.296643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.325815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=cd1012a5-c0e9-473b-8ac4-dccf8b779985,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:25.337951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=b4ce3c87-cb71-40ef-be9a-57c9e09e010c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:25.358097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '9dc8ec3f-ae70-4dcc-ad0d-472103764521', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:25.358479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: cfd0ae34-8401-40a9-aa98-7ce5914cdd4c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:25.367630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-426db0f9-dc2f-4402-9297-894610d5cd25 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 985 time: 3.1885290 Nov 05 14:46:25.380301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40482) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:25.479815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:25.551936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670ec1f6-ca90-4510-9fa0-02150752d264 req-99ee4f58-78a3-4997-a1f4-4f820bf039cf tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:25.553508 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-670ec1f6-ca90-4510-9fa0-02150752d264 req-99ee4f58-78a3-4997-a1f4-4f820bf039cf tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1970160 Nov 05 14:46:25.557056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, cfd0ae34-8401-40a9-aa98-7ce5914cdd4c) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:25.567372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e5aa70f-b34d-47a2-957c-3e7bb5aaa40c None None] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:25.572101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:25.572719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.644816 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e50d63b-2424-4fbc-bd23-04d197c14a6e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6745658 Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7e5aa70f-b34d-47a2-957c-3e7bb5aaa40c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:25.662407 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:25.669311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40484) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:25.679137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12cb3ec2-7341-4961-b054-7c2f8c10f771 None None] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:25.684669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1163645732', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:25.729831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.732033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Deleting port b4ce3c87-cb71-40ef-be9a-57c9e09e010c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:25.732591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.736919 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-670ec1f6-ca90-4510-9fa0-02150752d264 req-70a0080c-3ab9-4ea2-89da-bfd4531afb30 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1730518 Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-12cb3ec2-7341-4961-b054-7c2f8c10f771 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:25.770204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:25.781121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-203bbb29-8222-4831-87ba-e01705ddfcff None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:25.787971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Deleting subnet 84c193ea-9294-4fe7-b33c-753ea27f07be {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:25.791583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.828904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.829933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.830626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.864860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port b4ce3c87-cb71-40ef-be9a-57c9e09e010c, host hv-neutron-8168, got binding levels [] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:25.865250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.907399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.929183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Calling delete_port for b627e7dd-21a7-45e7-a688-3a6630c6ea23 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:25.930080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Calling delete_port for b4ce3c87-cb71-40ef-be9a-57c9e09e010c owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:25.941991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.955409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-203bbb29-8222-4831-87ba-e01705ddfcff None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:25.974419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.987143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:25.990347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.107284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.107891 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2f77fd02-c562-4272-b67a-d9c210936641 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4377544 Nov 05 14:46:26.114321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40490) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:26.123134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'port': {'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c', 'name': 'tempest-RoutersTest-645848300'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:26.139303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad1c19e-7d6e-4ac1-a508-5c723c6d885e req-e9863d2f-26e5-4d69-8d62-cc8818c5773b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:26.140637 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ad1c19e-7d6e-4ac1-a508-5c723c6d885e req-e9863d2f-26e5-4d69-8d62-cc8818c5773b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1750457 Nov 05 14:46:26.224340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 661b4be0-a8d2-427f-9d57-e89bc540536b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:26.255587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 661b4be0-a8d2-427f-9d57-e89bc540536b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:26.256325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 661b4be0-a8d2-427f-9d57-e89bc540536b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:26.267200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.314067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.320122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-cfd0ae34-8401-40a9-aa98-7ce5914cdd4c', 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': 'cd1012a5-c0e9-473b-8ac4-dccf8b779985'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:26.321854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.336844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event deleted for resources: {'Port': ['ID=b4ce3c87-cb71-40ef-be9a-57c9e09e010c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.358643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.367463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.372423 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ad1c19e-7d6e-4ac1-a508-5c723c6d885e req-cac7b33b-e29c-4042-88a1-bfaf49d6e432 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2137320 Nov 05 14:46:26.373504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.376773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9c890494-77ff-4a43-9b7d-dafc4c3210e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "DELETE /v2.0/ports/b4ce3c87-cb71-40ef-be9a-57c9e09e010c HTTP/1.1" status: 204 len: 168 time: 0.9918354 Nov 05 14:46:26.384374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40492) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:26.420768 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9dbede64-5dab-43aa-bd63-eebe7df046fb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:46:26.426918 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9dbede64-5dab-43aa-bd63-eebe7df046fb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports/b4ce3c87-cb71-40ef-be9a-57c9e09e010c HTTP/1.1" status: 404 len: 333 time: 0.0355670 Nov 05 14:46:26.426918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40494) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:26.435777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-754756150'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:26.453986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.459111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.471490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:26.475046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.504976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Allocated IP 172.20.0.2 (cfd0ae34-8401-40a9-aa98-7ce5914cdd4c/cd1012a5-c0e9-473b-8ac4-dccf8b779985/d4562258-9053-440c-835d-ae9bc51c67a3) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:26.523938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port dc202498-f916-4c98-aac0-194eb3d7fe3f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:26.524201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.529647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] device_id is not set on port a3119393-9336-4f0d-9adb-619c6bcabfa6 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:26.534736 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:46:26.535446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.574162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event updated for resources: {'Port': ['ID=705eef91-0052-4950-93bb-f88e7c2125fb,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.577056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.603678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Made reservation on behalf of 43d4035d66c84aaab60dcbe13e774ce5 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:26.605780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.626692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=aa22a1ea-cbd8-4195-b211-0c30db9f6fbe,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.629544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=84c193ea-9294-4fe7-b33c-753ea27f07be,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.630554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.642038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port 318cfd12-36f5-4d28-ae5c-fee4980a5331 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:26.645621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.652118 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-037b5482-0730-4572-8744-7e7a1a96d0f4 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/84c193ea-9294-4fe7-b33c-753ea27f07be HTTP/1.1" status: 204 len: 168 time: 1.0572643 Nov 05 14:46:26.652282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.652282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40496) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:26.681923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.699151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.720930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Pushing event deleted for resources: {'Port': ['ID=b627e7dd-21a7-45e7-a688-3a6630c6ea23,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.753724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:26.757209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:26.762223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:26.770421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.786220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Pushing event updated for resources: {'Port': ['ID=d4562258-9053-440c-835d-ae9bc51c67a3,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:26.817332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for dc202498-f916-4c98-aac0-194eb3d7fe3f owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:26.820495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Attempting to bind port d4562258-9053-440c-835d-ae9bc51c67a3 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:26.820495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Attempting to bind port d4562258-9053-440c-835d-ae9bc51c67a3 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9dc8ec3f-ae70-4dcc-ad0d-472103764521', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:26.820702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Attempting to bind port d4562258-9053-440c-835d-ae9bc51c67a3 on network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:26.827014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:26.827393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Checking segment: {'id': '9dc8ec3f-ae70-4dcc-ad0d-472103764521', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:26.827786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.828185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Bound using segment: {'id': '9dc8ec3f-ae70-4dcc-ad0d-472103764521', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:26.828689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Bound port: d4562258-9053-440c-835d-ae9bc51c67a3, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9dc8ec3f-ae70-4dcc-ad0d-472103764521', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'cfd0ae34-8401-40a9-aa98-7ce5914cdd4c'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:26.829068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.852754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.895495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] For port d4562258-9053-440c-835d-ae9bc51c67a3, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:26.898879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] For port d4562258-9053-440c-835d-ae9bc51c67a3, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4562258-9053-440c-835d-ae9bc51c67a3,segment=NetworkSegment(9dc8ec3f-ae70-4dcc-ad0d-472103764521),segment_id=9dc8ec3f-ae70-4dcc-ad0d-472103764521)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:26.904378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.910660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:26.919409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:26.920375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.20.0.6 (cfd0ae34-8401-40a9-aa98-7ce5914cdd4c/cd1012a5-c0e9-473b-8ac4-dccf8b779985/a3119393-9336-4f0d-9adb-619c6bcabfa6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:26.954277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:26.967003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789e27ff-c5fa-4582-b8df-3a7b59537232 None None] Pushing event updated for resources: {'Port': ['ID=d4562258-9053-440c-835d-ae9bc51c67a3,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:27.010099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP 82579e06-1912-44a9-b5f4-42c409b0bfac associated. External IP: 172.26.5.97, port: fb6206ba-3f42-47d3-ade2-52410eea44ff. Nov 05 14:46:27.141149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.244151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.253301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.256185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Router 44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:27.450253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Router b0aeb21d-d62d-4243-a921-eb51f69ad2fb has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:27.469649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.529912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=dc202498-f916-4c98-aac0-194eb3d7fe3f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:27.539594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:27.550468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] Sync routers for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:27.563255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:27.564162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:27.604309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:27.623348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:27.624363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:27.635872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Deleting port 29716c74-54f7-4923-be4d-b3ff019d83be {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:27.636525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.675352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:27.676237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc707b97-7e69-4b40-9881-58d36c67c636 None None] The sync data for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:27.712814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.831640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Network b13b759a-7518-4b98-a1b4-fcd147613815 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:27.836100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.851021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:27.859630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] For port 29716c74-54f7-4923-be4d-b3ff019d83be, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=29716c74-54f7-4923-be4d-b3ff019d83be,segment=NetworkSegment(48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f),segment_id=48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:27.860024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.875133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:27.875133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:27.875602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:27.918046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=318cfd12-36f5-4d28-ae5c-fee4980a5331,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:27.923349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Calling delete_port for 29716c74-54f7-4923-be4d-b3ff019d83be owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:27.929651 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ff8e495-095c-495a-9ff4-8bb08affa759 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6621685 Nov 05 14:46:27.935032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40500) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:27.988281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e45774db-369a-415e-95e6-30e5fd250f2e None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:28.002410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:28.020928 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] Sync routers for ids ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:28.043121 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] Routers {'b0aeb21d-d62d-4243-a921-eb51f69ad2fb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:28.043923 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.051846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.055797 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b53e045b-19ae-4e0e-b92d-49e2a3652497 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.6260293 Nov 05 14:46:28.055983 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b946bdd8-b7ac-4c8f-9c81-4ab45642ba33 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "PUT /v2.0/routers/b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 200 len: 705 time: 4.7440069 Nov 05 14:46:28.058617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40502) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.059137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40504) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.065498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:28.087956 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.098961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.099181 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] Routers {'b0aeb21d-d62d-4243-a921-eb51f69ad2fb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:28.099806 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.115970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:28.134612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ace0dc-50bb-4423-88e5-37ea308afadc req-2d7f285c-319c-4a28-8f31-3cc3bbea61b7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:28.142977 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-97ace0dc-50bb-4423-88e5-37ea308afadc req-2d7f285c-319c-4a28-8f31-3cc3bbea61b7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.6743886 Nov 05 14:46:28.147649 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.149995 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f6418a0-b803-4afa-8ce9-522677a19b55 None None] The sync data for ids ['b0aeb21d-d62d-4243-a921-eb51f69ad2fb'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:28.159048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.173495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:28.186113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=a3119393-9336-4f0d-9adb-619c6bcabfa6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:28.194548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:28.202011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:28.211163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] Provisioning complete for port d4562258-9053-440c-835d-ae9bc51c67a3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:28.211705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.216684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e45774db-369a-415e-95e6-30e5fd250f2e None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:28.248527 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ac2d6c88-5e3c-47c6-b15f-eca83ae4020c tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/routers/b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 200 len: 740 time: 0.1878169 Nov 05 14:46:28.255841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.298420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24870e34-7b41-4ef0-b6ba-ecbc2205eb14 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.344765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.362505 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3b8ac378-3453-496a-a65c-d011558d8af6 tempest-RoutersAdminTest-1866801823 tempest-RoutersAdminTest-1866801823-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 200 len: 205 time: 0.1043077 Nov 05 14:46:28.394980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.396786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.424127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:28.424672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-97ace0dc-50bb-4423-88e5-37ea308afadc req-e8384fbf-8cc5-4bad-a1f3-3bad57675388 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2793176 Nov 05 14:46:28.424821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.466438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Pushing event deleted for resources: {'Port': ['ID=29716c74-54f7-4923-be4d-b3ff019d83be,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:28.470515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] No DVR routers for this DVR port 29716c74-54f7-4923-be4d-b3ff019d83be on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:28.496597 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b1edc1c0-337e-49e5-b51c-7f0d429f0c6e tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 200 len: 205 time: 0.0954618 Nov 05 14:46:28.502187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40512) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.513418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4562258-9053-440c-835d-ae9bc51c67a3 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:28.550705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8590bf39-2f71-49c6-a23a-e7ef38698c0b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 2.4353187 Nov 05 14:46:28.568142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40514) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.568637 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-24870e34-7b41-4ef0-b6ba-ecbc2205eb14 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 05 14:46:28.573159 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-24870e34-7b41-4ef0-b6ba-ecbc2205eb14 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 HTTP/1.1" status: 409 len: 329 time: 0.6336765 Nov 05 14:46:28.602284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40518) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:28.644197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.690792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d4562258-9053-440c-835d-ae9bc51c67a3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:28.691410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.752094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.767026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:28.789830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:28.803622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] For port d4562258-9053-440c-835d-ae9bc51c67a3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4562258-9053-440c-835d-ae9bc51c67a3,segment=NetworkSegment(9dc8ec3f-ae70-4dcc-ad0d-472103764521),segment_id=9dc8ec3f-ae70-4dcc-ad0d-472103764521)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:28.834123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.836109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fd1ccb7c-d1e8-48e2-b784-b56a587e2542']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.885961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.886396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48c135b9-acf7-4fe2-b859-cd8eb8ea2a7f') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.889072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.897243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:28.897859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.902662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.912498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.914687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 5ae99c97-8514-42fa-92de-7eeebe3dfbcb has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:28.923134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784ba25a-7939-47c9-a8a2-61ea33d2f7c9 req-3ae8a304-92a3-4d76-a7b8-693d20db7b8a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:28.924824 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-784ba25a-7939-47c9-a8a2-61ea33d2f7c9 req-3ae8a304-92a3-4d76-a7b8-693d20db7b8a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2919660 Nov 05 14:46:28.954092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:28.956176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:28.990429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f83b2c0-a1c5-4eb8-aed4-379f0840defd None None] Pushing event updated for resources: {'Port': ['ID=d4562258-9053-440c-835d-ae9bc51c67a3,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:29.005864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:29.006803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.054119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.054355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea4ac4a-5009-4819-b293-8928a97b3da2 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:29.059013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.073328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b2d06a8-64ec-4c3d-b5db-eed470e146f1 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 5.7543395 Nov 05 14:46:29.077968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Releasing vlan 636 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:29.077968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:29.079331 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:29.098237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:46:29.098667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:46:29.105298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40520) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.142184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': 'fb6206ba-3f42-47d3-ade2-52410eea44ff', 'fixed_ip_address': '172.20.0.13'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:29.142637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.180918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.259284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-784ba25a-7939-47c9-a8a2-61ea33d2f7c9 req-bda70ec8-ea6f-4c9d-96c0-21735535ffa9 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2942259 Nov 05 14:46:29.286496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.291895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:29.295777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.302263 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc4539cb-1b3a-4b29-bc05-c0adc05fa6b0 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/5ae99c97-8514-42fa-92de-7eeebe3dfbcb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5389023 Nov 05 14:46:29.306772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port 318cfd12-36f5-4d28-ae5c-fee4980a5331 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:29.308151 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] 10.222.0.30 "DELETE /v2.0/networks/fd1ccb7c-d1e8-48e2-b784-b56a587e2542 HTTP/1.1" status: 204 len: 168 time: 2.6547639 Nov 05 14:46:29.309911 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] Sync routers for ids ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:29.311099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40522) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.324993 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] Routers {'5ae99c97-8514-42fa-92de-7eeebe3dfbcb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:29.326125 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.326463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.341537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.352040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5875dc24-69dc-4a28-ba42-583800030cd8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=5ae99c97-8514-42fa-92de-7eeebe3dfbcb HTTP/1.1" status: 200 len: 205 time: 0.0395379 Nov 05 14:46:29.353391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.356357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40526) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.358867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.359784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Fanout notify agent at l3_agent the message router_deleted on router b0aeb21d-d62d-4243-a921-eb51f69ad2fb {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:29.379547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.380726 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-93633302-c2e0-4d5c-bce2-1fee6bd4a359 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 204 len: 168 time: 0.8764102 Nov 05 14:46:29.387497 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.389448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40528) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.398411 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] Routers {'5ae99c97-8514-42fa-92de-7eeebe3dfbcb'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:29.399399 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.438831 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:29.439747 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3946ebc9-52a4-4ce5-9405-0d7ef0b7e990 None None] The sync data for ids ['5ae99c97-8514-42fa-92de-7eeebe3dfbcb'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:29.487959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a070c990-7b01-4b0c-a4a7-9aa02e6ef002 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 200 len: 205 time: 0.0965972 Nov 05 14:46:29.518824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40530) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.573504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=318cfd12-36f5-4d28-ae5c-fee4980a5331,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:29.577038 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-80a8a34b-29a0-41a7-84b3-b35823c324c3 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:29.579062 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80a8a34b-29a0-41a7-84b3-b35823c324c3 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/b0aeb21d-d62d-4243-a921-eb51f69ad2fb HTTP/1.1" status: 404 len: 336 time: 0.0547833 Nov 05 14:46:29.581465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.583271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40532) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.649728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.661138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7e11595e-c0ba-48ea-a1fd-f719c243eff9 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 200 len: 205 time: 0.0762484 Nov 05 14:46:29.691739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40536) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.706656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:29.706988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:29.707354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:29.745599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21b5b11a-5f3e-4b45-b7ad-46af0e5c6101 None None] Network fd1ccb7c-d1e8-48e2-b784-b56a587e2542 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:29.751855 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-009cf5e2-823e-4881-92cc-70d8356808ee tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:29.755444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-009cf5e2-823e-4881-92cc-70d8356808ee tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/623c2fc2-17ff-49b2-b598-2087b28b02c8 HTTP/1.1" status: 404 len: 336 time: 0.0602400 Nov 05 14:46:29.755444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:29.755444 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:29.755444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 2 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:29.759475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40538) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-21b5b11a-5f3e-4b45-b7ad-46af0e5c6101 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:29.761177 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:29.833425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b0276855-1cf5-4168-8589-5fa8f63fda85 None None] Provisioning complete for port a3119393-9336-4f0d-9adb-619c6bcabfa6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:29.833804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0276855-1cf5-4168-8589-5fa8f63fda85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.922656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:29.922993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:29.923314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:29.925144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b0276855-1cf5-4168-8589-5fa8f63fda85 None None] Port a3119393-9336-4f0d-9adb-619c6bcabfa6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:29.927375 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bdc28ad6-5964-43c4-9bdd-047c6faa5af3 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 200 len: 205 time: 0.1407402 Nov 05 14:46:29.932523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8716ec9-2e9b-44da-8c96-ac6fa4be6f2d admin admin] Pushing event deleted for resources: {'Network': ['ID=fd1ccb7c-d1e8-48e2-b784-b56a587e2542,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:29.934522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40540) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.937384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34edb19c-54aa-40fa-9293-918f89abd446 None None] DHCP port deletion for fd1ccb7c-d1e8-48e2-b784-b56a587e2542 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:29.938502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.940437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:29.940802 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:29.942004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.942185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:29.943371 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 3 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:29.948271 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-113ccf04-992e-4ec0-a4e7-a3cccf852a2d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3cb2c9da66364ac18972da6a46b083c1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2974448 Nov 05 14:46:29.959221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40542) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:29.964162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b0276855-1cf5-4168-8589-5fa8f63fda85 None None] Provisioning complete for port d4562258-9053-440c-835d-ae9bc51c67a3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:29.966184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0276855-1cf5-4168-8589-5fa8f63fda85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.018249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.018593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.018907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.036477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.036828 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.038447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 4 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.051804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.052306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 5ae99c97-8514-42fa-92de-7eeebe3dfbcb {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:30.061253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.064920 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bb423f8b-b4b6-421e-ac87-16e81d2d73ff tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/5ae99c97-8514-42fa-92de-7eeebe3dfbcb HTTP/1.1" status: 204 len: 168 time: 0.7003474 Nov 05 14:46:30.074968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40544) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.114514 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-bf8b3f0b-9741-4126-b9ee-4c85919f3697 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:30.118193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf8b3f0b-9741-4126-b9ee-4c85919f3697 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/bcd107c5-207b-4c10-8db9-04f186647dc0 HTTP/1.1" status: 404 len: 336 time: 0.1744092 Nov 05 14:46:30.128659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40546) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.144927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.145468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.145758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.162228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.162569 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.167811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 5 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.189103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.189436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.189776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.192576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.205413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.205750 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.213028 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 6 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.236842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b1461f5-ae58-4b05-95d8-c3a535d61797 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 200 len: 205 time: 0.1069791 Nov 05 14:46:30.249711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.250061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.250411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.254760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40548) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.259643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4562258-9053-440c-835d-ae9bc51c67a3 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:30.263369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet fb35e709-9cba-47ef-a2f1-ae86ed17df14 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:30.264817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40188a6e-36aa-4a2b-8250-80939b5090f1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:30.276286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.282223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.283941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.284270 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.308761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 7 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.310607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b52ec600-2d11-4366-9557-0e681b406e73 None None] Provisioning complete for port 705eef91-0052-4950-93bb-f88e7c2125fb triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:30.310983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b52ec600-2d11-4366-9557-0e681b406e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.326625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.326951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.327294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.351180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.351543 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.359463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 8 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.375489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.390669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b52ec600-2d11-4366-9557-0e681b406e73 None None] Port 705eef91-0052-4950-93bb-f88e7c2125fb cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:30.410702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.411251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.411457 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.424802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.425185 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.425863 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 9 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.428646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d4562258-9053-440c-835d-ae9bc51c67a3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:30.429307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.451323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-df8b3a6c-fc57-499e-a983-a2f32db32487 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:30.452357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-df8b3a6c-fc57-499e-a983-a2f32db32487 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/dc3ad0d1-e768-4fb1-99fa-b236f5d74c4e HTTP/1.1" status: 404 len: 336 time: 0.1091356 Nov 05 14:46:30.456144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.458722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.463256 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/75a272d8-d137-4f24-9ad2-52f91b26fcb3 HTTP/1.1" status: 204 len: 168 time: 0.5030911 Nov 05 14:46:30.463902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40552) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.494329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40188a6e-36aa-4a2b-8250-80939b5090f1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:30.496326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.496693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.497963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.509041 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b1f63534-1b32-4225-8449-8a6ec2333c2f tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 200 len: 205 time: 0.0405824 Nov 05 14:46:30.514327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40556) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.539055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.539398 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.540114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cd9b34-9903-408b-a496-7ef5fb27e836 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75a272d8-d137-4f24-9ad2-52f91b26fcb3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:30.545698 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 10 to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 Nov 05 14:46:30.572045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:30.572778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:30.573125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:30.582580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:30.582917 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:30.583284 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.588847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.617684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7938241c-fa79-45f1-9530-617c03bbf33f None None] Provisioning complete for port a3119393-9336-4f0d-9adb-619c6bcabfa6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:30.618454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7938241c-fa79-45f1-9530-617c03bbf33f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.627008 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-64435256-b984-41cc-ada9-fcf7bb225a99 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:30.628160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-64435256-b984-41cc-ada9-fcf7bb225a99 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/486c0616-e971-4b8e-aee1-2337dcde59df HTTP/1.1" status: 404 len: 336 time: 0.1093702 Nov 05 14:46:30.632397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40558) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.674142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c80e244-ad06-40b1-8744-1c133e211645 req-35ec13ed-02c6-4780-b4d5-fcb396368b07 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:30.675775 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c80e244-ad06-40b1-8744-1c133e211645 req-35ec13ed-02c6-4780-b4d5-fcb396368b07 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3034501 Nov 05 14:46:30.688864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3bdd4128-6b0b-4340-beb9-25ea74ab35ce tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "GET /v2.0/ports?device_id=c855435c-4f84-40a7-a80a-24d0dc876dec HTTP/1.1" status: 200 len: 205 time: 0.0537329 Nov 05 14:46:30.697801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40560) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.746932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7938241c-fa79-45f1-9530-617c03bbf33f None None] Port a3119393-9336-4f0d-9adb-619c6bcabfa6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:30.752198 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-f6ecd09f-74f5-4417-b896-e942a5af9494 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] delete failed (client error): The resource could not be found. Nov 05 14:46:30.753346 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f6ecd09f-74f5-4417-b896-e942a5af9494 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/routers/c855435c-4f84-40a7-a80a-24d0dc876dec HTTP/1.1" status: 404 len: 336 time: 0.0546117 Nov 05 14:46:30.758023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40562) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.824607 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2495b890-9730-4c0a-895f-f70c10295639 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] DELETE failed (client error): The resource could not be found. Nov 05 14:46:30.825327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2495b890-9730-4c0a-895f-f70c10295639 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:46:30.828807 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2495b890-9730-4c0a-895f-f70c10295639 tempest-RoutersAdminTest-1654664452 tempest-RoutersAdminTest-1654664452-project] 10.222.0.30 "DELETE /v2.0/subnets/4cd64ba4-2d2e-45d6-9348-34e5d3273d39 HTTP/1.1" status: 404 len: 337 time: 0.0716176 Nov 05 14:46:30.838394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port 318cfd12-36f5-4d28-ae5c-fee4980a5331, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:30.838951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempted to set empty binding levels {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:46:30.843427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.862807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.872282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 29716c74-54f7-4923-be4d-b3ff019d83be no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:30.891615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=fb35e709-9cba-47ef-a2f1-ae86ed17df14,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:30.913775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.920783 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c832d37-89ad-4770-9670-d08e24a5e3eb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/fb35e709-9cba-47ef-a2f1-ae86ed17df14 HTTP/1.1" status: 204 len: 168 time: 0.8422234 Nov 05 14:46:30.921471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40568) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.932211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] In _notify_port_updated(), no bound segment for port 318cfd12-36f5-4d28-ae5c-fee4980a5331 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:46:30.933066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:30.933658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.934182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.937507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "PUT /v2.0/ports/318cfd12-36f5-4d28-ae5c-fee4980a5331 HTTP/1.1" status: 200 len: 980 time: 2.8734004 Nov 05 14:46:30.938514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40570) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:30.943549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c80e244-ad06-40b1-8744-1c133e211645 req-d74cefdd-5e66-43f6-b287-50dcbc3a1210 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2595518 Nov 05 14:46:30.949619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.958523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 29716c74-54f7-4923-be4d-b3ff019d83be {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:30.959534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:30.961687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 29716c74-54f7-4923-be4d-b3ff019d83be not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:31.057097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b48c904-6853-41f7-acc5-18d740e40f45 None None] Network 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:31.117266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65cdd19b-b0fe-4cf3-bb78-87f7522eae4f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=318cfd12-36f5-4d28-ae5c-fee4980a5331,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:31.159611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.330837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] DHCP port deletion for 0959dfb7-dbc6-47f6-80c5-75159edeaaf8 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:31.364932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.423321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40584) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:31.424285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.430896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Deleting port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:31.430896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.561360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=a3119393-9336-4f0d-9adb-619c6bcabfa6,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:31.561607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] For port 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=816203d4-23d2-48b4-a8cd-5ee4011a1c51,segment=NetworkSegment(8fd33dd0-953c-4cde-84c3-a97fc01acf39),segment_id=8fd33dd0-953c-4cde-84c3-a97fc01acf39)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:31.562587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.626081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.626543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.626992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.627434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.627882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.628320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.628785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.629228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.629662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.630099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.630531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.630964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.631399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.632047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.632261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.632721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.633160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.633627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.634130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.634489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.634926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.635352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.635786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.637886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Calling delete_port for 816203d4-23d2-48b4-a8cd-5ee4011a1c51 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:31.652875 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4a42a8a0-f519-4249-9e05-131de129f1eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 20503 time: 0.7021322 Nov 05 14:46:31.654065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:31.655991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d44f1a84-ed89-4a55-9345-c75b6c84f0df None None] Provisioning complete for port a3119393-9336-4f0d-9adb-619c6bcabfa6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:31.656340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d44f1a84-ed89-4a55-9345-c75b6c84f0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.668925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ccefdc-8a5b-478d-8763-b92873add249 req-b223f286-aa75-4b14-8350-5b1006f74846 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:31.671242 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-32ccefdc-8a5b-478d-8763-b92873add249 req-b223f286-aa75-4b14-8350-5b1006f74846 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.5929463 Nov 05 14:46:31.697516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e37b63c-fa23-4e4f-9823-32da1fbe5f4c admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.737153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d44f1a84-ed89-4a55-9345-c75b6c84f0df None None] Port a3119393-9336-4f0d-9adb-619c6bcabfa6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:31.769639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.811879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] Pushing event deleted for resources: {'Port': ['ID=816203d4-23d2-48b4-a8cd-5ee4011a1c51,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:31.816924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f458a4f-c3e1-4f9b-8e60-b9f087874c2b None None] No DVR routers for this DVR port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:31.860438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:31.860812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.872764 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-32ccefdc-8a5b-478d-8763-b92873add249 req-f31fdc57-abd0-480b-8fdf-96102cbfe3fa tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1580751 Nov 05 14:46:31.894267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:31.938722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Deleting port 318cfd12-36f5-4d28-ae5c-fee4980a5331 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:31.939383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.025066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 816203d4-23d2-48b4-a8cd-5ee4011a1c51, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:32.025490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.048759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 816203d4-23d2-48b4-a8cd-5ee4011a1c51 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:32.050986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port 318cfd12-36f5-4d28-ae5c-fee4980a5331, host hv-neutron-8168, got binding levels [] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:32.051446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.054731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 was not found and therefore no delete operation was performed {{(pid=113581) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:46:32.062843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.070720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Calling delete_port for 318cfd12-36f5-4d28-ae5c-fee4980a5331 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:32.100790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=816203d4-23d2-48b4-a8cd-5ee4011a1c51,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:32.105849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 816203d4-23d2-48b4-a8cd-5ee4011a1c51 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:32.222440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 816203d4-23d2-48b4-a8cd-5ee4011a1c51 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:32.251959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 816203d4-23d2-48b4-a8cd-5ee4011a1c51 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:32.252780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 816203d4-23d2-48b4-a8cd-5ee4011a1c51 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:32.276148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.310275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event deleted for resources: {'Port': ['ID=318cfd12-36f5-4d28-ae5c-fee4980a5331,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:32.317449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.328825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.332368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7766dd60-5a3c-4f98-a026-24410a0c1340 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "DELETE /v2.0/ports/318cfd12-36f5-4d28-ae5c-fee4980a5331 HTTP/1.1" status: 204 len: 168 time: 0.6732380 Nov 05 14:46:32.334990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:32.372522 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6e36f5f-e13a-44ff-b63f-748f4e3f00fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:46:32.377719 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b6e36f5f-e13a-44ff-b63f-748f4e3f00fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports/318cfd12-36f5-4d28-ae5c-fee4980a5331 HTTP/1.1" status: 404 len: 333 time: 0.0382886 Nov 05 14:46:32.378635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40614) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:32.384106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-729560899', 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:32.388298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0959dfb7-dbc6-47f6-80c5-75159edeaaf8']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:32.400331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8fd33dd0-953c-4cde-84c3-a97fc01acf39') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:32.400727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8fd33dd0-953c-4cde-84c3-a97fc01acf39') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:32.415649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.435727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.442474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Made reservation on behalf of 43d4035d66c84aaab60dcbe13e774ce5 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:32.444956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.449259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:32.449733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:32.453044 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:32.501755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4057401c-6d08-41db-b45e-3dbb3483f707 req-df0e2a40-90df-4d79-8556-10750ddcca5d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:32.503854 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4057401c-6d08-41db-b45e-3dbb3483f707 req-df0e2a40-90df-4d79-8556-10750ddcca5d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.5203292 Nov 05 14:46:32.506574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e37b63c-fa23-4e4f-9823-32da1fbe5f4c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.506724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port dd4cfe18-817a-46c0-aa26-950defa8df97 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:32.511125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting port 705eef91-0052-4950-93bb-f88e7c2125fb {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:32.511675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.518566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.531825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e37b63c-fa23-4e4f-9823-32da1fbe5f4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.548142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40618) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:32.582624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.600643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.603844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/0959dfb7-dbc6-47f6-80c5-75159edeaaf8 HTTP/1.1" status: 204 len: 168 time: 1.6804407 Nov 05 14:46:32.607524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:32.608789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8eafc8b-d2a4-48ec-b7bc-1cfb050d4c96 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=0959dfb7-dbc6-47f6-80c5-75159edeaaf8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:32.610426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40622) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:32.622504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1230868243', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:32.681117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e37b63c-fa23-4e4f-9823-32da1fbe5f4c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b4f5f2aebd6049afbcec5ea5ef9aea38&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2486739 Nov 05 14:46:32.684884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40624) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:32.696185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e37b63c-fa23-4e4f-9823-32da1fbe5f4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41340be4-76a9-4d9d-bfc9-bfce7eb0fe80,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:32.702569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.703606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.767235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.791704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-890934211'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:32.804017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4057401c-6d08-41db-b45e-3dbb3483f707 req-ee447fb6-d18b-47fc-b656-d4d0b11d4dca tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2892573 Nov 05 14:46:32.830117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.833625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.851175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Calling delete_port for 705eef91-0052-4950-93bb-f88e7c2125fb owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:32.886752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.979147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Made reservation on behalf of 7b8b091cbe5242eea4eb723a5bba2dce for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:32.982591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:32.985645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.027219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:33.035478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.042879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:33.055229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:33.055936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:33.070601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.088295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.095475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:33.099811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.106647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:33.107616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:33.123921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3555f05d-615a-497f-a6f7-c949c97dbb33 req-2a128fbb-2477-46d1-99f1-2f5b628f7cf1 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:33.125529 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3555f05d-615a-497f-a6f7-c949c97dbb33 req-2a128fbb-2477-46d1-99f1-2f5b628f7cf1 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2400134 Nov 05 14:46:33.204447 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e6e035d2-2176-4ca1-964d-00b0f96ff558 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/82579e06-1912-44a9-b5f4-42c409b0bfac HTTP/1.1" status: 200 len: 977 time: 4.0982244 Nov 05 14:46:33.210516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40628) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:33.249217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Network b13b759a-7518-4b98-a1b4-fcd147613815 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:33.267768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:33.273659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=dd4cfe18-817a-46c0-aa26-950defa8df97,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:33.277832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.278056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:33.278889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:33.279489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.292231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.299118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.301765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:33.301872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.302552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f5bc78f-92e4-4698-b5a8-66c27655f1ee None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:33.302954 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/41340be4-76a9-4d9d-bfc9-bfce7eb0fe80 HTTP/1.1" status: 204 len: 168 time: 0.6171381 Nov 05 14:46:33.337443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93510f23-d8f9-43c0-ac22-55f96d523f19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41340be4-76a9-4d9d-bfc9-bfce7eb0fe80,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:33.341864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9011257f-1a17-436a-8bb0-e8ee1b58846f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 0.9622011 Nov 05 14:46:33.347468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40632) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:33.354226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.354919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3555f05d-615a-497f-a6f7-c949c97dbb33 req-9e349097-2c0f-4174-be97-c5504b082cf8 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2010701 Nov 05 14:46:33.437642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bae10cd1-49d8-466c-bd98-1edfaa056d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:33.441598 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bae10cd1-49d8-466c-bd98-1edfaa056d07 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports/dd4cfe18-817a-46c0-aa26-950defa8df97 HTTP/1.1" status: 200 len: 958 time: 0.0881963 Nov 05 14:46:33.443736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40636) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:33.470096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.484068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=a3119393-9336-4f0d-9adb-619c6bcabfa6,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:33.496852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.520052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.560129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:33.584545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Port': ['ID=705eef91-0052-4950-93bb-f88e7c2125fb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:33.598689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event updated for resources: {'SecurityGroup': ['ID=19d6160e-0525-4aa2-aee0-fd8628f9d352,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:33.603087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.603426 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Added segment b13c70d9-b21c-4ce0-9588-20cbf7b54cc4 of type vlan for network bc5a9665-de5d-4f5c-a0d4-fd66099e330d Nov 05 14:46:33.729994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.764490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.769379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.792589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port aa22a1ea-cbd8-4195-b211-0c30db9f6fbe {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:33.792937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.794607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40640) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:33.804181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.824512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Deleting port dd4cfe18-817a-46c0-aa26-950defa8df97 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:33.824837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.826659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.831994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:33.832590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:33.907132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:33.914481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:33.998290 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.4432690 Nov 05 14:46:34.006286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40642) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.018750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.019069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.023848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Request body: {'subnet': {'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:34.029278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.037762 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4ed20732-e038-42a6-9978-1768ba0dcd9f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=958d110f5740449b9e7fb352ead488b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2417755 Nov 05 14:46:34.071893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40644) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.095100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for aa22a1ea-cbd8-4195-b211-0c30db9f6fbe owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:34.101419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ac7b3a1-7799-47e5-b5a4-04e99c544f23 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event updated for resources: {'Network': ['ID=bc5a9665-de5d-4f5c-a0d4-fd66099e330d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:34.118426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:34.124241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Router 44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:34.138310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Calling delete_port for dd4cfe18-817a-46c0-aa26-950defa8df97 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:34.194132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 172.26.5.194 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/84cf6ecd-313a-46cd-b704-f6ccd010d289) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:34.219175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-017fdd77-ceda-4497-9c7c-cac5ec4e7b92 None None] Provisioning complete for port a3119393-9336-4f0d-9adb-619c6bcabfa6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:34.219935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-017fdd77-ceda-4497-9c7c-cac5ec4e7b92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.257123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-017fdd77-ceda-4497-9c7c-cac5ec4e7b92 None None] Port a3119393-9336-4f0d-9adb-619c6bcabfa6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:34.307152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:34.316993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d6988049-1723-488d-8733-be36d684c6a2 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7106633 Nov 05 14:46:34.318195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.318749 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] Sync routers for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:34.324911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40646) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.330086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 78ebd504-ad5b-4336-918b-6990db8c7d29 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:34.331114 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:34.331732 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.347651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Made reservation on behalf of 7b8b091cbe5242eea4eb723a5bba2dce for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:34.351057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.366056 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.374812 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] Routers {'44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:34.375403 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.410838 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.411490 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc16578-13f2-47fe-8228-8560aa5fc80f None None] The sync data for ids ['44c119f0-f14f-43e0-bfcd-b908c6cdf9b4'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:34.431416 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-15825bdb-10ca-4735-a004-86abdc0cb15c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] show failed (client error): The resource could not be found. Nov 05 14:46:34.432496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-15825bdb-10ca-4735-a004-86abdc0cb15c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "GET /v2.0/routers/tempest-non_exist_router-152634451 HTTP/1.1" status: 404 len: 334 time: 0.1052134 Nov 05 14:46:34.446612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40648) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.464647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.471146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-80ac5ef4-0025-406e-9286-5830db759e9c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Request body: {'router': {'name': 'new_name'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:34.545122 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-80ac5ef4-0025-406e-9286-5830db759e9c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] update failed (client error): The resource could not be found. Nov 05 14:46:34.546186 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80ac5ef4-0025-406e-9286-5830db759e9c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "PUT /v2.0/routers/tempest-non_exist_router-35925315 HTTP/1.1" status: 404 len: 333 time: 0.0864823 Nov 05 14:46:34.546862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.566240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40650) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.640651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event deleted for resources: {'Port': ['ID=dd4cfe18-817a-46c0-aa26-950defa8df97,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:34.668498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.672000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-91fd4415-65df-4d2f-94de-fa82c69d93a0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "DELETE /v2.0/ports/dd4cfe18-817a-46c0-aa26-950defa8df97 HTTP/1.1" status: 204 len: 168 time: 1.2266841 Nov 05 14:46:34.675124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40652) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.677605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.722586 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-859e9bd6-7fda-411f-8601-0cd3bcc2b9ad tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:46:34.724208 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-859e9bd6-7fda-411f-8601-0cd3bcc2b9ad tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports/dd4cfe18-817a-46c0-aa26-950defa8df97 HTTP/1.1" status: 404 len: 333 time: 0.0446763 Nov 05 14:46:34.728526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting subnet eb5b7c8c-d840-4e7e-8a01-002398f824ca {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:34.733395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40654) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.740713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-597893431'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:34.746833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.749463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.751806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.755332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ffccb97b-6ecd-4eae-a89f-c23aca1819dd HTTP/1.1" status: 204 len: 168 time: 0.6490433 Nov 05 14:46:34.784682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.788403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:34.797453 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7f92f0ec-d7fd-4dad-a3e7-43063e7b5900 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/78ebd504-ad5b-4336-918b-6990db8c7d29/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2244484 Nov 05 14:46:34.798593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40658) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.806640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] Sync routers for ids ['78ebd504-ad5b-4336-918b-6990db8c7d29'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:34.816357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da06a06-4988-4672-8e99-00d810efacac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffccb97b-6ecd-4eae-a89f-c23aca1819dd,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:34.827033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=aa22a1ea-cbd8-4195-b211-0c30db9f6fbe,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:34.834564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.840525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Made reservation on behalf of 43d4035d66c84aaab60dcbe13e774ce5 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:34.843422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.869561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:34.886162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] Routers {'78ebd504-ad5b-4336-918b-6990db8c7d29'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:34.889845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['78ebd504-ad5b-4336-918b-6990db8c7d29'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.892520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c974d59-2a73-4f9e-abec-7c399e66d566 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:34.894308 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3c974d59-2a73-4f9e-abec-7c399e66d566 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports/a3119393-9336-4f0d-9adb-619c6bcabfa6 HTTP/1.1" status: 200 len: 976 time: 0.0780816 Nov 05 14:46:34.897268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40660) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:34.933990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.945124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] Routers {'78ebd504-ad5b-4336-918b-6990db8c7d29'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:34.945901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['78ebd504-ad5b-4336-918b-6990db8c7d29'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.963060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:34.975069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:34.984936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:34.986683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:34.987570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b8882e9-13f8-4b18-a1f5-7858c233e211 None None] The sync data for ids ['78ebd504-ad5b-4336-918b-6990db8c7d29'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:34.996742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:35.004171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=84cf6ecd-313a-46cd-b704-f6ccd010d289,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:35.010416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.010707 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP 82579e06-1912-44a9-b5f4-42c409b0bfac disassociated (deleted). External IP: 172.26.5.97, port: fb6206ba-3f42-47d3-ade2-52410eea44ff. Nov 05 14:46:35.428737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:35.466734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.569816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.597645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.713069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:35.718552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.727152 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:35.738597 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:35.739928 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:35.744971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40680) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:35.767788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.783788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event updated for resources: {'Subnet': ['ID=c8acae7c-ce93-474d-81f6-f675b404e887,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:35.793181 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:35.797507 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e04b260-2a0d-4782-8dba-a85b37221763 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/82579e06-1912-44a9-b5f4-42c409b0bfac HTTP/1.1" status: 204 len: 168 time: 2.5856733 Nov 05 14:46:35.799502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40684) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:35.813107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.826159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e62e7a2-fa65-46c8-8c18-ac1b9fadc15f None None] Network 10f71e1e-c5ad-43b0-9378-480fe23658d1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:35.826630 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:35.827497 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:35.842814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.845960 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/subnets/eb5b7c8c-d840-4e7e-8a01-002398f824ca HTTP/1.1" status: 204 len: 168 time: 1.2757998 Nov 05 14:46:35.849919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40686) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:35.876876 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:35.878634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5708f32b-0c85-471d-a7d6-680e5f306ea2 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:35.886156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04262068-fc70-4377-bd2b-c8e6e13b4be7 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Subnet': ['ID=eb5b7c8c-d840-4e7e-8a01-002398f824ca,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:35.888236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Checking segment: {'id': 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:35.888685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Network hostable DHCP agents. Network: bc5a9665-de5d-4f5c-a0d4-fd66099e330d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:35.937935 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-266949a3-bd22-424e-8c24-8c39c9011357 tempest-AgentManagementNegativeTest-1281601883 tempest-AgentManagementNegativeTest-1281601883-project] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.1888204 Nov 05 14:46:35.978518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting subnet 469d5c06-41c4-4193-8652-d2da584eb272 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:35.983623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:35.985941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:36.002530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, bc5a9665-de5d-4f5c-a0d4-fd66099e330d) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:36.004564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.013567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94064b97-f7c0-4c40-aee2-86bc38534413 None None] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:36.015662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:36.016263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.057263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.060323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.070050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Network b13b759a-7518-4b98-a1b4-fcd147613815 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:36.090796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] DHCP port deletion for 10f71e1e-c5ad-43b0-9378-480fe23658d1 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:36.101071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port fb6206ba-3f42-47d3-ade2-52410eea44ff {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:36.101311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.113993 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f6ff33fa-b8e9-4e70-b498-274f721206f8 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0971704 Nov 05 14:46:36.113993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:36.118539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40690) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:36.125479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Request body: {'port': {'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d', 'name': 'tempest-DHCPAgentSchedulersTestJSON-569040407'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:36.128631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:36.129512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:36.130115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.136301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=2ebd4425-94ab-45b9-82e1-f670d25a5c34,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-94064b97-f7c0-4c40-aee2-86bc38534413 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:36.231611 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:36.247992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12618ae9-2de8-4ec2-9353-b9e36674e61f None None] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:36.248199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port a3119393-9336-4f0d-9adb-619c6bcabfa6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:36.248554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.258957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0842f932-b853-4524-b67e-bc1accc84862 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:36.286008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-37442f7c-88de-4614-9165-17c1ac2be5f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 1.5514328 Nov 05 14:46:36.292578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40692) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:36.299722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:36.318688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Deleting port 0842f932-b853-4524-b67e-bc1accc84862 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:36.319417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.403258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.405095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40696) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:36.407994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.422880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] For port 0842f932-b853-4524-b67e-bc1accc84862, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0842f932-b853-4524-b67e-bc1accc84862,segment=NetworkSegment(4a67fd41-849b-4a30-a532-ffa04bc15769),segment_id=4a67fd41-849b-4a30-a532-ffa04bc15769)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:36.423375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-12618ae9-2de8-4ec2-9353-b9e36674e61f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:36.439344 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:36.441836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.442514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Calling delete_port for 0842f932-b853-4524-b67e-bc1accc84862 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:36.459907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.460588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for fb6206ba-3f42-47d3-ade2-52410eea44ff owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:36.465521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for a3119393-9336-4f0d-9adb-619c6bcabfa6 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:36.496045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.539287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Made reservation on behalf of 7b8b091cbe5242eea4eb723a5bba2dce for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:36.542776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.580213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] device_id is not set on port e70593f7-acb4-42e6-b97d-07f4a99cab91 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:36.588886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.598708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 0842f932-b853-4524-b67e-bc1accc84862, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0842f932-b853-4524-b67e-bc1accc84862,segment=NetworkSegment(4a67fd41-849b-4a30-a532-ffa04bc15769),segment_id=4a67fd41-849b-4a30-a532-ffa04bc15769)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:36.614195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.618527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.672654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.694211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] No DVR routers for this DVR port 0842f932-b853-4524-b67e-bc1accc84862 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:36.695738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=0842f932-b853-4524-b67e-bc1accc84862,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:36.720212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Subnet': ['ID=469d5c06-41c4-4193-8652-d2da584eb272,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:36.722328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.730092 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-45f158db-e3aa-40c8-83c3-93d1c1feaf46 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/subnets/469d5c06-41c4-4193-8652-d2da584eb272 HTTP/1.1" status: 204 len: 168 time: 0.8790517 Nov 05 14:46:36.733540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-918c78b4-a5d4-44c2-a652-32d4b69fc252 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:36.735211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40700) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:36.753983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19adc3bc-fdc4-42d5-ac07-c4f0e93ad0c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.836118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-918c78b4-a5d4-44c2-a652-32d4b69fc252 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:36.838891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accfda04-7442-4272-a9d9-aaab306c6da4 None None] Pushing event deleted for resources: {'Port': ['ID=0842f932-b853-4524-b67e-bc1accc84862,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:36.914492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.953383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Allocated IP 172.20.0.7 (bc5a9665-de5d-4f5c-a0d4-fd66099e330d/c8acae7c-ce93-474d-81f6-f675b404e887/e70593f7-acb4-42e6-b97d-07f4a99cab91) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:36.960989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] device_id is not set on port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:36.974502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:36.987087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.008492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.066572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19adc3bc-fdc4-42d5-ac07-c4f0e93ad0c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.072409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 36968538-15fc-4d1c-ae93-dde6a2ae4700 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:37.077131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=2ebd4425-94ab-45b9-82e1-f670d25a5c34,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.079290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19adc3bc-fdc4-42d5-ac07-c4f0e93ad0c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.092413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=a3119393-9336-4f0d-9adb-619c6bcabfa6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.104532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.114803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.135688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.136060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.136340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.152779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-bc5a9665-de5d-4f5c-a0d4-fd66099e330d', 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d', 'tenant_id': '7b8b091cbe5242eea4eb723a5bba2dce', 'fixed_ips': [{'subnet_id': 'c8acae7c-ce93-474d-81f6-f675b404e887'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:37.154495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.155779 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-19adc3bc-fdc4-42d5-ac07-c4f0e93ad0c1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=65aa25fa34384b36a770249fcbcb08b9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7485240 Nov 05 14:46:37.160327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.160692 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.161098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40702) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:37.163630 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 2 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.195268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=fb6206ba-3f42-47d3-ade2-52410eea44ff,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.198265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['10f71e1e-c5ad-43b0-9378-480fe23658d1']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.214448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19adc3bc-fdc4-42d5-ac07-c4f0e93ad0c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e336f7b-8572-4a35-a11d-8f03b48b66c9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.248750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.249087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.249406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.306396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.306725 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.314941 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 3 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.389029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.389362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.389694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.413892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.414217 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.420082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 4 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.428483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.431032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:37.442669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] Sync routers for ids ['36968538-15fc-4d1c-ae93-dde6a2ae4700'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:37.455445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] Routers {'36968538-15fc-4d1c-ae93-dde6a2ae4700'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:37.456076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['36968538-15fc-4d1c-ae93-dde6a2ae4700'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.475443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.475773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.476108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.495975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.511042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.511720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.512991 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9c9d9b6c-2ccc-46ef-ba5d-af5e0f0bd98f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 4.8968241 Nov 05 14:46:37.513651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.513982 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.518768 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 5 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.523745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] Routers {'36968538-15fc-4d1c-ae93-dde6a2ae4700'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:37.524569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40704) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:37.524949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['36968538-15fc-4d1c-ae93-dde6a2ae4700'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.537676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4a67fd41-849b-4a30-a532-ffa04bc15769') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.537676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4a67fd41-849b-4a30-a532-ffa04bc15769') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.554315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.563695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:37.564365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff900ce1-409f-4bb1-8ea2-6dd5f0d85f8a None None] The sync data for ids ['36968538-15fc-4d1c-ae93-dde6a2ae4700'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:37.578376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.604908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.605263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.605576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.618986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.619308 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.620654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.625205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 6 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.663871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Releasing vlan 619 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:37.664321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:37.669012 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:37.682481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.682820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.683151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.700531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.703308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.704443 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0e336f7b-8572-4a35-a11d-8f03b48b66c9 HTTP/1.1" status: 204 len: 168 time: 0.5375595 Nov 05 14:46:37.709418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.709749 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.714703 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 7 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.735192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076878bb-d585-4ce2-9a14-6b3e4e7928b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e336f7b-8572-4a35-a11d-8f03b48b66c9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.739450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.748214 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2af1ce9c-f53f-41cd-b588-570bf7802fa6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers/36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 200 len: 885 time: 0.2206666 Nov 05 14:46:37.753026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40708) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:37.756943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.757272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.757607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.760749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.804661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Allocated IP 172.20.0.2 (bc5a9665-de5d-4f5c-a0d4-fd66099e330d/c8acae7c-ce93-474d-81f6-f675b404e887/4ad253c2-24b8-4d9b-ac30-0f4088b73805) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:37.808647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.813601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-09399344-91a3-4035-adc9-e65b6fac09c8 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/fb6206ba-3f42-47d3-ade2-52410eea44ff HTTP/1.1" status: 204 len: 168 time: 2.0123293 Nov 05 14:46:37.823004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40710) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:37.830947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:37.849649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.850014 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.857095 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 8 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:37.907955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:37.912724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event updated for resources: {'Port': ['ID=e70593f7-acb4-42e6-b97d-07f4a99cab91,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:37.920220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:37.923424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:37.923752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:37.924088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:37.926211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:37.955095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:37.971934 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:37.972136 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:37.974911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 9 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:38.001192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.010210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.011306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.012892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:38.013022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:38.013481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:38.026945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.027156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:38.027628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.030393 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/networks/10f71e1e-c5ad-43b0-9378-480fe23658d1 HTTP/1.1" status: 204 len: 168 time: 1.2873785 Nov 05 14:46:38.033427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.045992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-523fb8a2-604c-4752-af17-a69b086e8555 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Network': ['ID=10f71e1e-c5ad-43b0-9378-480fe23658d1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:38.059725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:38.060153 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:38.070879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:38.088030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:38.090494 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempt 10 to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 Nov 05 14:46:38.092676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:38.101162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Pushing event updated for resources: {'Port': ['ID=4ad253c2-24b8-4d9b-ac30-0f4088b73805,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:38.176521 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c5edfaa6-311d-44e1-8f88-cdf7342b5ca7 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.0540776 Nov 05 14:46:38.177798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40722) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.178564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:38.179065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:38.179426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempting to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:38.181700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Attempting to bind port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:38.182797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Attempting to bind port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:38.183384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Attempting to bind port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 on network bc5a9665-de5d-4f5c-a0d4-fd66099e330d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:38.190274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:38.190758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Checking segment: {'id': 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:38.191223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.191736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Bound using segment: {'id': 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:38.192505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Bound port: 4ad253c2-24b8-4d9b-ac30-0f4088b73805, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'bc5a9665-de5d-4f5c-a0d4-fd66099e330d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:38.193029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.200554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:46:38.201141 dv-neutron-816850-1-hyperv neutron-server[113581]: ERROR neutron.plugins.ml2.managers [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Failed to bind port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on host hv-neutron-8168 for vnic_type normal using segments [{'id': 'aad24a7e-a0ac-41fa-811f-c770bd5429ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'b13b759a-7518-4b98-a1b4-fcd147613815'}] Nov 05 14:46:38.201506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.228249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.231295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 78ebd504-ad5b-4336-918b-6990db8c7d29 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:38.280070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] For port 4ad253c2-24b8-4d9b-ac30-0f4088b73805, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:38.283573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] For port 4ad253c2-24b8-4d9b-ac30-0f4088b73805, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4ad253c2-24b8-4d9b-ac30-0f4088b73805,segment=NetworkSegment(b13c70d9-b21c-4ce0-9588-20cbf7b54cc4),segment_id=b13c70d9-b21c-4ce0-9588-20cbf7b54cc4)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:38.291453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.361060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ed4819-0d37-4334-a62a-0f74b077b7c9 None None] Pushing event updated for resources: {'Port': ['ID=4ad253c2-24b8-4d9b-ac30-0f4088b73805,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:38.388793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:38.401780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4ed8beec-c798-4fa8-96c0-32ee4de66d6a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/78ebd504-ad5b-4336-918b-6990db8c7d29/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4983656 Nov 05 14:46:38.401780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.412045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.412245 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] Sync routers for ids ['78ebd504-ad5b-4336-918b-6990db8c7d29'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:38.456083 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] Routers {'78ebd504-ad5b-4336-918b-6990db8c7d29'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:38.458083 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['78ebd504-ad5b-4336-918b-6990db8c7d29'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:38.550861 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:38.552968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Deleting port e70593f7-acb4-42e6-b97d-07f4a99cab91 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:38.553472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.571759 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] Routers {'78ebd504-ad5b-4336-918b-6990db8c7d29'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:38.572367 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['78ebd504-ad5b-4336-918b-6990db8c7d29'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:38.632550 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:38.633228 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bee83a45-c9a8-47f0-ad17-67ae02893745 None None] The sync data for ids ['78ebd504-ad5b-4336-918b-6990db8c7d29'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:38.775758 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-50b1d257-e6d5-4a4f-bbe6-0e3bef8fa0fd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 888 time: 1.0196724 Nov 05 14:46:38.781912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40736) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.783630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port 2ebd4425-94ab-45b9-82e1-f670d25a5c34, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:38.784261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attempted to set empty binding levels {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 05 14:46:38.790417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.794837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-1230868243'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:38.832213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.854703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-fdf17914-1c2c-4cdf-b074-1d36e5a8908e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] remove_router_interface failed (client error): The resource could not be found. Nov 05 14:46:38.858509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fdf17914-1c2c-4cdf-b074-1d36e5a8908e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/78ebd504-ad5b-4336-918b-6990db8c7d29/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.4533508 Nov 05 14:46:38.859956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40742) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.893385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] In _notify_port_updated(), no bound segment for port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 on network b13b759a-7518-4b98-a1b4-fcd147613815 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:46:38.894262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:38.894864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.896178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "PUT /v2.0/ports/2ebd4425-94ab-45b9-82e1-f670d25a5c34 HTTP/1.1" status: 200 len: 980 time: 2.6026614 Nov 05 14:46:38.907594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40744) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.924482 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1b8ac62f-fcd0-4a27-a520-32a0b3f0ca03 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=78ebd504-ad5b-4336-918b-6990db8c7d29 HTTP/1.1" status: 200 len: 205 time: 0.0572994 Nov 05 14:46:38.933449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40746) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:38.934812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting port af9c0163-df97-4e25-a644-4f21c724e670 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:38.935147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.959413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a6f743-2317-451e-856f-4489310ed061 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event updated for resources: {'Port': ['ID=2ebd4425-94ab-45b9-82e1-f670d25a5c34,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:38.967147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:38.983068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.68 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/827987bf-2fc2-4c5b-9558-8063b104d1b3) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:39.008232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-32e337f2-6231-4c40-8e6c-588f355b9fae tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.009186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-32e337f2-6231-4c40-8e6c-588f355b9fae tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.2066791 Nov 05 14:46:39.018833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40750) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.021611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Calling delete_port for e70593f7-acb4-42e6-b97d-07f4a99cab91 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:39.025715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-e73f15a5-4a79-4c0d-94f7-478c66e699a5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.026677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e73f15a5-4a79-4c0d-94f7-478c66e699a5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0062077 Nov 05 14:46:39.034708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40752) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.045485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-5b22ccf0-ebac-4b2f-82cf-894d95ac317e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.046502 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b22ccf0-ebac-4b2f-82cf-894d95ac317e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0108874 Nov 05 14:46:39.057918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40754) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.062684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-11274b85-2295-4a58-9cca-231d62df3918 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.063142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-11274b85-2295-4a58-9cca-231d62df3918 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0043731 Nov 05 14:46:39.071734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40756) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.079268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-19eca4bf-3f44-4a55-998c-a609ce0db722 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.082607 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-19eca4bf-3f44-4a55-998c-a609ce0db722 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0076036 Nov 05 14:46:39.086839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40758) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.096420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-b4a36d40-9cc2-46c1-a5ea-103d660931f3 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.097556 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b4a36d40-9cc2-46c1-a5ea-103d660931f3 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0096803 Nov 05 14:46:39.101347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40760) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.109321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.117049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-e22d5d3b-bb17-4ef7-9221-08ca27d8775d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.119289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e22d5d3b-bb17-4ef7-9221-08ca27d8775d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0126123 Nov 05 14:46:39.126198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.132958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-86e4f0da-122a-4da1-a256-7d98ab337b92 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.133951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-86e4f0da-122a-4da1-a256-7d98ab337b92 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0047154 Nov 05 14:46:39.138274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.146338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-b9ae306a-09e0-4cbf-9ff4-44c7e49f6cf0 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.147578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b9ae306a-09e0-4cbf-9ff4-44c7e49f6cf0 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0056934 Nov 05 14:46:39.154367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40766) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.162376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-33dc8cd6-9e7c-449b-ae48-994e22cb952a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.163310 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-33dc8cd6-9e7c-449b-ae48-994e22cb952a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0080197 Nov 05 14:46:39.170975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40768) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.186418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-88caa9a5-bbb4-4236-951b-e44aece57339 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.187333 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-88caa9a5-bbb4-4236-951b-e44aece57339 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0154963 Nov 05 14:46:39.192823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40770) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.197093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-02203a5b-a886-4d03-9be6-04a9820daf9a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.202448 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-02203a5b-a886-4d03-9be6-04a9820daf9a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0042548 Nov 05 14:46:39.202614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40772) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.202699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] For port af9c0163-df97-4e25-a644-4f21c724e670, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=af9c0163-df97-4e25-a644-4f21c724e670,segment=NetworkSegment(04290a8b-8896-41e5-a400-e582166aa816),segment_id=04290a8b-8896-41e5-a400-e582166aa816)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:39.202699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.205083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-032b44f3-88c5-4f58-b56c-1fe7be145ad3 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.208261 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-032b44f3-88c5-4f58-b56c-1fe7be145ad3 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0042145 Nov 05 14:46:39.210981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40774) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.216712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-1a1e0ae2-43eb-45dd-bca7-7deaefebc42b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.219943 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1a1e0ae2-43eb-45dd-bca7-7deaefebc42b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0053933 Nov 05 14:46:39.221531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40776) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.228389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-c49429a7-d627-4fb9-a7a8-8ae6cfed1a5e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.229331 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c49429a7-d627-4fb9-a7a8-8ae6cfed1a5e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0049584 Nov 05 14:46:39.235848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Deleting port 2ebd4425-94ab-45b9-82e1-f670d25a5c34 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:39.236182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.244818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40778) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.251131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-5ba6b625-5cd5-4b87-b3b4-c93cf8800da4 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.254490 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ba6b625-5cd5-4b87-b3b4-c93cf8800da4 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0063062 Nov 05 14:46:39.257547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Calling delete_port for af9c0163-df97-4e25-a644-4f21c724e670 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:39.260496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40780) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.268285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-61151f70-8946-4cfd-a2e0-26601c310803 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.271673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-61151f70-8946-4cfd-a2e0-26601c310803 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0079315 Nov 05 14:46:39.272209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40782) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.312504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-4155329d-7d92-4739-af32-87101a9010c7 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.312794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.313482 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4155329d-7d92-4739-af32-87101a9010c7 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0383310 Nov 05 14:46:39.317481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40784) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.323863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-0c009d92-3ffd-48f9-a8a6-a2424e18777f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.324818 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0c009d92-3ffd-48f9-a8a6-a2424e18777f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0044842 Nov 05 14:46:39.335914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40786) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.346989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-166d145c-5463-4cf3-bf61-7a763760188b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.350455 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-166d145c-5463-4cf3-bf61-7a763760188b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0105450 Nov 05 14:46:39.369975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.376307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-8d52a00d-8778-4188-930b-9ae9f52973c6 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.379570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8d52a00d-8778-4188-930b-9ae9f52973c6 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0062215 Nov 05 14:46:39.382309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40790) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.392826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-54b2438f-6c65-457a-b45c-8000fac4879f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.396181 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-54b2438f-6c65-457a-b45c-8000fac4879f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0075200 Nov 05 14:46:39.396181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] For port 2ebd4425-94ab-45b9-82e1-f670d25a5c34, host hv-neutron-8168, got binding levels [] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:39.396181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.397960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40792) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.418023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-f9f7c978-2ad0-4db9-a084-5d9565c35064 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.421432 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f9f7c978-2ad0-4db9-a084-5d9565c35064 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0144567 Nov 05 14:46:39.431910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40794) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.439063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-b4a14e15-c077-4047-b20e-47a76247316b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.443776 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b4a14e15-c077-4047-b20e-47a76247316b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0042927 Nov 05 14:46:39.443776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Calling delete_port for 2ebd4425-94ab-45b9-82e1-f670d25a5c34 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:39.445341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40796) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.452487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-83beefcd-4913-42e3-b91c-bd4928c14247 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.453669 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-83beefcd-4913-42e3-b91c-bd4928c14247 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0060055 Nov 05 14:46:39.455328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.455640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.459385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.459906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40798) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.469845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-4032165e-55d3-414a-b044-52030224aad1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.473326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4032165e-55d3-414a-b044-52030224aad1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0046792 Nov 05 14:46:39.475248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40800) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.508499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-c0525366-a849-4a77-b240-9fb3fe2d38bf tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.509535 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c0525366-a849-4a77-b240-9fb3fe2d38bf tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0349836 Nov 05 14:46:39.515105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.521177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-243a0820-bb07-420e-b916-c6ffe086c2d1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.525105 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-243a0820-bb07-420e-b916-c6ffe086c2d1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0043871 Nov 05 14:46:39.529853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.535519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-9b5bcca3-4f3d-451e-88f3-7644f439ffae tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.536498 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9b5bcca3-4f3d-451e-88f3-7644f439ffae tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0044100 Nov 05 14:46:39.546681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40806) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.552437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-6577655c-06fc-4942-b76a-5c8000d62663 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.556336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6577655c-06fc-4942-b76a-5c8000d62663 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0043209 Nov 05 14:46:39.556820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event deleted for resources: {'Port': ['ID=e70593f7-acb4-42e6-b97d-07f4a99cab91,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:39.561200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40808) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.565424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-deae4813-71af-4d29-bcf5-8be2bfa4918d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.568957 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-deae4813-71af-4d29-bcf5-8be2bfa4918d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0042715 Nov 05 14:46:39.572146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40810) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.576277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.581536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-720a80aa-9bce-43b1-9e37-7e791e7d7aec tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.584945 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-720a80aa-9bce-43b1-9e37-7e791e7d7aec tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0099180 Nov 05 14:46:39.585726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.586235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router 78ebd504-ad5b-4336-918b-6990db8c7d29 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:39.594393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.605633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-4ee7ef9e-c835-4ad0-bd75-344794665777 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.606618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4ee7ef9e-c835-4ad0-bd75-344794665777 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0069096 Nov 05 14:46:39.614203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40814) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.622034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.622189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb01c1cb-afd5-434b-ad66-81049884f681 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:39.626643 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-996cbdc3-f2e7-41c8-8bd1-7831f712e666 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/78ebd504-ad5b-4336-918b-6990db8c7d29 HTTP/1.1" status: 204 len: 168 time: 0.6863031 Nov 05 14:46:39.657489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-6f1d9fcc-5cc3-496f-b621-f6559d4dd72b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.661678 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6f1d9fcc-5cc3-496f-b621-f6559d4dd72b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0058172 Nov 05 14:46:39.661678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40816) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.664591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40818) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.666225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] Provisioning complete for port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:39.666794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.672215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-ce028a07-7b74-4faf-80fc-1bb8cfbc9067 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.673305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ce028a07-7b74-4faf-80fc-1bb8cfbc9067 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0071080 Nov 05 14:46:39.676306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40820) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.681375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-dd00f7d9-0701-40fa-bf91-a5488b8b784f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.682579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd00f7d9-0701-40fa-bf91-a5488b8b784f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0046737 Nov 05 14:46:39.686062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40822) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.690498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-55de833a-6d6c-4bef-8897-ba314f476246 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.691638 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55de833a-6d6c-4bef-8897-ba314f476246 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0044656 Nov 05 14:46:39.695003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40824) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.699902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-bbedda7a-81e8-4b2a-ba11-69aeae2df263 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.703610 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bbedda7a-81e8-4b2a-ba11-69aeae2df263 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0069332 Nov 05 14:46:39.708261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40826) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.713332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-6a8b4a58-1c17-4e89-aaf1-5a6dcdc64969 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.716671 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6a8b4a58-1c17-4e89-aaf1-5a6dcdc64969 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0042486 Nov 05 14:46:39.716786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.718427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40828) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.720726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:39.735212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-4e712c40-7a2f-41ed-9cd4-eb8ffdf81061 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.738964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e712c40-7a2f-41ed-9cd4-eb8ffdf81061 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0092690 Nov 05 14:46:39.753545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40830) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.754399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] No DVR routers for this DVR port af9c0163-df97-4e25-a644-4f21c724e670 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:39.754522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:39.756085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Port': ['ID=af9c0163-df97-4e25-a644-4f21c724e670,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:39.761811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.762344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:39.766734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-374fd93f-e82d-4075-b45b-f0ea1b5b9d17 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.770168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-374fd93f-e82d-4075-b45b-f0ea1b5b9d17 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0110750 Nov 05 14:46:39.774141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=827987bf-2fc2-4c5b-9558-8063b104d1b3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:39.777210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40832) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.802675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-0137a3d5-cf4c-4e93-9c03-3a1d3baf33a5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.806649 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0137a3d5-cf4c-4e93-9c03-3a1d3baf33a5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0043151 Nov 05 14:46:39.809360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.809996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40834) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.817566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-6fc10231-0b0e-4078-827a-9180f843dd9b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.819842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6fc10231-0b0e-4078-827a-9180f843dd9b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0060372 Nov 05 14:46:39.820831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.824194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-270a302a-b4d7-4d9d-b503-89a6d4a40284 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "DELETE /v2.0/ports/e70593f7-acb4-42e6-b97d-07f4a99cab91 HTTP/1.1" status: 204 len: 168 time: 1.6463892 Nov 05 14:46:39.825092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb01c1cb-afd5-434b-ad66-81049884f681 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:39.828661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet cd1012a5-c0e9-473b-8ac4-dccf8b779985 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:39.830779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40836) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.831117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40838) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.839285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-e1808240-7c2c-4917-9bbb-bc819bb1251b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.842726 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e1808240-7c2c-4917-9bbb-bc819bb1251b tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0054815 Nov 05 14:46:39.843495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.849609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.854239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.876137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40840) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.895682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] For port 4ad253c2-24b8-4d9b-ac30-0f4088b73805, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4ad253c2-24b8-4d9b-ac30-0f4088b73805,segment=NetworkSegment(b13c70d9-b21c-4ce0-9588-20cbf7b54cc4),segment_id=b13c70d9-b21c-4ce0-9588-20cbf7b54cc4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:39.896053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-a55d7197-b0d9-4e23-ae8d-498e8f765c6d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.897075 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a55d7197-b0d9-4e23-ae8d-498e8f765c6d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0196016 Nov 05 14:46:39.904232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40844) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.927277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-c6e563f0-9030-48d7-a28c-bdfe549ad8c5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.928161 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6e563f0-9030-48d7-a28c-bdfe549ad8c5 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0047185 Nov 05 14:46:39.940491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40846) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.941552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Pushing event deleted for resources: {'Port': ['ID=2ebd4425-94ab-45b9-82e1-f670d25a5c34,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:39.952975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-15305446-2ada-4112-bf36-973ba543c06f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.953957 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-15305446-2ada-4112-bf36-973ba543c06f tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0102789 Nov 05 14:46:39.957222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40848) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.961813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-ba0d5d15-19a9-4a89-ae08-e0ef1d329078 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.965349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.966138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ba0d5d15-19a9-4a89-ae08-e0ef1d329078 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0077267 Nov 05 14:46:39.967038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40850) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.975417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-5b94bd92-6bcb-47e5-b867-1dca11f73ffd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.979608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b94bd92-6bcb-47e5-b867-1dca11f73ffd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0083647 Nov 05 14:46:39.980404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40852) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:39.988552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:39.989707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-70aaf1a5-dd7b-4b6d-b934-16b2695afb72 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:39.996333 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-70aaf1a5-dd7b-4b6d-b934-16b2695afb72 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0072911 Nov 05 14:46:40.001992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.004942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 36968538-15fc-4d1c-ae93-dde6a2ae4700 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:40.005625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40854) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.007166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.007974 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-665224a0-a77e-415d-b6fd-a12a06a196fd tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "DELETE /v2.0/ports/2ebd4425-94ab-45b9-82e1-f670d25a5c34 HTTP/1.1" status: 204 len: 168 time: 1.0883176 Nov 05 14:46:40.012154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40856) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.013468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-f8e5e125-b8ba-4190-bb13-8e53d26eea78 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.017120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f8e5e125-b8ba-4190-bb13-8e53d26eea78 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0068433 Nov 05 14:46:40.018761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40858) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.042522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-586ef234-b9fe-4ba3-b177-a68dba986e2d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.043488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-586ef234-b9fe-4ba3-b177-a68dba986e2d tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0141833 Nov 05 14:46:40.044729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de4ff29f-65bd-41ea-b5af-181876db3316']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.055401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40860) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.060011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-fa17fbac-bfc6-4b58-98a7-e7aa22cdc9aa tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.060988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa17fbac-bfc6-4b58-98a7-e7aa22cdc9aa tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0044403 Nov 05 14:46:40.064747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '04290a8b-8896-41e5-a400-e582166aa816') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.065215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '04290a8b-8896-41e5-a400-e582166aa816') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.067594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40862) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.067758 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7db8bda2-dacb-4e40-b2eb-e75fa388f4b3 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4563 time: 0.2317026 Nov 05 14:46:40.074632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-43bef1a6-a1d7-423a-bbeb-6bc702e16582 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] GET failed (client error): The resource could not be found. Nov 05 14:46:40.077014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-ce00a557-ffd8-45bc-b375-021179eda55e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.080324 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ce00a557-ffd8-45bc-b375-021179eda55e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0045781 Nov 05 14:46:40.080483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099f0bfa-8047-45f1-a52a-d7c6c46c41de None None] Pushing event updated for resources: {'Port': ['ID=4ad253c2-24b8-4d9b-ac30-0f4088b73805,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:40.081719 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-43bef1a6-a1d7-423a-bbeb-6bc702e16582 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1922483540-project-admin] 10.222.0.30 "GET /v2.0/ports/2ebd4425-94ab-45b9-82e1-f670d25a5c34 HTTP/1.1" status: 404 len: 333 time: 0.0652699 Nov 05 14:46:40.084275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40864) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.084660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40866) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.084981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40868) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.094469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-674268002'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:40.104062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-ee29d728-630f-447a-96aa-110947793219 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.107557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee29d728-630f-447a-96aa-110947793219 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0156672 Nov 05 14:46:40.116388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40872) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.123795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-334b5a3a-91cf-4f30-8973-ae5ea73398e6 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.127219 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-334b5a3a-91cf-4f30-8973-ae5ea73398e6 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0059123 Nov 05 14:46:40.127219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.128119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40874) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.135775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-2bd33770-cb46-4e7b-bf33-6593bb40cf51 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.135775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2bd33770-cb46-4e7b-bf33-6593bb40cf51 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0045516 Nov 05 14:46:40.136099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.142287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40876) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.147754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-8308c226-e8f3-485e-a1b4-4ceab0b93686 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.150904 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8308c226-e8f3-485e-a1b4-4ceab0b93686 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0041595 Nov 05 14:46:40.154074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40878) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.158173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-460b57ac-ebe9-4600-b31f-2f299e94dffd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.159111 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-460b57ac-ebe9-4600-b31f-2f299e94dffd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0041289 Nov 05 14:46:40.160214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.166348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40880) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.172712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-3a9a6df1-60c8-4d9d-b111-d65f1544dead tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.176045 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a9a6df1-60c8-4d9d-b111-d65f1544dead tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0043333 Nov 05 14:46:40.177874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Releasing vlan 647 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:40.178295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:40.181902 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:40.185859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-10b7480c-70d7-4ab2-b69a-a3524c7f82ab tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.189317 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-10b7480c-70d7-4ab2-b69a-a3524c7f82ab tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0041094 Nov 05 14:46:40.199060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40884) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.216549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-046830bf-2739-40ca-a1e6-5fdaf01751a1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.220489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-046830bf-2739-40ca-a1e6-5fdaf01751a1 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0143933 Nov 05 14:46:40.223852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40886) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.228994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-b70c2021-4250-4965-b565-e5d4a6b6456a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.230162 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b70c2021-4250-4965-b565-e5d4a6b6456a tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0050747 Nov 05 14:46:40.235709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40888) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.245169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-15f94bb0-f7e1-410b-ae3b-b5475853f997 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.246207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-15f94bb0-f7e1-410b-ae3b-b5475853f997 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0045927 Nov 05 14:46:40.270324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40890) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.273277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.281871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-b2bdd27d-f1f4-4245-af45-8f94ac7bf49e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.283143 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2bdd27d-f1f4-4245-af45-8f94ac7bf49e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0058382 Nov 05 14:46:40.283902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Made reservation on behalf of 7b8b091cbe5242eea4eb723a5bba2dce for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:40.288449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.295231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40892) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.314991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-0d5d96ea-7581-433c-99ee-8771f018ad3e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.315952 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0d5d96ea-7581-433c-99ee-8771f018ad3e tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0045469 Nov 05 14:46:40.318662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40894) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.325944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-62991a23-508f-4957-b0f4-5f7773437afd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.329582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-62991a23-508f-4957-b0f4-5f7773437afd tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0100391 Nov 05 14:46:40.330355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.332231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40896) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.339512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-07d85c80-921c-469a-a2eb-478e9bbf2b32 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.343403 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-07d85c80-921c-469a-a2eb-478e9bbf2b32 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0073955 Nov 05 14:46:40.344371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40898) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.350167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.355633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-0960bd6e-061e-44ae-a92d-4af0e3056a70 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.356618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0960bd6e-061e-44ae-a92d-4af0e3056a70 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0079670 Nov 05 14:46:40.363084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.366531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.370116 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/networks/de4ff29f-65bd-41ea-b5af-181876db3316 HTTP/1.1" status: 204 len: 168 time: 2.3361461 Nov 05 14:46:40.372704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.374362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [None req-faf238e9-393f-4421-b99c-2e73e40db7fc tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.375356 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-faf238e9-393f-4421-b99c-2e73e40db7fc tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0063679 Nov 05 14:46:40.385280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.386071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7274e0-f0ba-48b6-a13d-d352e8168928 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Network': ['ID=de4ff29f-65bd-41ea-b5af-181876db3316,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:40.389759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:40.396310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [None req-1e1501eb-42b6-4c96-9ae5-afcf68f2d588 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] http://10.222.0.30:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:46:40.398123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.406464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 608} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:40.407104 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1e1501eb-42b6-4c96-9ae5-afcf68f2d588 tempest-ExtensionsTestJSON-1956381826 tempest-ExtensionsTestJSON-1956381826-project] 10.222.0.30 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0142124 Nov 05 14:46:40.410969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] Sync routers for ids ['36968538-15fc-4d1c-ae93-dde6a2ae4700'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:40.428569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4ad253c2-24b8-4d9b-ac30-0f4088b73805 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:40.433849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.434196 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Added segment 1e77b54c-124a-46aa-8940-663f9aa3f702 of type vlan for network e6f83adb-8b84-4dd2-a8ba-e009d72da153 Nov 05 14:46:40.436611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] Routers {'36968538-15fc-4d1c-ae93-dde6a2ae4700'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:40.437608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['36968538-15fc-4d1c-ae93-dde6a2ae4700'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.439683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.444345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a47b99a1-6f8a-4854-99ff-965300c8f960 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 200 len: 892 time: 1.6538603 Nov 05 14:46:40.473254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40908) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.525887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting subnet bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:40.530198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.530686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.561392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] Routers {'36968538-15fc-4d1c-ae93-dde6a2ae4700'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:40.564719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['36968538-15fc-4d1c-ae93-dde6a2ae4700'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.603888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.609487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.617623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:40.618892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc5952b9-baa0-414a-9c32-7e584e335245 None None] The sync data for ids ['36968538-15fc-4d1c-ae93-dde6a2ae4700'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:40.629480 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:40.630072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.815045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.818806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40912) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:40.915539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.931237 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:40.934613 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/subnets/bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1 HTTP/1.1" status: 204 len: 168 time: 0.5604937 Nov 05 14:46:40.953041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40916) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.004634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf7557a-1d07-44e7-bb51-b1135a10b6d1 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Subnet': ['ID=bad66e7e-d2a3-4c6d-8c09-8efe81ee08d1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.020953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.032773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd4214de-7b68-4ac8-b30f-03ce724b004c admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.067102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.088382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=cd1012a5-c0e9-473b-8ac4-dccf8b779985,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.103079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.105503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c8a8cd5-a1f5-48a6-85a4-c658000b4d7e None None] Network de4ff29f-65bd-41ea-b5af-181876db3316 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:41.108859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-92500edb-58c0-4213-9c2e-e2f7ecbda0d5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/cd1012a5-c0e9-473b-8ac4-dccf8b779985 HTTP/1.1" status: 204 len: 168 time: 1.4430671 Nov 05 14:46:41.110620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40918) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8c8a8cd5-a1f5-48a6-85a4-c658000b4d7e None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:41.128768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:41.148291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-984d6172-4ca8-46d0-b15d-fe170e81c8db None None] Network c978ac01-0f0b-46ac-bbdb-ac6b7f142966 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:41.169638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.185242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd4214de-7b68-4ac8-b30f-03ce724b004c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.189992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Deleting port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:41.190366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.193033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd4214de-7b68-4ac8-b30f-03ce724b004c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.278298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c18fa428-cd03-4ab6-b1ef-93c1f1d93a6f None None] Provisioning complete for port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:41.278822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c18fa428-cd03-4ab6-b1ef-93c1f1d93a6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.307085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e22fb415-cf5d-4108-9d69-424d3759129b None None] DHCP port deletion for de4ff29f-65bd-41ea-b5af-181876db3316 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:41.351668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.375805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b13b759a-7518-4b98-a1b4-fcd147613815']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:41.407030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aad24a7e-a0ac-41fa-811f-c770bd5429ab') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:41.407315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aad24a7e-a0ac-41fa-811f-c770bd5429ab') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:41.411105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.424211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:41.424211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.434548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] DHCP port deletion for c978ac01-0f0b-46ac-bbdb-ac6b7f142966 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:41.455172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.517566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Deleting port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:41.518682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.536943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.546616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Releasing vlan 638 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:41.547022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.575422 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bd4214de-7b68-4ac8-b30f-03ce724b004c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=67aa56ee634a42048cc266fd57202d28&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7534468 Nov 05 14:46:41.583007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5068dd7b-b0f5-4cb1-b363-479d992a8f4a None None] Could not find standard attr ID for object e70593f7-acb4-42e6-b97d-07f4a99cab91. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:46:41.588916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40920) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.609880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd4214de-7b68-4ac8-b30f-03ce724b004c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=696929f9-3394-4cbc-8966-8ff7698a6f86,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.618378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] For port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,segment=NetworkSegment(950362af-88db-4447-a5bd-4867cf3898be),segment_id=950362af-88db-4447-a5bd-4867cf3898be)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:41.623281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:41.636735 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:41.654156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Calling delete_port for 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:41.669610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] For port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,segment=NetworkSegment(950362af-88db-4447-a5bd-4867cf3898be),segment_id=950362af-88db-4447-a5bd-4867cf3898be)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:41.669994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.672842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event updated for resources: {'Network': ['ID=e6f83adb-8b84-4dd2-a8ba-e009d72da153,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.697818 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-db6b3f67-8a7e-4732-b821-ee9148392898 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers/36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 200 len: 892 time: 1.2217817 Nov 05 14:46:41.699257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.703332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.714718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Calling delete_port for 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:41.725744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.732762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a657e6f4-356d-464f-b4af-2bf29a37d9fe tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.6442111 Nov 05 14:46:41.733724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.740318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40924) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.761739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network e6f83adb-8b84-4dd2-a8ba-e009d72da153 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:41.771687 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ce35fba-a1e6-4dcf-9a11-fba20f2f56c3 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 200 len: 205 time: 0.0633373 Nov 05 14:46:41.772597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.783239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40926) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.832366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.835983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] 10.222.0.30 "DELETE /v2.0/networks/b13b759a-7518-4b98-a1b4-fcd147613815 HTTP/1.1" status: 204 len: 168 time: 1.7453887 Nov 05 14:46:41.836909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f6b34df-2d76-43ac-80dd-c8dfbcc6d0f5 None None] Network cfd0ae34-8401-40a9-aa98-7ce5914cdd4c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:41.844376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.878729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.888136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c288e57d-1934-41fd-93c7-44e52cdbf2a9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1193481990-project] Pushing event deleted for resources: {'Network': ['ID=b13b759a-7518-4b98-a1b4-fcd147613815,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.920442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.922848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] Pushing event deleted for resources: {'Port': ['ID=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:41.930345 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.1024604 Nov 05 14:46:41.934700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-946089b4-d248-4662-8f6f-f6d0ad253dfd None None] No DVR routers for this DVR port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:41.943494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40930) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:41.951051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:41.953974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'port': {'network_id': '1557b5a0-960f-471e-a237-a6a5b7dcc894', 'name': 'tempest-FloatingIPTestJSON-677572932'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:41.977919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09867a3a-67a4-41ea-b71e-53cc0963628c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=827987bf-2fc2-4c5b-9558-8063b104d1b3,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:42.032522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port d4562258-9053-440c-835d-ae9bc51c67a3 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:42.033090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.089873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] DHCP port deletion for cfd0ae34-8401-40a9-aa98-7ce5914cdd4c request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:42.121930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40934) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:42.145754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Deleting port d4562258-9053-440c-835d-ae9bc51c67a3 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:42.147122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.155803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.160326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port d4562258-9053-440c-835d-ae9bc51c67a3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4562258-9053-440c-835d-ae9bc51c67a3,segment=NetworkSegment(9dc8ec3f-ae70-4dcc-ad0d-472103764521),segment_id=9dc8ec3f-ae70-4dcc-ad0d-472103764521)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:42.160734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.163553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.165727 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/696929f9-3394-4cbc-8966-8ff7698a6f86 HTTP/1.1" status: 204 len: 168 time: 0.5743070 Nov 05 14:46:42.191271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.197822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for d4562258-9053-440c-835d-ae9bc51c67a3 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:42.199804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:42.204698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.254483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] device_id is not set on port 079bebef-076c-4962-81c3-4d212688d3ea yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:42.261278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] For port d4562258-9053-440c-835d-ae9bc51c67a3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4562258-9053-440c-835d-ae9bc51c67a3,segment=NetworkSegment(9dc8ec3f-ae70-4dcc-ad0d-472103764521),segment_id=9dc8ec3f-ae70-4dcc-ad0d-472103764521)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:42.262552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.271062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device af9c0163-df97-4e25-a644-4f21c724e670 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:42.302629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: af9c0163-df97-4e25-a644-4f21c724e670 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:42.303055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device af9c0163-df97-4e25-a644-4f21c724e670 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:42.303533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4562258-9053-440c-835d-ae9bc51c67a3 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:42.306123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Calling delete_port for d4562258-9053-440c-835d-ae9bc51c67a3 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:42.332152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-896dfa32-2a44-41c0-828b-649334fbd521 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=696929f9-3394-4cbc-8966-8ff7698a6f86,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:42.347996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Port': ['ID=45fd6ccb-3dd0-4b9f-b992-0b92198cb659,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:42.367185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] No DVR routers for this DVR port 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:42.372872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.383996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.5 (1557b5a0-960f-471e-a237-a6a5b7dcc894/797dfb34-cf8a-436e-96e5-05a94bb2f935/079bebef-076c-4962-81c3-4d212688d3ea) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:42.390597 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d97e884c-76fa-4fd2-b581-8cd83d9e275a tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks HTTP/1.1" status: 200 len: 6393 time: 0.6462853 Nov 05 14:46:42.425448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40942) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:42.550653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.573947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.607807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] Pushing event deleted for resources: {'Port': ['ID=d4562258-9053-440c-835d-ae9bc51c67a3,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:42.639035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ade837d9-fe6e-4dbd-96ad-257006f16bf5 None None] No DVR routers for this DVR port d4562258-9053-440c-835d-ae9bc51c67a3 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:42.645461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.647493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:42.660939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.702931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd0718ba-130f-48ce-bfee-6c86cc0c6635 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:42.707798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:42.708364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 45fd6ccb-3dd0-4b9f-b992-0b92198cb659 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:42.709794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c978ac01-0f0b-46ac-bbdb-ac6b7f142966']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:42.721720 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1ef8998d-2d89-4d44-bda4-1eccbddc5a17 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=aa1dbf0a760f4b908147f8b9122343c5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5970347 Nov 05 14:46:42.723158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40952) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:42.731721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '950362af-88db-4447-a5bd-4867cf3898be') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:42.732026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '950362af-88db-4447-a5bd-4867cf3898be') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:42.736907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.757312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.777712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=d4562258-9053-440c-835d-ae9bc51c67a3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:42.785010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.788492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port d4562258-9053-440c-835d-ae9bc51c67a3 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:42.819367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7f9ba93-e574-4082-8435-02a9fbd86ad1 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] Network e6f83adb-8b84-4dd2-a8ba-e009d72da153 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:42.822268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.829289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd0718ba-130f-48ce-bfee-6c86cc0c6635 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:42.833140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Releasing vlan 623 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:42.833922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:42.840140 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:42.892325 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c7f9ba93-e574-4082-8435-02a9fbd86ad1 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "POST /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.4643786 Nov 05 14:46:42.895543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40956) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:42.913799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.914025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 84cf6ecd-313a-46cd-b704-f6ccd010d289 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:42.914025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.926768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.964172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.983531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:42.987555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/networks/c978ac01-0f0b-46ac-bbdb-ac6b7f142966 HTTP/1.1" status: 204 len: 168 time: 2.0331886 Nov 05 14:46:42.997200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40960) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.000909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cfd0ae34-8401-40a9-aa98-7ce5914cdd4c']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:43.010025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3818576a-7e90-4b55-82c7-70a43dab18fd tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Pushing event deleted for resources: {'Network': ['ID=c978ac01-0f0b-46ac-bbdb-ac6b7f142966,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:43.020993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9dc8ec3f-ae70-4dcc-ad0d-472103764521') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:43.021569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9dc8ec3f-ae70-4dcc-ad0d-472103764521') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:43.022728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.075303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.076286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.099391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 84cf6ecd-313a-46cd-b704-f6ccd010d289 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:43.118154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.123028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.127036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.132496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f87e246b-75bd-4e25-8a12-5700bb428e1c HTTP/1.1" status: 204 len: 168 time: 0.3994205 Nov 05 14:46:43.132496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40966) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.132883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-41b231da-5542-4cf9-a2d6-16b159cac2f4 tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "GET /v2.0/ports?device_id=44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 HTTP/1.1" status: 200 len: 205 time: 0.0686543 Nov 05 14:46:43.153395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e58404d1-3a0c-4871-807c-191d5949b285 None None] Network e6f83adb-8b84-4dd2-a8ba-e009d72da153 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:43.179448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 1557b5a0-960f-471e-a237-a6a5b7dcc894 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:43.196314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:43.212813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:43.216847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.239107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa96422d-6920-4850-984b-ff4971259ce2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f87e246b-75bd-4e25-8a12-5700bb428e1c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:43.290293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40970) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.313285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.323660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:43.324088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.329598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=079bebef-076c-4962-81c3-4d212688d3ea,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:43.331959 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:43.448392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:43.449055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.474187 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7d904415-defc-4980-bf09-2ac3bee72864 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.5287523 Nov 05 14:46:43.478677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40976) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.489693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-45471f20-607a-4606-8dda-9c27931cb4f6 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks HTTP/1.1" status: 200 len: 6400 time: 0.5918300 Nov 05 14:46:43.492384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40978) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.494909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': '079bebef-076c-4962-81c3-4d212688d3ea'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:43.501635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.511543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.515887 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/cfd0ae34-8401-40a9-aa98-7ce5914cdd4c HTTP/1.1" status: 204 len: 168 time: 2.3611045 Nov 05 14:46:43.520714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40980) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.526680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-374393862'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:43.557942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9b2101-787e-4204-bf9d-98663ae10797 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=cfd0ae34-8401-40a9-aa98-7ce5914cdd4c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:43.619914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:43.624117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.627037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.636013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.642994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9202e015-8b42-433c-98c6-eb0134bb6204 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "DELETE /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks/e6f83adb-8b84-4dd2-a8ba-e009d72da153 HTTP/1.1" status: 204 len: 168 time: 0.1487885 Nov 05 14:46:43.646824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'networks': [{'name': 'tempest-network--1875095460'}, {'name': 'tempest-network--1456179830'}]} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:43.647147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-network--1875095460'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:43.647482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.647617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-network--1456179830'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:43.649470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40982) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.673959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 616} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:43.685727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.686093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 90f16d9f-0002-4dc2-8fd0-4646d7836558 of type vlan for network 4bc0e879-b691-43e1-ba30-4cce655d2888 Nov 05 14:46:43.687531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'network': 2} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:43.692336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.707959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40984) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.737071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.762950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.763476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Fanout notify agent at l3_agent the message router_deleted on router 44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:43.768475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.780795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.781916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31620c3f-527d-4ed8-9cf4-35801fec836c tempest-RoutersNegativeTest-1181649538 tempest-RoutersNegativeTest-1181649538-project] 10.222.0.30 "DELETE /v2.0/routers/44c119f0-f14f-43e0-bfcd-b908c6cdf9b4 HTTP/1.1" status: 204 len: 168 time: 0.6486828 Nov 05 14:46:43.817041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.844788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2c0df271-fed6-424b-a866-706cefddd1ce admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=43d4035d66c84aaab60dcbe13e774ce5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1343243 Nov 05 14:46:43.847383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40988) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.854851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.860475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:43.861070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:43.878926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=84cf6ecd-313a-46cd-b704-f6ccd010d289,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:43.952820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.4275258 Nov 05 14:46:43.959497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40990) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:43.979956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:44.003456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3316df82-0531-4847-9c88-4a37b90ff448 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=4bc0e879-b691-43e1-ba30-4cce655d2888,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:44.014998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:44.090469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.108730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.109293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.131082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 40994) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.170989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.200250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 648} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:44.209573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.209909 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment 3d910d19-49fc-4a42-85f5-49fc7e7e0b5e of type vlan for network 3adf1a8a-18bf-4c37-be07-aaf6e85f20cc Nov 05 14:46:44.267072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2bb8f64b-20f0-4f3f-b4d1-cb71780e69db tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks HTTP/1.1" status: 200 len: 4891 time: 0.6116805 Nov 05 14:46:44.273118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 40998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.284326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.293204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.296452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'SecurityGroup': ['ID=10f6a4c1-0c9a-41c0-aff1-1121d306e493,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:44.315538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.387818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:44.391538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.394469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 649} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:44.413929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ea05014-fb3f-42a2-b84b-cb70eec418ee tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/networks/bc5a9665-de5d-4f5c-a0d4-fd66099e330d/dhcp-agents HTTP/1.1" status: 200 len: 811 time: 0.1393976 Nov 05 14:46:44.417679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41000) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.426436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.430279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.465029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f958e22f-a057-4563-baa0-91a9d694ad8e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5a98ebc5362e4966a5581cb2ea2ccf1b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3295341 Nov 05 14:46:44.466863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.467292 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment 66259341-76a4-4d89-852e-cda6fa425cd3 of type vlan for network d79ba6f2-195d-4178-80e0-16f51c67326d Nov 05 14:46:44.470305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.522725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4803d8d5-b63d-4926-a98f-ce01cb87d0e6 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/networks/bc5a9665-de5d-4f5c-a0d4-fd66099e330d/dhcp-agents HTTP/1.1" status: 200 len: 811 time: 0.1039002 Nov 05 14:46:44.525961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41004) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.544124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.549348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.552024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.553162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e7eb2ddf-e6e6-4df5-9107-edcc1331bbf4 HTTP/1.1" status: 204 len: 168 time: 0.7048538 Nov 05 14:46:44.568234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.568822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 36968538-15fc-4d1c-ae93-dde6a2ae4700 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:44.572618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c6ab25-92d5-4251-840a-526604be46c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7eb2ddf-e6e6-4df5-9107-edcc1331bbf4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:44.585898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.590711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1d99ed90-18fa-4b63-8bcf-6abe076e89f6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 204 len: 168 time: 2.8040035 Nov 05 14:46:44.590862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41008) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.599482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-11198055'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:44.643645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.644051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.649833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:44.655015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:44.655658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.702372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.731919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:44.735422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.750089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 1.4405599 Nov 05 14:46:44.757581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41012) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.772436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:44.806291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=3adf1a8a-18bf-4c37-be07-aaf6e85f20cc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:44.822328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 3adf1a8a-18bf-4c37-be07-aaf6e85f20cc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:44.857185 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-25d0f4e2-ad48-4415-9eb7-088874053c93 tempest-DHCPAgentSchedulersTestJSON-1730273309 tempest-DHCPAgentSchedulersTestJSON-1730273309-project-admin] 10.222.0.30 "GET /v2.0/agents/e00c03f2-9866-481b-b4b5-10f75e3fb25b/dhcp-networks HTTP/1.1" status: 200 len: 4891 time: 0.3300424 Nov 05 14:46:44.860940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41014) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:44.993183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.005449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.008498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.009826 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/77d9b60d-aab6-48cd-8a15-e0d895621195 HTTP/1.1" status: 204 len: 168 time: 0.5084393 Nov 05 14:46:45.013493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 644} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:45.019542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.029663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.074902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37bdcc77-f2ee-41cf-a0e7-cfa27368be45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77d9b60d-aab6-48cd-8a15-e0d895621195,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:45.076417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.077041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff452a6e-cfb4-441b-af90-80feb904085e tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=d79ba6f2-195d-4178-80e0-16f51c67326d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:45.102637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.103280 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 72879cc7-b887-4f38-aade-19c22aa0b99a of type vlan for network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 Nov 05 14:46:45.180048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d79ba6f2-195d-4178-80e0-16f51c67326d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:45.180629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=841b00df-9663-4f2d-9b64-5d0b3f368de5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:45.196253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b77415c-ea30-483a-9ffe-254e1ae68eeb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.198523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.202886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b77415c-ea30-483a-9ffe-254e1ae68eeb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.208928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b77415c-ea30-483a-9ffe-254e1ae68eeb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.215092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b77415c-ea30-483a-9ffe-254e1ae68eeb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.216845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1b77415c-ea30-483a-9ffe-254e1ae68eeb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.4529834 Nov 05 14:46:45.221504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41028) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:45.236848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.271294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '90f16d9f-0002-4dc2-8fd0-4646d7836558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:45.271676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 4bc0e879-b691-43e1-ba30-4cce655d2888, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:45.315952 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e6f83adb-8b84-4dd2-a8ba-e009d72da153']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:45.324859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.332449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.332449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.337107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e77b54c-124a-46aa-8940-663f9aa3f702') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:45.337862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e77b54c-124a-46aa-8940-663f9aa3f702') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:45.345292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:45.355551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.391411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.393399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.405181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Releasing vlan 608 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:45.405587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.410395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 4bc0e879-b691-43e1-ba30-4cce655d2888) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:45.410490 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:45.413465 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP d23c29b5-746c-4378-b140-a6f1d684984e associated. External IP: 172.26.5.68, port: 079bebef-076c-4962-81c3-4d212688d3ea. Nov 05 14:46:45.415989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:45.416640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.417142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06b67ae3-dc3e-444d-9070-c54cf2f228af None None] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:45.426937 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.8321974 Nov 05 14:46:45.427737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41036) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:45.435755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:45.442908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbba97bb-d8ef-4cc2-a18f-35d1995949bd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:45.496792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:45.501051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-19a3958c-eafb-4b21-8b85-ab54e55fc4e3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5365868 Nov 05 14:46:45.501051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41040) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:45.508509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-598476693', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:45.551104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.552165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.579085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:45.590827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-06b67ae3-dc3e-444d-9070-c54cf2f228af None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:45.602155 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:45.614815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f4b99d5-7d42-4c99-a476-7311a47e395f None None] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5f4b99d5-7d42-4c99-a476-7311a47e395f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:45.709807 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:45.730579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45688b56-f8bd-4f8a-be65-d5ca97c6cd18 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:45.736539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.748076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.759685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.762095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:45.765740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "DELETE /v2.0/networks/e6f83adb-8b84-4dd2-a8ba-e009d72da153 HTTP/1.1" status: 204 len: 168 time: 0.9005358 Nov 05 14:46:45.766961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0550faa4-eb81-4e5c-ac50-3bab8fd65f1e tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event deleted for resources: {'Network': ['ID=e6f83adb-8b84-4dd2-a8ba-e009d72da153,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:45.771319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41052) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:45.948291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45688b56-f8bd-4f8a-be65-d5ca97c6cd18 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:46.108190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:46.125774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.188949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3adf1a8a-18bf-4c37-be07-aaf6e85f20cc']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.205152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d910d19-49fc-4a42-85f5-49fc7e7e0b5e') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.205444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d910d19-49fc-4a42-85f5-49fc7e7e0b5e') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.246319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.266748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.277185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 648 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:46.277591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:46.282675 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:46.292220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41068) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.296005 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-f30f3ba3-cc91-4eb1-8bff-481e67b3035d tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] DELETE failed (client error): The resource could not be found. Nov 05 14:46:46.297298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f30f3ba3-cc91-4eb1-8bff-481e67b3035d tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:46:46.300472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:46.301531 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f30f3ba3-cc91-4eb1-8bff-481e67b3035d tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "DELETE /v2.0/ports/e70593f7-acb4-42e6-b97d-07f4a99cab91 HTTP/1.1" status: 404 len: 333 time: 0.5292876 Nov 05 14:46:46.304717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41070) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.313236 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:46.329496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.333390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-4bc0e879-b691-43e1-ba30-4cce655d2888', 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '841b00df-9663-4f2d-9b64-5d0b3f368de5'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:46.333951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-65c70172-08d8-4985-8758-e87eb7f0d64b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.8326163 Nov 05 14:46:46.335036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.336656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.342273 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:46.342893 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.347434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41074) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.348063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.414146 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.438927 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:46.439528 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.451051 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-66430500-6236-4c40-849b-a8f493d646e7 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/d23c29b5-746c-4378-b140-a6f1d684984e HTTP/1.1" status: 200 len: 976 time: 2.9674172 Nov 05 14:46:46.456776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41078) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.502781 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:46.503818 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f5a63cf-08e3-405c-9cb6-b8ba0284a66d None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:46.539958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=189d2f8e-7ed3-4fb9-8612-eb0a1fa59267,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:46.658441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '72879cc7-b887-4f38-aade-19c22aa0b99a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:46.658814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:46.666269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--331878968'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:46.733719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.748913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.770415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Deleting subnet c8acae7c-ce93-474d-81f6-f675b404e887 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:46.777511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.780076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.803579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.819438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:46.829013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.832688 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/3adf1a8a-18bf-4c37-be07-aaf6e85f20cc HTTP/1.1" status: 204 len: 168 time: 1.6097958 Nov 05 14:46:46.838183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41088) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.849678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51289e10-e4a9-479c-bfd0-a07b11850c77 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=3adf1a8a-18bf-4c37-be07-aaf6e85f20cc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:46.855017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:46.870088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.924337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 079bebef-076c-4962-81c3-4d212688d3ea {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:46.925156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.940890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:46.941491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:46.945250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41090) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:46.947691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Allocated IP 172.20.0.2 (4bc0e879-b691-43e1-ba30-4cce655d2888/841b00df-9663-4f2d-9b64-5d0b3f368de5/5008455b-6ccc-489a-ae32-75ca97162f49) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:47.019848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.036619 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2a777ae2-778a-4081-b41b-3e3435d5e37c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6046486 Nov 05 14:46:47.038348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41094) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:47.064604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1628460161', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:47.083626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.110581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.114381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-1460716947'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:47.176200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.242852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.243900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.249546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event deleted for resources: {'Subnet': ['ID=c8acae7c-ce93-474d-81f6-f675b404e887,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.251707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.257648 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8f371896-1479-430b-a7ee-166bb446a1fa tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "DELETE /v2.0/subnets/c8acae7c-ce93-474d-81f6-f675b404e887 HTTP/1.1" status: 204 len: 168 time: 0.9262991 Nov 05 14:46:47.258804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41096) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:47.311395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.334588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.342338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.348548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.371894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.373211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.387027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:47.391286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.394426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:47.396563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:47.404347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Pushing event updated for resources: {'Port': ['ID=5008455b-6ccc-489a-ae32-75ca97162f49,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.405534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.406203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.406319 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP d23c29b5-746c-4378-b140-a6f1d684984e disassociated. External IP: 172.26.5.68, port: 079bebef-076c-4962-81c3-4d212688d3ea. Nov 05 14:46:47.406617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 079bebef-076c-4962-81c3-4d212688d3ea owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:47.455567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.460151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Attempting to bind port 5008455b-6ccc-489a-ae32-75ca97162f49 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:47.460633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Attempting to bind port 5008455b-6ccc-489a-ae32-75ca97162f49 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '90f16d9f-0002-4dc2-8fd0-4646d7836558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:47.461095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Attempting to bind port 5008455b-6ccc-489a-ae32-75ca97162f49 on network 4bc0e879-b691-43e1-ba30-4cce655d2888 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:47.466188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:47.466560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Checking segment: {'id': '90f16d9f-0002-4dc2-8fd0-4646d7836558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:47.466959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.467369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Bound using segment: {'id': '90f16d9f-0002-4dc2-8fd0-4646d7836558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:47.467832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Bound port: 5008455b-6ccc-489a-ae32-75ca97162f49, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90f16d9f-0002-4dc2-8fd0-4646d7836558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '4bc0e879-b691-43e1-ba30-4cce655d2888'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:47.468234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.483880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.493077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.514179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Deleting port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:47.514511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.532827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa8e3b31-b04d-465e-98e9-96fd2e926ded,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.552509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] For port 5008455b-6ccc-489a-ae32-75ca97162f49, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:47.556307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] For port 5008455b-6ccc-489a-ae32-75ca97162f49, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5008455b-6ccc-489a-ae32-75ca97162f49,segment=NetworkSegment(90f16d9f-0002-4dc2-8fd0-4646d7836558),segment_id=90f16d9f-0002-4dc2-8fd0-4646d7836558)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:47.562026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.562332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d79ba6f2-195d-4178-80e0-16f51c67326d']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:47.613980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] For port 4ad253c2-24b8-4d9b-ac30-0f4088b73805, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4ad253c2-24b8-4d9b-ac30-0f4088b73805,segment=NetworkSegment(b13c70d9-b21c-4ce0-9588-20cbf7b54cc4),segment_id=b13c70d9-b21c-4ce0-9588-20cbf7b54cc4)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:47.614325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.620937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.622140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4532ab1c-5e60-4007-bb83-8204d9338e44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.5647316 Nov 05 14:46:47.625040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.20.0.1 (4bc0e879-b691-43e1-ba30-4cce655d2888/841b00df-9663-4f2d-9b64-5d0b3f368de5/bf87ba07-eb79-45e2-9c05-aeecd4520da2) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:47.627967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.630158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '66259341-76a4-4d89-852e-cda6fa425cd3') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:47.630453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '66259341-76a4-4d89-852e-cda6fa425cd3') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:47.632213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41098) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:47.634045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa8a606-b6f1-4fdb-8e07-88871febaa8e None None] Pushing event updated for resources: {'Port': ['ID=5008455b-6ccc-489a-ae32-75ca97162f49,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.645397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Calling delete_port for 4ad253c2-24b8-4d9b-ac30-0f4088b73805 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:47.695225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.704374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.705548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.736541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=079bebef-076c-4962-81c3-4d212688d3ea,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.769177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.797438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.799852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.804018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.805464 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-383784e8-7ce8-403d-ac10-8129b1b0ba28 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.8576422 Nov 05 14:46:47.817201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41100) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:47.881123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.920343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 649 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:47.920967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:47.925879 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:47.964785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event deleted for resources: {'Port': ['ID=4ad253c2-24b8-4d9b-ac30-0f4088b73805,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:47.977766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:47.979572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] No DVR routers for this DVR port 4ad253c2-24b8-4d9b-ac30-0f4088b73805 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:48.017785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.019036 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.7248783 Nov 05 14:46:48.024196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41102) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:48.040319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792efd70-5f7b-4f08-bd1b-7f5577672895 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=33e4fbdf-b949-4151-aa5e-4e6943e328ff,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:48.122190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.129148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.148357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.154300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/d79ba6f2-195d-4178-80e0-16f51c67326d HTTP/1.1" status: 204 len: 168 time: 1.3148160 Nov 05 14:46:48.156994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41104) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:48.159093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6345df09-1729-4641-b636-537c3e34e9d9 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=d79ba6f2-195d-4178-80e0-16f51c67326d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:48.159403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:48.204632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.249706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.321635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.353987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5008455b-6ccc-489a-ae32-75ca97162f49 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:48.415849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.425766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.455433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5008455b-6ccc-489a-ae32-75ca97162f49 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:48.456078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.478238 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0355ee60-0a08-4abe-b16f-5eebe7bdf63d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.4528220 Nov 05 14:46:48.492323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc5a9665-de5d-4f5c-a0d4-fd66099e330d']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:48.494643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41106) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:48.532037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-security--1301974377', 'description': 'tempest-security-description-1022348595'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:48.571002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.583476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:48.584037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b13c70d9-b21c-4ce0-9588-20cbf7b54cc4') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:48.622355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 5008455b-6ccc-489a-ae32-75ca97162f49, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5008455b-6ccc-489a-ae32-75ca97162f49,segment=NetworkSegment(90f16d9f-0002-4dc2-8fd0-4646d7836558),segment_id=90f16d9f-0002-4dc2-8fd0-4646d7836558)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:48.623927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.628399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.642967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.684041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=5008455b-6ccc-489a-ae32-75ca97162f49,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:48.698073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=bf87ba07-eb79-45e2-9c05-aeecd4520da2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:48.758784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:48.762835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:48.765440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:48.818978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e00624d-7c1f-44f6-a5f8-b4c99abdca92 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:48.858814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.921317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e00624d-7c1f-44f6-a5f8-b4c99abdca92 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:48.923695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.923821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c71daa3d-3169-48a7-aae5-4391a932ca1d None None] Provisioning complete for port 5008455b-6ccc-489a-ae32-75ca97162f49 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:48.924075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c71daa3d-3169-48a7-aae5-4391a932ca1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.924207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Fanout notify agent at l3_agent the message router_deleted on router b665b76a-c044-47ae-801a-88e40c4c71a9 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:48.943879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:48.944635 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9ffb5b78-dbf1-4710-a24a-459ee38d8a21 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "DELETE /v2.0/routers/b665b76a-c044-47ae-801a-88e40c4c71a9 HTTP/1.1" status: 204 len: 168 time: 1.1264422 Nov 05 14:46:48.952684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41108) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:48.964168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Request body: {'router': {'name': 'tempest-router-1947134537', 'distributed': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:48.999213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8::1 (20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60/189d2f8e-7ed3-4fb9-8612-eb0a1fa59267/9f9e42c3-7988-446b-b2b0-07eadc4ad7cf) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:49.020386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.054943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a2b00bc-5e8c-4144-a5a3-51d45f3e9953 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:49.055902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.056940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.066235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a2b00bc-5e8c-4144-a5a3-51d45f3e9953 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:49.072113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4a2b00bc-5e8c-4144-a5a3-51d45f3e9953 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.9075022 Nov 05 14:46:49.082044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41110) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.093808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-99635223'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:49.098314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:46:49.098504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:46:49.102656 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:46:49.111514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.165573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.188694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:49.214389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:49.224228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-a731804a-d589-4418-89e9-b6bdee7b7aee service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2934391 Nov 05 14:46:49.255977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:49.259557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.260020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:49.261150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:49.261618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.317566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:49.320011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.326497 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] 10.222.0.30 "DELETE /v2.0/networks/bc5a9665-de5d-4f5c-a0d4-fd66099e330d HTTP/1.1" status: 204 len: 168 time: 2.0645156 Nov 05 14:46:49.343163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.351272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:49.352366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:49.369704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372406ea-330f-4263-b7b0-2ff2e66738f6 tempest-DHCPAgentSchedulersTestJSON-1856612599 tempest-DHCPAgentSchedulersTestJSON-1856612599-project] Pushing event deleted for resources: {'Network': ['ID=bc5a9665-de5d-4f5c-a0d4-fd66099e330d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:49.373921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.404985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60', 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '189d2f8e-7ed3-4fb9-8612-eb0a1fa59267'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:46:49.406063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.415720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.418237 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.424795 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-563eabbe-8ee0-4605-b5f5-625696806ed6 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/079bebef-076c-4962-81c3-4d212688d3ea HTTP/1.1" status: 204 len: 168 time: 2.9637783 Nov 05 14:46:49.428755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.428913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:49.429939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7290218-7b23-4f17-a529-0c56fe8c4851 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:49.441508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.443618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58cd2542-297d-416f-a10f-7289229562aa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.4878204 Nov 05 14:46:49.445014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41114) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.446820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41116) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.461394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.464576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.468541 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "PUT /v2.0/security-groups/33e4fbdf-b949-4151-aa5e-4e6943e328ff HTTP/1.1" status: 200 len: 1795 time: 0.9525778 Nov 05 14:46:49.479097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.543999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d39de15f-a364-4f10-8a3a-0807cf441bc0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=33e4fbdf-b949-4151-aa5e-4e6943e328ff,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:49.566344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:49.596514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.597646 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment 1a5fedee-ac0c-40b8-bf52-52e64e219385 of type vlan for network 9125539d-11d2-4fe7-bfff-725c83382e25 Nov 05 14:46:49.657572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-df85c657-8935-4ad0-b13a-d7862d297773 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:49.658931 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-df85c657-8935-4ad0-b13a-d7862d297773 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.3665948 Nov 05 14:46:49.678673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.696488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf71276a-93be-4f1b-a336-b95761ea6210 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/floatingips/d23c29b5-746c-4378-b140-a6f1d684984e HTTP/1.1" status: 200 len: 687 time: 0.2428401 Nov 05 14:46:49.697043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41120) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.704140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.771066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.797787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Allocated IP 2001:db8::2 (20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60/189d2f8e-7ed3-4fb9-8612-eb0a1fa59267/1332bf7d-741b-450b-bb91-c55583f1f4d6) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:49.848976 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:46:49.851129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41124) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.861866 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b2adfd1-9819-40c9-95c8-3332c548d28d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups/33e4fbdf-b949-4151-aa5e-4e6943e328ff HTTP/1.1" status: 200 len: 1795 time: 0.3816471 Nov 05 14:46:49.874458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41126) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:49.902483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:49.932210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.937950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:49.938598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:49.986822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:49.998241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:49.999087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.047045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c5460ea0-87b1-4d84-8cde-2520646003ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.047173 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.9613822 Nov 05 14:46:50.054120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41130) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.067475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-dbccc93b-2d6a-4980-8589-0231765319d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:50.068602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-dbccc93b-2d6a-4980-8589-0231765319d5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.3852310 Nov 05 14:46:50.070159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b820a7-e597-4167-ab27-f3e7d7f2c7ec tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=9125539d-11d2-4fe7-bfff-725c83382e25,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.088382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 827987bf-2fc2-4c5b-9558-8063b104d1b3 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:50.088819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.091814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 9125539d-11d2-4fe7-bfff-725c83382e25 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:50.141810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.144048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.196158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=9f9e42c3-7988-446b-b2b0-07eadc4ad7cf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.204360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.216233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.222732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1224953804'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.264732 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-0a729cdb-117c-4092-8e94-c95983391620 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.1864974 Nov 05 14:46:50.278705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Pushing event updated for resources: {'Port': ['ID=1332bf7d-741b-450b-bb91-c55583f1f4d6,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.282699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5008455b-6ccc-489a-ae32-75ca97162f49 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:50.292446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.326841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.333379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:50.337505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:50.349097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:50.371625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-1d259c0b-7606-4677-b2d1-0391fde15ba7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:50.373468 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-1d259c0b-7606-4677-b2d1-0391fde15ba7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.0947840 Nov 05 14:46:50.374085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.374876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 71601361-11f0-4ad0-9ea4-7ef68468d391 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:50.380534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.385338 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c9b922bb-28a6-421f-ad22-047e55c6113e tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "DELETE /v2.0/routers/71601361-11f0-4ad0-9ea4-7ef68468d391 HTTP/1.1" status: 204 len: 168 time: 0.9214044 Nov 05 14:46:50.385338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:50.386760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41132) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.386948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.398315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Request body: {'router': {'name': 'tempest-router-471315932', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '969a364891e94aa09f47af4535b08fd0'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.438949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 612} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:50.449074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.449508 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment a95a04a2-b731-402b-8a06-c2f47f22a687 of type vlan for network 4344a2b9-5ada-47af-b062-bb134ea469c3 Nov 05 14:46:50.457249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Attempting to bind port 1332bf7d-741b-450b-bb91-c55583f1f4d6 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:46:50.457797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Attempting to bind port 1332bf7d-741b-450b-bb91-c55583f1f4d6 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '72879cc7-b887-4f38-aade-19c22aa0b99a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:46:50.458958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Attempting to bind port 1332bf7d-741b-450b-bb91-c55583f1f4d6 on network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:46:50.467001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-da7c89ca-244a-4901-bb65-f2d76c5842a6 None None] Provisioning complete for port 5008455b-6ccc-489a-ae32-75ca97162f49 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:50.467423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-da7c89ca-244a-4901-bb65-f2d76c5842a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.470414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5008455b-6ccc-489a-ae32-75ca97162f49 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:50.470878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.477716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.479852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.494149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:46:50.494944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Checking segment: {'id': '72879cc7-b887-4f38-aade-19c22aa0b99a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:50.495404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.495894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Bound using segment: {'id': '72879cc7-b887-4f38-aade-19c22aa0b99a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:46:50.496656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Bound port: 1332bf7d-741b-450b-bb91-c55583f1f4d6, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72879cc7-b887-4f38-aade-19c22aa0b99a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:46:50.497139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.505972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.528797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.532528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.536665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/33e4fbdf-b949-4151-aa5e-4e6943e328ff HTTP/1.1" status: 204 len: 168 time: 0.6611893 Nov 05 14:46:50.537318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41134) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.548536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.565425 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d4d1a2be-a2e0-408e-9419-e0af3bfa912a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7b8b091cbe5242eea4eb723a5bba2dce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7103090 Nov 05 14:46:50.571393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41136) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.575235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.581075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.581281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:50.581976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.598911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e19e9c-ed3c-4739-8c2d-90519b7ac785 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=33e4fbdf-b949-4151-aa5e-4e6943e328ff,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.630150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.635606 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-19469d7e-42d8-4217-8a61-14fc3673e3e9 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.2420087 Nov 05 14:46:50.636604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41138) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.647995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] For port 1332bf7d-741b-450b-bb91-c55583f1f4d6, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:46:50.655358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] For port 1332bf7d-741b-450b-bb91-c55583f1f4d6, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1332bf7d-741b-450b-bb91-c55583f1f4d6,segment=NetworkSegment(72879cc7-b887-4f38-aade-19c22aa0b99a),segment_id=72879cc7-b887-4f38-aade-19c22aa0b99a)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:46:50.669512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Request body: {'router': {'distributed': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.674204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-6ab55169-4407-4f8f-80af-a28f50eae110 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:50.676160 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-6ab55169-4407-4f8f-80af-a28f50eae110 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2879348 Nov 05 14:46:50.724609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.726663 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5e6bff9e-ed04-4250-92be-471ac248b179 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1737866 Nov 05 14:46:50.727450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=4344a2b9-5ada-47af-b062-bb134ea469c3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.732195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41140) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.740944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.740944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.752201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a3b226ce-c032-46f1-aaf1-3a7208cc97a8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.5580690 Nov 05 14:46:50.754620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.758200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41142) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.761140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-61a5161c-0f41-4f54-a475-963a3481238a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] delete failed (client error): The resource could not be found. Nov 05 14:46:50.762311 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61a5161c-0f41-4f54-a475-963a3481238a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/33e4fbdf-b949-4151-aa5e-4e6943e328ff HTTP/1.1" status: 404 len: 347 time: 0.0270615 Nov 05 14:46:50.766570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:50.768661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.775820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--571853355'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.776127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 4344a2b9-5ada-47af-b062-bb134ea469c3 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:50.806442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'ports': [{'network_id': '9125539d-11d2-4fe7-bfff-725c83382e25', 'name': 'tempest-port--431275848', 'admin_state_up': True}, {'network_id': '4344a2b9-5ada-47af-b062-bb134ea469c3', 'admin_state_up': False}]} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.806872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'port': {'network_id': '9125539d-11d2-4fe7-bfff-725c83382e25', 'name': 'tempest-port--431275848', 'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.807353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'port': {'network_id': '4344a2b9-5ada-47af-b062-bb134ea469c3', 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:50.857565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-da7c89ca-244a-4901-bb65-f2d76c5842a6 None None] Provisioning complete for port bf87ba07-eb79-45e2-9c05-aeecd4520da2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:50.858115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-da7c89ca-244a-4901-bb65-f2d76c5842a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.868770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 827987bf-2fc2-4c5b-9558-8063b104d1b3 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:50.885265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e2f766-d47c-45c2-909c-4733d80ca17a None None] Pushing event updated for resources: {'Port': ['ID=1332bf7d-741b-450b-bb91-c55583f1f4d6,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.908032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.916432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-da7c89ca-244a-4901-bb65-f2d76c5842a6 None None] Port bf87ba07-eb79-45e2-9c05-aeecd4520da2 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:50.920078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:50.927459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=bf87ba07-eb79-45e2-9c05-aeecd4520da2,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:50.927459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.160555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.234543 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-03938d0a-714f-44be-8b0e-97837a738b67 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5105579 Nov 05 14:46:51.408733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.434803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.435138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.476725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:51.495639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:51.562633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.572078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.621641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=113581) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Nov 05 14:46:51.622260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Router 57c41063-55be-4477-9f74-8922e31df1d7 migrating from provider to provider. {{(pid=113581) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Nov 05 14:46:51.622384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.641541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.647120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'port': 2} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:51.652435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.661799 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d0f1b61-9340-4317-a9c1-242fded6d529 req-797dfcc7-74ae-4fb3-be05-d631f83ba4c7 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3731577 Nov 05 14:46:51.662801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.678574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.681269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.686175 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/19d6160e-0525-4aa2-aee0-fd8628f9d352 HTTP/1.1" status: 204 len: 168 time: 1.1064994 Nov 05 14:46:51.708818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.713023 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.9422469 Nov 05 14:46:51.717594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3114ccc3-1ffb-42ac-af29-b344948c7559 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f310c539-2799-4c94-82e4-7b759b3d2ed0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:51.722133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41148) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:51.746719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': 'f310c539-2799-4c94-82e4-7b759b3d2ed0', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:51.762228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66c68b8-7090-4085-b6d2-63cdcd14da72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19d6160e-0525-4aa2-aee0-fd8628f9d352,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:51.765244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.813105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.839930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.862661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.863465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:51.865351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.002232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:52.011235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=9f9e42c3-7988-446b-b2b0-07eadc4ad7cf,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:52.103500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:52.139811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=827987bf-2fc2-4c5b-9558-8063b104d1b3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:52.214246 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.scheduler.l3_agent_scheduler [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] No L3 agents can host the router 57c41063-55be-4477-9f74-8922e31df1d7 Nov 05 14:46:52.214896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.227457 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:52.282286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6838e72-dd8e-45f3-afc3-ca1c8e153142 None None] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:52.294464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.335089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.338235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.339420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.340026 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f146b561-a122-4265-ac72-8ac8a4ecd13f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/d23c29b5-746c-4378-b140-a6f1d684984e HTTP/1.1" status: 204 len: 168 time: 2.6370282 Nov 05 14:46:52.344023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41154) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.346044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2cbfea75-1ca4-4fdc-b166-4119d898844f admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.352293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '847bc79e-f772-436e-8b2b-a881706bd85f'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:52.402698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] device_id is not set on port 1e708627-e175-4e10-a0db-267bdb23f776 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e6838e72-dd8e-45f3-afc3-ca1c8e153142 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:52.407300 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:52.411543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03f403b4-5591-4b72-89d9-d640fe39a87c None None] Network bc5a9665-de5d-4f5c-a0d4-fd66099e330d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:52.414781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1332bf7d-741b-450b-bb91-c55583f1f4d6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:52.426982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c411edd-5762-4fdb-94e1-aa6f468ce8ef,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:52.434559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:52.441203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f33f736c-235d-4620-976f-c6e65aa35d93 None None] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:52.443299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-af637723-d67a-49b5-b154-914dc5de981d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.0850265 Nov 05 14:46:52.444257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41156) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.445735 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] Sync routers for ids ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:52.466544 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] Routers {'caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:52.473246 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:52.496869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.500671 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-05ee9575-1401-4e8e-a27a-af36d77f1e63 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7653935 Nov 05 14:46:52.506176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41158) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.534372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d402da0-4eea-4568-b402-6157608a34ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:52.536950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8d402da0-4eea-4568-b402-6157608a34ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports/bf87ba07-eb79-45e2-9c05-aeecd4520da2 HTTP/1.1" status: 200 len: 910 time: 0.0890071 Nov 05 14:46:52.541259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41160) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.571407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.571808 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:52.581533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.584771 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] Routers {'caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:52.586615 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:52.625073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 0f311556-941e-4003-8a09-cc61a2768eb9 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:46:52.625627 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:52.626447 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0a58b4e-f0d4-4b43-a907-9180156aff16 None None] The sync data for ids ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:52.628955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.630369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.636185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.640192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/0c411edd-5762-4fdb-94e1-aa6f468ce8ef HTTP/1.1" status: 204 len: 168 time: 0.1324770 Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-03f403b4-5591-4b72-89d9-d640fe39a87c None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:46:52.644956 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:52.648195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41162) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.649003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f175448d-a371-4558-ad01-a9f8a3a992bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.668641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Provisioning complete for port 1332bf7d-741b-450b-bb91-c55583f1f4d6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:52.669020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.680190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d9b013-673e-4c9e-ac6f-944cb9748a17 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0c411edd-5762-4fdb-94e1-aa6f468ce8ef,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:52.742559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8e26693-6c5f-474e-ac81-bf66d994f232 None None] DHCP port deletion for bc5a9665-de5d-4f5c-a0d4-fd66099e330d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f33f736c-235d-4620-976f-c6e65aa35d93 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:46:52.762830 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:46:52.811983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8db2fa93-93af-4665-ace6-f3bc95d4ef7d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1594975 Nov 05 14:46:52.814501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41164) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.834109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1332bf7d-741b-450b-bb91-c55583f1f4d6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:52.834594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.854612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:52.863013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-64acd7dd-ff16-4828-bdd1-edf44493ca4c tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/0f311556-941e-4003-8a09-cc61a2768eb9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2231517 Nov 05 14:46:52.870512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41166) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:52.875653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] Sync routers for ids ['0f311556-941e-4003-8a09-cc61a2768eb9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:52.902150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.908483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Hosts for router 57c41063-55be-4477-9f74-8922e31df1d7: [] {{(pid=113581) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Nov 05 14:46:52.973306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:52.992988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Hosts for other DVR routers connected to router 57c41063-55be-4477-9f74-8922e31df1d7: set() {{(pid=113581) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Nov 05 14:46:52.996224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.000354 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4c87ebc3-093e-4151-aeef-08cfb247f3ce tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "PUT /v2.0/routers/57c41063-55be-4477-9f74-8922e31df1d7 HTTP/1.1" status: 200 len: 716 time: 2.3437164 Nov 05 14:46:53.003846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41168) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.008911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.067838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0d02aa7-b765-4e2f-b8a9-adb9fce99034 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:53.072028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f0d02aa7-b765-4e2f-b8a9-adb9fce99034 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports/9f9e42c3-7988-446b-b2b0-07eadc4ad7cf HTTP/1.1" status: 200 len: 911 time: 0.1971898 Nov 05 14:46:53.072028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.074410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.075887 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/f310c539-2799-4c94-82e4-7b759b3d2ed0 HTTP/1.1" status: 204 len: 168 time: 0.2604351 Nov 05 14:46:53.077041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41170) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.083841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41172) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.089466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '189d2f8e-7ed3-4fb9-8612-eb0a1fa59267'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:53.098560 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a20707e-eb7e-43a0-a875-636d0861fda4 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "GET /v2.0/routers/57c41063-55be-4477-9f74-8922e31df1d7 HTTP/1.1" status: 200 len: 716 time: 0.0894439 Nov 05 14:46:53.106084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41174) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.124317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] For port 1332bf7d-741b-450b-bb91-c55583f1f4d6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1332bf7d-741b-450b-bb91-c55583f1f4d6,segment=NetworkSegment(72879cc7-b887-4f38-aade-19c22aa0b99a),segment_id=72879cc7-b887-4f38-aade-19c22aa0b99a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:53.129082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] Routers {'0f311556-941e-4003-8a09-cc61a2768eb9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:53.129915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['0f311556-941e-4003-8a09-cc61a2768eb9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:53.134407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.172851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:53.186509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.196657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8219df-b752-43f1-b6b4-afc560c675fa tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f310c539-2799-4c94-82e4-7b759b3d2ed0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:53.260732 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7b4ecbe3-da4d-45ea-aca4-cddc98acfacc tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1249511 Nov 05 14:46:53.266353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41180) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.273290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--2117156596'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:53.315285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] device_id is not set on port d53f96ca-e1b6-46de-9bfc-51a41a523b6e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:46:53.327498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] Routers {'0f311556-941e-4003-8a09-cc61a2768eb9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:53.328281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['0f311556-941e-4003-8a09-cc61a2768eb9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:53.330277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Provisioning complete for port 5008455b-6ccc-489a-ae32-75ca97162f49 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:53.330795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.385817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.400055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.417699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Pushing event updated for resources: {'Port': ['ID=1332bf7d-741b-450b-bb91-c55583f1f4d6,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:53.433771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:53.434483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68121e73-98ba-4150-baed-37c463c6bc6c None None] The sync data for ids ['0f311556-941e-4003-8a09-cc61a2768eb9'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:53.459091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.460415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f8e0bd1-9672-4e8a-a3c0-ecaa7c9cd3f8 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:53.535966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.541248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.579506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:53.592977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f8e0bd1-9672-4e8a-a3c0-ecaa7c9cd3f8 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:53.595100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Provisioning complete for port bf87ba07-eb79-45e2-9c05-aeecd4520da2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:53.595652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.603671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.605073 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b8c5b6a3-4e71-4fe1-a808-c17cd800cd44 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3376331 Nov 05 14:46:53.628922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2cbfea75-1ca4-4fdc-b166-4119d898844f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.629802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41182) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.639745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6fe861c3-865c-4181-9cff-a6681747c867 tempest-RoutersTestDVR-866900250 tempest-RoutersTestDVR-866900250-project] 10.222.0.30 "GET /v2.0/routers/57c41063-55be-4477-9f74-8922e31df1d7 HTTP/1.1" status: 200 len: 682 time: 0.5304253 Nov 05 14:46:53.641884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41184) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.646785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:53.657400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2cbfea75-1ca4-4fdc-b166-4119d898844f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.680577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-83a271ff-5e9b-4d7e-ad22-71f50571c1b0 None None] Port bf87ba07-eb79-45e2-9c05-aeecd4520da2 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:53.761003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.787789 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2cbfea75-1ca4-4fdc-b166-4119d898844f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=93151e0135fb496da4bc6b52256e8e35&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5715580 Nov 05 14:46:53.796087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbfea75-1ca4-4fdc-b166-4119d898844f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aab9cbb7-96b4-44cd-9a18-3e476ba81d88,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:53.809690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41186) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:53.834493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.842486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.846666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Provisioning complete for port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:53.847046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.898127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:53.908889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.910233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Provisioning complete for port bf87ba07-eb79-45e2-9c05-aeecd4520da2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:53.910622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:53.957595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3f008063-b62f-40e8-811d-fbab7942a309 None None] Port bf87ba07-eb79-45e2-9c05-aeecd4520da2 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:54.042760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.046465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.050096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.063201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.081585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.093891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.163100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.163635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 57c41063-55be-4477-9f74-8922e31df1d7 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:54.163764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=62248d5e-60fa-44d2-b071-2f9490536d2e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:54.168823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.174205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.175340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-40a2a434-cc64-4c52-bf6e-70484ab7a191 tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "DELETE /v2.0/routers/57c41063-55be-4477-9f74-8922e31df1d7 HTTP/1.1" status: 204 len: 168 time: 0.5325203 Nov 05 14:46:54.184575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41188) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:54.197845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.201664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Request body: {'router': {'name': 'tempest-router-1593328403', 'distributed': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:54.202187 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ef692cd4-6c06-4dc4-9614-0b38628a8b59 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5711243 Nov 05 14:46:54.203805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41190) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:54.212836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:54.220814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Port': ['ID=1e708627-e175-4e10-a0db-267bdb23f776,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:54.263353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.40 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d908586d-349a-4b14-bdfc-42352bb100c7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:54.292016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Checking segment: {'id': '1a5fedee-ac0c-40b8-bf52-52e64e219385', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '9125539d-11d2-4fe7-bfff-725c83382e25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:54.292510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network hostable DHCP agents. Network: 9125539d-11d2-4fe7-bfff-725c83382e25, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:54.300431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1332bf7d-741b-450b-bb91-c55583f1f4d6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:46:54.312895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.314915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.373678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1332bf7d-741b-450b-bb91-c55583f1f4d6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:54.376501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.508122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network 9125539d-11d2-4fe7-bfff-725c83382e25 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:54.516053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4ad253c2-24b8-4d9b-ac30-0f4088b73805 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:46:54.527832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.529001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.539335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 4ad253c2-24b8-4d9b-ac30-0f4088b73805 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:46:54.539735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4ad253c2-24b8-4d9b-ac30-0f4088b73805 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:46:54.548295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 9125539d-11d2-4fe7-bfff-725c83382e25) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:54.595558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:54.596308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.607312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.636433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97e7df09-faa5-439c-a0bd-7d1e8a787df3 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:46:54.640244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.647283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.661737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.664312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.667818 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/aab9cbb7-96b4-44cd-9a18-3e476ba81d88 HTTP/1.1" status: 204 len: 168 time: 0.8548632 Nov 05 14:46:54.683453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020e94aa-6e93-4746-ada9-81c7be039d8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aab9cbb7-96b4-44cd-9a18-3e476ba81d88,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:54.689403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.694012 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d4b600b4-e1c2-4bf9-97c0-4677f8fb32fa tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.5034750 Nov 05 14:46:54.696068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41194) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:54.745407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1d1ca00b-953f-45b3-9c08-aae3f371f1ab None None] Provisioning complete for port 1332bf7d-741b-450b-bb91-c55583f1f4d6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:54.745772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1d1ca00b-953f-45b3-9c08-aae3f371f1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.746879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.790046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.796626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:54.797368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.798739 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/ports/9f9e42c3-7988-446b-b2b0-07eadc4ad7cf HTTP/1.1" status: 200 len: 911 time: 1.7172208 Nov 05 14:46:54.845590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.846523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97e7df09-faa5-439c-a0bd-7d1e8a787df3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:46:54.848227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:54.849065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a00e1bc7-ecbc-437b-ad82-aa6e31305762 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=9f9e42c3-7988-446b-b2b0-07eadc4ad7cf,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:54.855367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.937585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:54.975138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1d1ca00b-953f-45b3-9c08-aae3f371f1ab None None] Provisioning complete for port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:54.975909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1d1ca00b-953f-45b3-9c08-aae3f371f1ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.006644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.012925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2da9729a-6e72-48b5-a4c5-d578c798f510,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:55.040738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.045579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7a9c068d-59ea-4e6f-83e8-b9a1a6d0a891 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.8329215 Nov 05 14:46:55.050433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41200) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:55.051111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Port': ['ID=d53f96ca-e1b6-46de-9bfc-51a41a523b6e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:55.058998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:55.059242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1d1ca00b-953f-45b3-9c08-aae3f371f1ab None None] Port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:55.120732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Checking segment: {'id': 'a95a04a2-b731-402b-8a06-c2f47f22a687', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 612, 'network_id': '4344a2b9-5ada-47af-b062-bb134ea469c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:46:55.121227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network hostable DHCP agents. Network: 4344a2b9-5ada-47af-b062-bb134ea469c3, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:46:55.124794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.127789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.143605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.156971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.239884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.240389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Fanout notify agent at l3_agent the message router_deleted on router c3c5453b-08dc-43a4-b01d-fb998ca9c9b7 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:55.243740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network 4344a2b9-5ada-47af-b062-bb134ea469c3 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:46:55.246334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.247098 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-51643d0c-e4e3-4607-ac95-a776158648fe tempest-RoutersTestDVR-858843102 tempest-RoutersTestDVR-858843102-project-admin] 10.222.0.30 "DELETE /v2.0/routers/c3c5453b-08dc-43a4-b01d-fb998ca9c9b7 HTTP/1.1" status: 204 len: 168 time: 0.5500114 Nov 05 14:46:55.263145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:55.292153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:55.297750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:55.302196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=d908586d-349a-4b14-bdfc-42352bb100c7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:55.327240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 4344a2b9-5ada-47af-b062-bb134ea469c3) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:55.341629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:55.347694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:55.352652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:55.353348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.374466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.389745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.419767 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f677f599-baef-4ad4-92e8-edcb35e5bc4c tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 4.6154144 Nov 05 14:46:55.441681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41208) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:55.499200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=495517f7-7903-4180-974f-ae45ad04e267,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:55.530429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.546847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.547880 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c8f9fcae-958c-4018-b928-62fbe30c8969 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4938316 Nov 05 14:46:55.570608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41214) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:55.570980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41216) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:55.573896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port bf87ba07-eb79-45e2-9c05-aeecd4520da2 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:55.575137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.576924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:55.673800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.741466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa2d2c16-c932-4f34-a9df-63eb873668b8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:55.749040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa2d2c16-c932-4f34-a9df-63eb873668b8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:55.753774 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aa2d2c16-c932-4f34-a9df-63eb873668b8 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.3066304 Nov 05 14:46:55.754234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41224) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:55.794650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.825556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c1b9f95-c543-4b45-9a34-8c3e32860c9c admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.870136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for bf87ba07-eb79-45e2-9c05-aeecd4520da2 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:55.876571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.952386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:55.977375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.051267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c83d92e-49f6-4342-9f21-fdcde7dbd32a,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:56.055456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Deleting port 1e708627-e175-4e10-a0db-267bdb23f776 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:56.055802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.066459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-809a681e-1fce-4f1d-a2cd-3c76a1415d88 None None] Network 9125539d-11d2-4fe7-bfff-725c83382e25 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:56.070923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-246adbeb-9be9-4823-8ef7-75bf2e1f46c4 None None] Network 4344a2b9-5ada-47af-b062-bb134ea469c3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:56.191105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3cace617-621e-41a3-aa5b-d25d2ba4eb51 None None] Provisioning complete for port 1332bf7d-741b-450b-bb91-c55583f1f4d6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:56.191105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3cace617-621e-41a3-aa5b-d25d2ba4eb51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.208948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c1b9f95-c543-4b45-9a34-8c3e32860c9c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.214746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.219525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4036d5cd-7347-4d77-b2e5-928f60ab47b7 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6475968 Nov 05 14:46:56.220355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:56.251750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:56.260951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c1b9f95-c543-4b45-9a34-8c3e32860c9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.291809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.305200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3c1b9f95-c543-4b45-9a34-8c3e32860c9c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=969a364891e94aa09f47af4535b08fd0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7317259 Nov 05 14:46:56.323896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41238) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:56.341917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3cace617-621e-41a3-aa5b-d25d2ba4eb51 None None] Provisioning complete for port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:46:56.342384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3cace617-621e-41a3-aa5b-d25d2ba4eb51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.358503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Calling delete_port for 1e708627-e175-4e10-a0db-267bdb23f776 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:56.386265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3cace617-621e-41a3-aa5b-d25d2ba4eb51 None None] Port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:46:56.407750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.423663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.441200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.449430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1b9f95-c543-4b45-9a34-8c3e32860c9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fe6c354-2cce-489c-a548-680c239497ee,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:56.473200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:56.473717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.500052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.500359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=bf87ba07-eb79-45e2-9c05-aeecd4520da2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:56.593593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.615921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.623163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.644839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.659648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.663489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2981068c-8f6a-4761-9638-225c3d481a2f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:56.696658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Port': ['ID=1e708627-e175-4e10-a0db-267bdb23f776,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:56.701586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.703092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.705700 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-212dc855-5c68-49c0-865e-fe0d343bf1f2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4586842 Nov 05 14:46:56.707842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:56.708751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 9f9e42c3-7988-446b-b2b0-07eadc4ad7cf owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:56.728264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.733102 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f548b64b-680c-4c35-bbd1-b113e9e12aaa tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/ports/1e708627-e175-4e10-a0db-267bdb23f776 HTTP/1.1" status: 204 len: 168 time: 0.9706755 Nov 05 14:46:56.736496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41252) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:56.762731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.798827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.801454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:56.805707 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9fe6c354-2cce-489c-a548-680c239497ee HTTP/1.1" status: 204 len: 168 time: 0.4729526 Nov 05 14:46:56.924583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fabffff-03f5-40de-82ce-bdb817ab21df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fe6c354-2cce-489c-a548-680c239497ee,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:57.074459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:57.082393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.161029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.192223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.221018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.238970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:57.249264 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] Sync routers for ids ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:57.256896 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0195c764-d9dc-4694-9ba9-e6a7c8178547 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.7089460 Nov 05 14:46:57.263375 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] Routers {'caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:57.264156 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:57.281274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41264) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.281649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41266) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.302632 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:57.313566 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] Routers {'caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:57.314611 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:57.336986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.339427 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0d0b8b21-ef03-4ad3-8f57-43b63486d75e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 HTTP/1.1" status: 200 len: 205 time: 0.0551114 Nov 05 14:46:57.344915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41268) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.352928 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:57.353909 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41acfcf2-2093-4ebe-a8d2-5294445890a9 None None] The sync data for ids ['caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:57.356012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bdfa4027-a11d-4c6d-8048-09ccf3f302a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.362565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=d908586d-349a-4b14-bdfc-42352bb100c7,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:57.392986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=9f9e42c3-7988-446b-b2b0-07eadc4ad7cf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:57.432351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.436997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.441780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/2981068c-8f6a-4761-9638-225c3d481a2f HTTP/1.1" status: 204 len: 168 time: 0.7273195 Nov 05 14:46:57.442545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41272) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.459769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.515330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.563024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593fcfcf-c702-439c-bed9-553d46e0c1eb tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2981068c-8f6a-4761-9638-225c3d481a2f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:57.573472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Deleting port d53f96ca-e1b6-46de-9bfc-51a41a523b6e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:57.573823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.578871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.709525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-31197038-43fc-4601-8915-d03f17736f0a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.2303696 Nov 05 14:46:57.738639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41278) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.738981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41280) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:57.767120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.791484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Calling delete_port for d53f96ca-e1b6-46de-9bfc-51a41a523b6e owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:57.845745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.908163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.925594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:57.964558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 0f311556-941e-4003-8a09-cc61a2768eb9 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:57.977777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.989889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.991017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/0c83d92e-49f6-4342-9f21-fdcde7dbd32a HTTP/1.1" status: 204 len: 168 time: 0.2480531 Nov 05 14:46:57.993390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:57.999735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41284) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.021985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28ebaaa-da18-4847-8b12-abe35e416928 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0c83d92e-49f6-4342-9f21-fdcde7dbd32a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:58.033957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.038611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.045444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP 39a923a3-c759-4e2d-a8f4-d2df55d740f1 associated. External IP: 172.26.5.40, port: 847bc79e-f772-436e-8b2b-a881706bd85f. Nov 05 14:46:58.155534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.157931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.158488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:58.165888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.170068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-93c90ed8-309a-4001-9743-27cd5ebb557b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 HTTP/1.1" status: 204 len: 168 time: 0.8241901 Nov 05 14:46:58.172759 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-da3b6c52-91b9-46ef-9d06-bc0b9189b83d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.1707230 Nov 05 14:46:58.176158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41286) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.176519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41288) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.183014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bdfa4027-a11d-4c6d-8048-09ccf3f302a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.195135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:58.205281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] Sync routers for ids ['0f311556-941e-4003-8a09-cc61a2768eb9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:58.212338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bdfa4027-a11d-4c6d-8048-09ccf3f302a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.217049 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] Routers {'0f311556-941e-4003-8a09-cc61a2768eb9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:58.218054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['0f311556-941e-4003-8a09-cc61a2768eb9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:58.224359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ea297f11-61bd-4729-a91b-6cdf696598c8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/0f311556-941e-4003-8a09-cc61a2768eb9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3702049 Nov 05 14:46:58.225548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41290) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.247731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Port': ['ID=d53f96ca-e1b6-46de-9bfc-51a41a523b6e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:58.255396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:58.265859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] Routers {'0f311556-941e-4003-8a09-cc61a2768eb9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:58.267292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['0f311556-941e-4003-8a09-cc61a2768eb9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:58.269962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.275394 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-831a0cd2-192c-4b70-bd7b-0723ba4d60a3 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/ports/d53f96ca-e1b6-46de-9bfc-51a41a523b6e HTTP/1.1" status: 204 len: 168 time: 1.5374982 Nov 05 14:46:58.285004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41292) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.296373 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd4a2fc8-eca0-40cb-977a-557f49c0cf4a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=0f311556-941e-4003-8a09-cc61a2768eb9 HTTP/1.1" status: 200 len: 205 time: 0.0628607 Nov 05 14:46:58.300309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41294) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.304885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bdfa4027-a11d-4c6d-8048-09ccf3f302a0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9b52eebbc96a4a599c8ef2091ccf8372&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0188360 Nov 05 14:46:58.310964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfa4027-a11d-4c6d-8048-09ccf3f302a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=842d18c9-5db7-4ef8-bcb9-b7a2a9f2a5e3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:58.312370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:58.313059 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-185130ed-98ce-43ce-8499-6bd86c636fd4 None None] The sync data for ids ['0f311556-941e-4003-8a09-cc61a2768eb9'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:58.316915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41296) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.329865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.358822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.367054 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a4c25eaf-da1c-46b6-b5ba-b860cea8e96d tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0772343 Nov 05 14:46:58.372576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 841b00df-9663-4f2d-9b64-5d0b3f368de5 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:58.376495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41298) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.381240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1125422432'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:58.392705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.454358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.467749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.480783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.485534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.486728 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/495517f7-7903-4180-974f-ae45ad04e267 HTTP/1.1" status: 204 len: 168 time: 0.3059969 Nov 05 14:46:58.500506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41300) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.511605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:58.515102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.521488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37b01630-3493-4ab1-9a97-25d088a08a6a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=495517f7-7903-4180-974f-ae45ad04e267,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:58.550046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.603430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 631} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:58.634657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.634657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment a33eff58-78b9-4112-a457-aac5d6ebbbc9 of type vlan for network 12fc43d1-538f-48b7-b772-7b5de0bc0925 Nov 05 14:46:58.658485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.715245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.720101 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ca52f54-8b76-4b4b-8d4c-c9a32f589741 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.2150183 Nov 05 14:46:58.720277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.722056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41304) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.755546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:46:58.762825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.769884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.778495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.818716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.822264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Allocated IP 172.26.5.236 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/94044d6f-6897-42d8-a7a8-264bdd92cd39) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:46:58.836420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.841936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:58.842516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.848714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.887684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.888318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 0f311556-941e-4003-8a09-cc61a2768eb9 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:46:58.895266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.896358 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d65d8314-0cf9-4221-8bef-00ad95786d1a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/0f311556-941e-4003-8a09-cc61a2768eb9 HTTP/1.1" status: 204 len: 168 time: 0.5948272 Nov 05 14:46:58.899980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41306) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.921567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:58.949880 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.5699487 Nov 05 14:46:58.951708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41308) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:58.958706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2117876553'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:59.005135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=841b00df-9663-4f2d-9b64-5d0b3f368de5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.009804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6a6daf-10b8-49a4-a71c-74e88662ea67 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=12fc43d1-538f-48b7-b772-7b5de0bc0925,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.012760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.016670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.019933 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4a606999-75c4-478d-ab89-b1c3a490566e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/841b00df-9663-4f2d-9b64-5d0b3f368de5 HTTP/1.1" status: 204 len: 168 time: 0.8403423 Nov 05 14:46:59.026527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41310) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.026738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab424276-750c-4346-bdda-288208b6c9cb None None] Network 4bc0e879-b691-43e1-ba30-4cce655d2888 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:46:59.027250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.030993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/2da9729a-6e72-48b5-a4c5-d578c798f510 HTTP/1.1" status: 204 len: 168 time: 0.2876494 Nov 05 14:46:59.031127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 12fc43d1-538f-48b7-b772-7b5de0bc0925 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:59.031213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.034221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.035010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41312) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.035478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/842d18c9-5db7-4ef8-bcb9-b7a2a9f2a5e3 HTTP/1.1" status: 204 len: 168 time: 0.7176335 Nov 05 14:46:59.054514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 189d2f8e-7ed3-4fb9-8612-eb0a1fa59267 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:46:59.083883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.107094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.140110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ca8ecd7-45ab-41cf-88df-b0353049b1ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=842d18c9-5db7-4ef8-bcb9-b7a2a9f2a5e3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.152672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7019246-5821-4b59-8e1e-0d9b2b41ec2e tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2da9729a-6e72-48b5-a4c5-d578c798f510,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.161959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:46:59.166508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:59.169950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.174168 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:46:59.190041 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:59.194761 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:59.227154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.233000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.234188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.265451 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6236a0d6-433d-4c9b-a38f-7faeec97a520 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.2270417 Nov 05 14:46:59.268592 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:59.285657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.288528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.290099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:46:59.291122 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:59.307321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:46:59.310401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:46:59.314317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:46:59.327705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] DHCP port deletion for 4bc0e879-b691-43e1-ba30-4cce655d2888 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:46:59.358347 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:46:59.359133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03807a86-a461-4a7d-95aa-2f40531e6f15 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:46:59.366238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 646} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:59.383043 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-97820f44-97e1-4313-a0f5-0af5efb63b48 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 7.0342064 Nov 05 14:46:59.383340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=94044d6f-6897-42d8-a7a8-264bdd92cd39,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.385870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41322) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.393460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-1900745837'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:46:59.397074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Deleting port 5008455b-6ccc-489a-ae32-75ca97162f49 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:59.397733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.413374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.414363 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Added segment ef5347d6-e1fa-4bf0-adb5-8a536be5c06a of type vlan for network 37a37ece-8bc6-46d8-affe-bf36a1c2defe Nov 05 14:46:59.433356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.458309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.472412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:46:59.472629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.482127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.504410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] For port 5008455b-6ccc-489a-ae32-75ca97162f49, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5008455b-6ccc-489a-ae32-75ca97162f49,segment=NetworkSegment(90f16d9f-0002-4dc2-8fd0-4646d7836558),segment_id=90f16d9f-0002-4dc2-8fd0-4646d7836558)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:59.506378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.531255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 648} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:46:59.537355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.540334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Calling delete_port for 5008455b-6ccc-489a-ae32-75ca97162f49 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:59.543468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.572265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.586407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.586796 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Added segment 513e292e-0597-449f-afd4-5834a3410799 of type vlan for network e52cb240-363f-413c-995e-29ff18f19dea Nov 05 14:46:59.598171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.613461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.614685 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/62248d5e-60fa-44d2-b071-2f9490536d2e HTTP/1.1" status: 204 len: 168 time: 0.3229685 Nov 05 14:46:59.621747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41330) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.656525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf87cf6-5d7e-447d-ad5b-cc960cbc8c2b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=62248d5e-60fa-44d2-b071-2f9490536d2e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.662518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.663008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.666638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.669375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:59.669998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.703751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] Pushing event deleted for resources: {'Port': ['ID=5008455b-6ccc-489a-ae32-75ca97162f49,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.705698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.714576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:46:59.715566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.724550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2a3ed11-4042-4cb9-b5c9-cb675ce62944 None None] No DVR routers for this DVR port 5008455b-6ccc-489a-ae32-75ca97162f49 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:46:59.750256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 5008455b-6ccc-489a-ae32-75ca97162f49 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:46:59.750613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.777853 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f157dcff-4703-44ea-85a9-930b73ce8063 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1549215 Nov 05 14:46:59.791864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41336) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.824563 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8586125 Nov 05 14:46:59.824563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.842184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c2dc53e-76f0-49cf-9f83-cff7ce09ef65 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Network': ['ID=37a37ece-8bc6-46d8-affe-bf36a1c2defe,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.855444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 37a37ece-8bc6-46d8-affe-bf36a1c2defe details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:46:59.867597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=189d2f8e-7ed3-4fb9-8612-eb0a1fa59267,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:46:59.877557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.884370 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6d76e106-4d31-4622-95ef-36f66d54dcf2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/189d2f8e-7ed3-4fb9-8612-eb0a1fa59267 HTTP/1.1" status: 204 len: 168 time: 0.9802465 Nov 05 14:46:59.885678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41340) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:46:59.894233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 5008455b-6ccc-489a-ae32-75ca97162f49, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:46:59.894562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.949415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 5008455b-6ccc-489a-ae32-75ca97162f49 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:46:59.959900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Port 5008455b-6ccc-489a-ae32-75ca97162f49 was not found and therefore no delete operation was performed {{(pid=113581) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:46:59.981691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:46:59.983686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41344) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:00.003732 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.6142092 Nov 05 14:47:00.006829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41346) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:00.012353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'subnets': [{'network_id': '12fc43d1-538f-48b7-b772-7b5de0bc0925', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1476692167', 'ip_version': 4}, {'network_id': '37a37ece-8bc6-46d8-affe-bf36a1c2defe', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.012902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'subnet': {'network_id': '12fc43d1-538f-48b7-b772-7b5de0bc0925', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1476692167', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.013620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Request body: {'subnet': {'network_id': '37a37ece-8bc6-46d8-affe-bf36a1c2defe', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.017563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'subnet': {'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.018977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e916f7d-10f4-4db3-aef2-576b4f618dc3 None None] Network 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:00.120829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=5008455b-6ccc-489a-ae32-75ca97162f49,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:00.132729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port 5008455b-6ccc-489a-ae32-75ca97162f49 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:00.142199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.172851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.176821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.263076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.265896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.267132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac HTTP/1.1" status: 204 len: 168 time: 0.4742730 Nov 05 14:47:00.275686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41354) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:00.281418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:00.285444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5008455b-6ccc-489a-ae32-75ca97162f49 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:00.285930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.324433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5008455b-6ccc-489a-ae32-75ca97162f49 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:00.324826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5008455b-6ccc-489a-ae32-75ca97162f49 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:00.360770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41356) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:00.380498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f22f871-48b6-49e8-8d62-52638a6c17b9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Network': ['ID=e52cb240-363f-413c-995e-29ff18f19dea,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:00.398811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network e52cb240-363f-413c-995e-29ff18f19dea details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:00.402858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a9b417-c6ac-4633-a845-698c95b66b45 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c52e1d5-a8fb-4f4f-9c52-217853b7a4ac,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:00.433010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] DHCP port deletion for 20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:00.581058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Deleting port 1332bf7d-741b-450b-bb91-c55583f1f4d6 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:00.581529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.646531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] For port 1332bf7d-741b-450b-bb91-c55583f1f4d6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1332bf7d-741b-450b-bb91-c55583f1f4d6,segment=NetworkSegment(72879cc7-b887-4f38-aade-19c22aa0b99a),segment_id=72879cc7-b887-4f38-aade-19c22aa0b99a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:00.646936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.654200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-4d6e1552-dbd5-4581-b3e6-15ab65fbc29e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:00.655738 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-4d6e1552-dbd5-4581-b3e6-15ab65fbc29e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.7037764 Nov 05 14:47:00.665720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Calling delete_port for 1332bf7d-741b-450b-bb91-c55583f1f4d6 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:00.686526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.699307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'networks': [{'name': 'tempest-network--416163868'}, {'name': 'tempest-network--205638757'}]} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.699620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-network--416163868'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.700331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-network--205638757'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.704587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98405b5-a4d8-45d4-a04b-b0405cd95356 req-39540757-6f15-4acd-b4da-1b4bcce480ed tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:00.706849 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c98405b5-a4d8-45d4-a04b-b0405cd95356 req-39540757-6f15-4acd-b4da-1b4bcce480ed tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.7278416 Nov 05 14:47:00.741612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.750525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.751151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.761432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'network': 2} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:00.765923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.776349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] Pushing event deleted for resources: {'Port': ['ID=1332bf7d-741b-450b-bb91-c55583f1f4d6,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:00.779896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f2caa65-4b89-4fca-b73b-5453a9f66364 None None] No DVR routers for this DVR port 1332bf7d-741b-450b-bb91-c55583f1f4d6 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:00.815793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4bc0e879-b691-43e1-ba30-4cce655d2888']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:00.821920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.854260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90f16d9f-0002-4dc2-8fd0-4646d7836558') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:00.854565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90f16d9f-0002-4dc2-8fd0-4646d7836558') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:00.865324 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ed948e0-5708-4d91-a740-222add3c8369 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2452042 Nov 05 14:47:00.876293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41360) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:00.884989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--2040651295'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:00.891613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.911906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=94044d6f-6897-42d8-a7a8-264bdd92cd39,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:00.931485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.934062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.939552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Made reservation on behalf of e0f0c475b7f04f86a8e4cb4285c8b0d0 for: {'subnet': 2} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:00.944090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.944431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:00.979133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c98405b5-a4d8-45d4-a04b-b0405cd95356 req-9698ee21-f6a7-449f-a9fa-bf5b37d52fcf tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2391636 Nov 05 14:47:00.980130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 616 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:00.980558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.011156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:01.012533 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:01.025097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.026314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-78f7a3b7-9751-4edf-b52e-5769497894c9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.2821817 Nov 05 14:47:01.032406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.034171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41362) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:01.048894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-140249046'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:01.060845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-629561d7-3e55-4e30-80bc-52236c311b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:01.062332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-629561d7-3e55-4e30-80bc-52236c311b0d service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.3864141 Nov 05 14:47:01.134163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 1332bf7d-741b-450b-bb91-c55583f1f4d6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:01.134482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.137503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.147981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.159835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.160289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.162034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Made reservation on behalf of c42c986e04e54c80b6aef0970f0c38a0 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:01.165483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.174844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Subnet': ['ID=ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.196294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.199485 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/4bc0e879-b691-43e1-ba30-4cce655d2888 HTTP/1.1" status: 204 len: 168 time: 2.1698310 Nov 05 14:47:01.203554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.207644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41364) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:01.216042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-380024527', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:01.236369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f63a58-ce13-4ddd-8101-4ab375067798 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=4bc0e879-b691-43e1-ba30-4cce655d2888,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.245182 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-898d29c1-0ddf-46a5-9f99-75a1ac2f1367 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.1733129 Nov 05 14:47:01.260776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Checking segment: {'id': '513e292e-0597-449f-afd4-5834a3410799', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:01.261143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network hostable DHCP agents. Network: e52cb240-363f-413c-995e-29ff18f19dea, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:01.277547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f5ae4648-19d8-422a-92ec-c93af0261d88,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.292438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 1332bf7d-741b-450b-bb91-c55583f1f4d6, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:01.292864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.294854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 604} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:01.298389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.314991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.316277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 1332bf7d-741b-450b-bb91-c55583f1f4d6 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:01.325667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Port 1332bf7d-741b-450b-bb91-c55583f1f4d6 was not found and therefore no delete operation was performed {{(pid=113581) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:47:01.328138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.328475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment 59c4a7a8-ae55-4c7e-874e-d6c8b1541c80 of type vlan for network 45717159-a87b-470e-a5e2-c1b639e45ec5 Nov 05 14:47:01.333097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.345925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.346892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.358496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-7b5a2985-bfce-4bb6-a212-a26f39e0a778 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:01.359980 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-7b5a2985-bfce-4bb6-a212-a26f39e0a778 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.1033630 Nov 05 14:47:01.372604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network e52cb240-363f-413c-995e-29ff18f19dea is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:01.398518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=1332bf7d-741b-450b-bb91-c55583f1f4d6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.410713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.412923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5318704 Nov 05 14:47:01.425841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41366) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:01.430220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 1332bf7d-741b-450b-bb91-c55583f1f4d6 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:01.442225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '4a234d4f-6ef6-432a-984f-66e46d9cd7f8', 'direction': 'ingress', 'protocol': 17}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:01.448907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, e52cb240-363f-413c-995e-29ff18f19dea) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:01.453616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:01.454209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.458286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-384b7ff2-01d0-4ab3-8598-1ab3f2856aaf None None] Network e52cb240-363f-413c-995e-29ff18f19dea requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:01.467859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ccdc8c-7b9c-4e78-a082-e6a13a616205 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4a234d4f-6ef6-432a-984f-66e46d9cd7f8,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.475538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.524172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-384b7ff2-01d0-4ab3-8598-1ab3f2856aaf None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:01.550302 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:01.565366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d33c2687-ae1f-44f3-b42c-3d61a4cd6368 None None] Network e52cb240-363f-413c-995e-29ff18f19dea requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:01.613580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.617861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-edc119c2-5519-4863-8299-84340eccb3e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:01.619381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-edc119c2-5519-4863-8299-84340eccb3e3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2310851 Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d33c2687-ae1f-44f3-b42c-3d61a4cd6368 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:01.642070 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:01.648552 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a2a9876b-99f1-45b4-90f2-9d94b698ae84 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6346619 Nov 05 14:47:01.652226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.653350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.657095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e69d643d-03ed-4a14-9dea-3d0fc35408aa None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:01.657266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41368) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:01.664742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:01.670491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-556674618', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:01.681573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.701829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:01.715956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '72879cc7-b887-4f38-aade-19c22aa0b99a') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:01.716185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '72879cc7-b887-4f38-aade-19c22aa0b99a') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:01.736028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.742973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e69d643d-03ed-4a14-9dea-3d0fc35408aa None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:01.766779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.783256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 644 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:01.783651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:01.788201 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:01.790648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.790648 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment 66bcfec0-412d-46e6-bcb7-e7f810d470ae of type vlan for network 52c7b5f8-c294-4a6f-980b-fd50a09e17e7 Nov 05 14:47:01.798311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:01.804963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.839381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.839603 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Added segment c1962c9b-c098-47a0-8037-8f8f49cad9ce of type vlan for network 55f3c8c4-4916-4d69-b913-0862a86fec4a Nov 05 14:47:01.862658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e4d80342-2cf7-445d-8230-5dbb7507ca4f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:01.873281 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-163127f5-0632-4fb9-92fa-ed1cb71f36f7 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2400606 Nov 05 14:47:01.905173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.906449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.937990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.942853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.953955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:01.961562 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60 HTTP/1.1" status: 204 len: 168 time: 2.0746620 Nov 05 14:47:01.962673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41370) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:01.980255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.003974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.006844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-996496667', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:02.020608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-e52cb240-363f-413c-995e-29ff18f19dea', 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea', 'tenant_id': '5aba8d2cde554c148588ac154e0c5e0f', 'fixed_ips': [{'subnet_id': 'ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:02.022343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.023971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55bfeab-06ab-4959-96aa-43bdd7714b4d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=20da7c08-6a9d-4bf1-be94-7fd2e4eb4c60,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.031778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.084678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-09313f4b-bb1e-4845-9839-446cbb3a93d5 req-f67fbd31-3250-4f6f-a7a5-487d913983c1 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2026925 Nov 05 14:47:02.086579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.091613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.092930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.094652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=586c5d54-ca70-43df-a661-f3d10a5b02d1,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.105256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.130283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.134901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6d83340d-7eaa-45bf-949b-d67189a4f9cd tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.7000520 Nov 05 14:47:02.134901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.134901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.138349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41374) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.139575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.144358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.145106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.220381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Subnet': ['ID=8d5e93be-7dcf-4cb3-b8ea-769e6430e08d,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.235240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.259422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.260122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Allocated IP 172.20.0.2 (e52cb240-363f-413c-995e-29ff18f19dea/ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6/83951ccd-ecac-4142-af05-2957f7709b01) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:02.275396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1332bf7d-741b-450b-bb91-c55583f1f4d6 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:02.287149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Checking segment: {'id': 'a33eff58-78b9-4112-a457-aac5d6ebbbc9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '12fc43d1-538f-48b7-b772-7b5de0bc0925'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:02.287539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network hostable DHCP agents. Network: 12fc43d1-538f-48b7-b772-7b5de0bc0925, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:02.297459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.298759 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ab71861-f696-400b-9f42-11a14462c2e4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 702 time: 0.3299127 Nov 05 14:47:02.305008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41376) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.308981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 1332bf7d-741b-450b-bb91-c55583f1f4d6 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:02.308981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1332bf7d-741b-450b-bb91-c55583f1f4d6 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:02.313594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1205366260'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:02.331701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.365749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network 12fc43d1-538f-48b7-b772-7b5de0bc0925 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:02.367626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.372601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.373537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.374136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.377221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:02.381137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.402964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 12fc43d1-538f-48b7-b772-7b5de0bc0925) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:02.405263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1318 time: 2.0432627 Nov 05 14:47:02.410200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41378) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.417018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.422065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=45717159-a87b-470e-a5e2-c1b639e45ec5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.445497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 45717159-a87b-470e-a5e2-c1b639e45ec5 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:02.478879 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.4354384 Nov 05 14:47:02.515382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41380) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.521018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Request body: {'subnet': {'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:02.525239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 634} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:02.560492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.560726 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 7eff7e35-335f-4774-8c0f-46053cb26ca0 of type vlan for network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 Nov 05 14:47:02.579675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event updated for resources: {'Subnet': ['ID=b8da4614-1a41-4e1b-aa90-c7cda3ede85e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.582713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.584789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998e2d5c-3652-4e47-856e-d7f15a732c1f req-2ebe4c34-4fb5-4ba9-bcaf-fb0b58f0640d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.587657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-998e2d5c-3652-4e47-856e-d7f15a732c1f req-2ebe4c34-4fb5-4ba9-bcaf-fb0b58f0640d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.4975605 Nov 05 14:47:02.591687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.617693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.620590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.621923 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/4a234d4f-6ef6-432a-984f-66e46d9cd7f8 HTTP/1.1" status: 204 len: 168 time: 0.4782872 Nov 05 14:47:02.637785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Network e52cb240-363f-413c-995e-29ff18f19dea is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:02.639421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41382) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.657277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:02.665422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.669351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:02.673200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.680757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe0fceb-070e-4d22-9d92-ffb3973ab7c3 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a234d4f-6ef6-432a-984f-66e46d9cd7f8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.703648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Checking segment: {'id': 'ef5347d6-e1fa-4bf0-adb5-8a536be5c06a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 646, 'network_id': '37a37ece-8bc6-46d8-affe-bf36a1c2defe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:02.704317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network hostable DHCP agents. Network: 37a37ece-8bc6-46d8-affe-bf36a1c2defe, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:02.717541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Pushing event updated for resources: {'Port': ['ID=83951ccd-ecac-4142-af05-2957f7709b01,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.725187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d805e122-8994-4ebe-ac3f-d80584c3ed5c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.731136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d805e122-8994-4ebe-ac3f-d80584c3ed5c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.737961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d805e122-8994-4ebe-ac3f-d80584c3ed5c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.744552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d805e122-8994-4ebe-ac3f-d80584c3ed5c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.746274 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d805e122-8994-4ebe-ac3f-d80584c3ed5c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2405 time: 0.3309216 Nov 05 14:47:02.755081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.760403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6bc547-bbfd-4476-93e1-a1f43c4eedf3 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=52c7b5f8-c294-4a6f-980b-fd50a09e17e7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.761686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Attempting to bind port 83951ccd-ecac-4142-af05-2957f7709b01 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:02.762840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Attempting to bind port 83951ccd-ecac-4142-af05-2957f7709b01 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '513e292e-0597-449f-afd4-5834a3410799', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:02.762840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Attempting to bind port 83951ccd-ecac-4142-af05-2957f7709b01 on network e52cb240-363f-413c-995e-29ff18f19dea {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:02.768504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:02.769021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Checking segment: {'id': '513e292e-0597-449f-afd4-5834a3410799', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:02.769531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.770028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Bound using segment: {'id': '513e292e-0597-449f-afd4-5834a3410799', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:02.770621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Bound port: 83951ccd-ecac-4142-af05-2957f7709b01, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '513e292e-0597-449f-afd4-5834a3410799', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:02.771506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.772169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.778294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.778904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.788851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 52c7b5f8-c294-4a6f-980b-fd50a09e17e7 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:02.820589 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2cccbb08-1861-4173-9377-3240b849ce70 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1688499 Nov 05 14:47:02.848179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Network 37a37ece-8bc6-46d8-affe-bf36a1c2defe is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:02.857855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41386) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.860990 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5549905 Nov 05 14:47:02.865699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--1288321976'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:02.876681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41388) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:02.883346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:02.901894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] For port 83951ccd-ecac-4142-af05-2957f7709b01, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:02.905979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] For port 83951ccd-ecac-4142-af05-2957f7709b01, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83951ccd-ecac-4142-af05-2957f7709b01,segment=NetworkSegment(513e292e-0597-449f-afd4-5834a3410799),segment_id=513e292e-0597-449f-afd4-5834a3410799)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:02.911151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.913056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 37a37ece-8bc6-46d8-affe-bf36a1c2defe) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:02.938762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-998e2d5c-3652-4e47-856e-d7f15a732c1f req-9969a40c-9bb2-4d83-a61f-85b9255b43b7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2547743 Nov 05 14:47:02.953187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.953945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:02.954840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.958148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fc50f7-ea8d-480d-87f8-c2b467823cbd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=58e096c3-c0f8-415c-ae1a-d740c70eafa2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:02.986106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:02.994962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fec7669-618b-41d7-a51d-cfdc19a9ca8b None None] Pushing event updated for resources: {'Port': ['ID=83951ccd-ecac-4142-af05-2957f7709b01,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.000301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f3c9ab-09da-4dea-96b5-3961387b0dae tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Network': ['ID=55f3c8c4-4916-4d69-b913-0862a86fec4a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.010600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:03.059910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:03.066993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.104381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.110734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.131441 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4cd89096-f6cd-447f-8f94-117dc990f4e6 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 3.1231060 Nov 05 14:47:03.144207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41390) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:03.165556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Made reservation on behalf of c42c986e04e54c80b6aef0970f0c38a0 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:03.169920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.204998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:03.208866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.221315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.222721 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3605735 Nov 05 14:47:03.232965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bfb4375-54e6-4770-8067-67b3db629067 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9e867511-4ca7-4f70-87de-0b54b868563a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.232965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41392) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:03.308829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--1104129263'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:03.369262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f31fb6d-6ad3-4060-912f-2b4cb398935d tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:03.370804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f31fb6d-6ad3-4060-912f-2b4cb398935d tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:03.372343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f31fb6d-6ad3-4060-912f-2b4cb398935d tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:03.374120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0f31fb6d-6ad3-4060-912f-2b4cb398935d tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.2280254 Nov 05 14:47:03.379022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41394) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:03.434819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.473693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Deleting subnet 8d5e93be-7dcf-4cb3-b8ea-769e6430e08d {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:03.483462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.486629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.537054 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:47:03.553068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.581480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.608867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.654862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.660553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45717159-a87b-470e-a5e2-c1b639e45ec5']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:03.686952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '59c4a7a8-ae55-4c7e-874e-d6c8b1541c80') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:03.687246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '59c4a7a8-ae55-4c7e-874e-d6c8b1541c80') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:03.720902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.728553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.732527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.735322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.754771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.787674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=6bb60fd7-5d44-43a7-aab2-e78614f10a7b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.820032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.823452 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.5578561 Nov 05 14:47:03.826700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41396) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:03.828851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ef0435-6375-4e49-9041-9ab5d37bfaf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=90a4476b-daa3-466e-bdf1-b728f4c09435,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.837056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '9e867511-4ca7-4f70-87de-0b54b868563a', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '90a4476b-daa3-466e-bdf1-b728f4c09435', 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:03.862449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 604 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:03.862699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.862817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:03.863123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 58e096c3-c0f8-415c-ae1a-d740c70eafa2, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:03.865824 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:03.876610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.26.5.144 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/53925ba0-19be-4f77-9e52-61ecd5c66364) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:03.881380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.919665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Subnet': ['ID=8d5e93be-7dcf-4cb3-b8ea-769e6430e08d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:03.926809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.930155 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3eb7880-a777-40ce-83a3-a87e7c16e0e2 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/subnets/8d5e93be-7dcf-4cb3-b8ea-769e6430e08d HTTP/1.1" status: 204 len: 168 time: 0.5478368 Nov 05 14:47:03.932538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:03.934929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41398) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:03.943567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.968501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:03.988051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 58e096c3-c0f8-415c-ae1a-d740c70eafa2) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:04.002600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:04.003455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.038622 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Deleting subnet b8da4614-1a41-4e1b-aa90-c7cda3ede85e {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:04.045357 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71497e35-228d-491e-95ac-896920a2aeeb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1678791 Nov 05 14:47:04.050650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41402) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:04.051464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.116083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.143306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.164166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.167447 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/45717159-a87b-470e-a5e2-c1b639e45ec5 HTTP/1.1" status: 204 len: 168 time: 1.4042544 Nov 05 14:47:04.198869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.201439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41404) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:04.258515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ccebe27-545d-49db-8ceb-22227316e857 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=45717159-a87b-470e-a5e2-c1b639e45ec5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:04.267620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-730a36ee-7b63-4fcc-b6f4-88421b1d440d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:04.321942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83951ccd-ecac-4142-af05-2957f7709b01 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:04.393016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.396676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] Provisioning complete for port 83951ccd-ecac-4142-af05-2957f7709b01 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:04.397172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.399655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.401345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Subnet': ['ID=b78a57f4-c61c-4312-97f0-1447ac268aab,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:04.419425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Checking segment: {'id': 'c1962c9b-c098-47a0-8037-8f8f49cad9ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:04.419793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network hostable DHCP agents. Network: 55f3c8c4-4916-4d69-b913-0862a86fec4a, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:04.491358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.501209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.517607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 83951ccd-ecac-4142-af05-2957f7709b01 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:04.518102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.521096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:04.537492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.562111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.601940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.604480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 55f3c8c4-4916-4d69-b913-0862a86fec4a) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:04.622403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df38610-4052-43ee-9e70-d3d79a54938a req-021bd0d3-3d1e-4a8e-8769-ca1dc897b19f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:04.623932 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3df38610-4052-43ee-9e70-d3d79a54938a req-021bd0d3-3d1e-4a8e-8769-ca1dc897b19f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.5740793 Nov 05 14:47:04.630135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:04.630757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.633414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=205f2eca-f5ab-4165-b8e2-5708822ec43b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:04.638046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:04.656724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:04.659555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.664027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['52c7b5f8-c294-4a6f-980b-fd50a09e17e7']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:04.675796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:04.705772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.709834 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca41d786-2c4a-4e46-8b85-f1ebd457a91d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.8791981 Nov 05 14:47:04.710001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '66bcfec0-412d-46e6-bcb7-e7f810d470ae') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:04.710001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '66bcfec0-412d-46e6-bcb7-e7f810d470ae') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:04.712963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41406) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:04.713122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.26.5.188 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/7d5219a8-b63e-4d28-9244-6068379c4220) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:04.724871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-730a36ee-7b63-4fcc-b6f4-88421b1d440d None None] Unable to find a vacant binding_index for network 55f3c8c4-4916-4d69-b913-0862a86fec4a and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:47:04.729588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=53925ba0-19be-4f77-9e52-61ecd5c66364,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:04.737537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-63a5e5f2-737d-4f24-a220-3f63649b9b4a tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.2184110 Nov 05 14:47:04.747776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41408) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:04.751518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] For port 83951ccd-ecac-4142-af05-2957f7709b01, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83951ccd-ecac-4142-af05-2957f7709b01,segment=NetworkSegment(513e292e-0597-449f-afd4-5834a3410799),segment_id=513e292e-0597-449f-afd4-5834a3410799)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:04.755137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.755318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-285654336', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:04.757309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-730a36ee-7b63-4fcc-b6f4-88421b1d440d None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 55f3c8c4-4916-4d69-b913-0862a86fec4a) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:04.761835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.762845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.768999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.844742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.845457 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3df38610-4052-43ee-9e70-d3d79a54938a req-3f68b634-4d47-469b-ae1a-222e3e1d5034 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2132723 Nov 05 14:47:04.855233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.868725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 609 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:04.868725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:04.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:04.894177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.915768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.918664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.950588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.953232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:04.959438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f06eec-c73a-452d-912d-a48e3786ca4b None None] Pushing event updated for resources: {'Port': ['ID=83951ccd-ecac-4142-af05-2957f7709b01,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:04.966363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:47:04.966363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:47:05.016075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Subnet': ['ID=b8da4614-1a41-4e1b-aa90-c7cda3ede85e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:05.021876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.025262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ce86ab5-8fc6-4a5c-8c6d-942f1dde9682 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/subnets/b8da4614-1a41-4e1b-aa90-c7cda3ede85e HTTP/1.1" status: 204 len: 168 time: 1.0893519 Nov 05 14:47:05.029449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41412) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.088089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.096014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.109202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.114584 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/52c7b5f8-c294-4a6f-980b-fd50a09e17e7 HTTP/1.1" status: 204 len: 168 time: 0.8960402 Nov 05 14:47:05.119126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41414) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.147792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.151926 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/205f2eca-f5ab-4165-b8e2-5708822ec43b HTTP/1.1" status: 204 len: 168 time: 0.4335029 Nov 05 14:47:05.158032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41416) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.163233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-55f3c8c4-4916-4d69-b913-0862a86fec4a', 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a', 'tenant_id': 'c42c986e04e54c80b6aef0970f0c38a0', 'fixed_ips': [{'subnet_id': 'b78a57f4-c61c-4312-97f0-1447ac268aab'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:05.165203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.172730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.178161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.180228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111d3fa3-5e0e-459d-897f-7f552f7ca7ea tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=205f2eca-f5ab-4165-b8e2-5708822ec43b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:05.182055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a10461d-63d4-4944-b114-1b0088cd853a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=52c7b5f8-c294-4a6f-980b-fd50a09e17e7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:05.187955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:05.191087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.230236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77ac4019-5da8-4e0c-83cc-dd5bd608a2ce tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:05.232184 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-77ac4019-5da8-4e0c-83cc-dd5bd608a2ce tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2013824 Nov 05 14:47:05.244930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41418) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.394112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-de793404-72ff-45fb-993e-14130bb8fe7a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.2330639 Nov 05 14:47:05.395614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41420) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.429275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.430969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8::1 (58e096c3-c0f8-415c-ae1a-d740c70eafa2/6bb60fd7-5d44-43a7-aab2-e78614f10a7b/903a8613-fdd3-40c5-affe-14ef83b866c7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:05.462647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.467504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.630339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.636167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Allocated IP 172.20.0.2 (55f3c8c4-4916-4d69-b913-0862a86fec4a/b78a57f4-c61c-4312-97f0-1447ac268aab/6c9be92a-4c10-4474-9443-3eacf4f37558) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:05.674713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ccc1565-0deb-4eb7-923a-53477bab91ba tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:05.681848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ccc1565-0deb-4eb7-923a-53477bab91ba tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:05.691922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ccc1565-0deb-4eb7-923a-53477bab91ba tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.5638452 Nov 05 14:47:05.701920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41422) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:05.708395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-883894681'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:05.737302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.766450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:05.770156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.810334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.814208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.826896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.839998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 639} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:05.871532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:05.879294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:05.883468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.884028 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment 82efba53-9333-4c4b-9081-45e8f9d49b42 of type vlan for network b7364174-b030-4f06-a3e1-47690a5a3858 Nov 05 14:47:05.884481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:05.887950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Pushing event updated for resources: {'Port': ['ID=6c9be92a-4c10-4474-9443-3eacf4f37558,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:05.903823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:05.923773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:05.941476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.951968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:05.954643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=7d5219a8-b63e-4d28-9244-6068379c4220,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:05.963719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-db70f418-fe32-482d-8825-9542d27af91e None None] Provisioning complete for port 83951ccd-ecac-4142-af05-2957f7709b01 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:05.964100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db70f418-fe32-482d-8825-9542d27af91e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.965711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Attempting to bind port 6c9be92a-4c10-4474-9443-3eacf4f37558 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:05.966216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Attempting to bind port 6c9be92a-4c10-4474-9443-3eacf4f37558 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c1962c9b-c098-47a0-8037-8f8f49cad9ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:05.966591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Attempting to bind port 6c9be92a-4c10-4474-9443-3eacf4f37558 on network 55f3c8c4-4916-4d69-b913-0862a86fec4a {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:05.997979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:05.997979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Checking segment: {'id': 'c1962c9b-c098-47a0-8037-8f8f49cad9ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:05.998355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:05.998646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Bound using segment: {'id': 'c1962c9b-c098-47a0-8037-8f8f49cad9ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:05.999359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Bound port: 6c9be92a-4c10-4474-9443-3eacf4f37558, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1962c9b-c098-47a0-8037-8f8f49cad9ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:06.000042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.034281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.045277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.061326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.063782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.067869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/90a4476b-daa3-466e-bdf1-b728f4c09435 HTTP/1.1" status: 204 len: 168 time: 0.5476439 Nov 05 14:47:06.073467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41424) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:06.081446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['37a37ece-8bc6-46d8-affe-bf36a1c2defe']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:06.119549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586213ec-ebee-49c0-bbe2-a01f75000c96 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=90a4476b-daa3-466e-bdf1-b728f4c09435,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.124297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ef5347d6-e1fa-4bf0-adb5-8a536be5c06a') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:06.124929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ef5347d6-e1fa-4bf0-adb5-8a536be5c06a') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:06.125250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] For port 6c9be92a-4c10-4474-9443-3eacf4f37558, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:06.130605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] For port 6c9be92a-4c10-4474-9443-3eacf4f37558, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6c9be92a-4c10-4474-9443-3eacf4f37558,segment=NetworkSegment(c1962c9b-c098-47a0-8037-8f8f49cad9ce),segment_id=c1962c9b-c098-47a0-8037-8f8f49cad9ce)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:06.140974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.148740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.164809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.170518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:06.171079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.216422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.252247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d88013-ee8a-4c93-8c07-351bb72c9da9 None None] Pushing event updated for resources: {'Port': ['ID=6c9be92a-4c10-4474-9443-3eacf4f37558,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.272590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.278824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.285771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Allocated IP 2001:db8::2 (58e096c3-c0f8-415c-ae1a-d740c70eafa2/6bb60fd7-5d44-43a7-aab2-e78614f10a7b/d84d7e40-6eaa-48ec-93b7-98c687ccf6d1) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:06.297859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 646 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:06.298557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.353774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83951ccd-ecac-4142-af05-2957f7709b01 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:06.361564 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:06.415850 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.7125232 Nov 05 14:47:06.420233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:06.427516 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-adaecd07-98ef-4979-89e3-736eff371569 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.3491232 Nov 05 14:47:06.428874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41426) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:06.431565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.436131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.439796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/37a37ece-8bc6-46d8-affe-bf36a1c2defe HTTP/1.1" status: 204 len: 168 time: 1.1936162 Nov 05 14:47:06.444014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41428) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:06.444339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41430) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:06.445294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:06.447834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:06.448387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.451436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bae6827-e58c-4af0-8685-5c17683836b6 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=b7364174-b030-4f06-a3e1-47690a5a3858,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.464432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network b7364174-b030-4f06-a3e1-47690a5a3858 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:06.473920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.483938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-858849328'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:06.509754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.569468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 83951ccd-ecac-4142-af05-2957f7709b01 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:06.570561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.616662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-058e60aa-685e-492f-9314-16386a6d2ec0 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=37a37ece-8bc6-46d8-affe-bf36a1c2defe,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.624317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.664098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.676086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.748301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.768666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:06.772866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.784225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:06.794573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:06.801304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.805409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:06.805717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.817833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Pushing event updated for resources: {'Port': ['ID=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:06.847899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Allocated IP 172.26.5.133 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/46effe91-4ae9-4fe4-9a06-ddcdf3653f24) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:06.873676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.876793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:06.881961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Attempting to bind port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:06.883043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Attempting to bind port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:06.883459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Attempting to bind port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 on network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:06.886522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.890853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:06.891520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Checking segment: {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:06.892048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.892468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Bound using segment: {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:06.893898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Bound port: d84d7e40-6eaa-48ec-93b7-98c687ccf6d1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:06.893898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.933008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:06.933358 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment 6694845a-f3aa-49f7-8393-1c833ba21aa5 of type vlan for network 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c Nov 05 14:47:06.957873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router d9899e1d-cca2-46ee-a15f-19b76977fd0a is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:06.971934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] For port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:06.976019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] For port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:06.981159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.060705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812b7aa7-7820-4630-ada0-a17eb64686a3 None None] Pushing event updated for resources: {'Port': ['ID=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:07.064780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.082693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.095727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.098370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.101959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/9e867511-4ca7-4f70-87de-0b54b868563a HTTP/1.1" status: 204 len: 168 time: 0.6414218 Nov 05 14:47:07.109854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41434) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:07.188635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.205124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12fc43d1-538f-48b7-b772-7b5de0bc0925']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.208683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.212893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e782f7-9216-4048-a146-80fb02260627 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e867511-4ca7-4f70-87de-0b54b868563a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:07.222950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:07.235922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a33eff58-78b9-4112-a457-aac5d6ebbbc9') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.236238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a33eff58-78b9-4112-a457-aac5d6ebbbc9') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.253794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] Sync routers for ids ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:07.258778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.264351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:07.273151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.287828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.299439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] Routers {'d9899e1d-cca2-46ee-a15f-19b76977fd0a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:07.300876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.337866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.341986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-943e6af1-4b64-43e5-a075-a31b580102d8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 879 time: 6.1293972 Nov 05 14:47:07.346061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41436) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:07.366834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.399462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] Routers {'d9899e1d-cca2-46ee-a15f-19b76977fd0a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:07.399462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.426826 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.9831853 Nov 05 14:47:07.428273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.432857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41438) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:07.433915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.456863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:07.457763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea99995-0c54-43ff-8079-2102c73ea746 None None] The sync data for ids ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:07.460319 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8df0cb53-a892-412a-8190-b7d950b53cf0 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3096793 Nov 05 14:47:07.465340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'ports': [{'network_id': 'b7364174-b030-4f06-a3e1-47690a5a3858', 'name': 'tempest-port--665678963', 'admin_state_up': True}, {'network_id': '878b0dea-d5e3-4848-9ac9-a9dfe767bf1c', 'admin_state_up': False}]} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:07.466052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'port': {'network_id': 'b7364174-b030-4f06-a3e1-47690a5a3858', 'name': 'tempest-port--665678963', 'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:07.467285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'port': {'network_id': '878b0dea-d5e3-4848-9ac9-a9dfe767bf1c', 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:07.482005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41440) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:07.497118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--1175842826'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:07.539327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 631 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:07.539833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.543185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb34196-5af4-4680-9a42-e0c04b499629 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=878b0dea-d5e3-4848-9ac9-a9dfe767bf1c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:07.546634 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:07.555769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:07.839184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:07.854782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:07.860020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=46effe91-4ae9-4fe4-9a06-ddcdf3653f24,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:07.870717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:07.894986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] Provisioning complete for port 6c9be92a-4c10-4474-9443-3eacf4f37558 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:07.895592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.895681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:07.931064 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2fa5f6ed-59a2-40fb-ba6e-7ab7f291f781 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers/d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 200 len: 880 time: 0.5838776 Nov 05 14:47:07.938735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41442) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:07.999106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.003052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.005139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.008611 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/12fc43d1-538f-48b7-b772-7b5de0bc0925 HTTP/1.1" status: 204 len: 168 time: 1.5492833 Nov 05 14:47:08.019428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41444) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:08.050516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] For port 6c9be92a-4c10-4474-9443-3eacf4f37558, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6c9be92a-4c10-4474-9443-3eacf4f37558,segment=NetworkSegment(c1962c9b-c098-47a0-8037-8f8f49cad9ce),segment_id=c1962c9b-c098-47a0-8037-8f8f49cad9ce)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:08.056799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.120314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a62ff3f-bd1e-45ec-bf08-ff7c5fccf614 None None] Pushing event updated for resources: {'Port': ['ID=6c9be92a-4c10-4474-9443-3eacf4f37558,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:08.123004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c42a5d1-ccaf-4582-b707-b8156ea48d36 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=12fc43d1-538f-48b7-b772-7b5de0bc0925,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:08.126532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:08.240235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.258093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.271391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.271777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.306521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.358041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.379046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:08.388182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'port': 2} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:08.409139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.470217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:08.471120 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.473597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2792824-8fca-4c14-86f3-3d9812746a49 None None] Network 12fc43d1-538f-48b7-b772-7b5de0bc0925 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.484427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:08.490127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c047d2b-1963-4f98-9792-553987da8bfc None None] Network 37a37ece-8bc6-46d8-affe-bf36a1c2defe requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.492528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.506410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6832bd7-4c99-4dc9-b7c7-9b204fff1c41 None None] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5c047d2b-1963-4f98-9792-553987da8bfc None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.530703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.542286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.544340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.0510547 Nov 05 14:47:08.552816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41448) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:08.553667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e39075f-020e-4a5e-a973-6b96851b1470 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ebef3f99-efa6-41b7-a93e-f914e5f3fbb4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:08.558105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.568499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ca90dcc-6926-441c-95e2-3fc75a6d1ab8 None None] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.570868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': 'ebef3f99-efa6-41b7-a93e-f914e5f3fbb4', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:08.603216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfede966-ddfd-4ecc-bded-23bd4f1a4ebe None None] Network 37a37ece-8bc6-46d8-affe-bf36a1c2defe requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.603592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:08.606577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4344a2b9-5ada-47af-b062-bb134ea469c3']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.621761 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] Sync routers for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:08.626940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cfede966-ddfd-4ecc-bded-23bd4f1a4ebe None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.629745 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f2792824-8fca-4c14-86f3-3d9812746a49 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.631946 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.673343 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:08.674415 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.674761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d167dcef-eb4a-4f22-b154-72769b9083ec None None] Network 12fc43d1-538f-48b7-b772-7b5de0bc0925 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.677440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a95a04a2-b731-402b-8a06-c2f47f22a687') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.677440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a95a04a2-b731-402b-8a06-c2f47f22a687') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.695783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.696316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-90468387-4a96-4a87-bda9-8d1bf35356f8 None None] Provisioning complete for port 83951ccd-ecac-4142-af05-2957f7709b01 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:08.696717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90468387-4a96-4a87-bda9-8d1bf35356f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d167dcef-eb4a-4f22-b154-72769b9083ec None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:08.698508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.699789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bdd300b7-2f6a-48ab-9971-306dfdc23b83 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 7.0368631 Nov 05 14:47:08.708260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41450) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:08.711777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:08.712506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.717548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.739219 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.740325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.749823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 612 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:08.750291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.753275 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:08.753888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.760397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:08.762401 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b6832bd7-4c99-4dc9-b7c7-9b204fff1c41 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:08.792317 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1ca90dcc-6926-441c-95e2-3fc75a6d1ab8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:08.796204 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:08.813335 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:08.813973 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-270d0b4d-b184-4ab7-b810-50dfd62b2cea None None] The sync data for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:08.836843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dde01c3a-1ce7-4573-a013-95f8a9fa47e6 None None] Network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.873322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7919161-e506-48db-9b0a-6679a2895991 None None] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:08.883807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] device_id is not set on port 5632a553-16ed-48a5-8c6c-80e3adb8dc56 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:08.887958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a41b6283-a251-4b58-b250-7b8fc42d7817 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 883 time: 0.9464333 Nov 05 14:47:08.893855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41452) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:08.951031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:08.993197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.009949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.067722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41c317bb-f325-45fd-8bfa-17a58c199c88,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.077416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.078652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e0b00862-ff71-4120-9c1b-a37bbe0c424b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.5220733 Nov 05 14:47:09.085040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] device_id is not set on port 81ae4df0-234e-4d9b-a8b8-23f16025ce5e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:09.105656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41454) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:09.123897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b7919161-e506-48db-9b0a-6679a2895991 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:09.186511 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-dde01c3a-1ce7-4573-a013-95f8a9fa47e6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:09.191068 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:09.192939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.196276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.198483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.216440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.216790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:09.222781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.223578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6c9be92a-4c10-4474-9443-3eacf4f37558 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:09.268727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-380024527'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:09.268919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-90468387-4a96-4a87-bda9-8d1bf35356f8 None None] Provisioning complete for port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:09.269537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90468387-4a96-4a87-bda9-8d1bf35356f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.275395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.277432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.324526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.330605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/4344a2b9-5ada-47af-b062-bb134ea469c3 HTTP/1.1" status: 204 len: 168 time: 1.3011944 Nov 05 14:47:09.337645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41456) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:09.382135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.384690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bc1add-8ec7-4aa7-916b-a83e8575ebbb tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=4344a2b9-5ada-47af-b062-bb134ea469c3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.402875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 6c9be92a-4c10-4474-9443-3eacf4f37558 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:09.403276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.487164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Port': ['ID=5632a553-16ed-48a5-8c6c-80e3adb8dc56,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.502946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Checking segment: {'id': '82efba53-9333-4c4b-9081-45e8f9d49b42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'b7364174-b030-4f06-a3e1-47690a5a3858'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:09.503321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network hostable DHCP agents. Network: b7364174-b030-4f06-a3e1-47690a5a3858, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:09.597959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network b7364174-b030-4f06-a3e1-47690a5a3858 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:09.619802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, b7364174-b030-4f06-a3e1-47690a5a3858) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:09.635964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05bafbd7-b034-41ae-90b6-9ec198814584 None None] Network b7364174-b030-4f06-a3e1-47690a5a3858 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:09.654592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:09.655465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.668161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:09.700766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.752168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.753256 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/41c317bb-f325-45fd-8bfa-17a58c199c88 HTTP/1.1" status: 204 len: 168 time: 0.6449542 Nov 05 14:47:09.756434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Port': ['ID=81ae4df0-234e-4d9b-a8b8-23f16025ce5e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.762344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6e9bd250-07c7-4fef-b27e-069251b817cb None None] Provisioning complete for port 903a8613-fdd3-40c5-affe-14ef83b866c7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:09.762802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e9bd250-07c7-4fef-b27e-069251b817cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.764304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41458) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:09.790765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712c9527-440c-4aeb-8096-704fed78811a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=41c317bb-f325-45fd-8bfa-17a58c199c88,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:09.816567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6e9bd250-07c7-4fef-b27e-069251b817cb None None] Port 903a8613-fdd3-40c5-affe-14ef83b866c7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:09.846507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.886069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fe46576-b682-434f-8fab-f7691b7a1b1a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:09.901901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d49cfbb4-fd71-4933-94ef-6b38ff62a953 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1295965 Nov 05 14:47:09.910707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:09.937936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Checking segment: {'id': '6694845a-f3aa-49f7-8393-1c833ba21aa5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '878b0dea-d5e3-4848-9ac9-a9dfe767bf1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:09.938310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network hostable DHCP agents. Network: 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:09.973500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-481cc5dd-a3d6-416b-bea9-b22a5c2ddaf4 None None] Provisioning complete for port 903a8613-fdd3-40c5-affe-14ef83b866c7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:09.973879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-481cc5dd-a3d6-416b-bea9-b22a5c2ddaf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:09.977964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:09.991263 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9237dcae-b8ba-4318-b039-7c1bfacc4632 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9342244 Nov 05 14:47:09.992275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41462) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.002794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.008896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:10.010319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-365111525'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:10.017288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:10.031192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fe46576-b682-434f-8fab-f7691b7a1b1a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:10.033871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.041477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:10.049860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:10.050110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:10.050343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.055868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:10.061216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:10.062131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.088911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-481cc5dd-a3d6-416b-bea9-b22a5c2ddaf4 None None] Port 903a8613-fdd3-40c5-affe-14ef83b866c7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:10.094971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.102750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:10.106208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.136296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Router e6e28daf-a432-4b99-b5c5-52edeeed433c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:10.139236 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-70fbdefa-8b47-4bcd-9ad0-adce68e373e7 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 2.6825690 Nov 05 14:47:10.140054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41464) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.157172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9125539d-11d2-4fe7-bfff-725c83382e25']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.185742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a5fedee-ac0c-40b8-bf52-52e64e219385') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.186547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a5fedee-ac0c-40b8-bf52-52e64e219385') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.207921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 619} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:10.211539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:10.229981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.234792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.236755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.237106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment d1cdcc46-1486-4d67-a930-fced125afed6 of type vlan for network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 Nov 05 14:47:10.305582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.312154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.317197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:10.326635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.337129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router d9899e1d-cca2-46ee-a15f-19b76977fd0a has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:10.337373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Releasing vlan 605 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:10.337700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:10.342347 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:10.350182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7300065-a0c0-446f-b20b-228795c0420d tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:10.357375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7300065-a0c0-446f-b20b-228795c0420d tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:10.361897 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f7300065-a0c0-446f-b20b-228795c0420d tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.2153890 Nov 05 14:47:10.363626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41466) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.386909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.449486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.455227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:10.455811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.514706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:10.515134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.523644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.540161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.545856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] 10.222.0.30 "DELETE /v2.0/networks/9125539d-11d2-4fe7-bfff-725c83382e25 HTTP/1.1" status: 204 len: 168 time: 1.2043574 Nov 05 14:47:10.546116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:10.567195 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] Sync routers for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:10.595933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04872fa-9698-4c62-9df9-cb403de84ca1 tempest-BulkNetworkOpsTest-373087947 tempest-BulkNetworkOpsTest-373087947-project] Pushing event deleted for resources: {'Network': ['ID=9125539d-11d2-4fe7-bfff-725c83382e25,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:10.603549 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6024041 Nov 05 14:47:10.614936 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:10.619512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41470) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.620295 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.713536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a354838-2a8b-4f28-a94a-fd65e6afab04 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:10.715592 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.718395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:10.729312 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:10.729928 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.752709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6877d458-a862-4c48-8147-9e9e3753628a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:10.780358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.783289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.784214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:10.787374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/ebef3f99-efa6-41b7-a93e-f914e5f3fbb4 HTTP/1.1" status: 204 len: 168 time: 0.8724892 Nov 05 14:47:10.788432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41472) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.797266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:06Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:07Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.806187 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.807003 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095c4653-d7c2-443a-b9e3-455b5fb14791 None None] The sync data for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:10.810322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e5cc3b-6c86-40cb-827a-b7e647cdd549 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebef3f99-efa6-41b7-a93e-f914e5f3fbb4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:10.814262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.818212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-269aaca1-86d5-4362-bed3-84e0ec4ab818 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 891 time: 6.0654731 Nov 05 14:47:10.820878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41474) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.842229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:10.842609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Updating router 14f376dc-94df-47af-b41b-575261751bcd port 903a8613-fdd3-40c5-affe-14ef83b866c7 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:10.844040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:10.862420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.866803 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a6a48dc-f3ba-49f6-9251-c9c7df2bd24c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 200 len: 887 time: 1.6320100 Nov 05 14:47:10.867604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Deleting port 5632a553-16ed-48a5-8c6c-80e3adb8dc56 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:10.867953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.870680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41476) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:10.902540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] Sync routers for ids ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:10.966042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:10.994344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] Routers {'d9899e1d-cca2-46ee-a15f-19b76977fd0a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:10.994565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:10.997143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.011370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.1 (e52cb240-363f-413c-995e-29ff18f19dea/ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6/27fa8a6c-d90e-45fc-9f03-b02492a9b4a7) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:11.024741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Calling delete_port for 5632a553-16ed-48a5-8c6c-80e3adb8dc56 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:11.027208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:11.031296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.033121 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-11027789-079d-4767-8331-aae65e11246a tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2315733 Nov 05 14:47:11.033798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41480) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.048879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group': {'name': 'tempest-secgroup--68509613'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:11.075822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:11.105105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] Routers {'d9899e1d-cca2-46ee-a15f-19b76977fd0a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:11.105715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:11.107426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a354838-2a8b-4f28-a94a-fd65e6afab04 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:11.142019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41482) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.191425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.345707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.353332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:11.354090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fa042f4-05c5-451b-aef0-f1780df96d16 None None] The sync data for ids ['d9899e1d-cca2-46ee-a15f-19b76977fd0a'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:11.495755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.509744 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-484e51fd-bcf8-45e2-9a17-4b2503f8019e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers/d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 200 len: 887 time: 0.6363151 Nov 05 14:47:11.510767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.512999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41486) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.540478 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-80174c8c-a223-4b65-bb21-3328d11508d3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e0f0c475b7f04f86a8e4cb4285c8b0d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3950820 Nov 05 14:47:11.549047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41488) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.559279 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a5407537-2937-418c-bd5d-97258a5754b0 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 200 len: 205 time: 0.0441308 Nov 05 14:47:11.563382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41490) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.584490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.588982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1759 time: 0.5473671 Nov 05 14:47:11.596703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41492) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.596703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.606850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '8fb4e426-5f7c-46c7-80be-9c4c9f796323', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:11.623239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.673622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a596f8-d3fa-40e8-8863-7129cde9b849 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8fb4e426-5f7c-46c7-80be-9c4c9f796323,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:11.682753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Port': ['ID=5632a553-16ed-48a5-8c6c-80e3adb8dc56,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:11.697416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.703705 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-940edb93-e131-4bf3-a6c6-bdb37c21d8b8 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/ports/5632a553-16ed-48a5-8c6c-80e3adb8dc56 HTTP/1.1" status: 204 len: 168 time: 1.3356638 Nov 05 14:47:11.705819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41494) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:11.736120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.780178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.791482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.792542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network e52cb240-363f-413c-995e-29ff18f19dea is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:11.807072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:11.819090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:11.823235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=27fa8a6c-d90e-45fc-9f03-b02492a9b4a7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:11.836157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=08e17274-b197-46e0-912c-f6754806a9e1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:11.860975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:11.861311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:11.869068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7ad6bbe-7b94-4b53-943e-681be4dfd31f None None] Pushing event updated for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:11.875188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.892011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Deleting port 81ae4df0-234e-4d9b-a8b8-23f16025ce5e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:11.892209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.909088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.926811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.943686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:11.945255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Attempting to bind port 903a8613-fdd3-40c5-affe-14ef83b866c7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:11.945816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Attempting to bind port 903a8613-fdd3-40c5-affe-14ef83b866c7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:11.946039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Attempting to bind port 903a8613-fdd3-40c5-affe-14ef83b866c7 on network 58e096c3-c0f8-415c-ae1a-d740c70eafa2 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:11.952004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:11.952329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Checking segment: {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:11.953403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.953940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Bound using segment: {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:11.954548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Bound port: 903a8613-fdd3-40c5-affe-14ef83b866c7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eff7e35-335f-4774-8c0f-46053cb26ca0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:11.954975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.963977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:11.973243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:11.973855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:11.987306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.009383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Calling delete_port for 81ae4df0-234e-4d9b-a8b8-23f16025ce5e owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:12.022304 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4782e23f-9f43-4ae3-9b04-eea7abfd4dfc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.3982496 Nov 05 14:47:12.026095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41496) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:12.029306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.048265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.059940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] For port 903a8613-fdd3-40c5-affe-14ef83b866c7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:12.064645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] For port 903a8613-fdd3-40c5-affe-14ef83b866c7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=903a8613-fdd3-40c5-affe-14ef83b866c7,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:12.071800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.094345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.138657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:12.139678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:12.235887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.251259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.253415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7ad6bbe-7b94-4b53-943e-681be4dfd31f None None] Pushing event updated for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:12.299049 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:12.325581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.397083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Port': ['ID=81ae4df0-234e-4d9b-a8b8-23f16025ce5e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:12.407582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.411277 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ebaf5ce-d3df-40dd-8675-5d7153e0924a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/ports/81ae4df0-234e-4d9b-a8b8-23f16025ce5e HTTP/1.1" status: 204 len: 168 time: 0.7061365 Nov 05 14:47:12.414606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41498) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:12.505398 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ff14567b-3f02-4d3e-8171-1cacb9ad6752 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0880294 Nov 05 14:47:12.542886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41500) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:12.548483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-497895678'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:12.589604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:06Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:12Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:12.603204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:12.607233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.624486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bc880c-d517-42be-aff5-b722d39799bc None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:06Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:12Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:12.699062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 625} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:12.741066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.741956 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment f06eec91-dc43-439f-b9de-e7f6446d5516 of type vlan for network ec442af7-4b00-4fab-90b3-bf7ab99a4af3 Nov 05 14:47:12.781434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29701a19-6524-4732-9740-614f48429e20 None None] Network 878b0dea-d5e3-4848-9ac9-a9dfe767bf1c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:12.799358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4403a3d-58b4-4d60-9101-f156b54e1249,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:12.817703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.845734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.847149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.851724 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cd16bb8b-b45d-4ff3-a819-0ce414321107 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.2553010 Nov 05 14:47:12.855089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:12.867692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeafd98d-2818-47d8-9040-7adebaa7d3c6 None None] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:12.884739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.890744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:12.891349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6091e6a4-9013-463f-a990-56ab970dc407 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules/e4403a3d-58b4-4d60-9101-f156b54e1249 HTTP/1.1" status: 200 len: 763 time: 0.0315280 Nov 05 14:47:12.891833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:12.891954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:13.020649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Provisioning complete for port 6c9be92a-4c10-4474-9443-3eacf4f37558 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:13.021070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-aeafd98d-2818-47d8-9040-7adebaa7d3c6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:13.146019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:13.191582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Allocated IP 172.20.0.1 (55f3c8c4-4916-4d69-b913-0862a86fec4a/b78a57f4-c61c-4312-97f0-1447ac268aab/42c11451-cbb5-416e-845c-8450e44bc782) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:13.210679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c396c84-ceb8-48a2-a513-20dfc45073f1 None None] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:13.270765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.284691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.288601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.290224 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/10f6a4c1-0c9a-41c0-aff1-1121d306e493 HTTP/1.1" status: 204 len: 168 time: 1.7377324 Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9c396c84-ceb8-48a2-a513-20dfc45073f1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:13.313526 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:13.327439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Provisioning complete for port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:13.327439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.369171 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.8251755 Nov 05 14:47:13.381200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:13.407435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1184941499'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:13.459731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Provisioning complete for port 903a8613-fdd3-40c5-affe-14ef83b866c7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:13.459731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.480865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69485f6b-806f-4a00-a32c-aa9e5060a63c tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=ec442af7-4b00-4fab-90b3-bf7ab99a4af3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:13.489368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86af2c5f-6352-49a3-b15b-34501a5ce43b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10f6a4c1-0c9a-41c0-aff1-1121d306e493,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:13.506331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ec442af7-4b00-4fab-90b3-bf7ab99a4af3 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:13.544519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:13.554805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.560704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8:1::1 (39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4/08e17274-b197-46e0-912c-f6754806a9e1/5031e98f-53f2-4342-92c1-6581a63a6416) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:13.583312 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c4f75401-8142-4e8a-82d0-1fb947e33b1c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.5445569 Nov 05 14:47:13.586993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41512) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:13.674417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 633} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:13.690751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.737768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] For port 903a8613-fdd3-40c5-affe-14ef83b866c7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=903a8613-fdd3-40c5-affe-14ef83b866c7,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:13.756057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.759510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.775273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.775744 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Added segment 7bf83c7e-74aa-4ac8-8c62-a509e3f238d4 of type vlan for network eec9d398-df04-41e1-9623-37577a729afc Nov 05 14:47:13.834175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.837018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9640a6b5-c7c6-4f47-9dfa-a1ed1c426dd0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:13.840174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44fcaeed-551a-41ce-9eaa-781974c829da None None] Pushing event updated for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:13.880063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.887167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:13.887797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.911552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.915467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.936316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f98841a4-06c3-4152-909e-276042734376 None None] Provisioning complete for port 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:13.937070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f98841a4-06c3-4152-909e-276042734376 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.945645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 53925ba0-19be-4f77-9e52-61ecd5c66364 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:13.945645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:13.979967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.008740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f98841a4-06c3-4152-909e-276042734376 None None] Port 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:14.021600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9640a6b5-c7c6-4f47-9dfa-a1ed1c426dd0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:14.024773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.6372879 Nov 05 14:47:14.034497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f98841a4-06c3-4152-909e-276042734376 None None] Provisioning complete for port 903a8613-fdd3-40c5-affe-14ef83b866c7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:14.034862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f98841a4-06c3-4152-909e-276042734376 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.035868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a7df46-2bb6-4399-ae25-3528429a8984 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Network': ['ID=eec9d398-df04-41e1-9623-37577a729afc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:14.070113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.084130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.100240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.103923 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/e4403a3d-58b4-4d60-9101-f156b54e1249 HTTP/1.1" status: 204 len: 168 time: 0.5119817 Nov 05 14:47:14.104869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network eec9d398-df04-41e1-9623-37577a729afc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:14.107870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41522) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:14.127950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eabde7c2-d6d9-472e-bbe3-d0df56692a10 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e4403a3d-58b4-4d60-9101-f156b54e1249,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:14.187330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.220304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.311138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:14.321891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:14.342363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:14.343371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.348336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 903a8613-fdd3-40c5-affe-14ef83b866c7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:14.358917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:14.466046 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-819b39f7-0c6c-4d51-b525-8389ffc5ad85 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.3549562 Nov 05 14:47:14.473450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:14.480544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.501113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '8fb4e426-5f7c-46c7-80be-9c4c9f796323', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:14.557568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 53925ba0-19be-4f77-9e52-61ecd5c66364 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:14.578855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.624564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:14.734527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 903a8613-fdd3-40c5-affe-14ef83b866c7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:14.735499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.806367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-1407016852'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:14.927107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:14.927970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:14.957383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:14.966576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:14.974098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:14.977298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.018250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.070494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.072251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Allocated IP 2001:db8:1::2 (39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4/08e17274-b197-46e0-912c-f6754806a9e1/07441921-73d7-400b-8121-54b80682d4e8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:15.073698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:15.078161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.088862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.089853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.091016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.103102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.111557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.208737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.218957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.235500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.246387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.290691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:15.302015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:15.306120 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:15.320969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:15.324148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:15.331737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.335505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.336443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Pushing event updated for resources: {'Port': ['ID=07441921-73d7-400b-8121-54b80682d4e8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.357215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.379521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Attempting to bind port 07441921-73d7-400b-8121-54b80682d4e8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:15.379521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Attempting to bind port 07441921-73d7-400b-8121-54b80682d4e8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:15.379813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Attempting to bind port 07441921-73d7-400b-8121-54b80682d4e8 on network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:15.386508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:15.387129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Checking segment: {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:15.387654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.388144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Bound using segment: {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:15.389048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Bound port: 07441921-73d7-400b-8121-54b80682d4e8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:15.389445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.401248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=42c11451-cbb5-416e-845c-8450e44bc782,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.407189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.436222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=53925ba0-19be-4f77-9e52-61ecd5c66364,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.439402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.440496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router d9899e1d-cca2-46ee-a15f-19b76977fd0a {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:47:15.448718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.450331 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-419ce340-002f-4088-b1e8-afc98ba3017e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 204 len: 168 time: 3.8809869 Nov 05 14:47:15.456274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b04ad2b8-b873-4e57-a7f3-3e975393a454,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.458344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41538) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:15.464423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-228006070'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:15.466432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.470996 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8f2fcb7c-9994-4f5d-b6fa-d616396ef44b tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9743211 Nov 05 14:47:15.470996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.474204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41540) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:15.507992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 623} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:15.518009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cf08b40c-22cb-4a5b-80dc-d9afbb6bda07,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.543427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:15.547627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.554776 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-67aeb10c-05ec-472c-b2f5-4100299b2519 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules/b04ad2b8-b873-4e57-a7f3-3e975393a454 HTTP/1.1" status: 200 len: 763 time: 0.0775185 Nov 05 14:47:15.560112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41542) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:15.560854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] For port 07441921-73d7-400b-8121-54b80682d4e8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:15.563799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.564072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment f8efc8e7-db86-4936-ba27-aa89e0b79b73 of type vlan for network a79abec6-87fd-477e-a6d8-3655432a4a0a Nov 05 14:47:15.566879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] For port 07441921-73d7-400b-8121-54b80682d4e8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07441921-73d7-400b-8121-54b80682d4e8,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:15.567183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:15.571458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.572660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.587948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.633381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:15.684357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d23086-72bc-4a7b-9a17-414681e5f998 None None] Pushing event updated for resources: {'Port': ['ID=07441921-73d7-400b-8121-54b80682d4e8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.690971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-efdc5cad-6a70-4d2e-a7b4-66e7d4eb4139 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1255989 Nov 05 14:47:15.696420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41544) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:15.731797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.745952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.755481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=27fa8a6c-d90e-45fc-9f03-b02492a9b4a7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:15.771235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.771691 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 083057b0-d34d-4a37-a170-69e2e5403a68 of type vlan for network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 Nov 05 14:47:15.826049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.838776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.863986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.867257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:15.877557 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-359eeddb-2a5e-49ab-b075-edb6b24987a6 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8471429 Nov 05 14:47:15.877910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41546) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:15.885349 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:15.895812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1143942971'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:15.898744 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:15.899570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:15.917174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.928391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:15.944390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network e52cb240-363f-413c-995e-29ff18f19dea is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:15.949233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:15.956650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:15.980403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:47:16.079299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:16.084711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.090942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:16.098936 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.4730294 Nov 05 14:47:16.125782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.133697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:16.134709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.137319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41548) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:16.155487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339a271b-feba-4590-9b2a-eafe087d0493 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=a79abec6-87fd-477e-a6d8-3655432a4a0a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:16.168750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:16.181177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'name': 'tempest-PortsIpV6TestJSON-832234932'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:16.198666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.260322 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.8005724 Nov 05 14:47:16.262636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:16.315999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:16.364587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:16.368428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.379066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 601} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:16.379540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.380957 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/b04ad2b8-b873-4e57-a7f3-3e975393a454 HTTP/1.1" status: 204 len: 168 time: 0.6769726 Nov 05 14:47:16.384106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41552) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:16.427141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07441921-73d7-400b-8121-54b80682d4e8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:16.505146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 07441921-73d7-400b-8121-54b80682d4e8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:16.505526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.532781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.538784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7019a2e3-ec9f-4a09-8104-64c1c49dfb09 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b04ad2b8-b873-4e57-a7f3-3e975393a454,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:16.544909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 9a83dd0f-1883-433c-afe5-4aed57ac9495 of type vlan for network 0fdf843c-7982-468e-94d0-f4115b6b1a14 Nov 05 14:47:16.552967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2f99d4-7f67-48df-96e9-d82edcf76c99 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=fa1635ff-ba8b-4974-91aa-d6d6bb688a53,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:16.570450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:14Z', 'revision_number': 3, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:14Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:16.586064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:16.641469 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:16.642095 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Updating router 14f376dc-94df-47af-b41b-575261751bcd port 5031e98f-53f2-4342-92c1-6581a63a6416 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:16.705280 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.752408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.771469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.789766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:16.799501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.823960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 07441921-73d7-400b-8121-54b80682d4e8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07441921-73d7-400b-8121-54b80682d4e8,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:16.830482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:16.908314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=07441921-73d7-400b-8121-54b80682d4e8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.154197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.163070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa64fcd4-cd65-4941-bc5f-4ec3973e705d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:17.179626 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.267419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] It took 0.50 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:47:17.287172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 7eb70a75-dc91-43e4-a84d-332680a5220e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:17.330281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Pushing event updated for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.362954 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.363580 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.365554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.366063 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.367606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.368847 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.369570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.370401 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.371663 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.373201 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.373746 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.376882 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:17.401185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.419019 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9c9fe6c6-f793-4ea0-ac51-0bc6776f5053 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 1.0158439 Nov 05 14:47:17.431279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41554) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:17.431610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41556) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:17.432596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.436666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:17.448031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'subnets': [{'network_id': 'ec442af7-4b00-4fab-90b3-bf7ab99a4af3', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--2090257317', 'ip_version': 6}, {'network_id': 'eec9d398-df04-41e1-9623-37577a729afc', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.448655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'subnet': {'network_id': 'ec442af7-4b00-4fab-90b3-bf7ab99a4af3', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--2090257317', 'ip_version': 6}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.449555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Request body: {'subnet': {'network_id': 'eec9d398-df04-41e1-9623-37577a729afc', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.453099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa64fcd4-cd65-4941-bc5f-4ec3973e705d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:17.454169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:17.457632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Request body: {'security_group_rule': {'security_group_id': '8fb4e426-5f7c-46c7-80be-9c4c9f796323', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.457782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.462819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] Sync routers for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:17.468269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.474385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:17.475108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.483640 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Attempting to bind port 5031e98f-53f2-4342-92c1-6581a63a6416 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:17.484009 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Attempting to bind port 5031e98f-53f2-4342-92c1-6581a63a6416 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:17.484366 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Attempting to bind port 5031e98f-53f2-4342-92c1-6581a63a6416 on network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:17.486393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41558) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:17.486784 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6804b35d-b195-42c8-b361-cda9e23af425 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/routers/3672df9b-7cff-43da-87eb-5b9b05f42cf2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.7752943 Nov 05 14:47:17.491931 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:17.492299 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Checking segment: {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:17.492769 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.493092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Bound using segment: {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:17.493679 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Bound port: 5031e98f-53f2-4342-92c1-6581a63a6416, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1cdcc46-1486-4d67-a930-fced125afed6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:17.494076 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.498571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Provisioning complete for port 07441921-73d7-400b-8121-54b80682d4e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:17.499179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.528190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'port': {'network_id': 'e52cb240-363f-413c-995e-29ff18f19dea', 'name': 'tempest-FloatingIPTestJSON-1311718639'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.530210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:17.531037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:17.551158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.580360 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] For port 5031e98f-53f2-4342-92c1-6581a63a6416, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:17.585981 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] For port 5031e98f-53f2-4342-92c1-6581a63a6416, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5031e98f-53f2-4342-92c1-6581a63a6416,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:17.590780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:17.593922 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.640863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.648856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:17.649761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:17.659131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.681503 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81650f9-2077-4a08-846b-255b2a2b38dd None None] Pushing event updated for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.683536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.702318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:17.702563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2269144-fa53-4389-bab2-b70c5dc1baf7,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.703409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23c3c33-b460-4a80-b1b4-b9d24851185c None None] The sync data for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:17.726849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.729437 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:17.729835 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:17.775126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=42c11451-cbb5-416e-845c-8450e44bc782,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.781045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=0fdf843c-7982-468e-94d0-f4115b6b1a14,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:17.805692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:17.805927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Made reservation on behalf of 5aba8d2cde554c148588ac154e0c5e0f for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:17.809517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.832313 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28c32a90-64f0-4080-bf19-4d2799756126 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 1.9527347 Nov 05 14:47:17.837427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41560) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:17.845371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:17.857546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] device_id is not set on port fc70461b-e5fd-49ca-90dc-ba2ce8d4790c yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:17.870423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.872157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f095d210-a6ff-45b0-8f77-2129348d7397 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4334285 Nov 05 14:47:17.878248 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:17.902641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Provisioning complete for port 5031e98f-53f2-4342-92c1-6581a63a6416 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:17.903014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:17.950273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41562) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:17.970535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Allocated IP 172.20.0.10 (e52cb240-363f-413c-995e-29ff18f19dea/ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6/fc70461b-e5fd-49ca-90dc-ba2ce8d4790c) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:18.016214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:18.022128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:18.031363 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aa5d6120-56b8-47f8-8163-3f2992d70f15 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules/f2269144-fa53-4389-bab2-b70c5dc1baf7 HTTP/1.1" status: 200 len: 764 time: 0.0438247 Nov 05 14:47:18.037466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41564) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:18.056718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.094664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] For port 5031e98f-53f2-4342-92c1-6581a63a6416, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5031e98f-53f2-4342-92c1-6581a63a6416,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:18.099602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-615f7beb-0913-4fbf-a71e-b5c01a0aab4d tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.0601444 Nov 05 14:47:18.104189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.105538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41566) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:18.142203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.148638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Made reservation on behalf of 2fe29b0ec6724b9b8750b0fe1b6a9ffe for: {'subnet': 2} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:18.153961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.154559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.181234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.192489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.197070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9edbba-b3df-422d-9b70-7c76e8c1caee None None] Pushing event updated for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.197281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.324584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07441921-73d7-400b-8121-54b80682d4e8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:18.344204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Network e52cb240-363f-413c-995e-29ff18f19dea is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:18.368438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:18.371094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:18.381152 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:14Z', 'revision_number': 3, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:17Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:18.405245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event updated for resources: {'Port': ['ID=fc70461b-e5fd-49ca-90dc-ba2ce8d4790c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.459706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 07441921-73d7-400b-8121-54b80682d4e8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:18.460851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.471992 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02796568-d5c5-4e6e-a130-050c2653a4b6 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:14Z', 'revision_number': 3, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:17Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:18.524138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:18.528743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.612448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.620270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': 'f8efc8e7-db86-4936-ba27-aa89e0b79b73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:18.620719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: a79abec6-87fd-477e-a6d8-3655432a4a0a, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:18.623788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.657639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:18.658336 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.679154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.691833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=7eb70a75-dc91-43e4-a84d-332680a5220e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.755439 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-755c3cf8-3787-4bca-9239-51f97cb0d6aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.2414553 Nov 05 14:47:18.762564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41568) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:18.770418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Request body: {'floatingip': {'port_id': 'fc70461b-e5fd-49ca-90dc-ba2ce8d4790c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:18.804162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Router e6e28daf-a432-4b99-b5c5-52edeeed433c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:18.814758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.828398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.831937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:18.834150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.838042 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/f2269144-fa53-4389-bab2-b70c5dc1baf7 HTTP/1.1" status: 204 len: 168 time: 0.7286742 Nov 05 14:47:18.867657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41570) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:18.901577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b2aaf7-0dc8-4245-bac8-07aaa855da2f tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f2269144-fa53-4389-bab2-b70c5dc1baf7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.905853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=33b01162-f96a-4dd7-afd3-3f31bda2f001,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.928356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a79abec6-87fd-477e-a6d8-3655432a4a0a) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:18.959667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:18.967603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:18.969116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:18.986233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Subnet': ['ID=dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:18.998576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '083057b0-d34d-4a37-a170-69e2e5403a68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:18.999137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: fa1635ff-ba8b-4974-91aa-d6d6bb688a53, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:19.002536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.003417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.003765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.004105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.004497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.004834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.005164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.005583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.005914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.006774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.007602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.007932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:19.009889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fad9d68-68e7-41c3-a827-228e0792726e None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:19.050756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.054984 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d2df0953-40db-4a38-982e-13e4c136175c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1812694 Nov 05 14:47:19.054984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Checking segment: {'id': 'f06eec91-dc43-439f-b9de-e7f6446d5516', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'ec442af7-4b00-4fab-90b3-bf7ab99a4af3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:19.054984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network hostable DHCP agents. Network: ec442af7-4b00-4fab-90b3-bf7ab99a4af3, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:19.057839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41572) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:19.144192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:19.157445 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] Sync routers for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:19.158793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:19.167971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d48ef23f-7aa3-4839-b899-d016ed1ef45d tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "PUT /v2.0/routers/e6e28daf-a432-4b99-b5c5-52edeeed433c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.3470588 Nov 05 14:47:19.168230 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8becfd2e-401b-43c8-8168-0c979e4a7d57 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 3.0264921 Nov 05 14:47:19.169882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41574) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:19.171528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41576) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:19.173701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network ec442af7-4b00-4fab-90b3-bf7ab99a4af3 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:19.189696 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:19.190420 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:19.197241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1332659575'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:19.211500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Request body: {'port': {'network_id': '55f3c8c4-4916-4d69-b913-0862a86fec4a', 'name': 'tempest-FloatingIPAdminTestJSON-871118088'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:19.226378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, ec442af7-4b00-4fab-90b3-bf7ab99a4af3) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:19.239124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3eec7e15-6493-40b4-b16c-47004deeb9b7 None None] Provisioning complete for port 07441921-73d7-400b-8121-54b80682d4e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:19.239733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3eec7e15-6493-40b4-b16c-47004deeb9b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.242409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-995d1919-6980-4be7-a02a-91b944c04ae9 None None] Network ec442af7-4b00-4fab-90b3-bf7ab99a4af3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:19.284133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.305895 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:19.309490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fa1635ff-ba8b-4974-91aa-d6d6bb688a53) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:19.336366 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:19.337189 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:46:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:19.363849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51ff8de7-1107-4a83-a426-f8941f0f1c28 None None] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:19.375290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:19.375898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.421396 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:19.423109 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df76fb13-78a4-4f41-b4ef-4392eae7db04 None None] The sync data for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:19.502964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.529932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:19.533458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.598351 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4ee94777-8b8e-4e50-95b9-cdb2907dcf46 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.2596076 Nov 05 14:47:19.603562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.606671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41578) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:19.618553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Made reservation on behalf of c42c986e04e54c80b6aef0970f0c38a0 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:19.627918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.657712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-2029078037', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:19.695598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event updated for resources: {'Subnet': ['ID=c64ecc59-d0fd-4cdd-84d2-4b33eed5b210,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:19.712431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 617} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:19.789680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=6c19ebe2-7077-4835-9f1a-e3750940caf5,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:19.808058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.808836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 1007cc3e-7ba0-45e0-8c29-29092d7a6608 of type vlan for network bcd6995c-594a-4c95-a132-5bfd769138d0 Nov 05 14:47:19.815249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] device_id is not set on port d22a480d-9c9c-44da-871f-01eb2fc65720 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:19.831987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Checking segment: {'id': '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:19.833041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network hostable DHCP agents. Network: eec9d398-df04-41e1-9623-37577a729afc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:19.837826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-995d1919-6980-4be7-a02a-91b944c04ae9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:19.849648 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-51ff8de7-1107-4a83-a426-f8941f0f1c28 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:19.870577 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:19.893701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3eec7e15-6493-40b4-b16c-47004deeb9b7 None None] Provisioning complete for port 5031e98f-53f2-4342-92c1-6581a63a6416 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:19.897275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3eec7e15-6493-40b4-b16c-47004deeb9b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.899387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aa2bdff-6bc5-4dde-9cda-5381794fc770 None None] Network ec442af7-4b00-4fab-90b3-bf7ab99a4af3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:19.904605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f14a431e-4aea-415c-83a6-9a7e6e079c37 None None] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:19.955379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:19.955931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 0fdf843c-7982-468e-94d0-f4115b6b1a14, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:19.984552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:19.985708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.021329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.052596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:20.071085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0fdf843c-7982-468e-94d0-f4115b6b1a14) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:20.074030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Network eec9d398-df04-41e1-9623-37577a729afc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:20.078645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-37a552f0-59cc-48cf-9542-7b21fa3cfc03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.083250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.086988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.094558 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "DELETE /v2.0/security-groups/8fb4e426-5f7c-46c7-80be-9c4c9f796323 HTTP/1.1" status: 204 len: 168 time: 1.0294402 Nov 05 14:47:20.094792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41580) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.096721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30371015-f6f0-4853-a27d-91da12f20187 None None] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:20.133113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.133969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7aa2bdff-6bc5-4dde-9cda-5381794fc770 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.149694 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f14a431e-4aea-415c-83a6-9a7e6e079c37 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.166661 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.189355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3aa523d-583f-4810-aa79-cf2f1c0a572c tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fb4e426-5f7c-46c7-80be-9c4c9f796323,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:20.200103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, eec9d398-df04-41e1-9623-37577a729afc) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:20.204497 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c431ff8a-0a05-40b2-84f7-ac0f52dd0311 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 2.3659780 Nov 05 14:47:20.205212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.208408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.211990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41582) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.215753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.216435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.241736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be8bb63e-8ad3-484b-9547-3f6d451b7adc None None] Network eec9d398-df04-41e1-9623-37577a729afc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:20.248484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.249178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.249950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.263510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.351030 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b1a84da7-6f83-4342-be87-0ae72e86cfe2 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2503724 Nov 05 14:47:20.363021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41584) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.386946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:47:20.404119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.2146692 Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-be8bb63e-8ad3-484b-9547-3f6d451b7adc None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.414621 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-30371015-f6f0-4853-a27d-91da12f20187 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.420987 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.430113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5031e98f-53f2-4342-92c1-6581a63a6416 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:20.430538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41586) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.433868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'ports': [{'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'}, {'network_id': 'bcd6995c-594a-4c95-a132-5bfd769138d0'}]} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:20.434180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:20.434656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'bcd6995c-594a-4c95-a132-5bfd769138d0'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:20.435364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Allocated IP 172.20.0.8 (55f3c8c4-4916-4d69-b913-0862a86fec4a/b78a57f4-c61c-4312-97f0-1447ac268aab/d22a480d-9c9c-44da-871f-01eb2fc65720) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:20.448944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9562c154-8b96-479a-8e31-17ba8a29c96a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=bcd6995c-594a-4c95-a132-5bfd769138d0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:20.462750 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8635f56b-7453-4d90-a779-998d77ac286e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1476 time: 3.0198877 Nov 05 14:47:20.470554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.473818 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f9dfecee-fd1f-4048-a2be-8796568e800b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.8209419 Nov 05 14:47:20.473818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41588) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.474863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.491725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40c46b9d-2348-4ad2-86de-62f5b2b576c1 None None] Network eec9d398-df04-41e1-9623-37577a729afc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:20.497515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78d9bece-daa1-455a-a86f-9c8a1fa16029 None None] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:20.499321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network bcd6995c-594a-4c95-a132-5bfd769138d0 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:20.587832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.665527 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-789a3dd8-fdcd-45ae-9ade-f2a4504e17d9 tempest-SecGroupTest-1494602889 tempest-SecGroupTest-1494602889-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2957976 Nov 05 14:47:20.695195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaef4547-48ff-417d-8748-4d4134662a2a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.700134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaef4547-48ff-417d-8748-4d4134662a2a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.702154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaef4547-48ff-417d-8748-4d4134662a2a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:20.704483 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eaef4547-48ff-417d-8748-4d4134662a2a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2102 time: 0.2306683 Nov 05 14:47:20.715727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Provisioning complete for port fc70461b-e5fd-49ca-90dc-ba2ce8d4790c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:20.716006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.717628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:20.760268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.768967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5031e98f-53f2-4342-92c1-6581a63a6416 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:20.769335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-40c46b9d-2348-4ad2-86de-62f5b2b576c1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.772081 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.816925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Port fc70461b-e5fd-49ca-90dc-ba2ce8d4790c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-78d9bece-daa1-455a-a86f-9c8a1fa16029 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:20.818710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:20.837509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0400c40-9344-4066-add0-5506575c5fe6 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:20.844993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.872802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Provisioning complete for port 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:20.873450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.884323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:20.943023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:20.947213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:20.953097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:20.957372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event updated for resources: {'Port': ['ID=d22a480d-9c9c-44da-871f-01eb2fc65720,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:20.997657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Port 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:21.014519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:21.015323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.036509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8e59cf6d-7030-4be0-9faf-1b40b76074b3 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8338003 Nov 05 14:47:21.037427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41598) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:21.044673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41600) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:21.045230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Provisioning complete for port 5031e98f-53f2-4342-92c1-6581a63a6416 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:21.045597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.118270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0400c40-9344-4066-add0-5506575c5fe6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:21.180115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Deleting subnet dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:21.184933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.241616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.242823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'project_id': 'c42c986e04e54c80b6aef0970f0c38a0', 'port_id': 'd22a480d-9c9c-44da-871f-01eb2fc65720'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:21.246498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Provisioning complete for port 42c11451-cbb5-416e-845c-8450e44bc782 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:21.246865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.276786 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP 39a923a3-c759-4e2d-a8f4-d2df55d740f1 associated. External IP: 172.26.5.40, port: 847bc79e-f772-436e-8b2b-a881706bd85f. Nov 05 14:47:21.288774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.316727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dd66790f-7d86-4fa8-9df4-c42e49f923e6 None None] Port 42c11451-cbb5-416e-845c-8450e44bc782 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:21.338021 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-854ef439-dca6-4f7b-9ffe-0e755614e97a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d73dc2e2400c409d91b95c8471aa60cd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2954190 Nov 05 14:47:21.338256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41606) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:21.407028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.443158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.456509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a32173b1-e2d7-42cb-b02d-f8eba63c602d None None] Provisioning complete for port 5031e98f-53f2-4342-92c1-6581a63a6416 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:21.456873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a32173b1-e2d7-42cb-b02d-f8eba63c602d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.484616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.545405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.547846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.551463 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fa8e3b31-b04d-465e-98e9-96fd2e926ded HTTP/1.1" status: 204 len: 168 time: 0.2098281 Nov 05 14:47:21.551716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0fdf843c-7982-468e-94d0-f4115b6b1a14', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:21.551716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.611935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf38a473-f956-4e3b-8adf-780eb9b94cec None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-ec442af7-4b00-4fab-90b3-bf7ab99a4af3', 'network_id': 'ec442af7-4b00-4fab-90b3-bf7ab99a4af3', 'tenant_id': '2fe29b0ec6724b9b8750b0fe1b6a9ffe', 'fixed_ips': [{'subnet_id': 'dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:21.613776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bf38a473-f956-4e3b-8adf-780eb9b94cec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.618755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa8e3b31-b04d-465e-98e9-96fd2e926ded,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:21.631322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.632164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.632595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.632939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.633276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.633677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.633928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.634359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.634583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.634907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.635226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.635547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0592992-b9fe-452f-8a0a-ee11095b2a2c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:21.659440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Allocated IP 172.26.5.137 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/16c6e917-be41-42ed-812a-1192879d1d28) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:21.661799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-eec9d398-df04-41e1-9623-37577a729afc', 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc', 'tenant_id': '2fe29b0ec6724b9b8750b0fe1b6a9ffe', 'fixed_ips': [{'subnet_id': 'c64ecc59-d0fd-4cdd-84d2-4b33eed5b210'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:21.663454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.669151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fa1635ff-ba8b-4974-91aa-d6d6bb688a53', 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '33b01162-f96a-4dd7-afd3-3f31bda2f001'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:21.670257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.795987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.820148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.832219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 2} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:21.837672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.877707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.913166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:21.925173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:21.928542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:21.931026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:21.955302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Pushing event updated for resources: {'Port': ['ID=16c6e917-be41-42ed-812a-1192879d1d28,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:22.098558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Allocated IP 2001:db8:2::2 (0fdf843c-7982-468e-94d0-f4115b6b1a14/6c19ebe2-7077-4835-9f1a-e3750940caf5/47cdf27d-8821-436b-92cc-df3431932767) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:22.142501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-bf38a473-f956-4e3b-8adf-780eb9b94cec None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b: This subnet is being modified by another concurrent operation. Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 300, in create_dhcp_port Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 05 14:47:22.243965 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise exception Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b: This subnet is being modified by another concurrent operation. Nov 05 14:47:22.248997 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:22.256293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port cddee9b3-7098-45a1-87b0-94fb25f1881f yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:22.261712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Subnet': ['ID=dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:22.265427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.272145 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-732e252b-7d5b-4a67-be86-7dd1eddc65ac tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/subnets/dfd9ff26-96db-4b79-b6be-a6a80f0c2a6b HTTP/1.1" status: 204 len: 168 time: 1.5129485 Nov 05 14:47:22.277944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:22.347776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.362940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.376316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.440398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.444669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a3bd7a95-4270-44d6-82a4-981b04bffb27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.456962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Allocated IP 172.20.0.2 (fa1635ff-ba8b-4974-91aa-d6d6bb688a53/33b01162-f96a-4dd7-afd3-3f31bda2f001/c07c9ebd-8a7a-434a-af0d-775ce3e499b8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:22.480245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Deleting subnet c64ecc59-d0fd-4cdd-84d2-4b33eed5b210 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:22.484506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Allocated IP 2001:db8:0:1::1 (eec9d398-df04-41e1-9623-37577a729afc/c64ecc59-d0fd-4cdd-84d2-4b33eed5b210/55277edb-35bc-4ca1-bbb2-9850dc7da0ff) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:22.624288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.630343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.631378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.648259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:22.657032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.707191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Pushing event updated for resources: {'Port': ['ID=16c6e917-be41-42ed-812a-1192879d1d28,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:22.719120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.779986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Pushing event updated for resources: {'Port': ['ID=47cdf27d-8821-436b-92cc-df3431932767,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:22.783089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:22.822373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:22.827481 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Floating IP 334a1237-97a3-4cad-8601-66f55411e711 associated. External IP: 172.26.5.137, port: d22a480d-9c9c-44da-871f-01eb2fc65720. Nov 05 14:47:22.830969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:22.839178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.839548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.839896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.840228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.840590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.840917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.841259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.841569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.841892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.842210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.842529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.842844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:47:22.903967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.905046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.918152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.925998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.929257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.940550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.968190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Attempting to bind port 47cdf27d-8821-436b-92cc-df3431932767 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:22.968654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Attempting to bind port 47cdf27d-8821-436b-92cc-df3431932767 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:22.969001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Attempting to bind port 47cdf27d-8821-436b-92cc-df3431932767 on network 0fdf843c-7982-468e-94d0-f4115b6b1a14 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:22.987305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:22.989471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:22.989848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Checking segment: {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:22.990472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:22.990654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Bound using segment: {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:22.991146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Bound port: 47cdf27d-8821-436b-92cc-df3431932767, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:22.991529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.004673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Network eec9d398-df04-41e1-9623-37577a729afc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:23.007680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:23.018066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:23.020357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:23.024908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Pushing event updated for resources: {'Port': ['ID=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:23.027540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:23.194580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Pushing event updated for resources: {'Port': ['ID=55277edb-35bc-4ca1-bbb2-9850dc7da0ff,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:23.216747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Attempting to bind port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:23.217129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Attempting to bind port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '083057b0-d34d-4a37-a170-69e2e5403a68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:23.217487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Attempting to bind port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 on network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:23.221386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Attempting to bind port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:23.221755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Attempting to bind port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:23.222119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Attempting to bind port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff on network eec9d398-df04-41e1-9623-37577a729afc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:23.231935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:23.232383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Checking segment: {'id': '083057b0-d34d-4a37-a170-69e2e5403a68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:23.232750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.233150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Bound using segment: {'id': '083057b0-d34d-4a37-a170-69e2e5403a68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:23.233637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Bound port: c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '083057b0-d34d-4a37-a170-69e2e5403a68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'fa1635ff-ba8b-4974-91aa-d6d6bb688a53'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:23.234022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.236687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] For port 47cdf27d-8821-436b-92cc-df3431932767, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:23.238895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 46, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:23.239269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Checking segment: {'id': '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:23.239669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.240065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Bound using segment: {'id': '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:23.240581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Bound port: 55277edb-35bc-4ca1-bbb2-9850dc7da0ff, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': 'eec9d398-df04-41e1-9623-37577a729afc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:23.241016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.244216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] For port 47cdf27d-8821-436b-92cc-df3431932767, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=47cdf27d-8821-436b-92cc-df3431932767,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:23.262862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.355989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Router e6e28daf-a432-4b99-b5c5-52edeeed433c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:23.408815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.415154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 2468a47e-d9a0-44e0-bb4e-b63e693b5bd5 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:23.433425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.441136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec795f1-8f33-48a2-ad3c-f9ed0180ced0 None None] Pushing event updated for resources: {'Port': ['ID=47cdf27d-8821-436b-92cc-df3431932767,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:23.450171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] For port c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:23.454432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] For port c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,segment=NetworkSegment(083057b0-d34d-4a37-a170-69e2e5403a68),segment_id=083057b0-d34d-4a37-a170-69e2e5403a68)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:23.456005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] For port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:23.459148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.462755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] For port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=55277edb-35bc-4ca1-bbb2-9850dc7da0ff,segment=NetworkSegment(7bf83c7e-74aa-4ac8-8c62-a509e3f238d4),segment_id=7bf83c7e-74aa-4ac8-8c62-a509e3f238d4)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:23.486451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:23.493354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.522848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] Sync routers for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:23.535220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.546930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.20.0.1 (fa1635ff-ba8b-4974-91aa-d6d6bb688a53/33b01162-f96a-4dd7-afd3-3f31bda2f001/4d00d328-99a7-4561-83f4-63a3fe7296a7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:23.561023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:23.561663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.563800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd94590-8830-44ba-b68d-d2fdc67056f7 None None] Pushing event updated for resources: {'Port': ['ID=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:23.607658 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c0fa632b-2340-402d-9425-839815a517f6 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 2.5616136 Nov 05 14:47:23.610346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41612) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:23.638578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.658567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:23.659198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.673843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:23.685525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:23.703316 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:23.711689 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.727987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f87f153-c167-40be-b17d-89a8b91445f9 None None] Pushing event updated for resources: {'Port': ['ID=55277edb-35bc-4ca1-bbb2-9850dc7da0ff,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:23.731403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.732197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8120243-0228-44d0-8a58-2a2c2dd6614c None None] The sync data for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:23.775358 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.803994 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:23.805389 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.822820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7bf0103a-7d71-492e-b9b8-d839504a6676 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "GET /v2.0/floatingips/334a1237-97a3-4cad-8601-66f55411e711 HTTP/1.1" status: 200 len: 982 time: 0.2070529 Nov 05 14:47:23.830148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41614) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:23.884442 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:23.885560 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-194d48b8-b971-4b0a-98c0-ed1d16988d7a None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:23.982583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:23.986535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8:2::1 (0fdf843c-7982-468e-94d0-f4115b6b1a14/6c19ebe2-7077-4835-9f1a-e3750940caf5/94e6657e-0b4c-4d4c-aea4-e92e173c7045) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:24.033208 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e32e789f-30d2-4fa3-a7c9-48ddda641f13 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3021 time: 0.2007568 Nov 05 14:47:24.033908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41616) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:24.193770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.269757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.281241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.290906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port 16c6e917-be41-42ed-812a-1192879d1d28 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:24.291242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.375852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 55277edb-35bc-4ca1-bbb2-9850dc7da0ff up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:24.383715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.384649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.396520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for 16c6e917-be41-42ed-812a-1192879d1d28 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:24.405274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:24.424080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:24.424360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.428805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:24.468382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=4d00d328-99a7-4561-83f4-63a3fe7296a7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:24.477500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:24.489566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.538299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.592492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.594650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.610660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:24.627276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=16c6e917-be41-42ed-812a-1192879d1d28,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:24.654879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.658463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:24.671345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:24.671713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:47:24.672070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:47:24.672182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.705793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.706119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Floating IP 334a1237-97a3-4cad-8601-66f55411e711 disassociated (deleted). External IP: 172.26.5.137, port: d22a480d-9c9c-44da-871f-01eb2fc65720. Nov 05 14:47:24.716579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=cddee9b3-7098-45a1-87b0-94fb25f1881f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:24.724668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.726839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Subnet': ['ID=c64ecc59-d0fd-4cdd-84d2-4b33eed5b210,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:24.746842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.752584 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c46ef4bc-e712-42ed-86aa-c37298866a9e tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/subnets/c64ecc59-d0fd-4cdd-84d2-4b33eed5b210 HTTP/1.1" status: 204 len: 168 time: 2.4662554 Nov 05 14:47:24.753377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41618) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:24.830360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.854351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef295a21-a77d-4f3b-bec2-d3eda9d0940f tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:24.855855 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ef295a21-a77d-4f3b-bec2-d3eda9d0940f tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1015887 Nov 05 14:47:24.869492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41620) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:24.901335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=2468a47e-d9a0-44e0-bb4e-b63e693b5bd5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:24.911161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:24.912345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:24.984439 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:24.985441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '1007cc3e-7ba0-45e0-8c29-29092d7a6608', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': 'bcd6995c-594a-4c95-a132-5bfd769138d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:24.985711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: bcd6995c-594a-4c95-a132-5bfd769138d0, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:24.998247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.012310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:25.013472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] Provisioning complete for port 47cdf27d-8821-436b-92cc-df3431932767 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:25.014110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.018781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:25.019381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.108398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Router e6e28daf-a432-4b99-b5c5-52edeeed433c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:25.112314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.128608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Deleting port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:25.128947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.155520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] For port 47cdf27d-8821-436b-92cc-df3431932767, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=47cdf27d-8821-436b-92cc-df3431932767,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:25.160436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.233762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.242339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] For port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=55277edb-35bc-4ca1-bbb2-9850dc7da0ff,segment=NetworkSegment(7bf83c7e-74aa-4ac8-8c62-a509e3f238d4),segment_id=7bf83c7e-74aa-4ac8-8c62-a509e3f238d4)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:25.242702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.247788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.262325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Calling delete_port for 55277edb-35bc-4ca1-bbb2-9850dc7da0ff owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:25.267680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:25.359400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:25.365370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.416726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] Sync routers for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:25.427431 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6973866e-b3bb-4204-8f06-7f46d8de308f tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/floatingips/334a1237-97a3-4cad-8601-66f55411e711 HTTP/1.1" status: 204 len: 168 time: 1.3919244 Nov 05 14:47:25.433971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41622) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:25.441164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:25.464688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e3e940-3ebd-4112-aadf-ecb8d1dd748e None None] Pushing event updated for resources: {'Port': ['ID=47cdf27d-8821-436b-92cc-df3431932767,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:25.468737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:25.469338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.469784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.481492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.518223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.524065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network bcd6995c-594a-4c95-a132-5bfd769138d0 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:25.537496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Port': ['ID=55277edb-35bc-4ca1-bbb2-9850dc7da0ff,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:25.542021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] No DVR routers for this DVR port 55277edb-35bc-4ca1-bbb2-9850dc7da0ff on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:25.549899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c07c9ebd-8a7a-434a-af0d-775ce3e499b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:25.553175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:25.553848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.617911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.618828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca199ad2-cf3c-40f7-8399-157b4a813e0e None None] The sync data for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:25.642489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] Provisioning complete for port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:25.643164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.663663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.682033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:25.687206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.689367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:25.690057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.696605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] Sync routers for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:25.711063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eec9d398-df04-41e1-9623-37577a729afc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.713383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.717048 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:25.719248 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.721012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.721313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7bf83c7e-74aa-4ac8-8c62-a509e3f238d4') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.731568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.745226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.751702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 633 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:25.752123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.776867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, bcd6995c-594a-4c95-a132-5bfd769138d0) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:25.797715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.804544 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.814379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:25.820838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:25.825949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:25.826641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:25.828261 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:25.837300 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:25.838686 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.897558 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:25.898660 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd2738ab-631c-4fb2-89b0-f3c9b40b609f None None] The sync data for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:25.908766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.920798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.926572 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/eec9d398-df04-41e1-9623-37577a729afc HTTP/1.1" status: 204 len: 168 time: 1.0543263 Nov 05 14:47:25.926750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1565569-c902-43ec-bfb2-4c7debd25bb1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:25.938149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41624) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:25.944545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-258da51a-2c5c-477f-ba95-14ac74017645 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 5.5116065 Nov 05 14:47:25.947624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e82aa88-b532-4595-9bbb-82f2c42d0654 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=eec9d398-df04-41e1-9623-37577a729afc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:25.950962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41626) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:25.954091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.956166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:25.982440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] For port c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,segment=NetworkSegment(083057b0-d34d-4a37-a170-69e2e5403a68),segment_id=083057b0-d34d-4a37-a170-69e2e5403a68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:25.987387 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3b657d44-4eec-4aac-a0dd-a8083e45fdcb tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/floatingips/39a923a3-c759-4e2d-a8f4-d2df55d740f1 HTTP/1.1" status: 200 len: 978 time: 7.2212675 Nov 05 14:47:25.991943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41628) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:26.000375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.095290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.120656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.138724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:47:26.139081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:47:26.142914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6bd6a0dd-28ce-4226-8248-2d102f710ef8 None None] Could not find standard attr ID for object 55277edb-35bc-4ca1-bbb2-9850dc7da0ff. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:47:26.149741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f9028e-cc9c-43aa-94c0-8ac7c72cbcf9 None None] Pushing event updated for resources: {'Port': ['ID=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:26.190594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1565569-c902-43ec-bfb2-4c7debd25bb1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:26.414699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.425087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.542461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 2468a47e-d9a0-44e0-bb4e-b63e693b5bd5 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:26.542803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.573290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.575170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baab53bd-e8da-48a4-bc38-b8d2d77846f8 None None] DHCP port deletion for eec9d398-df04-41e1-9623-37577a729afc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:26.585173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=4d00d328-99a7-4561-83f4-63a3fe7296a7,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:26.590122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.609698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port fc70461b-e5fd-49ca-90dc-ba2ce8d4790c {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:26.610036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.653070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ec442af7-4b00-4fab-90b3-bf7ab99a4af3']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:26.670289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.684344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f06eec91-dc43-439f-b9de-e7f6446d5516') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:26.684859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f06eec91-dc43-439f-b9de-e7f6446d5516') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:26.696577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 2468a47e-d9a0-44e0-bb4e-b63e693b5bd5 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:26.707071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.722675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Allocated IP 172.26.5.221 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/35f74ed8-68ac-406c-9f38-0a8c8e8ccae2) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:26.727409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 47cdf27d-8821-436b-92cc-df3431932767 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:26.738954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.764339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 625 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:26.764776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.774226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:26.775780 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:26.797622 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.816540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 47cdf27d-8821-436b-92cc-df3431932767 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:26.817094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.887137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.887993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.962575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.976224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:26.979612 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/ec442af7-4b00-4fab-90b3-bf7ab99a4af3 HTTP/1.1" status: 204 len: 168 time: 1.0402479 Nov 05 14:47:26.994962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41630) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:27.021564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e20c73-5654-4a0f-b410-0121aef22e55 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=ec442af7-4b00-4fab-90b3-bf7ab99a4af3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:27.054889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c07c9ebd-8a7a-434a-af0d-775ce3e499b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:27.077214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.087079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.136089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=2468a47e-d9a0-44e0-bb4e-b63e693b5bd5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:27.142984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.145024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:27.145399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.149566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0bf44dff-a1a7-4244-9cd9-d72dc8731f88 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/2468a47e-d9a0-44e0-bb4e-b63e693b5bd5 HTTP/1.1" status: 204 len: 168 time: 1.1930590 Nov 05 14:47:27.157107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41632) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:27.231563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.239189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:27.265224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 47cdf27d-8821-436b-92cc-df3431932767 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:27.279122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:27.296910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:27.314203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:27.326983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:27.335587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 47cdf27d-8821-436b-92cc-df3431932767 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:27.336714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.344642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.348546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1065ff01-dd72-428a-bca2-dd58e360acd7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:27.355403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1065ff01-dd72-428a-bca2-dd58e360acd7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:27.357661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1065ff01-dd72-428a-bca2-dd58e360acd7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1455 time: 0.1995003 Nov 05 14:47:27.358878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:27.363915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41634) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:27.407346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Pushing event updated for resources: {'Port': ['ID=35f74ed8-68ac-406c-9f38-0a8c8e8ccae2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:27.474524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:27.484059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:27.495497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.495868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.496190 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Floating IP 39a923a3-c759-4e2d-a8f4-d2df55d740f1 disassociated. External IP: 172.26.5.40, port: fc70461b-e5fd-49ca-90dc-ba2ce8d4790c. Nov 05 14:47:27.504793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for fc70461b-e5fd-49ca-90dc-ba2ce8d4790c owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:27.533779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 55277edb-35bc-4ca1-bbb2-9850dc7da0ff no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:27.557053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.558913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 55277edb-35bc-4ca1-bbb2-9850dc7da0ff {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:27.559254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 55277edb-35bc-4ca1-bbb2-9850dc7da0ff not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:27.578609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Provisioning complete for port 47cdf27d-8821-436b-92cc-df3431932767 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:27.579213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.623333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07acd02b-d69a-4780-ab9f-b0b371cb8622 None None] Network bcd6995c-594a-4c95-a132-5bfd769138d0 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:27.628122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port cddee9b3-7098-45a1-87b0-94fb25f1881f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:27.628513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.698088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.797237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.823223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for cddee9b3-7098-45a1-87b0-94fb25f1881f owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:27.850179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Provisioning complete for port 4d00d328-99a7-4561-83f4-63a3fe7296a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:27.850561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.866716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.898788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Port 4d00d328-99a7-4561-83f4-63a3fe7296a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:27.922530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Provisioning complete for port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:27.922802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.934062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:27.945680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:27.989171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=fc70461b-e5fd-49ca-90dc-ba2ce8d4790c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:28.027589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['878b0dea-d5e3-4848-9ac9-a9dfe767bf1c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:28.083355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.094644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.109143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6694845a-f3aa-49f7-8393-1c833ba21aa5') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:28.109694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6694845a-f3aa-49f7-8393-1c833ba21aa5') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:28.133489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.134319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.146232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.151363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=cddee9b3-7098-45a1-87b0-94fb25f1881f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:28.161140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.191806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-009db532-5c4f-42b9-b299-caa838b1bccc None None] Port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.214102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:28.223653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.227237 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8b33983-e5ef-429f-95a5-a2ef049aaa4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/cddee9b3-7098-45a1-87b0-94fb25f1881f HTTP/1.1" status: 204 len: 168 time: 0.8619499 Nov 05 14:47:28.233864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41636) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:28.241985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Pushing event updated for resources: {'Port': ['ID=35f74ed8-68ac-406c-9f38-0a8c8e8ccae2,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:28.289090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.310959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.313789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5dda3038-3041-49b5-a162-40a166c8da23 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8763127 Nov 05 14:47:28.317013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41638) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:28.318009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.324153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Provisioning complete for port 4d00d328-99a7-4561-83f4-63a3fe7296a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.325034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.376559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Port 4d00d328-99a7-4561-83f4-63a3fe7296a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.389689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Provisioning complete for port d22a480d-9c9c-44da-871f-01eb2fc65720 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.390226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.449132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:28.449835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:28.453087 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:28.462277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Port d22a480d-9c9c-44da-871f-01eb2fc65720 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.474325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.474991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.516194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-474a0b36-16db-4a80-aa43-02e4abf9a732 None None] Port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.596282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:28.619832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.636191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Provisioning complete for port 4d00d328-99a7-4561-83f4-63a3fe7296a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.636904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.676391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Port 4d00d328-99a7-4561-83f4-63a3fe7296a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.687282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:28.687871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.726753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-98d13e80-eb51-43e6-b736-8101a33b3a4b None None] Port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:28.727895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.841154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Allocated IP 172.26.5.59 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/8cd0fd12-c177-43a9-809a-36a983840492) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:28.895427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:28.903735 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f5e6f982-45c8-40c6-a4b0-fbeb4c1d563f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6876068 Nov 05 14:47:28.903825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41642) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:28.906123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:28.908826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1880326890'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:28.909851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:28.915327 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-37c2958f-2c4a-469f-a150-0a945d49f981 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/6f09333b-8a7d-4c45-a7b6-f77c9c0ce730/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.3680837 Nov 05 14:47:28.920753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:28.921514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:28.925133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] Sync routers for ids ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:28.928606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59849007-582a-485b-9c0e-8446f06e1489 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:28.930240 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-59849007-582a-485b-9c0e-8446f06e1489 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.6525877 Nov 05 14:47:28.932418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:28.933229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41644) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:28.933483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41646) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:28.943619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:28.947713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] Routers {'6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:28.947856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.949152 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:28.956317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.960083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:28.964077 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/878b0dea-d5e3-4848-9ac9-a9dfe767bf1c HTTP/1.1" status: 204 len: 168 time: 1.9604280 Nov 05 14:47:28.968659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41648) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.007405 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.016862 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-7bbced69-85e1-4031-9367-41219669d44a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:47:29.018166 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] Routers {'6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:29.018478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7bbced69-85e1-4031-9367-41219669d44a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/2468a47e-d9a0-44e0-bb4e-b63e693b5bd5 HTTP/1.1" status: 404 len: 333 time: 0.0753646 Nov 05 14:47:29.019612 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.023772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41650) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.024501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9bd9742-c8ae-4110-a698-73f12505c3a2 tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=878b0dea-d5e3-4848-9ac9-a9dfe767bf1c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:29.056324 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.056897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.057550 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71221549-9f1d-4681-829a-7f4f16e9d0f4 None None] The sync data for ids ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:29.063497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65697fbe-eccf-4c8d-a4ba-4db7c5840e62 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:29.064954 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-65697fbe-eccf-4c8d-a4ba-4db7c5840e62 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports/4d00d328-99a7-4561-83f4-63a3fe7296a7 HTTP/1.1" status: 200 len: 910 time: 0.1301520 Nov 05 14:47:29.068963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41652) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.069136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:29.069490 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ba689f0-38e3-46e9-a9cb-1feee7d3062c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:47:29.071072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ba689f0-38e3-46e9-a9cb-1feee7d3062c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/cddee9b3-7098-45a1-87b0-94fb25f1881f HTTP/1.1" status: 404 len: 333 time: 0.0434868 Nov 05 14:47:29.074749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41654) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.077796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '33b01162-f96a-4dd7-afd3-3f31bda2f001'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:29.135350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:29.205854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.206101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added segment 318ab219-8855-4fd6-bdea-65a663eb9894 of type vlan for network 69c5a99e-4b1d-45d3-ac20-56f420b70051 Nov 05 14:47:29.225578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.247575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:29.254562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.271717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] Sync routers for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:29.295447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:29.295709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.334446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.340158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.350154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.352901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:29.353511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.359014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:25Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:26Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.384223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.390609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.391326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b378f572-f3af-4b37-843a-9b1d08be1152 None None] The sync data for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:29.398537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.402302 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ed8bc98-ddb4-4866-876f-3618f94e3f4f tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/fc70461b-e5fd-49ca-90dc-ba2ce8d4790c HTTP/1.1" status: 204 len: 168 time: 3.4083779 Nov 05 14:47:29.406031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b7364174-b030-4f06-a3e1-47690a5a3858']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.406538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41656) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.416823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:29.417205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Updating router 14f376dc-94df-47af-b41b-575261751bcd port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:29.420646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.426401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:29.426976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.447061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.447313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '82efba53-9333-4c4b-9081-45e8f9d49b42') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.447623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '82efba53-9333-4c4b-9081-45e8f9d49b42') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.462300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bcd6995c-594a-4c95-a132-5bfd769138d0']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.476429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1007cc3e-7ba0-45e0-8c29-29092d7a6608') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.478182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1007cc3e-7ba0-45e0-8c29-29092d7a6608') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:29.501250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.511263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.524970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.537263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6324599 Nov 05 14:47:29.539511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41658) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.549922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'subnet': {'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:29.555047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.610657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 617 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:29.611053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:29.614393 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:29.616943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:29.618109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd2993a8-b9fb-4a18-beea-ea6a93dc0c14 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Network': ['ID=69c5a99e-4b1d-45d3-ac20-56f420b70051,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:29.620282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.632958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:29.637074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:29.639036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Pushing event updated for resources: {'Port': ['ID=8cd0fd12-c177-43a9-809a-36a983840492,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:29.641593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.645707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Releasing vlan 639 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:29.646103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:29.650150 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:29.782321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.785911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:29.786406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.790245 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/bcd6995c-594a-4c95-a132-5bfd769138d0 HTTP/1.1" status: 204 len: 168 time: 0.7145641 Nov 05 14:47:29.805124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41660) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:29.810288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1183271226'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:29.830880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.833371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce433ff-7c63-4666-9e91-e9e22a02c343 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=bcd6995c-594a-4c95-a132-5bfd769138d0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:29.867492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.873139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] 10.222.0.30 "DELETE /v2.0/networks/b7364174-b030-4f06-a3e1-47690a5a3858 HTTP/1.1" status: 204 len: 168 time: 0.9010627 Nov 05 14:47:29.873301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Made reservation on behalf of f47c1e1d128a41dbac53e7ce0c8e5b5b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:29.874881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.909990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173a8b4c-d49c-4547-872e-f550fc7a623a tempest-BulkNetworkOpsIpV6Test-121838002 tempest-BulkNetworkOpsIpV6Test-121838002-project] Pushing event deleted for resources: {'Network': ['ID=b7364174-b030-4f06-a3e1-47690a5a3858,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:29.980003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.981481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:29.986248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.987038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:29.989252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.075540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a261564c-950e-4130-82e7-caf5b191980b None None] Pushing event updated for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:30.079127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:30.116734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.119773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 7900e086-38aa-45ee-9277-0f507d1e46f1 of type vlan for network dbf96fb6-2824-4db2-813b-50e540a2403c Nov 05 14:47:30.150436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Attempting to bind port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:30.150874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Attempting to bind port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:30.151245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Attempting to bind port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 on network 0fdf843c-7982-468e-94d0-f4115b6b1a14 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:30.157786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:30.158303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Checking segment: {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:30.158988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.159391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Bound using segment: {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:30.160008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Bound port: 94e6657e-0b4c-4d4c-aea4-e92e173c7045, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a83dd0f-1883-433c-afe5-4aed57ac9495', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:30.160435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.207756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.250073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] For port 94e6657e-0b4c-4d4c-aea4-e92e173c7045, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:30.254115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] For port 94e6657e-0b4c-4d4c-aea4-e92e173c7045, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=94e6657e-0b4c-4d4c-aea4-e92e173c7045,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:30.260104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.263939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.299631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.304102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.318322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.325513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:30.326400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.342310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:30.342936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:30.378050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.421380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a261564c-950e-4130-82e7-caf5b191980b None None] Pushing event updated for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:30.461487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=4d00d328-99a7-4561-83f4-63a3fe7296a7,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:30.471802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:30.471802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.475938 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-01c8a628-dcc4-4f6e-814a-548b7a33e223 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/ports/4d00d328-99a7-4561-83f4-63a3fe7296a7 HTTP/1.1" status: 200 len: 910 time: 1.3998561 Nov 05 14:47:30.476095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Subnet': ['ID=b821e8d9-71a6-4f8a-9f12-735b1439a1e6,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:30.477232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41666) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:30.510107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:30.510417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.514324 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7080116 Nov 05 14:47:30.520838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41668) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:30.530060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:30.542588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:30.564678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9d1632-2e45-4254-b9e7-3cd929679a63 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=dbf96fb6-2824-4db2-813b-50e540a2403c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:30.595097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network dbf96fb6-2824-4db2-813b-50e540a2403c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:30.616856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Checking segment: {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:30.617219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network hostable DHCP agents. Network: 69c5a99e-4b1d-45d3-ac20-56f420b70051, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:30.637973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41670) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:30.659641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.829695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:30.864301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.900288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] For port 94e6657e-0b4c-4d4c-aea4-e92e173c7045, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=94e6657e-0b4c-4d4c-aea4-e92e173c7045,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:30.933959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.946880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 69c5a99e-4b1d-45d3-ac20-56f420b70051) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:30.956205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.967618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.973211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d572f587-3bd9-422d-b55a-453b5d67e55f None None] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:30.987102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:30.988733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:30.997199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:31.002069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.085832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2024a4-d83f-4331-9402-becab519efcd None None] Pushing event updated for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:31.086545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Pushing event updated for resources: {'Port': ['ID=8cd0fd12-c177-43a9-809a-36a983840492,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:31.101502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:25Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d572f587-3bd9-422d-b55a-453b5d67e55f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:31.109195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:31.125600 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-36351020-f912-410f-9ac2-8bdac6d754cb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.5796630 Nov 05 14:47:31.126342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:47:31.127899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41674) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:31.129769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:47:31.136891 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e493ce8e-963a-4b4f-8d01-5f963497f0c4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2fe29b0ec6724b9b8750b0fe1b6a9ffe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4953229 Nov 05 14:47:31.137097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b12fadd2-4995-4926-8e8d-a0d5cd3da0f8 None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:31.137097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b12fadd2-4995-4926-8e8d-a0d5cd3da0f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.137922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.139351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab44c36-a813-44cf-88c9-cd7d523bef4c None None] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:31.140268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41676) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:31.143493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7199253-bcc1-4445-aa14-4bab78ed1ab9 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:25Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fab44c36-a813-44cf-88c9-cd7d523bef4c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:31.302307 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:31.332772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0f9e024-76c8-4309-a638-493ed22f7fe9 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:31.413593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:31.414097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.417691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.496658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0f9e024-76c8-4309-a638-493ed22f7fe9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:31.579228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=926965ef-d5f1-4d02-846a-ee6c43bb40a9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:31.595779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '7900e086-38aa-45ee-9277-0f507d1e46f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:31.596156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: dbf96fb6-2824-4db2-813b-50e540a2403c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:31.622252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.639825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.641213 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1727c84a-32b9-4a6a-b63f-e42b5d212680 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.3231330 Nov 05 14:47:31.641925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 27fa8a6c-d90e-45fc-9f03-b02492a9b4a7 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:31.644116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41678) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:31.650782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network dbf96fb6-2824-4db2-813b-50e540a2403c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:31.664097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.681449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.705328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.725713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, dbf96fb6-2824-4db2-813b-50e540a2403c) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:31.793842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:31.794470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.856243 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c53b5d32-846e-4e18-a124-dc1cf215d09d tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2915 time: 0.2087274 Nov 05 14:47:31.857865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41680) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:31.861545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e948abdc-9a96-4cc2-94fe-6a5213b1ac24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3395712 Nov 05 14:47:31.869363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41682) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:31.874248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c', 'name': 'tempest-PortsIpV6TestJSON-82483159'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:31.898642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-69c5a99e-4b1d-45d3-ac20-56f420b70051', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:31.899694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.949287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.952100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:31.966202 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f5ae4648-19d8-422a-92ec-c93af0261d88 HTTP/1.1" status: 204 len: 168 time: 0.3966982 Nov 05 14:47:32.080565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Allocated IP 2001:db8:3::2 (69c5a99e-4b1d-45d3-ac20-56f420b70051/b821e8d9-71a6-4f8a-9f12-735b1439a1e6/14fbc4aa-652d-4722-b7e7-7fefcfbf3c80) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:32.109241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103b0f8a-af24-486c-9459-a23decacdd3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5ae4648-19d8-422a-92ec-c93af0261d88,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:32.170755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:32.175899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.291458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 869d55bb-d28f-40aa-a7f6-8326f9472ecc yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:32.292228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.303124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.316223 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-11045dc2-bf91-4352-b402-e13d28b8da45 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 691 time: 0.4551010 Nov 05 14:47:32.319382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41692) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:32.352717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Pushing event updated for resources: {'Port': ['ID=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:32.366544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:32.368614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:32.371025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:32.434033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Attempting to bind port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:32.434763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Attempting to bind port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:32.435354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Attempting to bind port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 on network 69c5a99e-4b1d-45d3-ac20-56f420b70051 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:32.445295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:32.446212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Checking segment: {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:32.446873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.447374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Bound using segment: {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:32.448319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Bound port: 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:32.449165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.545545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] For port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:32.545857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Deleting port 8cd0fd12-c177-43a9-809a-36a983840492 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:32.545857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.550360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] For port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:32.557792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.559865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.571653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.630414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=27fa8a6c-d90e-45fc-9f03-b02492a9b4a7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:32.639715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4a606c-67c2-48e9-bdfd-7a5386b60aaf None None] Pushing event updated for resources: {'Port': ['ID=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:32.728312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.728695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.746357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Calling delete_port for 8cd0fd12-c177-43a9-809a-36a983840492 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:32.770802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::29f (dbf96fb6-2824-4db2-813b-50e540a2403c/926965ef-d5f1-4d02-846a-ee6c43bb40a9/869d55bb-d28f-40aa-a7f6-8326f9472ecc) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:32.885015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 4d00d328-99a7-4561-83f4-63a3fe7296a7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:32.885346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.945527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:32.990174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:33.128660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.165811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Pushing event deleted for resources: {'Port': ['ID=8cd0fd12-c177-43a9-809a-36a983840492,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:33.195924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-eaf218fb-5733-458b-98f8-928526c4dadc tempest-DvrRoutersNegativeTest-1655049276 tempest-DvrRoutersNegativeTest-1655049276-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1218783122', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:33.199056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.policy [None req-eaf218fb-5733-458b-98f8-928526c4dadc tempest-DvrRoutersNegativeTest-1655049276 tempest-DvrRoutersNegativeTest-1655049276-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=113580) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Nov 05 14:47:33.199719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.policy [None req-eaf218fb-5733-458b-98f8-928526c4dadc tempest-DvrRoutersNegativeTest-1655049276 tempest-DvrRoutersNegativeTest-1655049276-project] Failed policy check for 'create_router' {{(pid=113580) enforce /opt/stack/neutron/neutron/policy.py:524}} Nov 05 14:47:33.200347 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-eaf218fb-5733-458b-98f8-928526c4dadc tempest-DvrRoutersNegativeTest-1655049276 tempest-DvrRoutersNegativeTest-1655049276-project] create failed (client error): Access was denied to this resource. Nov 05 14:47:33.201459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eaf218fb-5733-458b-98f8-928526c4dadc tempest-DvrRoutersNegativeTest-1655049276 tempest-DvrRoutersNegativeTest-1655049276-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.1928260 Nov 05 14:47:33.264290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.270272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Allocated IP 2001:db8:3::1 (69c5a99e-4b1d-45d3-ac20-56f420b70051/b821e8d9-71a6-4f8a-9f12-735b1439a1e6/9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:33.274719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 94e6657e-0b4c-4d4c-aea4-e92e173c7045 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:33.300089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.301664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.303606 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-58f90a61-59f5-498e-848d-0462d2a67d34 tempest-FloatingIPAdminTestJSON-1575275356 tempest-FloatingIPAdminTestJSON-1575275356-project] 10.222.0.30 "DELETE /v2.0/floatingips/eb15ef1b-b558-4e6f-8b0a-b36b82734816 HTTP/1.1" status: 204 len: 168 time: 0.9824326 Nov 05 14:47:33.308436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41712) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:33.349469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:33.350228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.356599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 4d00d328-99a7-4561-83f4-63a3fe7296a7 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:33.380707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.406332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:33.532192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:33.589117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:33.589504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.608706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41716) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:33.652048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Deleting port 35f74ed8-68ac-406c-9f38-0a8c8e8ccae2 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:33.652707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.655119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.660450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.696442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.731738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network dbf96fb6-2824-4db2-813b-50e540a2403c is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:33.754603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:33.762883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:33.768995 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] Sync routers for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:33.780258 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-91d5c957-360f-43b4-aa89-6defb0fedb7c tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/routers/3672df9b-7cff-43da-87eb-5b9b05f42cf2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3725350 Nov 05 14:47:33.785083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41720) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:33.790270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:33.792581 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:33.793463 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:33.803087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:33.804143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.819753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=869d55bb-d28f-40aa-a7f6-8326f9472ecc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:33.835997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-77d26a4b-641f-42d9-8a54-91083a34b98b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.9633694 Nov 05 14:47:33.862158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41722) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:33.871768 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:33.898596 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] Routers {'3672df9b-7cff-43da-87eb-5b9b05f42cf2'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:33.899570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:33.907347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005492de-0326-4a07-9cc3-b345a6eafce4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.931734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.952840 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:33.953829 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205d9745-50f9-44fb-be5e-dbbaaf6575b5 None None] The sync data for ids ['3672df9b-7cff-43da-87eb-5b9b05f42cf2'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:33.958304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:33.959940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.961421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.963452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:33.992695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.003749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:34.015087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Calling delete_port for 35f74ed8-68ac-406c-9f38-0a8c8e8ccae2 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:34.021334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:34.024251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:34.025003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.034980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:34.056881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf2c7628-d1f7-4621-a8bc-f10b69ecd988 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:34.070040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:34.130310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=4d00d328-99a7-4561-83f4-63a3fe7296a7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:34.148760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.165608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5dbc94b4-eeaa-4f8d-bd74-a3468618e7cd None None] Provisioning complete for port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:34.165988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5dbc94b4-eeaa-4f8d-bd74-a3468618e7cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.202783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 869d55bb-d28f-40aa-a7f6-8326f9472ecc {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:34.203401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.252743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf2c7628-d1f7-4621-a8bc-f10b69ecd988 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:34.258510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005492de-0326-4a07-9cc3-b345a6eafce4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.315241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-005492de-0326-4a07-9cc3-b345a6eafce4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.596336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-dbf96fb6-2824-4db2-813b-50e540a2403c', 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '926965ef-d5f1-4d02-846a-ee6c43bb40a9'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:34.598134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.684199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005492de-0326-4a07-9cc3-b345a6eafce4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94e1c2dc-a96c-4b5a-baee-833470fa3ba4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:34.692785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.696560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.706023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.712716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.720310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 869d55bb-d28f-40aa-a7f6-8326f9472ecc owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:34.734690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-005492de-0326-4a07-9cc3-b345a6eafce4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=35132e58d16b416cba0c7e79de53aeb1&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1201737 Nov 05 14:47:34.736867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41724) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:34.751587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.797282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Allocated IP 2001:db8::2 (dbf96fb6-2824-4db2-813b-50e540a2403c/926965ef-d5f1-4d02-846a-ee6c43bb40a9/0ead911d-d007-496c-bfb5-4c9c18888f17) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:34.828592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Pushing event deleted for resources: {'Port': ['ID=35f74ed8-68ac-406c-9f38-0a8c8e8ccae2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:34.931314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 7d5219a8-b63e-4d28-9244-6068379c4220 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:34.931787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.976078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.978668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:34.984714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d8586f51-cd4e-4c4e-aa45-360ffa66ce77 tempest-FloatingIPAdminTestJSON-1604051924 tempest-FloatingIPAdminTestJSON-1604051924-project-admin] 10.222.0.30 "DELETE /v2.0/floatingips/797084d1-3540-481a-bd9f-1669406cb3a7 HTTP/1.1" status: 204 len: 168 time: 1.6754427 Nov 05 14:47:34.986835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41726) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.002564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.010464 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.058365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.068920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:35.089219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Network dbf96fb6-2824-4db2-813b-50e540a2403c is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:35.093052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:35.102618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:35.108208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Pushing event updated for resources: {'Port': ['ID=0ead911d-d007-496c-bfb5-4c9c18888f17,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.154697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.165148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.193278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:35.212965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.218595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Attempting to bind port 0ead911d-d007-496c-bfb5-4c9c18888f17 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:35.219292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Attempting to bind port 0ead911d-d007-496c-bfb5-4c9c18888f17 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '7900e086-38aa-45ee-9277-0f507d1e46f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:35.219760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Attempting to bind port 0ead911d-d007-496c-bfb5-4c9c18888f17 on network dbf96fb6-2824-4db2-813b-50e540a2403c {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:35.231936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 7d5219a8-b63e-4d28-9244-6068379c4220 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:35.238435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:35.238745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Checking segment: {'id': '7900e086-38aa-45ee-9277-0f507d1e46f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:35.239249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.239970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Bound using segment: {'id': '7900e086-38aa-45ee-9277-0f507d1e46f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:35.241540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Bound port: 0ead911d-d007-496c-bfb5-4c9c18888f17, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7900e086-38aa-45ee-9277-0f507d1e46f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'dbf96fb6-2824-4db2-813b-50e540a2403c'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:35.242036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.304046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:35.312583 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b6b818d-7eb4-46d1-a9db-0b3c682fbe2b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/6f09333b-8a7d-4c45-a7b6-f77c9c0ce730/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8326032 Nov 05 14:47:35.315769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.326921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:35.327457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.339182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] Sync routers for ids ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:35.359148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-75a29a94-1221-4287-abe3-be83990707b2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 HTTP/1.1" status: 200 len: 205 time: 0.0435162 Nov 05 14:47:35.363148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41730) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.376981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] For port 0ead911d-d007-496c-bfb5-4c9c18888f17, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:35.378954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=869d55bb-d28f-40aa-a7f6-8326f9472ecc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.379096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.383334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.386765 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/94e1c2dc-a96c-4b5a-baee-833470fa3ba4 HTTP/1.1" status: 204 len: 168 time: 0.6359713 Nov 05 14:47:35.409119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] Routers {'6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:35.409926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:35.416697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] For port 0ead911d-d007-496c-bfb5-4c9c18888f17, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0ead911d-d007-496c-bfb5-4c9c18888f17,segment=NetworkSegment(7900e086-38aa-45ee-9277-0f507d1e46f1),segment_id=7900e086-38aa-45ee-9277-0f507d1e46f1)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:35.460802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.462888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:35.465760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.472089 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e9151436-8f62-4845-ac4f-4d44de676dcc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/869d55bb-d28f-40aa-a7f6-8326f9472ecc HTTP/1.1" status: 204 len: 168 time: 1.6058443 Nov 05 14:47:35.472590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea00922-bb18-40e8-bb15-58d9956b4aae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94e1c2dc-a96c-4b5a-baee-833470fa3ba4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.475005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.492016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port d22a480d-9c9c-44da-871f-01eb2fc65720 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:35.492663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.511838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.558046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e13d1c92-a9da-4462-b55d-1ce5e15cc7ba None None] Provisioning complete for port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:35.558466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e13d1c92-a9da-4462-b55d-1ce5e15cc7ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.560195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] Routers {'6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:35.560961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:35.587678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.594482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.632618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9bc1566e-f72e-4fa0-88d6-820dc423052c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:47:35.633339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9bc1566e-f72e-4fa0-88d6-820dc423052c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:47:35.636494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9bc1566e-f72e-4fa0-88d6-820dc423052c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/869d55bb-d28f-40aa-a7f6-8326f9472ecc HTTP/1.1" status: 404 len: 333 time: 0.1477933 Nov 05 14:47:35.639968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.640818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.642459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41738) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.677024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for d22a480d-9c9c-44da-871f-01eb2fc65720 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:35.679536 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-aa065cc0-f3c6-48cd-9e02-4b29691cc301 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:47:35.681627 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aa065cc0-f3c6-48cd-9e02-4b29691cc301 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/869d55bb-d28f-40aa-a7f6-8326f9472ecc HTTP/1.1" status: 404 len: 333 time: 0.0362034 Nov 05 14:47:35.685246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41740) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:35.725112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:35.725663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5872f3f9-d6de-4d81-99f2-e2595468201f None None] The sync data for ids ['6f09333b-8a7d-4c45-a7b6-f77c9c0ce730'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:35.733449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a454cce3-2296-47e6-8d43-8d63072e4462 None None] Pushing event updated for resources: {'Port': ['ID=0ead911d-d007-496c-bfb5-4c9c18888f17,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.745029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 926965ef-d5f1-4d02-846a-ee6c43bb40a9 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:35.745531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e13d1c92-a9da-4462-b55d-1ce5e15cc7ba None None] Port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:35.752782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.755733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e13d1c92-a9da-4462-b55d-1ce5e15cc7ba None None] Provisioning complete for port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:35.756240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e13d1c92-a9da-4462-b55d-1ce5e15cc7ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.862086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.914806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=7d5219a8-b63e-4d28-9244-6068379c4220,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.919627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.926122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event updated for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:35.935228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:35.938705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.016734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.017234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router 6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:47:36.025503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.028748 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6036a2fe-de2b-40f7-ba8f-68b642038336 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 HTTP/1.1" status: 204 len: 168 time: 0.6630716 Nov 05 14:47:36.029746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41750) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.046971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Network 69c5a99e-4b1d-45d3-ac20-56f420b70051 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:36.067958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:36.101174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.134522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 33b01162-f96a-4dd7-afd3-3f31bda2f001 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:36.165764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.221937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.233026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.253093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:36.266483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.274830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.338834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.376139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.376707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Fanout notify agent at l3_agent the message router_deleted on router 3672df9b-7cff-43da-87eb-5b9b05f42cf2 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:47:36.385117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.388747 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4f1aae0-f18f-468b-80bb-5ed88e819b95 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/routers/3672df9b-7cff-43da-87eb-5b9b05f42cf2 HTTP/1.1" status: 204 len: 168 time: 2.6025944 Nov 05 14:47:36.391641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41758) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.398396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=d22a480d-9c9c-44da-871f-01eb2fc65720,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:36.404021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.443908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.452529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:36.465378 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:36.469544 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b66fcbcb-4535-4c2b-beff-052096326f00 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3398132 Nov 05 14:47:36.476218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:36.477074 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:36.487080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.493841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:36.494644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=926965ef-d5f1-4d02-846a-ee6c43bb40a9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:36.508701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.512098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf7653f4-dd5f-423a-8ac6-5f60b3141620 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/926965ef-d5f1-4d02-846a-ee6c43bb40a9 HTTP/1.1" status: 204 len: 168 time: 0.8245804 Nov 05 14:47:36.516783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41764) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.572763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.578834 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6835fbc3-b79a-47c7-a71a-bd988ac73887 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/ports/d22a480d-9c9c-44da-871f-01eb2fc65720 HTTP/1.1" status: 204 len: 168 time: 1.5881934 Nov 05 14:47:36.589043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41766) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.593673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41768) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.613340 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:36.655347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.677114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d7257d9-ae27-45a3-8ac4-eb5fb30966df tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:36.681611 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1d7257d9-ae27-45a3-8ac4-eb5fb30966df tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "GET /v2.0/ports?device_id=e6e28daf-a432-4b99-b5c5-52edeeed433c HTTP/1.1" status: 200 len: 913 time: 0.0888085 Nov 05 14:47:36.682080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41772) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:36.825714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--746846007'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:36.887619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.922405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 0ead911d-d007-496c-bfb5-4c9c18888f17 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:36.922868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.945090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:36.965478 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:34Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:35Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:36.994409 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:36.995167 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Updating router 14f376dc-94df-47af-b41b-575261751bcd port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:37.024128 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.105236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port 0ead911d-d007-496c-bfb5-4c9c18888f17, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0ead911d-d007-496c-bfb5-4c9c18888f17,segment=NetworkSegment(7900e086-38aa-45ee-9277-0f507d1e46f1),segment_id=7900e086-38aa-45ee-9277-0f507d1e46f1)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:37.105533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85e91fd3-e1f7-4309-b636-3d3ae8f5ca19 None None] Network dbf96fb6-2824-4db2-813b-50e540a2403c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:37.105995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.156245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 0ead911d-d007-496c-bfb5-4c9c18888f17 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:37.269179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0ead911d-d007-496c-bfb5-4c9c18888f17 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:37.347254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388f15b3-22fe-41bd-aad7-a94e013b2b9b req-c9b407cd-f7d3-4386-a5fc-c98d4bd55d13 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:37.348733 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-388f15b3-22fe-41bd-aad7-a94e013b2b9b req-c9b407cd-f7d3-4386-a5fc-c98d4bd55d13 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2657607 Nov 05 14:47:37.357469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting subnet ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:37.360750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.385982 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.393277 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.411619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Could not find standard attr ID for object 869d55bb-d28f-40aa-a7f6-8326f9472ecc. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:47:37.420884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.436770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.445709 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b6b8c10-0ceb-4308-b778-ceb9ce66fe0a None None] Pushing event updated for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:37.482800 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-388f15b3-22fe-41bd-aad7-a94e013b2b9b req-7fceccba-a314-4771-a4c2-39b2c39e3b07 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875294 Nov 05 14:47:37.507222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.513456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0ead911d-d007-496c-bfb5-4c9c18888f17 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:37.513828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.518643 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Attempting to bind port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:37.519195 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Attempting to bind port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:37.519625 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Attempting to bind port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 on network 69c5a99e-4b1d-45d3-ac20-56f420b70051 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:37.526370 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:37.527173 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Checking segment: {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:37.527809 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.528480 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Bound using segment: {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:37.529987 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Bound port: 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '318ab219-8855-4fd6-bdea-65a663eb9894', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:37.530810 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.575780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.585854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cbe0a52d-4ae0-4ca7-9c49-8b65e869c17e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:37.606673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Port 0ead911d-d007-496c-bfb5-4c9c18888f17 was deleted so its status cannot be updated. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Nov 05 14:47:37.610184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=0ead911d-d007-496c-bfb5-4c9c18888f17,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:37.664879 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] For port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:37.668182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.673221 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] For port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:37.676576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Provisioning complete for port 0ead911d-d007-496c-bfb5-4c9c18888f17 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:37.677052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.685273 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.729634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.730594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4884247-794b-4b95-984b-bd7ac1a8f6d3 None None] Network dbf96fb6-2824-4db2-813b-50e540a2403c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:37.738957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Port 0ead911d-d007-496c-bfb5-4c9c18888f17 was deleted so its status cannot be updated. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Nov 05 14:47:37.789657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port 0ead911d-d007-496c-bfb5-4c9c18888f17 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:37.791675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.804387 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b6b8c10-0ceb-4308-b778-ceb9ce66fe0a None None] Pushing event updated for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:37.807954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.821136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/33b01162-f96a-4dd7-afd3-3f31bda2f001 HTTP/1.1" status: 204 len: 168 time: 1.7884116 Nov 05 14:47:37.832852 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:37.834567 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:37.839855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41778) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:37.852514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Provisioning complete for port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:37.859667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:37.965710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c314054c-3bcf-4899-93c2-c45a47d9bf83 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=33b01162-f96a-4dd7-afd3-3f31bda2f001,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:38.006643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.008101 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.4136271 Nov 05 14:47:38.030083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41780) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:38.047346 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:38.071320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-168f722c-6f61-48f8-9a1e-023cec9d1b4b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1410c237-ba81-4aba-b367-2db73e8aac03,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:38.092006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.099576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.116555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c4fc64-21de-4b04-bab5-cb9294fafc05 req-bd5dc2ec-5c92-4616-b8b1-8621c368703a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:38.118068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-45c4fc64-21de-4b04-bab5-cb9294fafc05 req-bd5dc2ec-5c92-4616-b8b1-8621c368703a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3643019 Nov 05 14:47:38.126254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.166932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20f1aa29-0330-4737-9153-6dd27c853808 None None] Network fa1635ff-ba8b-4974-91aa-d6d6bb688a53 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:38.173247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85744495-6079-4db7-9688-8be22addb4e6 None None] DHCP port deletion for dbf96fb6-2824-4db2-813b-50e540a2403c request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:38.227605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dbf96fb6-2824-4db2-813b-50e540a2403c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:38.239632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.255139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7900e086-38aa-45ee-9277-0f507d1e46f1') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:38.255366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7900e086-38aa-45ee-9277-0f507d1e46f1') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:38.325157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.334561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] For port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:38.346913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.351374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.376158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-45c4fc64-21de-4b04-bab5-cb9294fafc05 req-3b23108b-55c8-42a6-a111-38e1906b49a3 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1914561 Nov 05 14:47:38.397947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.416172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c694be6e-4b3a-46ed-8705-554a4574b400 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.3839948 Nov 05 14:47:38.421372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 609 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:38.421778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.426536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41784) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:38.427227 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:38.443651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-security--1337233787', 'description': 'tempest-security-description-1300871614'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:38.492897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Provisioning complete for port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:38.493313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.585323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb9c271-1644-4a90-bd37-50d37edb625b None None] Pushing event updated for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:38.617902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] DHCP port deletion for fa1635ff-ba8b-4974-91aa-d6d6bb688a53 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:38.619247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:38.619649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.622502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:47:38.631555 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:34Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:37Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:38.668545 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40bcbb11-03ae-4918-83f9-16dc89908755 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:34Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:37Z', 'revision_number': 4, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:38.751099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.816638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Deleting port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:38.818605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.828824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Subnet': ['ID=ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:38.835600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Removed routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:47:38.836370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.851588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:38.859374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-12b56a42-4cba-4729-9ad9-c7794265cb0b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/subnets/ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6 HTTP/1.1" status: 204 len: 168 time: 2.4662857 Nov 05 14:47:38.864740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:38.896696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddc40840-65a0-4ffe-aa81-25a5014474a7 None None] Network e52cb240-363f-413c-995e-29ff18f19dea requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:39.051592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] For port c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,segment=NetworkSegment(083057b0-d34d-4a37-a170-69e2e5403a68),segment_id=083057b0-d34d-4a37-a170-69e2e5403a68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:39.051997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.101956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e7889b13-5020-47f0-8e20-185d3c9bc7c2 None None] Provisioning complete for port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:39.102331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e7889b13-5020-47f0-8e20-185d3c9bc7c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.104552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port c07c9ebd-8a7a-434a-af0d-775ce3e499b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,segment=NetworkSegment(083057b0-d34d-4a37-a170-69e2e5403a68),segment_id=083057b0-d34d-4a37-a170-69e2e5403a68)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:39.107233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.138835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Calling delete_port for c07c9ebd-8a7a-434a-af0d-775ce3e499b8 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:39.173528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for c07c9ebd-8a7a-434a-af0d-775ce3e499b8 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:39.213898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.250317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:39.266808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.280697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.357225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.362207 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/dbf96fb6-2824-4db2-813b-50e540a2403c HTTP/1.1" status: 204 len: 168 time: 2.8444290 Nov 05 14:47:39.400963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41790) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:39.404556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] DHCP port deletion for e52cb240-363f-413c-995e-29ff18f19dea request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:39.413432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dacbeea-2e39-4fd5-a88f-21529fdd823e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=dbf96fb6-2824-4db2-813b-50e540a2403c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:39.419276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.424389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1564834944'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:39.426408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:39.426730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.436861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.439964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.444793 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "PUT /v2.0/security-groups/1410c237-ba81-4aba-b367-2db73e8aac03 HTTP/1.1" status: 200 len: 1795 time: 1.0165133 Nov 05 14:47:39.447055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41792) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:39.473380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1cbb1b-92ab-4c01-9be2-2d6ab0efb008 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1410c237-ba81-4aba-b367-2db73e8aac03,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:39.503558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975976bc-5f67-4d92-a883-842c5adfbb9c req-635dea65-f073-4667-81d1-fd5bfe6bf8bd tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:39.506284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-975976bc-5f67-4d92-a883-842c5adfbb9c req-635dea65-f073-4667-81d1-fd5bfe6bf8bd tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2965991 Nov 05 14:47:39.532569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.560075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.567924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.580076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:39.583673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.621977 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-975976bc-5f67-4d92-a883-842c5adfbb9c req-9520b5ec-a383-4db6-bbce-0ddad5bcf743 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1065569 Nov 05 14:47:39.632646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:39.640140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.658334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] No DVR routers for this DVR port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:39.687426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05bf2fe7-92c1-4e10-acff-b7c297581771 None None] Pushing event deleted for resources: {'Port': ['ID=c07c9ebd-8a7a-434a-af0d-775ce3e499b8,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:39.717854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port 42c11451-cbb5-416e-845c-8450e44bc782 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:39.718275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.718865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Deleting port 83951ccd-ecac-4142-af05-2957f7709b01 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:39.719236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.727237 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ab6115d-da66-4f55-a8a5-40429c0d10b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups/1410c237-ba81-4aba-b367-2db73e8aac03 HTTP/1.1" status: 200 len: 1795 time: 0.2717478 Nov 05 14:47:39.728682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 83951ccd-ecac-4142-af05-2957f7709b01 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:39.729121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.738040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41794) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:39.781342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port c07c9ebd-8a7a-434a-af0d-775ce3e499b8 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:39.822162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] For port 83951ccd-ecac-4142-af05-2957f7709b01, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83951ccd-ecac-4142-af05-2957f7709b01,segment=NetworkSegment(513e292e-0597-449f-afd4-5834a3410799),segment_id=513e292e-0597-449f-afd4-5834a3410799)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:39.822560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.833485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b3a41600-5cb5-4253-947d-0afdcd263ea2 None None] Provisioning complete for port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:39.833688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3a41600-5cb5-4253-947d-0afdcd263ea2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.839445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Calling delete_port for 83951ccd-ecac-4142-af05-2957f7709b01 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:39.855005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.856073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:39.902558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:39.916298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0ead911d-d007-496c-bfb5-4c9c18888f17 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:39.916740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.924647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] For port 83951ccd-ecac-4142-af05-2957f7709b01, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83951ccd-ecac-4142-af05-2957f7709b01,segment=NetworkSegment(513e292e-0597-449f-afd4-5834a3410799),segment_id=513e292e-0597-449f-afd4-5834a3410799)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:39.925018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.927192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.930040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.930412 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 56ec4f12-fbec-43fd-8d5b-6dfdba29133f of type vlan for network 56c39989-7a56-4255-8ad7-419dc0706385 Nov 05 14:47:39.942201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for 42c11451-cbb5-416e-845c-8450e44bc782 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:39.942683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0ead911d-d007-496c-bfb5-4c9c18888f17 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:39.943825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0ead911d-d007-496c-bfb5-4c9c18888f17 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:39.943958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c07c9ebd-8a7a-434a-af0d-775ce3e499b8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:39.955587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:39.958026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 83951ccd-ecac-4142-af05-2957f7709b01 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:39.970171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: c07c9ebd-8a7a-434a-af0d-775ce3e499b8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:39.970512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c07c9ebd-8a7a-434a-af0d-775ce3e499b8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:40.040505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.045534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.048090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.049272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/1410c237-ba81-4aba-b367-2db73e8aac03 HTTP/1.1" status: 204 len: 168 time: 0.3100739 Nov 05 14:47:40.060749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41796) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.061492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc96530-240b-4414-bfeb-7be3bed91736 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1410c237-ba81-4aba-b367-2db73e8aac03,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.073421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] Pushing event deleted for resources: {'Port': ['ID=83951ccd-ecac-4142-af05-2957f7709b01,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.083389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aaa08a8-e04c-4b11-a46b-49e755b8d6b6 None None] No DVR routers for this DVR port 83951ccd-ecac-4142-af05-2957f7709b01 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:40.150358 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e3b2a7ea-1bd7-4d48-9813-afa31314326f tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0865972 Nov 05 14:47:40.154156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41798) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.155298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fa1635ff-ba8b-4974-91aa-d6d6bb688a53']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.168910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.176751 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-7c5e49ec-bec2-4802-adfa-3fe0e8c08a05 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] delete failed (client error): The resource could not be found. Nov 05 14:47:40.177873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c5e49ec-bec2-4802-adfa-3fe0e8c08a05 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/1410c237-ba81-4aba-b367-2db73e8aac03 HTTP/1.1" status: 404 len: 347 time: 0.0227320 Nov 05 14:47:40.178659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '083057b0-d34d-4a37-a170-69e2e5403a68') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.178955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '083057b0-d34d-4a37-a170-69e2e5403a68') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.182703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41800) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.187593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--918592964'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.202272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.241774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.247338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.249025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:40.259830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.261824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:40.263771 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-80bb9c0b-9bcf-49b7-8411-0e5469d35ee8 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 953 time: 3.7750223 Nov 05 14:47:40.264755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.267263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:40.267715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self.session.flush() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:40.270848 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:40.276484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:40.277102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.286636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.292050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:40.292655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.306907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.375107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:40.375637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=42c11451-cbb5-416e-845c-8450e44bc782,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.397817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.408527 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9990804 Nov 05 14:47:40.409624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41804) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.430018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '56c39989-7a56-4255-8ad7-419dc0706385', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.473970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.476391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41806) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.478162 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1c0db9c6-f14d-4d55-b3d0-77916a332a40 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 953 time: 0.2120245 Nov 05 14:47:40.508760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=83951ccd-ecac-4142-af05-2957f7709b01,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.513998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'routes': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.529475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.533157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/fa1635ff-ba8b-4974-91aa-d6d6bb688a53 HTTP/1.1" status: 204 len: 168 time: 2.6921222 Nov 05 14:47:40.535769 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:47:40.536890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] No DVR routers for this DVR port 83951ccd-ecac-4142-af05-2957f7709b01 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:40.549039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.554337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41808) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.559746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1057398300', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.581143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.627090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b6fab2ae-4539-46cc-9914-995a5e446f9c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.642230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da7904b-9d82-4173-84ca-64ebbab7ea8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=56c39989-7a56-4255-8ad7-419dc0706385,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.658544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.660163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.666733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 56c39989-7a56-4255-8ad7-419dc0706385 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:40.705711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d0ef5c-dbd5-4430-a839-c0b717de4230 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=fa1635ff-ba8b-4974-91aa-d6d6bb688a53,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:40.717971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 6, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.732181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.736399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-83ca87ac-0894-4a76-8ab5-732be7b1c105 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5495327 Nov 05 14:47:40.736399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.754240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:40.772968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41812) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.777353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:40.777723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'b6fab2ae-4539-46cc-9914-995a5e446f9c', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.777978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:40.785906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.873430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.874672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9d39c57c-5513-4aa6-962a-031e7554e25c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.3193047 Nov 05 14:47:40.877216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:40.878236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.881842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41814) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:40.889021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-622161528'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:40.919703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:40.952008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:40.955519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.084776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.087730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 600} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:41.103061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.125422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.125815 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d of type vlan for network 0d941fc7-e9da-40d5-a8b5-26174382c84d Nov 05 14:47:41.129087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 6, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.147363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e755eb55-b9ce-42ec-afa7-d6ecdeb17912,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:41.171946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83951ccd-ecac-4142-af05-2957f7709b01 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:41.175456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f16e0ade-5add-4a4b-8b12-ce9c4ba92d1c None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 6, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:41.181111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.182395 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-14c43be0-71fa-4b1b-a07e-61326fe3537b tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4082408 Nov 05 14:47:41.187444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.194524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41816) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.200428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 83951ccd-ecac-4142-af05-2957f7709b01 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:41.200893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83951ccd-ecac-4142-af05-2957f7709b01 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:41.209229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.253370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e52cb240-363f-413c-995e-29ff18f19dea']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.256913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:41.260663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.281894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.295834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2de1e38-09e1-4725-a2fd-db718a1efb54 req-decb0e58-64de-4252-9649-331ef63b9ed7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:41.297388 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d2de1e38-09e1-4725-a2fd-db718a1efb54 req-decb0e58-64de-4252-9649-331ef63b9ed7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2584651 Nov 05 14:47:41.300731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.303275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '513e292e-0597-449f-afd4-5834a3410799') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.303598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '513e292e-0597-449f-afd4-5834a3410799') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.354431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.360047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:41.360676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.378280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.435519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.440071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.445403 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/e755eb55-b9ce-42ec-afa7-d6ecdeb17912 HTTP/1.1" status: 204 len: 168 time: 0.2457595 Nov 05 14:47:41.448952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41818) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.452545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.5670817 Nov 05 14:47:41.460206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41820) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.469000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:41.481648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.489141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efc2951-8378-4c54-9a0f-da473076ff67 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e755eb55-b9ce-42ec-afa7-d6ecdeb17912,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:41.504137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Releasing vlan 648 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:41.505308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:41.512897 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:41.516643 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d2de1e38-09e1-4725-a2fd-db718a1efb54 req-c1cb5d3d-d7fb-43ab-a0f2-762db709c105 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1700745 Nov 05 14:47:41.523100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45515ac9-1ae4-4ede-860d-8a24216d7d1f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=0d941fc7-e9da-40d5-a8b5-26174382c84d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:41.546597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:41.548827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Router e6e28daf-a432-4b99-b5c5-52edeeed433c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:41.635415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:41.639051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.654294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e9472a6a-4288-4c08-9ecd-0b4a5668ab2c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1986759 Nov 05 14:47:41.661743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41822) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.662949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.683399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.686570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/networks/e52cb240-363f-413c-995e-29ff18f19dea HTTP/1.1" status: 204 len: 168 time: 2.8191516 Nov 05 14:47:41.690184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41824) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.748950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:41.759591 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fdcc60f8-53c1-496f-a956-142b5945f6e9 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "PUT /v2.0/routers/e6e28daf-a432-4b99-b5c5-52edeeed433c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0726752 Nov 05 14:47:41.761438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41826) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:41.762974 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] Sync routers for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:41.777452 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:41.778990 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.779127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0654ecdf-fb7c-41b5-baef-d5d229efc0aa tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Network': ['ID=e52cb240-363f-413c-995e-29ff18f19dea,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:41.824341 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.841290 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] Routers {'e6e28daf-a432-4b99-b5c5-52edeeed433c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:41.842803 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6e28daf-a432-4b99-b5c5-52edeeed433c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.846962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:47:41.847279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:47:41.882797 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:41.883446 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b929ff0-44c2-4546-8b09-4b2aa6530327 None None] The sync data for ids ['e6e28daf-a432-4b99-b5c5-52edeeed433c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:41.924106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.936981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:41.995523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.010693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.017795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.089242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.092319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=9d5ce551-58db-4073-ae49-e7c43059bdf9,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:42.123046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=aa8246cf-afad-4136-9822-e0e43b06086c,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:42.131563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.138415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:42.138836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 0d941fc7-e9da-40d5-a8b5-26174382c84d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:42.182389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:42.196297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0d941fc7-e9da-40d5-a8b5-26174382c84d) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:42.196611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '56ec4f12-fbec-43fd-8d5b-6dfdba29133f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:42.196874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: 56c39989-7a56-4255-8ad7-419dc0706385, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:42.202077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:42.202725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.202989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port d908586d-349a-4b14-bdfc-42352bb100c7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:42.203338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.212839 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6af1fb1-4b70-42bf-a7f3-a3386590df27 None None] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:42.224504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port 46effe91-4ae9-4fe4-9a06-ddcdf3653f24 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:42.225463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.234411 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-05199ed5-3b24-4de9-8adc-d009accc7b1b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7696021 Nov 05 14:47:42.244744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41828) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c6af1fb1-4b70-42bf-a7f3-a3386590df27 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:42.297493 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:42.313211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d2446a8-4c98-460b-bb80-182a74de978d None None] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:42.331930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.335083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.338753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/b6fab2ae-4539-46cc-9914-995a5e446f9c HTTP/1.1" status: 204 len: 168 time: 0.6714618 Nov 05 14:47:42.340524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41830) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:42.362652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 56c39989-7a56-4255-8ad7-419dc0706385 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:42.374991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fccd56d-df71-41b7-8301-5f8eac17a2ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6fab2ae-4539-46cc-9914-995a5e446f9c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:42.395591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 56c39989-7a56-4255-8ad7-419dc0706385) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:42.399030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.405533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.405857 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.406769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-931ccb02-7be9-4790-a447-90de717f789f None None] Network 56c39989-7a56-4255-8ad7-419dc0706385 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:42.409077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:42.409660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6d2446a8-4c98-460b-bb80-182a74de978d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:42.410182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:42.412253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.432395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for d908586d-349a-4b14-bdfc-42352bb100c7 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:42.489066 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eda67a32-1526-424a-b94f-c1b59795784d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0694733 Nov 05 14:47:42.498444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41832) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-931ccb02-7be9-4790-a447-90de717f789f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:42.505373 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:42.517578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94935a7e-bfd3-4670-9ab1-0eea83f4fde0 None None] Network 56c39989-7a56-4255-8ad7-419dc0706385 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:42.547612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '56c39989-7a56-4255-8ad7-419dc0706385', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-1621753902'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:42.556554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-94935a7e-bfd3-4670-9ab1-0eea83f4fde0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:42.596399 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:42.600257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:42.600346 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-357bcdbf-36ae-4931-adb0-976c34fc78e3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2543528 Nov 05 14:47:42.605288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41836) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:42.611398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e16e639-1187-491e-a1e2-9b5886393e44 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:42.616736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--339268540'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:42.660747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for 46effe91-4ae9-4fe4-9a06-ddcdf3653f24 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:42.748785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.749050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e16e639-1187-491e-a1e2-9b5886393e44 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:42.793638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:42.805819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.809973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2ddec7c5-195d-4a6c-99e9-e4afba335856 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 703 time: 2.2994790 Nov 05 14:47:42.810152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:42.812355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41838) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:42.835170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:42.835804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:42.858820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:42.935186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=d908586d-349a-4b14-bdfc-42352bb100c7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:42.993206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:43.026696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cea09b65-6007-41cd-94da-400d3a474a9a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 703 time: 0.2116883 Nov 05 14:47:43.028703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.033127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41840) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.046136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.129835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f11042-d1c1-48e2-bd38-ed78c6e91ef6 req-a893cc72-202e-4566-b49a-6f6e67c4782d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:43.133011 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-89f11042-d1c1-48e2-bd38-ed78c6e91ef6 req-a893cc72-202e-4566-b49a-6f6e67c4782d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.4966857 Nov 05 14:47:43.171984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.351445 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:43.354542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.394258 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-89f11042-d1c1-48e2-bd38-ed78c6e91ef6 req-9002a6a5-0682-47ac-93ec-0808e987a31b tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2333353 Nov 05 14:47:43.407103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.410006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.411353 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2666843b-45fa-4df8-a3af-d3729b1a0735 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/floatingips/39a923a3-c759-4e2d-a8f4-d2df55d740f1 HTTP/1.1" status: 204 len: 168 time: 1.6962388 Nov 05 14:47:43.417480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41842) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.439518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port b36704e7-e731-48bb-a2fd-04a9235df3de yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:43.440594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.441829 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.8307109 Nov 05 14:47:43.450504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41844) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.458851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': '3919ca3b-e48a-49a3-83d4-83cd39b9cecd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:43.465483 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-7a9886a7-6bd0-49b2-939a-a352a0812e15 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] DELETE failed (client error): The resource could not be found. Nov 05 14:47:43.466154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7a9886a7-6bd0-49b2-939a-a352a0812e15 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:47:43.469233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7a9886a7-6bd0-49b2-939a-a352a0812e15 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/fc70461b-e5fd-49ca-90dc-ba2ce8d4790c HTTP/1.1" status: 404 len: 333 time: 0.0505898 Nov 05 14:47:43.472079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc2c4662-66d6-4a78-affe-5703abe47fbd tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3919ca3b-e48a-49a3-83d4-83cd39b9cecd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:43.473089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0d941fc7-e9da-40d5-a8b5-26174382c84d', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:43.474091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41846) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.475212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.513002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-56c39989-7a56-4255-8ad7-419dc0706385', 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '9d5ce551-58db-4073-ae49-e7c43059bdf9'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:43.513868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.620872 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db93b7ec-e5a4-4a85-8353-8fb3d4592859 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/ports?device_id=3672df9b-7cff-43da-87eb-5b9b05f42cf2 HTTP/1.1" status: 200 len: 205 time: 0.0772419 Nov 05 14:47:43.624356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41848) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.648146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.672712 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-66ee78e9-0014-4931-924f-fd06b131ae8d tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] delete failed (client error): The resource could not be found. Nov 05 14:47:43.676681 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-66ee78e9-0014-4931-924f-fd06b131ae8d tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/routers/3672df9b-7cff-43da-87eb-5b9b05f42cf2 HTTP/1.1" status: 404 len: 336 time: 0.0507238 Nov 05 14:47:43.677242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41850) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.703406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=46effe91-4ae9-4fe4-9a06-ddcdf3653f24,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:43.725952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-bc9e2672-0bc3-47c5-9a5e-1b8133cd105b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] DELETE failed (client error): The resource could not be found. Nov 05 14:47:43.727069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bc9e2672-0bc3-47c5-9a5e-1b8133cd105b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:47:43.732135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bc9e2672-0bc3-47c5-9a5e-1b8133cd105b tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/subnets/ad17c8b1-0ee1-4808-9cee-c052c3e8b4c6 HTTP/1.1" status: 404 len: 337 time: 0.0427697 Nov 05 14:47:43.732975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41852) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:43.761890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.767160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Allocated IP 172.20.0.2 (0d941fc7-e9da-40d5-a8b5-26174382c84d/aa8246cf-afad-4136-9822-e0e43b06086c/f17709b5-1600-41e7-8b16-322e95b4eb0b) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:43.776910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:41Z', 'revision_number': 7, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:43.808925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:43.855287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::1ec (56c39989-7a56-4255-8ad7-419dc0706385/9d5ce551-58db-4073-ae49-e7c43059bdf9/b36704e7-e731-48bb-a2fd-04a9235df3de) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:43.861962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:43.862387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:43.864181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.905530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 847bc79e-f772-436e-8b2b-a881706bd85f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:43.905920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.971701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:43.971975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.981965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.990683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:43.992294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.001479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.047736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.087809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=12fc4daf-fa2f-4be4-ab98-8288dd8b0bc1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.103662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 847bc79e-f772-436e-8b2b-a881706bd85f owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:44.114661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.119997 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23f2c17f-7444-45fd-8e3e-8fabd6467025 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6671963 Nov 05 14:47:44.122806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41854) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:44.124959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.125709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Fanout notify agent at l3_agent the message router_deleted on router e6e28daf-a432-4b99-b5c5-52edeeed433c {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:47:44.134052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.137377 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6d63a5e1-a8b8-46a4-a0e2-67bc43806789 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/routers/e6e28daf-a432-4b99-b5c5-52edeeed433c HTTP/1.1" status: 204 len: 168 time: 2.3734200 Nov 05 14:47:44.139252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': '3919ca3b-e48a-49a3-83d4-83cd39b9cecd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:44.144358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41856) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:44.169904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.181908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.266789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:44.269323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.269667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.20.0.1 (0d941fc7-e9da-40d5-a8b5-26174382c84d/aa8246cf-afad-4136-9822-e0e43b06086c/e61f38d5-4494-4ce4-b69f-400225dbfec1) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:44.274360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.275078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:44.278339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:44.280547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Pushing event updated for resources: {'Port': ['ID=f17709b5-1600-41e7-8b16-322e95b4eb0b,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.283452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting subnet b78a57f4-c61c-4312-97f0-1447ac268aab {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:44.287777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.361529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:41Z', 'revision_number': 7, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:44.365286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Attempting to bind port f17709b5-1600-41e7-8b16-322e95b4eb0b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:44.365870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Attempting to bind port f17709b5-1600-41e7-8b16-322e95b4eb0b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:44.366407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Attempting to bind port f17709b5-1600-41e7-8b16-322e95b4eb0b on network 0d941fc7-e9da-40d5-a8b5-26174382c84d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:44.396652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7503b922-40e2-47ab-bea8-df0eea49a3a9 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:41Z', 'revision_number': 7, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5', 'name': '', 'network_id': '69c5a99e-4b1d-45d3-ac20-56f420b70051', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:bb:4c:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:32Z', 'updated_at': '2021-11-05T14:47:38Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': 'b821e8d9-71a6-4f8a-9f12-735b1439a1e6', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:44.398942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.402514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:44.402514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Checking segment: {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:44.402514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.402514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Bound using segment: {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:44.402951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Bound port: f17709b5-1600-41e7-8b16-322e95b4eb0b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:44.403239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.415506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.435398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.446813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.482665 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] For port f17709b5-1600-41e7-8b16-322e95b4eb0b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:44.488405 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] For port f17709b5-1600-41e7-8b16-322e95b4eb0b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17709b5-1600-41e7-8b16-322e95b4eb0b,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:44.504499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.528161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.546825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77d6d7a5-3c0d-4285-a678-f35f8f240909,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.569087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=847bc79e-f772-436e-8b2b-a881706bd85f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.573103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.574945 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58852186-9946-476b-b2ec-36e2eabb562d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4510000 Nov 05 14:47:44.581893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41860) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:44.595505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': '3919ca3b-e48a-49a3-83d4-83cd39b9cecd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:44.643825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 56c39989-7a56-4255-8ad7-419dc0706385 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:44.648784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed0849d-0cbb-4f3a-b3d4-9d8dc957fbfb None None] Pushing event updated for resources: {'Port': ['ID=f17709b5-1600-41e7-8b16-322e95b4eb0b,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.655900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.663645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:44.667273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:44.673876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:44.674532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.689266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Allocated IP 2001:db8::2 (56c39989-7a56-4255-8ad7-419dc0706385/9d5ce551-58db-4073-ae49-e7c43059bdf9/709750b6-c88d-4cae-a033-e3d0ed032cab) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:44.706369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.708008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=b36704e7-e731-48bb-a2fd-04a9235df3de,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.717835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.726434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:44.726777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.751112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca0d764c-be0e-4325-bdf4-00810e9df05c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 893 time: 2.2427633 Nov 05 14:47:44.752828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41862) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:44.835476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.864496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776f460d-b768-4730-862e-1fe4b6717231 req-5d880b72-3892-479e-949c-ed3039c2b867 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:44.866336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-776f460d-b768-4730-862e-1fe4b6717231 req-5d880b72-3892-479e-949c-ed3039c2b867 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2880466 Nov 05 14:47:44.870904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.877351 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fde041ad-607a-4425-b397-886f91556603 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/847bc79e-f772-436e-8b2b-a881706bd85f HTTP/1.1" status: 204 len: 168 time: 1.1403563 Nov 05 14:47:44.884275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41864) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:44.907346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.975946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.979082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.986436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Subnet': ['ID=b78a57f4-c61c-4312-97f0-1447ac268aab,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:44.990852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.991389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:44.995424 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9bb47d91-8332-4050-bbd4-d70bb20da585 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/subnets/b78a57f4-c61c-4312-97f0-1447ac268aab HTTP/1.1" status: 204 len: 168 time: 0.8500848 Nov 05 14:47:45.019290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41866) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:45.029994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:45.030435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.043993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Network 56c39989-7a56-4255-8ad7-419dc0706385 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:45.045609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:45.050838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:45.054509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:45.087569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Pushing event updated for resources: {'Port': ['ID=709750b6-c88d-4cae-a033-e3d0ed032cab,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.139708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:45.148726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Attempting to bind port 709750b6-c88d-4cae-a033-e3d0ed032cab on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:45.149232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Attempting to bind port 709750b6-c88d-4cae-a033-e3d0ed032cab by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '56ec4f12-fbec-43fd-8d5b-6dfdba29133f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:45.149777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Attempting to bind port 709750b6-c88d-4cae-a033-e3d0ed032cab on network 56c39989-7a56-4255-8ad7-419dc0706385 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:45.156098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:45.156619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Checking segment: {'id': '56ec4f12-fbec-43fd-8d5b-6dfdba29133f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:45.157391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.157784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Bound using segment: {'id': '56ec4f12-fbec-43fd-8d5b-6dfdba29133f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:45.158254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Bound port: 709750b6-c88d-4cae-a033-e3d0ed032cab, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56ec4f12-fbec-43fd-8d5b-6dfdba29133f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '56c39989-7a56-4255-8ad7-419dc0706385'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:45.158675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.159696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.168404 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-776f460d-b768-4730-862e-1fe4b6717231 req-b219f061-989f-40a1-b12b-fc5b233a3d09 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2856326 Nov 05 14:47:45.177066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.179587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:45.188918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:45.246919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.254173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port b36704e7-e731-48bb-a2fd-04a9235df3de {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:45.254514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.262524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1438ece4-1dd5-4335-8948-6cfaf910ac45,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.275145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.276490 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b1ea9632-d0ca-4319-a27b-2b6afded3edb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6925833 Nov 05 14:47:45.279224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41868) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:45.287272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': '3919ca3b-e48a-49a3-83d4-83cd39b9cecd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:45.297881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] For port 709750b6-c88d-4cae-a033-e3d0ed032cab, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:45.301632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17709b5-1600-41e7-8b16-322e95b4eb0b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:45.305478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] For port 709750b6-c88d-4cae-a033-e3d0ed032cab, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=709750b6-c88d-4cae-a033-e3d0ed032cab,segment=NetworkSegment(56ec4f12-fbec-43fd-8d5b-6dfdba29133f),segment_id=56ec4f12-fbec-43fd-8d5b-6dfdba29133f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:45.330382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.335381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.337314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port c9c433fd-a471-45c2-8f0a-e09334e2fdc6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:45.337654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.358873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.368569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.420910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c45d7ea-099b-4c00-9b89-dc4dffb00a1b None None] Pushing event updated for resources: {'Port': ['ID=709750b6-c88d-4cae-a033-e3d0ed032cab,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.431052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f17709b5-1600-41e7-8b16-322e95b4eb0b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:45.431518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.434944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.530554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.556175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.568398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port f17709b5-1600-41e7-8b16-322e95b4eb0b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17709b5-1600-41e7-8b16-322e95b4eb0b,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:45.572946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.578356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.586986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.607110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for b36704e7-e731-48bb-a2fd-04a9235df3de owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:45.617922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98f4fca1-fdb3-4208-af62-79853f273f9f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.627631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.630264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7d3fe786-1243-423f-a9b6-09144e1bcbae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3481958 Nov 05 14:47:45.632294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.642970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41870) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:45.654103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=f17709b5-1600-41e7-8b16-322e95b4eb0b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:45.659962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': '3919ca3b-e48a-49a3-83d4-83cd39b9cecd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:45.667928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.672144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port 6c9be92a-4c10-4474-9443-3eacf4f37558 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:45.672491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.754723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] For port 6c9be92a-4c10-4474-9443-3eacf4f37558, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6c9be92a-4c10-4474-9443-3eacf4f37558,segment=NetworkSegment(c1962c9b-c098-47a0-8037-8f8f49cad9ce),segment_id=c1962c9b-c098-47a0-8037-8f8f49cad9ce)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:45.755042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:45.768994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for 6c9be92a-4c10-4474-9443-3eacf4f37558 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:45.907958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:46.019112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:46.027713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c1e97285-9fa9-4b44-8ca7-c45379ee4707 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9928133 Nov 05 14:47:46.029296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:46.029971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41872) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:46.045274 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:46.046191 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:46.099767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet b821e8d9-71a6-4f8a-9f12-735b1439a1e6 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:46.107444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.138594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-308a7c4f-c72f-4957-93d4-fab9ed28f7d2 None None] Provisioning complete for port f17709b5-1600-41e7-8b16-322e95b4eb0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:46.139186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-308a7c4f-c72f-4957-93d4-fab9ed28f7d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.158260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for c9c433fd-a471-45c2-8f0a-e09334e2fdc6 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:46.160720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.161433 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:46.223779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.292285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.362487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.384340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.414111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=b821e8d9-71a6-4f8a-9f12-735b1439a1e6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:46.420542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.424809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-364c2159-dcac-4bb5-b51a-30cb31c119fb tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/b821e8d9-71a6-4f8a-9f12-735b1439a1e6 HTTP/1.1" status: 204 len: 168 time: 0.3935878 Nov 05 14:47:46.428525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41876) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:46.530029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.540669 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 8, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:46.573249 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:46.583819 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:46.584767 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:46.605385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:46.606231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.657303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.687185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,segment=NetworkSegment(318ab219-8855-4fd6-bdea-65a663eb9894),segment_id=318ab219-8855-4fd6-bdea-65a663eb9894)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:46.687426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.694914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d325f267-a2a7-4a22-a5fa-db138e8d14f1 req-c431c993-23f1-4a5a-b970-aba31b95ce7f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:46.696567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4d83af0-ec19-4e86-b147-aaa43e385a42 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:46.696715 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d325f267-a2a7-4a22-a5fa-db138e8d14f1 req-c431c993-23f1-4a5a-b970-aba31b95ce7f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3851883 Nov 05 14:47:46.708090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:46.713879 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:46.723083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.732296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=b36704e7-e731-48bb-a2fd-04a9235df3de,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:46.768115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.825400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.841169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.844259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Provisioning complete for port f17709b5-1600-41e7-8b16-322e95b4eb0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:46.845224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.852695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=14fbc4aa-652d-4722-b7e7-7fefcfbf3c80,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:46.858447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=6c9be92a-4c10-4474-9443-3eacf4f37558,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:46.861686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:46.863919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] No DVR routers for this DVR port 6c9be92a-4c10-4474-9443-3eacf4f37558 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:46.867340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:46.873834 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dcf1b61d-54b2-4655-b382-adc5ec4b199c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/b36704e7-e731-48bb-a2fd-04a9235df3de HTTP/1.1" status: 204 len: 168 time: 2.1182477 Nov 05 14:47:46.887571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41878) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:46.919953 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-7144dfaf-cd41-44a8-b919-82e803f182f2 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:47:46.924986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7144dfaf-cd41-44a8-b919-82e803f182f2 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/b36704e7-e731-48bb-a2fd-04a9235df3de HTTP/1.1" status: 404 len: 333 time: 0.0355875 Nov 05 14:47:46.928497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4d83af0-ec19-4e86-b147-aaa43e385a42 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:46.949475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be19f3da-682a-4403-b16a-29ad420f834f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:46.954277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41880) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:46.993397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.015439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['69c5a99e-4b1d-45d3-ac20-56f420b70051']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.026178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '318ab219-8855-4fd6-bdea-65a663eb9894') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.026480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '318ab219-8855-4fd6-bdea-65a663eb9894') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.030757 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 8, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.037129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.037320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.041624 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c104b283-d66d-4c3d-b474-0cbd00f29442 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 1.3939140 Nov 05 14:47:47.050902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.052897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.059560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:47.059560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.060523 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d325f267-a2a7-4a22-a5fa-db138e8d14f1 req-71287b0f-07bc-4478-b23f-e1a5fb1284dc tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3386233 Nov 05 14:47:47.075054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Provisioning complete for port 709750b6-c88d-4cae-a033-e3d0ed032cab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:47.075620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.115627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.138703 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-991aed13-0753-47b4-803a-7e5271a27da5 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 8, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '94e6657e-0b4c-4d4c-aea4-e92e173c7045', 'name': '', 'network_id': '0fdf843c-7982-468e-94d0-f4115b6b1a14', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:ae:01:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:22Z', 'updated_at': '2021-11-05T14:47:30Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6c19ebe2-7077-4835-9f1a-e3750940caf5', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:47.164976 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:47.172542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.194317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.197623 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/69c5a99e-4b1d-45d3-ac20-56f420b70051 HTTP/1.1" status: 204 len: 168 time: 0.7678709 Nov 05 14:47:47.198499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4f7af5-0e5c-40c0-9184-d7deb574b95a tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=69c5a99e-4b1d-45d3-ac20-56f420b70051,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:47.200737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41884) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.226831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.242139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=c9c433fd-a471-45c2-8f0a-e09334e2fdc6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:47.265745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 9d5ce551-58db-4073-ae49-e7c43059bdf9 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:47.284209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.287784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55f3c8c4-4916-4d69-b913-0862a86fec4a']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.303782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.322210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.351548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.355562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c1962c9b-c098-47a0-8037-8f8f49cad9ce') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.355945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c1962c9b-c098-47a0-8037-8f8f49cad9ce') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:47.387881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] For port 709750b6-c88d-4cae-a033-e3d0ed032cab, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=709750b6-c88d-4cae-a033-e3d0ed032cab,segment=NetworkSegment(56ec4f12-fbec-43fd-8d5b-6dfdba29133f),segment_id=56ec4f12-fbec-43fd-8d5b-6dfdba29133f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:47.398020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.418123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.428224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.460667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a09de1e6-2db2-4191-a997-016b3e40102d None None] Pushing event updated for resources: {'Port': ['ID=709750b6-c88d-4cae-a033-e3d0ed032cab,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:47.494986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.498625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.513444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.520098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8aaf98c0-53ce-4d5b-b0cf-e0034a3d2b31 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/ports/c9c433fd-a471-45c2-8f0a-e09334e2fdc6 HTTP/1.1" status: 204 len: 168 time: 2.6142840 Nov 05 14:47:47.524382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41886) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.527802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.545312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.549244 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/be19f3da-682a-4403-b16a-29ad420f834f HTTP/1.1" status: 204 len: 168 time: 0.4849963 Nov 05 14:47:47.549244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.551352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41888) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.571194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Releasing vlan 638 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:47.571634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.623746 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9465afc5-8ff3-4844-bd0c-e8fe7eacb830 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0688214 Nov 05 14:47:47.624714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41890) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:47.626792 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:47.688225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.701991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.775257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.780552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.784361 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/98f4fca1-fdb3-4208-af62-79853f273f9f HTTP/1.1" status: 204 len: 168 time: 0.1572471 Nov 05 14:47:47.790144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41892) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.814871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eac67ab-2067-4cf7-8e44-c172e20d741a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=98f4fca1-fdb3-4208-af62-79853f273f9f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:47.819713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5ab4460-bbb6-4451-a9c0-6edfe027ea61 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=be19f3da-682a-4403-b16a-29ad420f834f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:47.825389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.881100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17709b5-1600-41e7-8b16-322e95b4eb0b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:47.960361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:47.965230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-51a0c96d-f7a1-4b62-91d7-d6496caf3cfb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.1724815 Nov 05 14:47:47.969175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41894) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:47.992955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f17709b5-1600-41e7-8b16-322e95b4eb0b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:47.993473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.012851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.026130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.083799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.135145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 709750b6-c88d-4cae-a033-e3d0ed032cab up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:48.140993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.148107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.148715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.149629 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/1438ece4-1dd5-4335-8948-6cfaf910ac45 HTTP/1.1" status: 204 len: 168 time: 0.1793857 Nov 05 14:47:48.153674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41898) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:48.164562 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/9d5ce551-58db-4073-ae49-e7c43059bdf9 HTTP/1.1" status: 204 len: 168 time: 1.1759763 Nov 05 14:47:48.169364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:48.174827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df76938-3f5f-4de4-977e-365ce1a606e1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=9d5ce551-58db-4073-ae49-e7c43059bdf9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:48.187469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada7d0ba-f9dc-4d68-b4b1-14dddd309b43 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1438ece4-1dd5-4335-8948-6cfaf910ac45,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:48.198461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.203870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.217768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:48.229257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.235247 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/networks/55f3c8c4-4916-4d69-b913-0862a86fec4a HTTP/1.1" status: 204 len: 168 time: 3.2112608 Nov 05 14:47:48.260294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:48.268809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.280389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 709750b6-c88d-4cae-a033-e3d0ed032cab triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:48.280812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.284970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf90c129-b2ac-496b-a4b4-d8e848d08dec tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Network': ['ID=55f3c8c4-4916-4d69-b913-0862a86fec4a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:48.332401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a800a3ba-c03a-4f85-8326-f24eeb7b33a9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:48.341058 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a800a3ba-c03a-4f85-8326-f24eeb7b33a9 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "GET /v2.0/ports?device_id=53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c HTTP/1.1" status: 200 len: 913 time: 0.8106632 Nov 05 14:47:48.379712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:48.504345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b22be14-3c38-444c-80e8-ff303ae5dd41 None None] Network 55f3c8c4-4916-4d69-b913-0862a86fec4a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5b22be14-3c38-444c-80e8-ff303ae5dd41 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:47:48.526264 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:48.564867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Provisioning complete for port f17709b5-1600-41e7-8b16-322e95b4eb0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:48.565452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.636595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:48.640603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:48.718700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ac9d595-20d1-4fd9-8f3a-985ea37c21f5 None None] DHCP port deletion for 55f3c8c4-4916-4d69-b913-0862a86fec4a request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:48.750206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Provisioning complete for port e61f38d5-4494-4ce4-b69f-400225dbfec1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:48.750821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.795058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Port e61f38d5-4494-4ce4-b69f-400225dbfec1 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:48.808896 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-25126169-5778-4167-b814-c80c22102b27 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.6528234 Nov 05 14:47:48.816363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Provisioning complete for port 709750b6-c88d-4cae-a033-e3d0ed032cab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:48.816852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-49777aec-1bdb-4077-bedc-c400fcec0468 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.823274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41906) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:48.831724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:48.864875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547857f1-0519-4cdf-8916-0d5f7d292c2b req-b4558119-f6f9-45ff-b232-1a64b003e9ae tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:48.872564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-547857f1-0519-4cdf-8916-0d5f7d292c2b req-b4558119-f6f9-45ff-b232-1a64b003e9ae tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.6542180 Nov 05 14:47:48.990873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 94e6657e-0b4c-4d4c-aea4-e92e173c7045 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:48.991454 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.022306 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-547857f1-0519-4cdf-8916-0d5f7d292c2b req-7ffc6906-49c1-47da-9e5a-15059c1b66ce tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1335025 Nov 05 14:47:49.039183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.066666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.129335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 709750b6-c88d-4cae-a033-e3d0ed032cab {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:49.129952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.242107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efb1ca5d-ef8a-4f0e-aa8a-013a1dc6faa7 None None] Network 56c39989-7a56-4255-8ad7-419dc0706385 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:49.244724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8392a2cf-395d-40ee-a7b4-5d57c03fa301 None None] DHCP port deletion for 69c5a99e-4b1d-45d3-ac20-56f420b70051 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:49.246060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 94e6657e-0b4c-4d4c-aea4-e92e173c7045, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=94e6657e-0b4c-4d4c-aea4-e92e173c7045,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:49.246755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.246881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 709750b6-c88d-4cae-a033-e3d0ed032cab up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:49.266888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port 709750b6-c88d-4cae-a033-e3d0ed032cab, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=709750b6-c88d-4cae-a033-e3d0ed032cab,segment=NetworkSegment(56ec4f12-fbec-43fd-8d5b-6dfdba29133f),segment_id=56ec4f12-fbec-43fd-8d5b-6dfdba29133f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:49.267537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.280866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 94e6657e-0b4c-4d4c-aea4-e92e173c7045 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:49.296422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 709750b6-c88d-4cae-a033-e3d0ed032cab owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:49.379865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 709750b6-c88d-4cae-a033-e3d0ed032cab triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:49.380229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.439979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Deleting port 94044d6f-6897-42d8-a7a8-264bdd92cd39 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:49.440315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.461094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.466629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.467973 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/77d6d7a5-3c0d-4285-a678-f35f8f240909 HTTP/1.1" status: 204 len: 168 time: 0.6424062 Nov 05 14:47:49.475236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41908) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:49.515167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.535971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ec6f228c-ce6c-4831-90db-6b89dc6389e1 None None] Provisioning complete for port e61f38d5-4494-4ce4-b69f-400225dbfec1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:49.537155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ec6f228c-ce6c-4831-90db-6b89dc6389e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.537295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbb3f49-9cfb-424e-a964-b1e95872bf48 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=77d6d7a5-3c0d-4285-a678-f35f8f240909,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:49.565575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:49.567982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f631690-41e8-4a4e-ab75-c5e4f1e3c676 None None] DHCP port deletion for 56c39989-7a56-4255-8ad7-419dc0706385 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:49.582938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=709750b6-c88d-4cae-a033-e3d0ed032cab,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:49.595054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port 709750b6-c88d-4cae-a033-e3d0ed032cab on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:49.611661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:49.611661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9a872a2c-3d0d-49ad-b9f5-fe16ab1db6e5 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:49.612350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6c9be92a-4c10-4474-9443-3eacf4f37558 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:49.620007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:47:49.638567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 6c9be92a-4c10-4474-9443-3eacf4f37558 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:49.639427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6c9be92a-4c10-4474-9443-3eacf4f37558 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:49.640672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c2fb289-0de6-4b31-a79e-750ed19ef05d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:49.660221 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bbe3ce94-cb82-4a92-ab8b-5cae7eb8ac4d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1834490 Nov 05 14:47:49.668293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ec6f228c-ce6c-4831-90db-6b89dc6389e1 None None] Port e61f38d5-4494-4ce4-b69f-400225dbfec1 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:49.675779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ec6f228c-ce6c-4831-90db-6b89dc6389e1 None None] Could not find standard attr ID for object b36704e7-e731-48bb-a2fd-04a9235df3de. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:47:49.694233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41910) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:49.743761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.749944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.750276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.758476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c2fb289-0de6-4b31-a79e-750ed19ef05d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:49.794390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.799155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=94e6657e-0b4c-4d4c-aea4-e92e173c7045,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:49.806906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Calling delete_port for 94044d6f-6897-42d8-a7a8-264bdd92cd39 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:49.834993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:49.849531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.855876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['56c39989-7a56-4255-8ad7-419dc0706385']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:49.857491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:49.881096 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-719be9cb-1f1d-4d8e-97ed-cfc943f7d8ab tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6356308 Nov 05 14:47:49.881711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41912) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:49.892244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:49.892895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:49.895575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-1251982296'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:49.907900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.925097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:49.929117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.951735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56ec4f12-fbec-43fd-8d5b-6dfdba29133f') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:49.951735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56ec4f12-fbec-43fd-8d5b-6dfdba29133f') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:49.972082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:49.997984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 626} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:50.000192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.018491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:50.019334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:50.026462 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:50.038540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.038887 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment a0379f26-89d2-4e16-a3e0-05aaaa854d3e of type vlan for network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc Nov 05 14:47:50.075097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.077970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.090034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.094963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.097337 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/12fc4daf-fa2f-4be4-ab98-8288dd8b0bc1 HTTP/1.1" status: 204 len: 168 time: 0.3678508 Nov 05 14:47:50.103332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41916) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.118611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:50.120435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-59bd0b7f-9faf-4c4b-b496-26e1b4e93f2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.174301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b911f047-a36e-4b58-adf2-ea824eaf74c3 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=12fc4daf-fa2f-4be4-ab98-8288dd8b0bc1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:50.175684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.189121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.252777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.257205 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/56c39989-7a56-4255-8ad7-419dc0706385 HTTP/1.1" status: 204 len: 168 time: 2.0868723 Nov 05 14:47:50.263868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41918) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.280376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'name': 'tempest-PortsIpV6TestJSON-1630684668'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:50.292373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.341487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8dd4d389-8e7e-48a3-a86b-8018e9da20b5 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2294195 Nov 05 14:47:50.344275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41920) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.352366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642ce2bf-0eeb-4580-ace9-6a09093fe412 req-b9830a69-75f2-4968-824a-78fe2f96b1ec tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:50.353924 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-642ce2bf-0eeb-4580-ace9-6a09093fe412 req-b9830a69-75f2-4968-824a-78fe2f96b1ec tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1886327 Nov 05 14:47:50.377936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b3a706e-f130-428d-8eb7-600296b639d6 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=56c39989-7a56-4255-8ad7-419dc0706385,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:50.386422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Pushing event deleted for resources: {'Port': ['ID=94044d6f-6897-42d8-a7a8-264bdd92cd39,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:50.423995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.430688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:50.431321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.435692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.481404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.545411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:46Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:50.599823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:50.600190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Updating router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 port e61f38d5-4494-4ce4-b69f-400225dbfec1 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:50.605587 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.7210293 Nov 05 14:47:50.615946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.625779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:50.633635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.637280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.638867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/3919ca3b-e48a-49a3-83d4-83cd39b9cecd HTTP/1.1" status: 204 len: 168 time: 0.2926474 Nov 05 14:47:50.645162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41924) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.656888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.660231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.661672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-63a7d098-e0cb-4901-b583-1104f5bd1456 tempest-FloatingIPAdminTestJSON-722880978 tempest-FloatingIPAdminTestJSON-722880978-project] 10.222.0.30 "DELETE /v2.0/floatingips/cfbcce62-0ca0-402c-b640-44d0224e3e8b HTTP/1.1" status: 204 len: 168 time: 2.3970511 Nov 05 14:47:50.671213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.725322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d033fa-846c-43d3-bfcd-536e525c23cf tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3919ca3b-e48a-49a3-83d4-83cd39b9cecd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:50.766315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-621b851a-46d4-43c7-9785-935f6439f1bd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=86b74c83-f53f-4a3a-9f3f-2e22dd8234dc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:50.784837 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-642ce2bf-0eeb-4580-ace9-6a09093fe412 req-2f9f509b-85c1-401d-b045-850e14e8ea7d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3960431 Nov 05 14:47:50.802334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:50.809348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:50.837861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:50.847625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:50.854469 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2383cce6-9055-450d-b7df-be28bdf6d8cb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1964388 Nov 05 14:47:50.865712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41930) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:50.874591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--2006813369'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:50.948497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port bb4761c4-8825-4ce3-809a-b38c5272909a yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:51.010629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:51.014155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.121932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.129797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:51.141878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f5cfe172-0bba-4d60-af8d-7157fd356e1e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9401166 Nov 05 14:47:51.142607 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:51.182412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41936) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:51.192428 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:51.193813 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:51.200258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41938) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:51.294326 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:51.316578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:51.316984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.322481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731b5906-a94a-4562-8620-c48113d7290e req-e34bfc0c-520f-46b2-8102-ff7ed100ec5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:51.326295 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-e34bfc0c-520f-46b2-8102-ff7ed100ec5f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.2710083 Nov 05 14:47:51.361281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 6c19ebe2-7077-4835-9f1a-e3750940caf5 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:51.385275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3129e3-4515-4fd4-84e4-c61ae3ad308e req-ad092e22-81c1-41f4-b7fd-d89369e78b6f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:51.386802 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b3129e3-4515-4fd4-84e4-c61ae3ad308e req-ad092e22-81c1-41f4-b7fd-d89369e78b6f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2648301 Nov 05 14:47:51.431809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 709750b6-c88d-4cae-a033-e3d0ed032cab no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:51.462360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.463146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.490398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.516412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 709750b6-c88d-4cae-a033-e3d0ed032cab {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:51.516931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 709750b6-c88d-4cae-a033-e3d0ed032cab not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:51.518327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:51.532293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cac2b08a-be00-4346-8fbd-0e31ffd55038,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:51.560207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.568330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.571855 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ad070e19-b236-4685-8760-0d9e7041c26a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7025795 Nov 05 14:47:51.576421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.580593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41942) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:51.585871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'cac2b08a-be00-4346-8fbd-0e31ffd55038', 'direction': 'ingress', 'protocol': 17}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:51.593591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:51.594923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 14fbc4aa-652d-4722-b7e7-7fefcfbf3c80 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:51.612919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.696113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.723742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b3129e3-4515-4fd4-84e4-c61ae3ad308e req-ff939cdb-ec87-49c5-8725-9ea37b047ab2 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2939920 Nov 05 14:47:51.728930 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-121af098-1265-4cd9-b834-f7a106097fb1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c42c986e04e54c80b6aef0970f0c38a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5069470 Nov 05 14:47:51.742633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c0cd48-1514-47ba-85a3-a913c0709084 None None] Pushing event updated for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:51.746551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41944) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:51.763713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:49Z', 'revision_number': 9, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:51.765115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.768298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.826709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Attempting to bind port e61f38d5-4494-4ce4-b69f-400225dbfec1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:51.827462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Attempting to bind port e61f38d5-4494-4ce4-b69f-400225dbfec1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:51.828069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Attempting to bind port e61f38d5-4494-4ce4-b69f-400225dbfec1 on network 0d941fc7-e9da-40d5-a8b5-26174382c84d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:51.832439 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:51.835508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.839308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:51.840079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Checking segment: {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:51.841569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.842313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Bound using segment: {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:51.843548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Bound port: e61f38d5-4494-4ce4-b69f-400225dbfec1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 600, 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:51.844271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.854348 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:51.854971 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:51.862163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:51.864349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731b5906-a94a-4562-8620-c48113d7290e req-9852be73-35b8-45b5-94a1-03ca4e9a7eed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:51.865940 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-9852be73-35b8-45b5-94a1-03ca4e9a7eed service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.4967625 Nov 05 14:47:51.922233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:51.960989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] For port e61f38d5-4494-4ce4-b69f-400225dbfec1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:51.968890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] For port e61f38d5-4494-4ce4-b69f-400225dbfec1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e61f38d5-4494-4ce4-b69f-400225dbfec1,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:51.984653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.033153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a155eec2-e838-4894-9128-d3dff487ec5e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:52.042202 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:52.045772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.061760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-c6583901-4c1c-4d48-8682-296ae74072cf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.1688223 Nov 05 14:47:52.077632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.083070 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b5ad650d-309e-4c9c-8197-192884dbc8dc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.4990730 Nov 05 14:47:52.091594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.100245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41946) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:52.128045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.130978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.132232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] Provisioning complete for port e61f38d5-4494-4ce4-b69f-400225dbfec1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:52.138630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.149885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:52.150965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:52.205704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:52.223741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c0cd48-1514-47ba-85a3-a913c0709084 None None] Pushing event updated for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:52.245283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:52.288066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:52.293793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:52.294443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.308572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.310449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=bb4761c4-8825-4ce3-809a-b38c5272909a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:52.312172 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:49Z', 'revision_number': 9, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:52.346470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731b5906-a94a-4562-8620-c48113d7290e req-422d9e3a-7cb2-4d5e-8c46-9d4f20102d3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:52.348588 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc04b3d7-a118-4757-af26-8f91805d5711 None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:49Z', 'revision_number': 9, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '5031e98f-53f2-4342-92c1-6581a63a6416', 'name': '', 'network_id': '39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:08:15:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': '08e17274-b197-46e0-912c-f6754806a9e1', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:13Z', 'updated_at': '2021-11-05T14:47:18Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '08e17274-b197-46e0-912c-f6754806a9e1', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:52.349418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-422d9e3a-7cb2-4d5e-8c46-9d4f20102d3c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.2270999 Nov 05 14:47:52.370546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:52.370546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:47:52.386170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=9982b8d7-8946-4c79-ab2e-d9340565a4f3,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:52.409176 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa0f3748-c612-41a9-8f68-a735cff3fe97 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 2.1420109 Nov 05 14:47:52.412922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41948) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:52.451371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.454181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:47:52.462910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b1d5605-1af1-463c-b7e3-1865b00f9a8d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.485193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:52.494009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.502233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:52.507354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:52.507945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.529233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731b5906-a94a-4562-8620-c48113d7290e req-305ec8bb-649f-4853-85d8-7674ceaee89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:52.530746 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-305ec8bb-649f-4853-85d8-7674ceaee89c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1673694 Nov 05 14:47:52.538439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4a3554e-f998-4cd5-8870-36046d2a40d5 None None] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:52.552944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.555483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.559184 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e4d80342-2cf7-445d-8230-5dbb7507ca4f HTTP/1.1" status: 204 len: 168 time: 0.8091390 Nov 05 14:47:52.565756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=6c19ebe2-7077-4835-9f1a-e3750940caf5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:52.583065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.591386 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-45a25250-a363-4061-8d5b-5345f0681f7d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/6c19ebe2-7077-4835-9f1a-e3750940caf5 HTTP/1.1" status: 204 len: 168 time: 1.4013498 Nov 05 14:47:52.594405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.598288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41952) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:52.625230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5ffb202-ede5-4510-bcb9-1e79766f2705 None None] Network 0fdf843c-7982-468e-94d0-f4115b6b1a14 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:52.721582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:52.737981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e96af6cf-a9cb-4827-94e4-967be5e9018d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.1173215 Nov 05 14:47:52.751022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41954) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:52.915365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.036388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88702252-41e6-4765-8a12-324549c573f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4d80342-2cf7-445d-8230-5dbb7507ca4f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.137462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port bb4761c4-8825-4ce3-809a-b38c5272909a {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:53.138079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.139794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 94e6657e-0b4c-4d4c-aea4-e92e173c7045 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a4a3554e-f998-4cd5-8870-36046d2a40d5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:53.148855 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:53.187969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-461fe3f7-2c1f-4043-ad9a-30379816ec47 None None] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:47:53.191771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] For port e61f38d5-4494-4ce4-b69f-400225dbfec1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e61f38d5-4494-4ce4-b69f-400225dbfec1,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:53.211792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 94e6657e-0b4c-4d4c-aea4-e92e173c7045 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:53.212213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 94e6657e-0b4c-4d4c-aea4-e92e173c7045 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:53.225259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41964) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:53.248937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.269386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.297010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7dbb51b8-2e3e-47f5-95e9-f2926d838981 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.317214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=03d6a465-f1b8-4be5-bcf0-ec5ce49bdcee,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.341223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.386686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for bb4761c4-8825-4ce3-809a-b38c5272909a owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:53.406113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-3fe693ea-5aab-4326-9ba7-4019b5ea3978 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8483605 Nov 05 14:47:53.420369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] DHCP port deletion for 0fdf843c-7982-468e-94d0-f4115b6b1a14 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:47:53.467308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a746ac-5238-4fd1-9af0-ae3c10ba45ac None None] Pushing event updated for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.470375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-461fe3f7-2c1f-4043-ad9a-30379816ec47 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:47:53.471894 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:47:53.484500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.487644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.491764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/cac2b08a-be00-4346-8fbd-0e31ffd55038 HTTP/1.1" status: 204 len: 168 time: 1.3795719 Nov 05 14:47:53.506827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41968) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:53.511379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1929622b-2f11-4fed-b740-1cbbeab9bc3e None None] Provisioning complete for port e61f38d5-4494-4ce4-b69f-400225dbfec1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:53.511754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1929622b-2f11-4fed-b740-1cbbeab9bc3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.560510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1f3738-055c-4d20-b9d4-eb7b5fce5173 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cac2b08a-be00-4346-8fbd-0e31ffd55038,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.563457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:51Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:53.606973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae5eb4f-bc26-42e2-be00-62d733fe1045 None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:45Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:51Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:53.619567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb207b9-8fff-4575-9591-53134c3e463a req-fcc5d714-331d-43b6-bf41-7fc602bf5fd7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:53.621676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fb207b9-8fff-4575-9591-53134c3e463a req-fcc5d714-331d-43b6-bf41-7fc602bf5fd7 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.6979113 Nov 05 14:47:53.624080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Deleting port 47cdf27d-8821-436b-92cc-df3431932767 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:53.624507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.640187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 47cdf27d-8821-436b-92cc-df3431932767 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:53.641556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.714500 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-731b5906-a94a-4562-8620-c48113d7290e req-4c0874c4-6d70-4096-b186-759159f7ff13 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2981167 Nov 05 14:47:53.738594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] For port 47cdf27d-8821-436b-92cc-df3431932767, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=47cdf27d-8821-436b-92cc-df3431932767,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:53.739173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.755618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Calling delete_port for 47cdf27d-8821-436b-92cc-df3431932767 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:53.795040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7dbb51b8-2e3e-47f5-95e9-f2926d838981 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.795668 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b813698e-ab79-4186-91d2-0148d7a642fb tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2807336 Nov 05 14:47:53.799610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41970) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:53.806135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--1449347282'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:53.818944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7dbb51b8-2e3e-47f5-95e9-f2926d838981 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.846423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.856439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.877568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 47cdf27d-8821-436b-92cc-df3431932767, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=47cdf27d-8821-436b-92cc-df3431932767,segment=NetworkSegment(9a83dd0f-1883-433c-afe5-4aed57ac9495),segment_id=9a83dd0f-1883-433c-afe5-4aed57ac9495)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:53.877568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.889156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] Pushing event deleted for resources: {'Port': ['ID=47cdf27d-8821-436b-92cc-df3431932767,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.892873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dbe45ef-1370-4649-9673-e82979c8ad8d None None] No DVR routers for this DVR port 47cdf27d-8821-436b-92cc-df3431932767 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:53.916837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.922695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7dbb51b8-2e3e-47f5-95e9-f2926d838981 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3ea5d6d921a24b999731f88393fc8df1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6957271 Nov 05 14:47:53.923768 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fb207b9-8fff-4575-9591-53134c3e463a req-166bd861-a38a-43a4-9785-4c4c04d3dc12 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2889559 Nov 05 14:47:53.924398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41972) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:53.930333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5dcc6c1-2523-4005-928f-d6ce4504792a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:53.937308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=bb4761c4-8825-4ce3-809a-b38c5272909a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.964871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.971627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:53.976259 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1b791939-f933-43af-8d3c-74b07c111473 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/bb4761c4-8825-4ce3-809a-b38c5272909a HTTP/1.1" status: 204 len: 168 time: 1.5493569 Nov 05 14:47:53.977426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dbb51b8-2e3e-47f5-95e9-f2926d838981 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b31c56b-4053-44b9-9749-29e522d502a4,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:53.979843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41974) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:53.991685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'mac_address': 'fa:16:3e:fd:b1:2a', 'name': 'tempest-PortsIpV6TestJSON-1059168231'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:54.038798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 47cdf27d-8821-436b-92cc-df3431932767 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:54.088382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.114633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.146754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5dcc6c1-2523-4005-928f-d6ce4504792a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:54.297531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.297774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:54.330984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.334515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.338283 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5b31c56b-4053-44b9-9749-29e522d502a4 HTTP/1.1" status: 204 len: 168 time: 0.4027286 Nov 05 14:47:54.390801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da64df65-a264-44bb-93c6-2952ba22220f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b31c56b-4053-44b9-9749-29e522d502a4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:54.443475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.449292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.457982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.518830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=47cdf27d-8821-436b-92cc-df3431932767,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:54.540743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 47cdf27d-8821-436b-92cc-df3431932767 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:47:54.561438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.581376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:47:54.582402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.620068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.623848 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8204598 Nov 05 14:47:54.624658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41978) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:54.644503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--138400092'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:54.649149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c02bba56-2843-4993-9c79-7a7c0f0af476 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3c43fe6-61e5-4e34-932f-f09e37900fac,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:54.684272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port e76ed202-8f7c-46b4-9228-19b0b48462d2 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:54.736764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:54.742130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.742463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.770645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0fdf843c-7982-468e-94d0-f4115b6b1a14']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:54.781865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Allocated IP 172.21.0.2 (86b74c83-f53f-4a3a-9f3f-2e22dd8234dc/9982b8d7-8946-4c79-ab2e-d9340565a4f3/4609a411-ed2c-4358-82fa-e2711c3ba85f) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:54.788514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a83dd0f-1883-433c-afe5-4aed57ac9495') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:54.789284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a83dd0f-1883-433c-afe5-4aed57ac9495') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:54.808064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.876341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.899453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.908083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 601 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:54.908517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:54.912289 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:54.936406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41982) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.007889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61f90025-04e6-4c2b-87f5-6ffaa417a7dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.010761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.016723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.020630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.035373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.040525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/0fdf843c-7982-468e-94d0-f4115b6b1a14 HTTP/1.1" status: 204 len: 168 time: 2.4269533 Nov 05 14:47:55.062035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41986) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.065155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:55.073301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:55.078427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:55.081880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Pushing event updated for resources: {'Port': ['ID=4609a411-ed2c-4358-82fa-e2711c3ba85f,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.085510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.111312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.117690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4597f541-f682-45ce-b85d-df53a51e74f7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=0fdf843c-7982-468e-94d0-f4115b6b1a14,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.119406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:55.128761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f8401aa-fbfa-4f4e-a271-2b819553cf52 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "PUT /v2.0/routers/53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7458129 Nov 05 14:47:55.131866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.137229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41988) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.159768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] Sync routers for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:55.165263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Attempting to bind port 4609a411-ed2c-4358-82fa-e2711c3ba85f on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:55.165546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Attempting to bind port 4609a411-ed2c-4358-82fa-e2711c3ba85f by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:55.166248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Attempting to bind port 4609a411-ed2c-4358-82fa-e2711c3ba85f on network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:55.178739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.21.0.1 (86b74c83-f53f-4a3a-9f3f-2e22dd8234dc/9982b8d7-8946-4c79-ab2e-d9340565a4f3/d34e9d04-9129-4153-8e65-c2625f1d8dab) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:47:55.189952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:55.190624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Checking segment: {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:55.191294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.191788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Bound using segment: {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:55.192447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Bound port: 4609a411-ed2c-4358-82fa-e2711c3ba85f, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:55.193252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.215110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:55.215902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:55.254083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:55.300573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e61f38d5-4494-4ce4-b69f-400225dbfec1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:55.303043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7d8f7a52-b1c9-4f70-b089-dafb9ac19b46,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.332697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] Routers {'53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:55.335279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:55.343634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.353343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-236a84a6-53b9-4ddc-bafa-8f19e7e6e600 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.7114918 Nov 05 14:47:55.357349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 41990) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.361886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'f3c43fe6-61e5-4e34-932f-f09e37900fac', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '7d8f7a52-b1c9-4f70-b089-dafb9ac19b46', 'remote_ip_prefix': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:55.377402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a51146c-d93e-403a-8d12-34081bee9c9c req-fe9691fd-7d0f-4fdf-9700-a477f745edce tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:55.379874 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2a51146c-d93e-403a-8d12-34081bee9c9c req-fe9691fd-7d0f-4fdf-9700-a477f745edce tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.3451014 Nov 05 14:47:55.408898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:55.409566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72bcd20b-8b48-40ce-91e7-59c246fbfc49 None None] The sync data for ids ['53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:47:55.421359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.435739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] For port 4609a411-ed2c-4358-82fa-e2711c3ba85f, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:47:55.442892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61f90025-04e6-4c2b-87f5-6ffaa417a7dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.444697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.454557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] For port 4609a411-ed2c-4358-82fa-e2711c3ba85f, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4609a411-ed2c-4358-82fa-e2711c3ba85f,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:47:55.460793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61f90025-04e6-4c2b-87f5-6ffaa417a7dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.464751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.477615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e61f38d5-4494-4ce4-b69f-400225dbfec1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:55.477615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.545923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.575230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91835051-6fb8-4c0d-ad83-a2649d036131 None None] Pushing event updated for resources: {'Port': ['ID=4609a411-ed2c-4358-82fa-e2711c3ba85f,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.587308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:55.589621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.597100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-61f90025-04e6-4c2b-87f5-6ffaa417a7dc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2f1c45ca72ff4c35a296e7576aa11cd8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6525774 Nov 05 14:47:55.597100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=e76ed202-8f7c-46b4-9228-19b0b48462d2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.598465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41992) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.649822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f90025-04e6-4c2b-87f5-6ffaa417a7dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71426434-f89d-4d9f-9db9-5620440038c9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.652598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:55.660451 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2a51146c-d93e-403a-8d12-34081bee9c9c req-dfc02b16-e77f-407e-8da7-7bf07ec618bb tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2660336 Nov 05 14:47:55.672232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:55.678854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:55.679515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.728293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.733319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 47cdf27d-8821-436b-92cc-df3431932767 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:47:55.752287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.758501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.787077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 47cdf27d-8821-436b-92cc-df3431932767 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:47:55.787624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 47cdf27d-8821-436b-92cc-df3431932767 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:47:55.790218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-acd0f8a4-c759-45fb-8edc-f2e0575f8f90 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.8037019 Nov 05 14:47:55.790837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41996) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.881462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db365397-3493-4483-9a3a-23a311289fcd,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.881710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.882477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.893656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6642fd33-f7f5-4bd5-8342-395ad5ea8e75 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:55.895091 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6642fd33-f7f5-4bd5-8342-395ad5ea8e75 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/e76ed202-8f7c-46b4-9228-19b0b48462d2 HTTP/1.1" status: 200 len: 845 time: 0.1014798 Nov 05 14:47:55.898825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:55.904016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 41998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.912356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.916633 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9996f971-4123-4cbb-b72c-988258c7d184 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.5553153 Nov 05 14:47:55.918371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:55.919381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42000) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:55.925902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:55.933486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:55.950792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.974926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:55.979597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b125f051-581e-48bf-8cef-2f88434610af req-542595b2-6754-4bb8-abeb-b4aaaf53c245 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:55.984978 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b125f051-581e-48bf-8cef-2f88434610af req-542595b2-6754-4bb8-abeb-b4aaaf53c245 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2002459 Nov 05 14:47:56.026177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.062308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.075257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.128404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.133883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.135011 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/db365397-3493-4483-9a3a-23a311289fcd HTTP/1.1" status: 204 len: 168 time: 0.2146957 Nov 05 14:47:56.141946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:56.142504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b125f051-581e-48bf-8cef-2f88434610af req-ac81bbfd-2f8e-4568-95f3-b8d2410cc293 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1493139 Nov 05 14:47:56.175045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.180581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.186692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/71426434-f89d-4d9f-9db9-5620440038c9 HTTP/1.1" status: 204 len: 168 time: 0.5400796 Nov 05 14:47:56.189265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port e76ed202-8f7c-46b4-9228-19b0b48462d2 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:56.190411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.193683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359524d6-89b7-4cdf-a00c-36b652a42f60 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=db365397-3493-4483-9a3a-23a311289fcd,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:56.210802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting port 09fe48c0-01a9-4fc4-920e-2ba25aa12ee1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:56.211149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.212206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.229937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.695521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72bcafa-7d23-4461-b0b9-64db06f6fe2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71426434-f89d-4d9f-9db9-5620440038c9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:56.775266 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db984181-3203-4e37-8633-5a38bcabe2b2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.6286590 Nov 05 14:47:56.780118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.790018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42018) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:56.826887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for e76ed202-8f7c-46b4-9228-19b0b48462d2 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:56.847697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd14792-50ef-4a45-83b6-a0ef33a65c1d req-000677a6-dc54-4914-9b64-2617e3c062b5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:56.849991 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdd14792-50ef-4a45-83b6-a0ef33a65c1d req-000677a6-dc54-4914-9b64-2617e3c062b5 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.6205451 Nov 05 14:47:56.866422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a17cb65-0121-46a3-a8e3-877ef7273629 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:47:56.879871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:56.956982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] Provisioning complete for port 4609a411-ed2c-4358-82fa-e2711c3ba85f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:56.957357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.008995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.014096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Calling delete_port for 09fe48c0-01a9-4fc4-920e-2ba25aa12ee1 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:57.064725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 5031e98f-53f2-4342-92c1-6581a63a6416 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:47:57.065237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.083570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=e76ed202-8f7c-46b4-9228-19b0b48462d2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:57.100206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.102985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.107382 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c3fe88cd-70ec-4f48-90f8-c82ac2942b32 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/e76ed202-8f7c-46b4-9228-19b0b48462d2 HTTP/1.1" status: 204 len: 168 time: 1.2023866 Nov 05 14:47:57.114591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a17cb65-0121-46a3-a8e3-877ef7273629 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:47:57.123276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42028) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.146972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdd14792-50ef-4a45-83b6-a0ef33a65c1d req-acbd8cbe-5659-4be8-aefb-3f7e3330cc72 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2828679 Nov 05 14:47:57.159266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.165365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-33d7d478-5df3-46d3-bd25-053361a36e6b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:47:57.171384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-33d7d478-5df3-46d3-bd25-053361a36e6b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/e76ed202-8f7c-46b4-9228-19b0b48462d2 HTTP/1.1" status: 404 len: 333 time: 0.0480213 Nov 05 14:47:57.176408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42030) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.181560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'name': 'tempest-PortsIpV6TestJSON-530863354'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:57.182402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.188983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.196231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.252617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.301243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42034) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.301243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.304518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.305731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/7d8f7a52-b1c9-4f70-b089-dafb9ac19b46 HTTP/1.1" status: 204 len: 168 time: 0.5130672 Nov 05 14:47:57.315385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42036) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.343016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] For port 4609a411-ed2c-4358-82fa-e2711c3ba85f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4609a411-ed2c-4358-82fa-e2711c3ba85f,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:57.345709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4609a411-ed2c-4358-82fa-e2711c3ba85f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:57.359834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d231f9c-72c9-4edf-9c1e-b796e8610211 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d8f7a52-b1c9-4f70-b089-dafb9ac19b46,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:57.417935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.423296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.462633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Port': ['ID=09fe48c0-01a9-4fc4-920e-2ba25aa12ee1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:57.489970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:57.552099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-59dd2239-c90d-4569-a981-bd48ad5599fe tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4539 time: 0.2252929 Nov 05 14:47:57.559080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42042) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.579339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-548852991'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:57.587578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 5031e98f-53f2-4342-92c1-6581a63a6416, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5031e98f-53f2-4342-92c1-6581a63a6416,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:47:57.588088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.636854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.api [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 05 14:47:57.636854 dv-neutron-816850-1-hyperv neutron-server[113581]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 05 14:47:57.636854 dv-neutron-816850-1-hyperv neutron-server[113581]: [parameters: {'project_id': '6c1eac42b2854d16bc0940ee811229be', 'id': '60266567-400f-469f-a8ad-f444ef84a085', 'expiration': datetime.datetime(2021, 11, 5, 14, 49, 57, 613456)}] Nov 05 14:47:57.636854 dv-neutron-816850-1-hyperv neutron-server[113581]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=113581) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:47:57.637496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG oslo_db.api [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:47:57.638988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.649039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 5031e98f-53f2-4342-92c1-6581a63a6416 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:47:57.662240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:57.665893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.701800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 2c03ddd3-c8cd-410e-8ce0-99093fe33e9c yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:47:57.736130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a73becf-4a77-4df4-99d4-3a3ee344b52e None None] Pushing event updated for resources: {'Port': ['ID=4609a411-ed2c-4358-82fa-e2711c3ba85f,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:57.749039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04656374-065b-44c7-9777-aa2f2f2d9002 req-af1b137f-33bb-4774-b776-39309bf8d0fd tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:57.751292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-04656374-065b-44c7-9777-aa2f2f2d9002 req-af1b137f-33bb-4774-b776-39309bf8d0fd tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1568711 Nov 05 14:47:57.752560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.756074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.759985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4609a411-ed2c-4358-82fa-e2711c3ba85f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:57.759985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.795946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:57.805369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:57.835487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.836032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Fanout notify agent at l3_agent the message router_deleted on router 53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:47:57.848162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.849254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.849742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ee48c196-1d02-4450-9bbe-5e462f01b07e tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/routers/53c5d2ae-7daa-46f9-8115-9ee1a80e6d3c HTTP/1.1" status: 204 len: 168 time: 2.7052324 Nov 05 14:47:57.852635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42044) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:57.897592 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-04656374-065b-44c7-9777-aa2f2f2d9002 req-0ec3dcbc-c3db-4c2f-a4a3-9471ace48693 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0937841 Nov 05 14:47:57.919002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Deleting subnet 797dfb34-cf8a-436e-96e5-05a94bb2f935 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:47:57.921938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.970203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:57.973480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.031330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.113792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.155226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:58.162597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.171314 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/subnets/797dfb34-cf8a-436e-96e5-05a94bb2f935 HTTP/1.1" status: 204 len: 168 time: 0.3170919 Nov 05 14:47:58.171525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42046) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.174663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24d5849b-d36c-40aa-ac89-cd86d342db14 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Subnet': ['ID=797dfb34-cf8a-436e-96e5-05a94bb2f935,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.202191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.204933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.209009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/f3c43fe6-61e5-4e34-932f-f09e37900fac HTTP/1.1" status: 204 len: 168 time: 0.6400950 Nov 05 14:47:58.209637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.224646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42048) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.232395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61e2176-ff44-4df2-aff3-d07a3b939631 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3c43fe6-61e5-4e34-932f-f09e37900fac,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.275980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.281566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:58.285276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.303001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.406763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.409687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.436989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42050) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.437216 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4bc2f1b3-dcce-4b0e-988f-9ebcc4f11ffc tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.2114069 Nov 05 14:47:58.459343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--1239271191'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:58.459524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:47:58.464440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.471943 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3c0a7fa-2b7d-46a8-bf8a-c20e675c53aa tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7197909 Nov 05 14:47:58.476141 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:47:58.476698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=5031e98f-53f2-4342-92c1-6581a63a6416,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.476698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42052) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.482753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-433263186'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:58.488198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1557b5a0-960f-471e-a237-a6a5b7dcc894']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:58.489027 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:47:58.489855 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:58.525950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a8d37fa5-e1d8-46ef-8ec0-51d99f69f16c') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:58.526159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a8d37fa5-e1d8-46ef-8ec0-51d99f69f16c') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:58.546869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.557730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.586040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:47:58.587138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.628154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:47:58.638017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:47:58.642444 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:47:58.643961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:58.644630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.653655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.657568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.660613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=2c03ddd3-c8cd-410e-8ce0-99093fe33e9c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.665438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.682662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:58.686574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.700884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-944f7602-9579-4b59-ae8f-8642b8aadc21 None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:58.701472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-944f7602-9579-4b59-ae8f-8642b8aadc21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.702978 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fdef9d9a-6d02-4715-a440-780a1d84f72e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.5252004 Nov 05 14:47:58.707982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42054) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.713328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Releasing vlan 614 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:47:58.713745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.719535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5122340-2b63-4289-bea8-fe92422a9029,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.724517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:47:58.728113 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:47:58.732892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.734873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.785565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-944f7602-9579-4b59-ae8f-8642b8aadc21 None None] Port d34e9d04-9129-4153-8e65-c2625f1d8dab cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:58.805350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-944f7602-9579-4b59-ae8f-8642b8aadc21 None None] Provisioning complete for port 4609a411-ed2c-4358-82fa-e2711c3ba85f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:58.805867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-944f7602-9579-4b59-ae8f-8642b8aadc21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.835004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:58.893947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 604} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:47:58.905960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.908394 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bf372149-ec64-4ec0-8cfd-dd49620f0698 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4564860 Nov 05 14:47:58.917697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42056) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:58.918271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.919491 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246 of type vlan for network 1fb97d8a-9f3b-438a-9a84-527e5990548d Nov 05 14:47:58.929733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'a5122340-2b63-4289-bea8-fe92422a9029', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:58.946391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'SecurityGroup': ['ID=11ddda98-43c0-4ce7-b6e1-50d929ed73fb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:58.953346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.975036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.985653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:58.999292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] 10.222.0.30 "DELETE /v2.0/networks/1557b5a0-960f-471e-a237-a6a5b7dcc894 HTTP/1.1" status: 204 len: 168 time: 0.8229032 Nov 05 14:47:59.004313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.004733 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Added segment c25bd26f-d0c3-42a1-9e61-f742954e18ac of type vlan for network b10e20e9-e25a-4832-bd50-e158aa6d5da9 Nov 05 14:47:59.059532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42dd3c7d-e982-4dd5-8f85-c9ee607b4345 tempest-FloatingIPTestJSON-660110226 tempest-FloatingIPTestJSON-660110226-project] Pushing event deleted for resources: {'Network': ['ID=1557b5a0-960f-471e-a237-a6a5b7dcc894,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:59.063070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.143849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.151531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.192174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d8e4d740-e292-4777-96dc-2e68c03b81df None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:59.193796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d740-e292-4777-96dc-2e68c03b81df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.216678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.226013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:59.237144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.247276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.resource_extend [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:47:59.261107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d8e4d740-e292-4777-96dc-2e68c03b81df None None] Port d34e9d04-9129-4153-8e65-c2625f1d8dab cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:59.341222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4609a411-ed2c-4358-82fa-e2711c3ba85f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:47:59.365043 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:56Z', 'revision_number': 3, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:47:56Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:47:59.386391 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 2.0794561 Nov 05 14:47:59.390337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42064) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.404140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:47:59.413912 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:47:59.414540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Updating router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 port d34e9d04-9129-4153-8e65-c2625f1d8dab binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:47:59.418372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51db54c1-e3a9-40cc-8263-2d62b0d308f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Network': ['ID=b10e20e9-e25a-4832-bd50-e158aa6d5da9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:59.440983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:47:59.450768 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.496495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.498541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.512243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.523985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42066) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.525058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.531643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:59.532362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.545231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.558275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=debc7f89-6cb7-4382-8401-2be609b8a07e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:59.561911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4609a411-ed2c-4358-82fa-e2711c3ba85f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:59.562279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.597669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.599501 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80cd6051-d01e-4a01-87c8-f7c57bab84d2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.6776600 Nov 05 14:47:59.600867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:47:59.604856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.608718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42070) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.636143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e535c395-4243-49c8-97f2-900eb3bac64c None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:47:59.636567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e535c395-4243-49c8-97f2-900eb3bac64c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.641352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] In _notify_port_updated(), no bound segment for port 2c03ddd3-c8cd-410e-8ce0-99093fe33e9c on network a79abec6-87fd-477e-a6d8-3655432a4a0a {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:47:59.648070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:59.648850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.654121 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/ports/2c03ddd3-c8cd-410e-8ce0-99093fe33e9c HTTP/1.1" status: 200 len: 818 time: 0.9356060 Nov 05 14:47:59.668675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:47:59.669742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42072) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.673056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb9246c4-99ff-4ed9-9d76-66afd14b92f5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=2c03ddd3-c8cd-410e-8ce0-99093fe33e9c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:59.673355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e535c395-4243-49c8-97f2-900eb3bac64c None None] Port d34e9d04-9129-4153-8e65-c2625f1d8dab cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:47:59.689838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efea59b-5748-40e5-ab98-fb8f7df8f0e4 req-a6fe10e3-273c-4d10-ac02-5bcf0c6561f3 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:47:59.700686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1efea59b-5748-40e5-ab98-fb8f7df8f0e4 req-a6fe10e3-273c-4d10-ac02-5bcf0c6561f3 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.6293833 Nov 05 14:47:59.747777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.778847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.788054 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.796387 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.846059 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73cd1aaa-d36b-41c6-b943-be381ff12091 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5aba8d2cde554c148588ac154e0c5e0f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3157544 Nov 05 14:47:59.849385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42074) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.860499 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7e4484-6abe-41a0-a512-a654d2ba3bd7 None None] Pushing event updated for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:47:59.881948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.894459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.898304 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/debc7f89-6cb7-4382-8401-2be609b8a07e HTTP/1.1" status: 204 len: 168 time: 0.2846913 Nov 05 14:47:59.906866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42076) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:47:59.916130 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Attempting to bind port d34e9d04-9129-4153-8e65-c2625f1d8dab on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:47:59.917163 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Attempting to bind port d34e9d04-9129-4153-8e65-c2625f1d8dab by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:47:59.917163 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Attempting to bind port d34e9d04-9129-4153-8e65-c2625f1d8dab on network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:47:59.924093 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:47:59.924880 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Checking segment: {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:47:59.925290 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.925685 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Bound using segment: {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:47:59.926166 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Bound port: d34e9d04-9129-4153-8e65-c2625f1d8dab, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:47:59.926756 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:47:59.929406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cbe7b7f-0536-4744-a9fc-53e5a508e9ae tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=debc7f89-6cb7-4382-8401-2be609b8a07e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:00.000804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] For port d34e9d04-9129-4153-8e65-c2625f1d8dab, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:00.004865 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] For port d34e9d04-9129-4153-8e65-c2625f1d8dab, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d34e9d04-9129-4153-8e65-c2625f1d8dab,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:00.014375 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.044478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.081431 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7e4484-6abe-41a0-a512-a654d2ba3bd7 None None] Pushing event updated for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:00.101232 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:00.102190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:00.112095 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cc0a4d51-54e4-45d2-acaa-73678dc3fc06 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2042227 Nov 05 14:48:00.117062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.131386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42078) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:00.167944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.221979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:00.222614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.225548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=fe3e362f-5083-44d4-a2b6-0e9e05fc1d22,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:00.230512 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:00.237525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.7581489 Nov 05 14:48:00.265713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42080) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:00.312083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:00.338246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.365891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:00.383149 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-146a68a4-0cbf-4367-bf71-437330e3361b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3181725 Nov 05 14:48:00.383690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:00.386592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42082) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:00.407068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] For port d34e9d04-9129-4153-8e65-c2625f1d8dab, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d34e9d04-9129-4153-8e65-c2625f1d8dab,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:00.413229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:00.413910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:00.416431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.419288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.420721 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/88dda8f4-7ece-44f1-a88c-082f6122acd5 HTTP/1.1" status: 204 len: 168 time: 0.5632656 Nov 05 14:48:00.421005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.429657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e8840f-6086-4112-a5fe-2d8351700b41 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=1fb97d8a-9f3b-438a-9a84-527e5990548d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:00.461847 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1efea59b-5748-40e5-ab98-fb8f7df8f0e4 req-e3d8fbb8-1542-421e-a77a-b684be44533e tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7494867 Nov 05 14:48:00.462191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:00.462191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network hostable DHCP agents. Network: b10e20e9-e25a-4832-bd50-e158aa6d5da9, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:00.479918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 2c03ddd3-c8cd-410e-8ce0-99093fe33e9c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:00.484841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34f6f1c-c35e-418b-804c-1f87339059eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88dda8f4-7ece-44f1-a88c-082f6122acd5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:00.486165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.492375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.517062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:00.570725 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:56Z', 'revision_number': 3, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:47:59Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:00.595047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.613851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 08e17274-b197-46e0-912c-f6754806a9e1 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:00.625173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.639065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:00.649232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.669183 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbf0262f-cf62-4b13-ac62-3f5cf0389d0a None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:47:56Z', 'revision_number': 3, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:47:59Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:00.686688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 2c03ddd3-c8cd-410e-8ce0-99093fe33e9c owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:00.706936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.782409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, b10e20e9-e25a-4832-bd50-e158aa6d5da9) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:00.802777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:00.806956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.821533 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:00.832307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.856409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:00.902512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.949399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.951533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a5a7e95-348e-461a-8201-a08e0122f205 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:00.987575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.988514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f60a27-d452-4bc5-bbc7-0bbfb13a7cd3 req-cb8c9d81-5441-49e4-a477-1571bf25ffab tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:00.990969 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c3f60a27-d452-4bc5-bbc7-0bbfb13a7cd3 req-cb8c9d81-5441-49e4-a477-1571bf25ffab tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1943803 Nov 05 14:48:00.991908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:00.993213 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/a5122340-2b63-4289-bea8-fe92422a9029 HTTP/1.1" status: 204 len: 168 time: 0.8589869 Nov 05 14:48:01.009189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42094) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.036443 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a210d820-516f-487d-9e07-2a2adc6aefd0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.6388783 Nov 05 14:48:01.044265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3279db7-7148-4748-8a28-ac9df2709042 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5122340-2b63-4289-bea8-fe92422a9029,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:01.052352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42098) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.060596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'name': 'tempest-NetworksTestDHCPv6-950418639'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:01.077642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=2c03ddd3-c8cd-410e-8ce0-99093fe33e9c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:01.109475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3501dd91-26d1-4e80-9055-2222a233f4b6 None None] Pushing event updated for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:01.119793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a000bee8-9e80-4a01-9857-d38e8e3d3e31 None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:01.120191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a000bee8-9e80-4a01-9857-d38e8e3d3e31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.133676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.139500 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0868ae43-dba9-4934-8378-73dd6bde4811 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/2c03ddd3-c8cd-410e-8ce0-99093fe33e9c HTTP/1.1" status: 204 len: 168 time: 1.4339490 Nov 05 14:48:01.140537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42102) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.154889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.264644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=08e17274-b197-46e0-912c-f6754806a9e1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:01.267814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce190f25-ac9a-4792-b5f3-a1f6b43e2483 None None] Network 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:01.276063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.281436 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7ecc372d-6031-48bf-bc3b-b13c3b7ee2e1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/08e17274-b197-46e0-912c-f6754806a9e1 HTTP/1.1" status: 204 len: 168 time: 0.8900928 Nov 05 14:48:01.282001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42106) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.311391 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c3f60a27-d452-4bc5-bbc7-0bbfb13a7cd3 req-bc14a06e-6d9e-4d7c-a9e0-4cc714a44c93 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2764666 Nov 05 14:48:01.356086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d34e9d04-9129-4153-8e65-c2625f1d8dab up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:01.397528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed3ae276-0333-46b3-9af9-f4b238a40387 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:01.401808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ed3ae276-0333-46b3-9af9-f4b238a40387 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.2577579 Nov 05 14:48:01.402636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42110) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.441658 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-0b3f998e-4c07-4d22-8707-d837512c3099 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:01.447898 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0b3f998e-4c07-4d22-8707-d837512c3099 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/2c03ddd3-c8cd-410e-8ce0-99093fe33e9c HTTP/1.1" status: 404 len: 333 time: 0.0403781 Nov 05 14:48:01.450377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42114) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.459471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-284440423'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:01.482061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.541691 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c620cb1f-5418-410a-b4d3-b0b3ce8d6e97 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.5269549 Nov 05 14:48:01.546261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:01.550317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.553113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.560880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.572053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-51ff1a8b-9051-470b-b8ba-c78467d9b00b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8a5a7e95-348e-461a-8201-a08e0122f205 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:01.572785 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:01.574156 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-51ff1a8b-9051-470b-b8ba-c78467d9b00b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=643f5fc30ebb419c9fb85748c2767795&device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 1099 time: 0.7057407 Nov 05 14:48:01.582160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group': {'name': 'tempest-secgroup--1726097573'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:01.597713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-424af590-4f0e-412a-a090-3eb7624df0bd None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:01.650433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 602} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:01.667486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.668250 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 9f69a45a-2686-4fb8-8d74-a1c57f4712a2 of type vlan for network 06730b57-bbf8-4154-a487-3284984c861f Nov 05 14:48:01.679072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 07441921-73d7-400b-8121-54b80682d4e8 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:01.679669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.717009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:01.720665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.738145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:01.738511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 1fb97d8a-9f3b-438a-9a84-527e5990548d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:01.765785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=0408f5e3-09a3-44a0-8caa-8475b072368f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:01.771268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42124) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.783073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:01.794076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port d6cf7793-6c1b-4377-98a7-19c6cd75dbef yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:01.802262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.826244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.832015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 07441921-73d7-400b-8121-54b80682d4e8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07441921-73d7-400b-8121-54b80682d4e8,segment=NetworkSegment(d1cdcc46-1486-4d67-a930-fced125afed6),segment_id=d1cdcc46-1486-4d67-a930-fced125afed6)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:01.832697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.852372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1fb97d8a-9f3b-438a-9a84-527e5990548d) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:01.866261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:01.866872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.885228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 07441921-73d7-400b-8121-54b80682d4e8 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:01.892987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b29a442f-0194-4845-b2ee-b6bb7f8b61e5 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5843744 Nov 05 14:48:01.894431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42130) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:01.905076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-97cdac68-a7b5-4aa6-a89e-54dff9b46515 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:01.906566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-97cdac68-a7b5-4aa6-a89e-54dff9b46515 service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 200 len: 912 time: 0.2999601 Nov 05 14:48:01.909033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.914969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:01.915897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:01.983348 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-1bb7a5d5-bef2-40f1-88bc-a1ff46c9b2fa service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 200 len: 1001 time: 0.0674469 Nov 05 14:48:01.997999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abfccb55-b361-4554-80c7-d3d3380838b3 None None] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:02.089647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:02.090407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.091532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-597998903'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:02.100542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-d5a971d6-3aed-40f1-b379-bd807aca4d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:02.101125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] DHCP port deletion for 39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:02.102855 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-d5a971d6-3aed-40f1-b379-bd807aca4d0e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 200 len: 850 time: 0.0930979 Nov 05 14:48:02.104669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::d1 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/fe3e362f-5083-44d4-a2b6-0e9e05fc1d22/d6cf7793-6c1b-4377-98a7-19c6cd75dbef) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:02.135193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.6796677 Nov 05 14:48:02.143716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42132) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:02.149485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '06730b57-bbf8-4154-a487-3284984c861f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:02.154038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139f469f-40aa-4244-85f6-183049084edd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=06730b57-bbf8-4154-a487-3284984c861f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-424af590-4f0e-412a-a090-3eb7624df0bd None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:02.171642 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:02.177366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 06730b57-bbf8-4154-a487-3284984c861f details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:02.184826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:02.188514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.256674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.277293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-ca15d60a-1cf6-4bb9-898e-5edf1e253b2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:02.278834 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-ca15d60a-1cf6-4bb9-898e-5edf1e253b2a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc36919c-2228-49a8-98f4-75664fee44eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1675460 Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-abfccb55-b361-4554-80c7-d3d3380838b3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:02.285469 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:02.295133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.304996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db7ff684-12db-4ba3-a3ef-fea5424a9d2a None None] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:02.308830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.311742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:58Z', 'revision_number': 10, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:02.343438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.394561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.399034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.8274837 Nov 05 14:48:02.403522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42138) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:02.404287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=07441921-73d7-400b-8121-54b80682d4e8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:02.414611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port 07441921-73d7-400b-8121-54b80682d4e8 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:02.415017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:02.453493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'fa904185-9fde-4344-bb54-dfae81251680', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:02.454371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:02.457930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.464484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Deleting port 07441921-73d7-400b-8121-54b80682d4e8 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:02.465292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.469603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583dd40b-be1f-445b-930e-88cf1fb872ec tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa904185-9fde-4344-bb54-dfae81251680,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:02.533114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:02.533896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:02.598332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-2a1b2349-d2e1-4632-be83-9ac24b4266ff service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3043509 Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-db7ff684-12db-4ba3-a3ef-fea5424a9d2a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:02.631766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:02.637214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.643739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.660113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] For port 07441921-73d7-400b-8121-54b80682d4e8, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:02.660682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.682943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Calling delete_port for 07441921-73d7-400b-8121-54b80682d4e8 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:02.684899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.687911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.688762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.ipam_backend_mixin [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Port 07441921-73d7-400b-8121-54b80682d4e8 was not found and therefore no delete operation was performed {{(pid=113582) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:48:02.690581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:02.693855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.701017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc27a4fd-9b8c-4cc0-a46c-2854a66fdc91 req-6d760b58-fc7d-4aa6-bb07-36a836c0277f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:02.702571 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cc27a4fd-9b8c-4cc0-a46c-2854a66fdc91 req-6d760b58-fc7d-4aa6-bb07-36a836c0277f tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2494485 Nov 05 14:48:02.714406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:02.718905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.739667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1cdcc46-1486-4d67-a930-fced125afed6') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:02.740243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1cdcc46-1486-4d67-a930-fced125afed6') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:02.752401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] Pushing event deleted for resources: {'Port': ['ID=07441921-73d7-400b-8121-54b80682d4e8,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:02.759733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18823a15-ea2e-4bf1-bf3a-9e54ce81d336 None None] No DVR routers for this DVR port 07441921-73d7-400b-8121-54b80682d4e8 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:02.785829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.802318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 636} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:02.821785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3be561b0-ea01-4a05-beb0-c0ec2f13d5e1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:02.826071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'SecurityGroup': ['ID=709d6f57-657c-4fb0-b565-0baea87db68a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:02.833415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.839223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.839790 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 0408f50a-cd3d-4543-8801-f4470d128538 of type vlan for network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e Nov 05 14:48:02.859571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 619 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:02.860591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:02.888609 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:02.933832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:02.964428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.010940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.028033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=942e8b98-c749-4184-a696-50ae269521af,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.037436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.044928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3be561b0-ea01-4a05-beb0-c0ec2f13d5e1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:03.055336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.068958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.073201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ba2d8d19-6e75-48d8-a102-23b0f0cba5f2 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6642876 Nov 05 14:48:03.077670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42142) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.081721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.085222 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4 HTTP/1.1" status: 204 len: 168 time: 1.8024378 Nov 05 14:48:03.090114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.105834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:58Z', 'revision_number': 10, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:03.162817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9ac7f87c-769f-4db2-b5b2-c5854d14d961 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules/942e8b98-c749-4184-a696-50ae269521af HTTP/1.1" status: 200 len: 763 time: 0.0824506 Nov 05 14:48:03.173117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42146) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.190066 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c0d0495-2271-47de-a3df-8d73d141c6a8 req-6fb6f0f3-457e-4e32-ae1d-f565d6247349 service neutron] 10.222.0.32 "GET /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5799544 Nov 05 14:48:03.206686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.213072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8333d7-9363-4322-91bc-42f4d4d321cc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=39a1b919-8b6b-42d2-8aa1-5e3c2cc85df4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.214730 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cc27a4fd-9b8c-4cc0-a46c-2854a66fdc91 req-9d0cdb28-b639-4e7f-9ee5-a6ab79ad7e02 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4948502 Nov 05 14:48:03.215098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.222498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:03.224525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.255551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2b5bd3-0f17-434c-a70b-bc109e7e1b5f None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:47:58Z', 'revision_number': 10, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None, '_interfaces': [{'id': '903a8613-fdd3-40c5-affe-14ef83b866c7', 'name': '', 'network_id': '58e096c3-c0f8-415c-ae1a-d740c70eafa2', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'mac_address': 'fa:16:3e:b2:6f:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '14f376dc-94df-47af-b41b-575261751bcd', 'device_owner': 'network:router_interface', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:05Z', 'updated_at': '2021-11-05T14:47:13Z', 'revision_number': 5, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'subnets': [{'id': '6bb60fd7-5d44-43a7-aab2-e78614f10a7b', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:03.269093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d34e9d04-9129-4153-8e65-c2625f1d8dab up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:03.303548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:03.320927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:03.326982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:03.333724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:03.334725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.337383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=d6cf7793-6c1b-4377-98a7-19c6cd75dbef,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.352669 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f692cff3-4c63-457c-9377-243898858de6 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1779470 Nov 05 14:48:03.358138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.363051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42148) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.415551 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0737f814-81f5-4b12-9147-6c97f33d8dad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.3618867 Nov 05 14:48:03.420996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42150) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.422385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d34e9d04-9129-4153-8e65-c2625f1d8dab triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:03.422873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.472977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.509159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1fb97d8a-9f3b-438a-9a84-527e5990548d', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:03.510051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.512170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52006251-160b-4137-adc7-f462df86736d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': 'fe3e362f-5083-44d4-a2b6-0e9e05fc1d22'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:03.512436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.513221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.514366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=76087b71-9aa7-48ca-80b3-62e5718f6fcf,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.548444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '9f69a45a-2686-4fb8-8d74-a1c57f4712a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '06730b57-bbf8-4154-a487-3284984c861f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:03.548830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: 06730b57-bbf8-4154-a487-3284984c861f, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:03.558923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9c17c10-130f-4c3d-b93d-b9d326f52fa4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:03.560415 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9c17c10-130f-4c3d-b93d-b9d326f52fa4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 928 time: 0.1379695 Nov 05 14:48:03.563619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42154) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.576850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.608248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.609662 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/942e8b98-c749-4184-a696-50ae269521af HTTP/1.1" status: 204 len: 168 time: 0.2422266 Nov 05 14:48:03.613251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42156) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.635681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf0d7f8-ef35-4fcf-bc89-684a97ff149d tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=942e8b98-c749-4184-a696-50ae269521af,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.652193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.8760965 Nov 05 14:48:03.655427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 06730b57-bbf8-4154-a487-3284984c861f is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:03.683199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd5495a-4553-4350-a8d4-58ffe7e40a3f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=cf4a56c9-bc0c-4cd4-aa24-69852b584c3e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:03.745893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 06730b57-bbf8-4154-a487-3284984c861f) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:03.749343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:03.760972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:03.761818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.779384 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7031e2d5-75cd-437a-ba72-17646bb973c6 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1642895 Nov 05 14:48:03.784251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42158) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.802526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'fa904185-9fde-4344-bb54-dfae81251680', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:03.807743 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-52a3288d-b80b-4fef-af4c-b06c3043c5e9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6633110 Nov 05 14:48:03.811071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42160) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.811687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42162) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:03.830235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port d6cf7793-6c1b-4377-98a7-19c6cd75dbef {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:03.830754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.865481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:03.877377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '06730b57-bbf8-4154-a487-3284984c861f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:03.890036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07441921-73d7-400b-8121-54b80682d4e8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:03.936998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 07441921-73d7-400b-8121-54b80682d4e8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:03.937340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07441921-73d7-400b-8121-54b80682d4e8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:03.945686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:03.967644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for d6cf7793-6c1b-4377-98a7-19c6cd75dbef owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:04.039603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Allocated IP 172.22.0.2 (1fb97d8a-9f3b-438a-9a84-527e5990548d/0408f5e3-09a3-44a0-8caa-8475b072368f/90660ae6-0b86-4692-8397-89de23c5c0c1) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:04.049804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-52006251-160b-4137-adc7-f462df86736d None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/fe3e362f-5083-44d4-a2b6-0e9e05fc1d22/20e04871-7ef2-48ae-877b-794fd77ff2d7) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:04.125835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.160715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=d6cf7793-6c1b-4377-98a7-19c6cd75dbef,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.176309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.187659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.193209 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1cffd9ec-1b6c-4dc1-98f9-e843fd5081e6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/d6cf7793-6c1b-4377-98a7-19c6cd75dbef HTTP/1.1" status: 204 len: 168 time: 0.6259692 Nov 05 14:48:04.193495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42164) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.249129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccb87408-8b77-4c78-b068-c80c773865c8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:04.250658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccb87408-8b77-4c78-b068-c80c773865c8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:04.254636 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ccb87408-8b77-4c78-b068-c80c773865c8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0577588 Nov 05 14:48:04.254996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42166) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.302707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:04.306171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.341252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet fe3e362f-5083-44d4-a2b6-0e9e05fc1d22 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:04.409605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.422921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:04.426399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.438666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.480770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.485644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.491476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.493370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.496731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.537506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:04.544979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:04.551929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.553082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=87eaed94-061c-4d25-a9db-2083588a44d9,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.553232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52006251-160b-4137-adc7-f462df86736d None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:04.556355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:04.562837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-52006251-160b-4137-adc7-f462df86736d None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:04.565345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52006251-160b-4137-adc7-f462df86736d None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:04.590032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.591248 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-82c99587-70e4-447a-acd6-e2e4f73a84b7 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.7949188 Nov 05 14:48:04.594062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42170) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.600034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Pushing event updated for resources: {'Port': ['ID=90660ae6-0b86-4692-8397-89de23c5c0c1,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.621561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-36234650-60b3-4507-8469-50b75ca89e39 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules/87eaed94-061c-4d25-a9db-2083588a44d9 HTTP/1.1" status: 200 len: 763 time: 0.0238407 Nov 05 14:48:04.622344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42172) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.633187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05312a20-3508-4af6-92fd-c263fdfec8e1 req-ddf006e4-d4ab-49fb-bcdd-093332ca37da tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:04.634730 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05312a20-3508-4af6-92fd-c263fdfec8e1 req-ddf006e4-d4ab-49fb-bcdd-093332ca37da tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2886772 Nov 05 14:48:04.645696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.22.0.1 (1fb97d8a-9f3b-438a-9a84-527e5990548d/0408f5e3-09a3-44a0-8caa-8475b072368f/711c5642-fb28-4fa7-a9c6-15f78cc03028) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:04.689970 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-943d12a0-39c4-471a-891e-82b056d64b1a tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0669873 Nov 05 14:48:04.693125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42174) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.719386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-52006251-160b-4137-adc7-f462df86736d None None] Attempting to bind port 20e04871-7ef2-48ae-877b-794fd77ff2d7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:04.719605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-52006251-160b-4137-adc7-f462df86736d None None] Attempting to bind port 20e04871-7ef2-48ae-877b-794fd77ff2d7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:04.719886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52006251-160b-4137-adc7-f462df86736d None None] Attempting to bind port 20e04871-7ef2-48ae-877b-794fd77ff2d7 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:04.725196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.726583 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 76087b71-9aa7-48ca-80b3-62e5718f6fcf (CIDR: 2001:db8::/64) Nov 05 14:48:04.737527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.740488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.741501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52006251-160b-4137-adc7-f462df86736d None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:04.741880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52006251-160b-4137-adc7-f462df86736d None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:04.742287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.742687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52006251-160b-4137-adc7-f462df86736d None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:04.743164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-52006251-160b-4137-adc7-f462df86736d None None] Bound port: 20e04871-7ef2-48ae-877b-794fd77ff2d7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:04.743547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.746972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52006251-160b-4137-adc7-f462df86736d None None] Pushing event updated for resources: {'Port': ['ID=20e04871-7ef2-48ae-877b-794fd77ff2d7,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.750488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Attempting to bind port 90660ae6-0b86-4692-8397-89de23c5c0c1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:04.750488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Attempting to bind port 90660ae6-0b86-4692-8397-89de23c5c0c1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:04.750844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Attempting to bind port 90660ae6-0b86-4692-8397-89de23c5c0c1 on network 1fb97d8a-9f3b-438a-9a84-527e5990548d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:04.752758 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:04.753543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:04.764508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:04.765538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Checking segment: {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:04.765538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.765735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Bound using segment: {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:04.766130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Bound port: 90660ae6-0b86-4692-8397-89de23c5c0c1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:04.766640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.803249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.812206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.813469 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/87eaed94-061c-4d25-a9db-2083588a44d9 HTTP/1.1" status: 204 len: 168 time: 0.1194141 Nov 05 14:48:04.818189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42176) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.829021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47a5af9-44dd-4e32-a7f1-58e7345a841e tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=87eaed94-061c-4d25-a9db-2083588a44d9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.879579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8da1e599-50fe-4fc4-b7b4-f050198e97c4 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0580490 Nov 05 14:48:04.880936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.881479 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f797243a-9027-4303-941c-868b7df2be6d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0258362 Nov 05 14:48:04.881642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-52006251-160b-4137-adc7-f462df86736d None None] For port 20e04871-7ef2-48ae-877b-794fd77ff2d7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:04.887017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-52006251-160b-4137-adc7-f462df86736d None None] For port 20e04871-7ef2-48ae-877b-794fd77ff2d7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=20e04871-7ef2-48ae-877b-794fd77ff2d7,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:04.889651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42178) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.889798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42180) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.894755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] For port 90660ae6-0b86-4692-8397-89de23c5c0c1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:04.898601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Request body: {'security_group_rule': {'security_group_id': 'fa904185-9fde-4344-bb54-dfae81251680', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:04.900931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] For port 90660ae6-0b86-4692-8397-89de23c5c0c1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=90660ae6-0b86-4692-8397-89de23c5c0c1,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:04.904400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52006251-160b-4137-adc7-f462df86736d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.906332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '06730b57-bbf8-4154-a487-3284984c861f', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:04.919792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05312a20-3508-4af6-92fd-c263fdfec8e1 req-e6426872-57cd-414d-9644-61a47d068789 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2616825 Nov 05 14:48:04.927133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.933075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/fe3e362f-5083-44d4-a2b6-0e9e05fc1d22 HTTP/1.1" status: 204 len: 168 time: 0.6770616 Nov 05 14:48:04.934117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300b464c-aca9-4f1d-8a0b-e92d874c5174 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=fe3e362f-5083-44d4-a2b6-0e9e05fc1d22,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:04.935952 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42182) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:04.956932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:04.982951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.015414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52006251-160b-4137-adc7-f462df86736d None None] Pushing event updated for resources: {'Port': ['ID=20e04871-7ef2-48ae-877b-794fd77ff2d7,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:05.050728 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-12ed8d6a-2bb8-42ec-bf99-9b9b3deebd6f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1091044 Nov 05 14:48:05.052523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42186) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:05.057798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:05.096284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b785c085-d795-4b14-bad2-c40f95dd6516 None None] Pushing event updated for resources: {'Port': ['ID=90660ae6-0b86-4692-8397-89de23c5c0c1,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:05.108744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.141243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5031e98f-53f2-4342-92c1-6581a63a6416 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:05.146408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.164092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5031e98f-53f2-4342-92c1-6581a63a6416 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:05.164746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5031e98f-53f2-4342-92c1-6581a63a6416 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:05.179879 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Project c4ce37f5ee134d709e880beee3081670 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:48:05.198398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.250239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:05.285344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa8e7d3-1ce8-43bf-941c-da41cd61c1c9 req-b7a93258-216f-482c-a3d0-e27d37d2faad tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:05.287880 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2aa8e7d3-1ce8-43bf-941c-da41cd61c1c9 req-b7a93258-216f-482c-a3d0-e27d37d2faad tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2385767 Nov 05 14:48:05.327469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:05.331139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.351850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': '0408f50a-cd3d-4543-8801-f4470d128538', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:05.352217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: cf4a56c9-bc0c-4cd4-aa24-69852b584c3e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:05.371257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.371590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.425100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:05.428850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.433473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.526723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4ee2ba7-aa4f-47e7-97d4-86ceaf975933,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:05.561169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.562355 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0578c104-10c8-4bdf-abdf-8a2c0032aca0 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6715462 Nov 05 14:48:05.563761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:05.565161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42188) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:05.572611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:05.578640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:05.581230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:05.591377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:05.593047 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2aa8e7d3-1ce8-43bf-941c-da41cd61c1c9 req-b74d5e9d-b92d-4560-b247-ab81dfeb6263 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2799785 Nov 05 14:48:05.630685 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8f053617-ff20-44af-9d09-363790fdc4f4 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules/f4ee2ba7-aa4f-47e7-97d4-86ceaf975933 HTTP/1.1" status: 200 len: 769 time: 0.0642972 Nov 05 14:48:05.632309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, cf4a56c9-bc0c-4cd4-aa24-69852b584c3e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:05.640654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42192) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:05.654990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:05.655589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.699415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.704814 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8fbb027-6bac-4f27-b9e6-fc5730158fb9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 1.8475244 Nov 05 14:48:05.718788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42194) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:05.736542 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a31b652d-578a-4803-a8d4-c5ed8cf89373 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.0928881 Nov 05 14:48:05.741394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1548724473'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:05.743273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:05.792571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:05.796448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.855394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.892524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.894998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.895136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 647} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:05.934876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:05.935110 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment aa7f02c8-4b57-4634-8531-6acd51494902 of type vlan for network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 Nov 05 14:48:05.990056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8529a492-2ed7-4177-b6e2-1f792cdc4ffe req-71dcbbad-df58-4f6d-a916-43d0cd6a0178 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:05.991289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8529a492-2ed7-4177-b6e2-1f792cdc4ffe req-71dcbbad-df58-4f6d-a916-43d0cd6a0178 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1533401 Nov 05 14:48:05.995387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:06.010065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:06.016371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.023374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.026674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.026839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:06.027328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.027788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-group-rules/f4ee2ba7-aa4f-47e7-97d4-86ceaf975933 HTTP/1.1" status: 204 len: 168 time: 0.2822430 Nov 05 14:48:06.031323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42200) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.053924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.058107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=f6f3175d-c163-448a-9ed7-190917a19926,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.082478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeab0b6f-f2be-4b61-935b-175368489116 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f4ee2ba7-aa4f-47e7-97d4-86ceaf975933,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.094172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port 903a8613-fdd3-40c5-affe-14ef83b866c7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:06.094172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.109187 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23a20497-1671-4549-a853-c71a05447f64 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.0551255 Nov 05 14:48:06.112362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42202) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.135866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'name': 'tempest-NetworksTestDHCPv6-2103104868'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:06.140122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.145857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:06.146452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.164839 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d0447a12-dd00-423c-b8fc-c85078ecb7af tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1224198 Nov 05 14:48:06.182140 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8529a492-2ed7-4177-b6e2-1f792cdc4ffe req-1d9b7654-1ec9-4774-b39e-75bc55a300e1 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1699622 Nov 05 14:48:06.182626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42204) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.254463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.5318916 Nov 05 14:48:06.258320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42206) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.269682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '8c4e3da2-f9ab-4d15-9adb-0a9654713c40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:06.281623 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a00f033a-bd92-4464-ba9a-37ecf6c4e920 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=8c4e3da2-f9ab-4d15-9adb-0a9654713c40,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.295729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:06.378396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.413296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.426143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:06.430056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:06.430729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.430951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.532498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] For port 20e04871-7ef2-48ae-877b-794fd77ff2d7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=20e04871-7ef2-48ae-877b-794fd77ff2d7,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:06.586210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.594944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Could not find standard attr ID for object d6cf7793-6c1b-4377-98a7-19c6cd75dbef. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:06.616940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.619856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.624773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "DELETE /v2.0/security-groups/fa904185-9fde-4344-bb54-dfae81251680 HTTP/1.1" status: 204 len: 168 time: 0.4116824 Nov 05 14:48:06.625452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42208) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.651350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccda0ac-3f2e-4e43-8a0f-98e77d0ddefe None None] Pushing event updated for resources: {'Port': ['ID=20e04871-7ef2-48ae-877b-794fd77ff2d7,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.661609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb8ba80-3873-4726-96eb-715a79c9b85c tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa904185-9fde-4344-bb54-dfae81251680,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.707628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.740539 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2b7ee9e3-9003-49ff-ac04-cfc8fab73f9f tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1019330 Nov 05 14:48:06.741201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42210) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.780322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.842343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 06730b57-bbf8-4154-a487-3284984c861f is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:06.863697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:06.876577 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-17d1c774-a1c0-4f19-94f8-593f73daa251 tempest-SecGroupIPv6Test-289154958 tempest-SecGroupIPv6Test-289154958-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1263490 Nov 05 14:48:06.879336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:06.880131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.887755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=308e13f1-d31d-4998-a6c2-4d4fa01fd29e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.888676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7797bed-a521-4e12-b51f-874f32764271 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:06.906724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'aa7f02c8-4b57-4634-8531-6acd51494902', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '8c4e3da2-f9ab-4d15-9adb-0a9654713c40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:06.906989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=8a090c65-d7fb-4220-8814-b0198eb7fa87,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:06.907730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 8c4e3da2-f9ab-4d15-9adb-0a9654713c40, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:06.936943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:06.937980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port 903a8613-fdd3-40c5-affe-14ef83b866c7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=903a8613-fdd3-40c5-affe-14ef83b866c7,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:06.938370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.961246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 8c4e3da2-f9ab-4d15-9adb-0a9654713c40) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:06.966713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-793a6c13-5de2-473a-b83e-0ed01cc73b0b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 2.0713336 Nov 05 14:48:06.972079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42214) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:06.977166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for 903a8613-fdd3-40c5-affe-14ef83b866c7 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:06.984019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Provisioning complete for port 90660ae6-0b86-4692-8397-89de23c5c0c1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:06.984392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:06.990705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '06730b57-bbf8-4154-a487-3284984c861f', 'fixed_ips': [{'subnet_id': '76087b71-9aa7-48ca-80b3-62e5718f6fcf'}, {'subnet_id': '8a090c65-d7fb-4220-8814-b0198eb7fa87'}], 'name': 'tempest-PortsIpV6TestJSON-823397599'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:07.022066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:07.023087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.031120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:07.034189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.097177 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7e57e493-ee89-43d9-a610-38751b13ead2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 0.8357954 Nov 05 14:48:07.100642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42216) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:07.109484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.116025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port f5e063c4-2754-475a-9c55-2149d6a3f3cd yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:07.125383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.218685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.255575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:07.298326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.319941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 90660ae6-0b86-4692-8397-89de23c5c0c1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:07.366478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] For port 90660ae6-0b86-4692-8397-89de23c5c0c1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=90660ae6-0b86-4692-8397-89de23c5c0c1,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:07.376760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.403857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42222) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:07.414270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7797bed-a521-4e12-b51f-874f32764271 None None] Unable to find a vacant binding_index for network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:48:07.433075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7797bed-a521-4e12-b51f-874f32764271 None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 8c4e3da2-f9ab-4d15-9adb-0a9654713c40) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:07.462161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:07.462403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.462653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.471008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.479788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.507026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.511382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Pushing event updated for resources: {'Port': ['ID=90660ae6-0b86-4692-8397-89de23c5c0c1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:07.523285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:07.525440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 0778d4d2-0468-43f2-bd27-245b395a2a33 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:07.576015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 90660ae6-0b86-4692-8397-89de23c5c0c1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:07.576487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.640077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=903a8613-fdd3-40c5-affe-14ef83b866c7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:07.666039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.676216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57311ed6-b40c-4a6b-b8ed-6deb8954e673 req-961fa470-e77d-4160-a21b-33af95f95189 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:07.683932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-57311ed6-b40c-4a6b-b8ed-6deb8954e673 req-961fa470-e77d-4160-a21b-33af95f95189 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2805223 Nov 05 14:48:07.711848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=308e13f1-d31d-4998-a6c2-4d4fa01fd29e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:07.780086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b2655b72-c42c-4c30-b642-87cf1f472bdb None None] Could not find standard attr ID for object d6cf7793-6c1b-4377-98a7-19c6cd75dbef. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:07.796754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 20e04871-7ef2-48ae-877b-794fd77ff2d7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:07.798120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::278 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/f6f3175d-c163-448a-9ed7-190917a19926/f5e063c4-2754-475a-9c55-2149d6a3f3cd) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:07.830616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.839307 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-063e4d41-17c7-48c1-9473-df36b9b51d95 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c4ce37f5ee134d709e880beee3081670&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4320343 Nov 05 14:48:07.841367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.845217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42230) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:07.916918 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-57311ed6-b40c-4a6b-b8ed-6deb8954e673 req-cfdc8a68-e1a9-4d7b-a9ad-e43fa50fdf14 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2299197 Nov 05 14:48:07.920634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c4e3da2-f9ab-4d15-9adb-0a9654713c40']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:07.922046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:07.922519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.945641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa7f02c8-4b57-4634-8531-6acd51494902') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:07.945943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa7f02c8-4b57-4634-8531-6acd51494902') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:07.957107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-06730b57-bbf8-4154-a487-3284984c861f', 'network_id': '06730b57-bbf8-4154-a487-3284984c861f', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '76087b71-9aa7-48ca-80b3-62e5718f6fcf'}, {'subnet_id': '8a090c65-d7fb-4220-8814-b0198eb7fa87'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:07.958633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.975335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:07.976434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:07.997229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-cf4a56c9-bc0c-4cd4-aa24-69852b584c3e', 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e', 'tenant_id': 'f15c91f02d964fe68931931339a6282b', 'fixed_ips': [{'subnet_id': '8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:07.998196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.007075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:08.018135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.057329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 647 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:08.057747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:08.061389 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:08.063882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.193403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.222941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::2e7 (06730b57-bbf8-4154-a487-3284984c861f/76087b71-9aa7-48ca-80b3-62e5718f6fcf/0778d4d2-0468-43f2-bd27-245b395a2a33) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:08.232180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'f6f3175d-c163-448a-9ed7-190917a19926'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '20e04871-7ef2-48ae-877b-794fd77ff2d7'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:48:08.237407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.253966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8:0:1::3cd (06730b57-bbf8-4154-a487-3284984c861f/8a090c65-d7fb-4220-8814-b0198eb7fa87/0778d4d2-0468-43f2-bd27-245b395a2a33) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:08.262804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.269534 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/8c4e3da2-f9ab-4d15-9adb-0a9654713c40 HTTP/1.1" status: 204 len: 168 time: 1.1646707 Nov 05 14:48:08.279421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42234) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:08.292413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-353973885'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:08.308367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.320077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-42521448-2428-4938-be21-8c73ff5f48f1 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:08.321536 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-42521448-2428-4938-be21-8c73ff5f48f1 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.32 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.2420599 Nov 05 14:48:08.331039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4cdbb58-28d7-4396-bfee-f202509dd069 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=8c4e3da2-f9ab-4d15-9adb-0a9654713c40,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:08.364573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Allocated IP 172.20.255.242 (cf4a56c9-bc0c-4cd4-aa24-69852b584c3e/8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2/271c7e21-4444-45a0-8a1f-614588c74471) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:08.433353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:08.436592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.447877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.460371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:08.471964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:08.570663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.574087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.578341 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cbe0a52d-4ae0-4ca7-9c49-8b65e869c17e HTTP/1.1" status: 204 len: 168 time: 0.7318482 Nov 05 14:48:08.610556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c9ff322-a6c9-4c29-a4fc-43d4f97f1e02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbe0a52d-4ae0-4ca7-9c49-8b65e869c17e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:08.630742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 647} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:08.641214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.641800 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment a1d912ab-45ba-4c3b-8261-8952a5967b9f of type vlan for network 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a Nov 05 14:48:08.687616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:08.696269 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-143aabf0-c906-4d7c-9895-eb8ffce436ac tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.7960947 Nov 05 14:48:08.699966 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:08.707569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.713267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:08.714765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.715276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42240) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:08.716197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:08.720572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.729086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'network': {'name': 'tempest-RoutersTest-293566542'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:08.746678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:08.760554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-837696f3-2e7d-4d5a-a302-ca9da5c5c54f tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6647861 Nov 05 14:48:08.763591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42242) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:08.776820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:08.777493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.784116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:08.784891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.816621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:08.836239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:08.838276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting subnet 6bb60fd7-5d44-43a7-aab2-e78614f10a7b {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:08.841861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.843388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:08.869523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:08.870433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:08.870981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=38fa4b1a-98e1-4a9e-beb5-613b9678eb9a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:08.883409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Deleting port 13d06243-5eeb-4ace-b456-59f332abe92e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:08.883872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.888613 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Pushing event updated for resources: {'Port': ['ID=271c7e21-4444-45a0-8a1f-614588c74471,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:08.892805 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-715811eb-268c-4458-b39b-c60f3a26d682 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.6105063 Nov 05 14:48:08.895060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42246) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:08.902748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:08.904076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '38fa4b1a-98e1-4a9e-beb5-613b9678eb9a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:08.908009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=f5e063c4-2754-475a-9c55-2149d6a3f3cd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:08.965560 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:08.967943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:08.975229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.012171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:09.017948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:09.024924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:09.030818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.031474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.049637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 635} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:09.060336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.060710 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added segment 9ce004ab-8a09-48e4-84fc-0892f0beb95d of type vlan for network 2b4ec7e4-c25c-4dba-9f85-c62657895348 Nov 05 14:48:09.119964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.158468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.165901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.166532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.171434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.269186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a545e010-8e4f-4b96-854a-713978581b9c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 3.1390479 Nov 05 14:48:09.282443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42256) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:09.329479 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.6107285 Nov 05 14:48:09.339794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42262) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:09.347030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'subnet': {'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:09.350250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:09.417264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 90660ae6-0b86-4692-8397-89de23c5c0c1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:09.448664 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:05Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:06Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:09.464532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/f6f3175d-c163-448a-9ed7-190917a19926/20e04871-7ef2-48ae-877b-794fd77ff2d7) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:09.468228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95df4a1a-0331-4530-a87e-cb02b9b62e20 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Network': ['ID=2b4ec7e4-c25c-4dba-9f85-c62657895348,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:09.517519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:09.521670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.521831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4de0905-d173-4001-b09d-acc5c27aa5ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.528233 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:09.528843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4de0905-d173-4001-b09d-acc5c27aa5ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.530537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4de0905-d173-4001-b09d-acc5c27aa5ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1592 time: 0.2443609 Nov 05 14:48:09.530952 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Updating router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 port 711c5642-fb28-4fa7-a9c6-15f78cc03028 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:48:09.535393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42266) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:09.548616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:09.548902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.566742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Provisioning complete for port 90660ae6-0b86-4692-8397-89de23c5c0c1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:09.567558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.574962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Made reservation on behalf of bbde0bc4197d4a3abf61fecd96fbf9c9 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:09.578798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.602828 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.608380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.652359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:09.655895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Attempting to bind port 271c7e21-4444-45a0-8a1f-614588c74471 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:09.656611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Attempting to bind port 271c7e21-4444-45a0-8a1f-614588c74471 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '0408f50a-cd3d-4543-8801-f4470d128538', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:09.657983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Attempting to bind port 271c7e21-4444-45a0-8a1f-614588c74471 on network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:09.734337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 06730b57-bbf8-4154-a487-3284984c861f is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:09.738296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:09.739085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:48:09.739575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Checking segment: {'id': '0408f50a-cd3d-4543-8801-f4470d128538', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:09.740079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:48:09.740600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.741907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Bound using segment: {'id': '0408f50a-cd3d-4543-8801-f4470d128538', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:09.742697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Bound port: 271c7e21-4444-45a0-8a1f-614588c74471, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0408f50a-cd3d-4543-8801-f4470d128538', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'cf4a56c9-bc0c-4cd4-aa24-69852b584c3e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:09.743331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.746616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:09.766061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:09.773213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.773964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.809712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a44d36-1aed-4fa6-b859-1e07b62fe18e req-a59b352c-0b8f-4d17-a85c-66798112ceb9 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:09.811556 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-83a44d36-1aed-4fa6-b859-1e07b62fe18e req-a59b352c-0b8f-4d17-a85c-66798112ceb9 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.7481966 Nov 05 14:48:09.833920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=0778d4d2-0468-43f2-bd27-245b395a2a33,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:09.846790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] For port 13d06243-5eeb-4ace-b456-59f332abe92e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=13d06243-5eeb-4ace-b456-59f332abe92e,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:09.847161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.878196 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1280f4b0-e41f-4b53-81f4-4c26403a4178 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1016 time: 2.8980560 Nov 05 14:48:09.886924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42276) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:09.899961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] For port 271c7e21-4444-45a0-8a1f-614588c74471, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:09.902854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '76087b71-9aa7-48ca-80b3-62e5718f6fcf'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:09.904259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] For port 271c7e21-4444-45a0-8a1f-614588c74471, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=271c7e21-4444-45a0-8a1f-614588c74471,segment=NetworkSegment(0408f50a-cd3d-4543-8801-f4470d128538),segment_id=0408f50a-cd3d-4543-8801-f4470d128538)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:09.947653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:09.957761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:09.965500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42278) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:10.000771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:10.123543 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-83a44d36-1aed-4fa6-b859-1e07b62fe18e req-4de9c241-9685-4436-a7a7-a662bef40728 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2968976 Nov 05 14:48:10.149086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:10.149720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:10.152632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.158586 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.245092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-819195017'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:10.333367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port f5e063c4-2754-475a-9c55-2149d6a3f3cd {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:10.333712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.348428 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.368449 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.428692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 90660ae6-0b86-4692-8397-89de23c5c0c1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:10.429716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.448009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.450011 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9031d198-c760-4960-b0ea-6359fc663bf7 None None] Pushing event updated for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:10.472003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.481921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e2e3da-fd26-4285-be28-db7457870f66 None None] Pushing event updated for resources: {'Port': ['ID=271c7e21-4444-45a0-8a1f-614588c74471,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:10.494724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:10.519287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Made reservation on behalf of 9bd96d5f582546bbb7c280fd62f1e4c1 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:10.522750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.527514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.536725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/6bb60fd7-5d44-43a7-aab2-e78614f10a7b HTTP/1.1" status: 204 len: 168 time: 1.7706552 Nov 05 14:48:10.537933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42282) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:10.554483 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Attempting to bind port 711c5642-fb28-4fa7-a9c6-15f78cc03028 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:10.555606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Attempting to bind port 711c5642-fb28-4fa7-a9c6-15f78cc03028 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:10.556151 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Attempting to bind port 711c5642-fb28-4fa7-a9c6-15f78cc03028 on network 1fb97d8a-9f3b-438a-9a84-527e5990548d {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:10.562631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18858281-2f7c-48c1-a762-e940827ad8fe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Subnet': ['ID=6bb60fd7-5d44-43a7-aab2-e78614f10a7b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:10.566001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:10.566696 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Checking segment: {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:10.568554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.569112 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Bound using segment: {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:10.570097 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Bound port: 711c5642-fb28-4fa7-a9c6-15f78cc03028, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:10.570693 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.587786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.676905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:10.679508 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] For port 711c5642-fb28-4fa7-a9c6-15f78cc03028, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:10.684895 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] For port 711c5642-fb28-4fa7-a9c6-15f78cc03028, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=711c5642-fb28-4fa7-a9c6-15f78cc03028,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:10.691744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.694405 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.713999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32c55b2a-f01e-4e32-a8d3-4e028cb7893d None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:10.722704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.723062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.723495 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Floating IP 1d474aed-25dd-44fe-aa9b-abe75b9570eb disassociated. External IP: 172.26.5.23, port: 13d06243-5eeb-4ace-b456-59f332abe92e. Nov 05 14:48:10.723879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Calling delete_port for 13d06243-5eeb-4ace-b456-59f332abe92e owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:10.727030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for f5e063c4-2754-475a-9c55-2149d6a3f3cd owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:10.735793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] For port 20e04871-7ef2-48ae-877b-794fd77ff2d7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=20e04871-7ef2-48ae-877b-794fd77ff2d7,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:10.781364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=83412e46-d0f7-473c-81fe-44457c7d732a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:10.789595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Allocated IP 2001:db8::2 (06730b57-bbf8-4154-a487-3284984c861f/76087b71-9aa7-48ca-80b3-62e5718f6fcf/eb5a9024-36d1-46c2-99bd-b5a62d5258c3) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:10.808144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Provisioning complete for port 711c5642-fb28-4fa7-a9c6-15f78cc03028 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:10.808862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.809805 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9031d198-c760-4960-b0ea-6359fc663bf7 None None] Pushing event updated for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:10.833835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.843578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Allocated IP 2001:db8:0:1::2 (06730b57-bbf8-4154-a487-3284984c861f/8a090c65-d7fb-4220-8814-b0198eb7fa87/eb5a9024-36d1-46c2-99bd-b5a62d5258c3) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:10.844498 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:10.845287 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:10.869216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.907996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.922250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'a1d912ab-45ba-4c3b-8261-8952a5967b9f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '38fa4b1a-98e1-4a9e-beb5-613b9678eb9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:10.922733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:10.950003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.962572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:10.996081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:11.063873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:11.117427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.121530 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/f5e063c4-2754-475a-9c55-2149d6a3f3cd HTTP/1.1" status: 204 len: 168 time: 1.5835667 Nov 05 14:48:11.127984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b41186bb-d4be-497e-99d9-2c440071923d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=f5e063c4-2754-475a-9c55-2149d6a3f3cd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:11.130547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42284) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:11.198809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:11.217579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.218410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.261520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Checking segment: {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:11.262518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network hostable DHCP agents. Network: 2b4ec7e4-c25c-4dba-9f85-c62657895348, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:11.276655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Subnet': ['ID=2c2e96ed-b727-4039-a867-c1c057b74aba,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:11.332068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67c42c8a-6dff-4c42-8a6e-bc2949ff301a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.334343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67c42c8a-6dff-4c42-8a6e-bc2949ff301a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.342824 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-67c42c8a-6dff-4c42-8a6e-bc2949ff301a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2051067 Nov 05 14:48:11.345482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14945770-d01c-4cb7-ab60-e1e995151332 None None] Pushing event updated for resources: {'Port': ['ID=20e04871-7ef2-48ae-877b-794fd77ff2d7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:11.373427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42288) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:11.378127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.426651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:11.439916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 2b4ec7e4-c25c-4dba-9f85-c62657895348) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:11.453624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.454276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.464729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 271c7e21-4444-45a0-8a1f-614588c74471 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:11.472493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83553166-4022-4471-bdfb-6cff38822ec5 req-4d5a5793-2358-4aee-8876-4d2ca3533984 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.475276 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83553166-4022-4471-bdfb-6cff38822ec5 req-4d5a5793-2358-4aee-8876-4d2ca3533984 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 946 time: 0.1815746 Nov 05 14:48:11.509817 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:05Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:10Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:11.517667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.529005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet f6f3175d-c163-448a-9ed7-190917a19926 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:11.546077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3b54d3b4-5796-476a-900b-b56867ea87d4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.2005539 Nov 05 14:48:11.546297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.553603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42290) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:11.558794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:11.569291 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1cfbdb0-7248-4d0b-8441-af941175b71e None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:05Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:10Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:11.573887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.574563 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Added segment b2e432e1-a1e7-4038-9d0e-ddfed0490bfc of type vlan for network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b Nov 05 14:48:11.622000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] For port 711c5642-fb28-4fa7-a9c6-15f78cc03028, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=711c5642-fb28-4fa7-a9c6-15f78cc03028,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:11.654213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.695542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.702312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.760632 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-461471b4-bafa-4594-a057-52354086c9c2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 2.8607268 Nov 05 14:48:11.768840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42292) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:11.777077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.778452 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83553166-4022-4471-bdfb-6cff38822ec5 req-1ca87184-f413-482b-8f89-6c68a43ed54d tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups?id=40e045d3-0c39-49ee-9afb-128e4a54e42c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2929502 Nov 05 14:48:11.784264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:11.784948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.804289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.825157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Deleting port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:11.825503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.831598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.839760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 271c7e21-4444-45a0-8a1f-614588c74471 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:11.840219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:11.931705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9a9613f8-c087-4bcc-942d-24381869adbc None None] Provisioning complete for port 271c7e21-4444-45a0-8a1f-614588c74471 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:11.932232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9a9613f8-c087-4bcc-942d-24381869adbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.005536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ee06c66-8093-4d91-9b78-74d45807fa2d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.006409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2962f324-82bf-440f-b02b-7b2bfcb334b0 None None] Pushing event updated for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.011886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.014179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Network 06730b57-bbf8-4154-a487-3284984c861f is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:12.019506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.113007 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 2.1138339 Nov 05 14:48:12.117205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42294) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:12.125658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Request body: {'subnet': {'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:12.169352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event deleted for resources: {'Port': ['ID=13d06243-5eeb-4ace-b456-59f332abe92e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.203058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb0b500-708b-481e-88ac-f25eccfbdd54 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event updated for resources: {'Network': ['ID=86b0fe83-8f1f-4f5a-96f1-49f97741c68b,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.213532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:12.227401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] For port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,segment=NetworkSegment(7eff7e35-335f-4774-8c0f-46053cb26ca0),segment_id=7eff7e35-335f-4774-8c0f-46053cb26ca0)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:12.228163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.245883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:12.249643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:12.260526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Delete allocated IP 2001:db8:0:1::3cd (06730b57-bbf8-4154-a487-3284984c861f/8a090c65-d7fb-4220-8814-b0198eb7fa87) {{(pid=113581) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:48:12.276893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Calling delete_port for d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:12.313296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Made reservation on behalf of 9bd96d5f582546bbb7c280fd62f1e4c1 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:12.317262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.324093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.349273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.410528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Pushing event updated for resources: {'Port': ['ID=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.490531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Attempting to bind port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:12.491206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Attempting to bind port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9f69a45a-2686-4fb8-8d74-a1c57f4712a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '06730b57-bbf8-4154-a487-3284984c861f'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:12.491853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Attempting to bind port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 on network 06730b57-bbf8-4154-a487-3284984c861f {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:12.510935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 271c7e21-4444-45a0-8a1f-614588c74471, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=271c7e21-4444-45a0-8a1f-614588c74471,segment=NetworkSegment(0408f50a-cd3d-4543-8801-f4470d128538),segment_id=0408f50a-cd3d-4543-8801-f4470d128538)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:12.514207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:12.514742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Checking segment: {'id': '9f69a45a-2686-4fb8-8d74-a1c57f4712a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '06730b57-bbf8-4154-a487-3284984c861f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:12.515258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.515777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Bound using segment: {'id': '9f69a45a-2686-4fb8-8d74-a1c57f4712a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '06730b57-bbf8-4154-a487-3284984c861f'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:12.516408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Bound port: eb5a9024-36d1-46c2-99bd-b5a62d5258c3, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9f69a45a-2686-4fb8-8d74-a1c57f4712a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '06730b57-bbf8-4154-a487-3284984c861f'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:12.516936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.525064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.534303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.548181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 903a8613-fdd3-40c5-affe-14ef83b866c7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:12.571140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9a9613f8-c087-4bcc-942d-24381869adbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.624779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 903a8613-fdd3-40c5-affe-14ef83b866c7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:12.625267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 903a8613-fdd3-40c5-affe-14ef83b866c7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:12.651713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.697922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=271c7e21-4444-45a0-8a1f-614588c74471,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.707776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.715291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.720858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] For port eb5a9024-36d1-46c2-99bd-b5a62d5258c3, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:12.726161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] For port eb5a9024-36d1-46c2-99bd-b5a62d5258c3, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,segment=NetworkSegment(9f69a45a-2686-4fb8-8d74-a1c57f4712a2),segment_id=9f69a45a-2686-4fb8-8d74-a1c57f4712a2)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:12.727750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-9a9613f8-c087-4bcc-942d-24381869adbc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:48:12.728231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-9a9613f8-c087-4bcc-942d-24381869adbc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:48:12.731353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.763731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.798628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def9c206-990a-4253-8cbf-b498cb370284 None None] Pushing event updated for resources: {'Port': ['ID=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.812584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Allocated IP 172.23.0.1 (2b4ec7e4-c25c-4dba-9f85-c62657895348/2c2e96ed-b727-4039-a867-c1c057b74aba/352e7f58-dffc-48d3-beb6-394f50f52fa7) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:12.819677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event updated for resources: {'Subnet': ['ID=cd57bf86-8d2e-4939-b60e-8b8752eaf6e5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.843446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Checking segment: {'id': 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:12.843816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Network hostable DHCP agents. Network: 86b0fe83-8f1f-4f5a-96f1-49f97741c68b, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:12.863530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] In _notify_port_updated(), no bound segment for port 0778d4d2-0468-43f2-bd27-245b395a2a33 on network 06730b57-bbf8-4154-a487-3284984c861f {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:48:12.869904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:12.870545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.874577 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/ports/0778d4d2-0468-43f2-bd27-245b395a2a33 HTTP/1.1" status: 200 len: 925 time: 2.9808886 Nov 05 14:48:12.875610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42298) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:12.882864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5528b3-e827-48bd-ac9a-6861dcce8ff0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=0778d4d2-0468-43f2-bd27-245b395a2a33,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:12.887797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '76087b71-9aa7-48ca-80b3-62e5718f6fcf'}, {'subnet_id': '8a090c65-d7fb-4220-8814-b0198eb7fa87'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:12.896144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Router 51c9704a-323f-4947-9153-8af2348f332c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:12.944703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:12.968606 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6ffa3f59-a8e9-40bf-8b81-ff87fcf938f4 req-4b599cb4-1d52-4e89-9a7f-9eaea58dbb13 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.0679963 Nov 05 14:48:12.974703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 86b0fe83-8f1f-4f5a-96f1-49f97741c68b) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:12.975010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:12.985217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.007600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:13.008289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.084282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Port': ['ID=d84d7e40-6eaa-48ec-93b7-98c687ccf6d1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:13.097804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.107044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.111765 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/f6f3175d-c163-448a-9ed7-190917a19926 HTTP/1.1" status: 204 len: 168 time: 1.7139757 Nov 05 14:48:13.113377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No DVR routers for this DVR port d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:13.115295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03699f66-f5c2-4a36-ac0d-f153449415d1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=f6f3175d-c163-448a-9ed7-190917a19926,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:13.116312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42300) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:13.122502 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-98c642cc-63a8-4c99-9a35-a9c9e25ba815 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0042489 Nov 05 14:48:13.132679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42302) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:13.177953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Request body: {'port': {'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b', 'name': 'tempest-TagsExtTest-350122279'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:13.231733 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-572313e3-1f38-4d05-89e9-3eba63a99edb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1080143 Nov 05 14:48:13.237006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.249252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42304) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:13.281989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:13.392887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.451208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bbb9619c-62c1-4058-97d8-e8b993360cba None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:13.451815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bbb9619c-62c1-4058-97d8-e8b993360cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.516437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 13d06243-5eeb-4ace-b456-59f332abe92e no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:13.560828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device eb5a9024-36d1-46c2-99bd-b5a62d5258c3 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:13.566311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 13d06243-5eeb-4ace-b456-59f332abe92e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:13.567427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 13d06243-5eeb-4ace-b456-59f332abe92e not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:13.593484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:13.596781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.654557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.657038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.677132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:13.678371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.705282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58e096c3-c0f8-415c-ae1a-d740c70eafa2']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:13.726452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Made reservation on behalf of 9bd96d5f582546bbb7c280fd62f1e4c1 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:13.730163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.732659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7eff7e35-335f-4774-8c0f-46053cb26ca0') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:13.733528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7eff7e35-335f-4774-8c0f-46053cb26ca0') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:13.737633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:13.745529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.754914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Sync routers for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:13.772927 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:13.773896 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:13.790500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.812784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.833939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:13.842881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] device_id is not set on port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:13.853177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:13.855162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:13.860365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:13.871319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port eb5a9024-36d1-46c2-99bd-b5a62d5258c3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,segment=NetworkSegment(9f69a45a-2686-4fb8-8d74-a1c57f4712a2),segment_id=9f69a45a-2686-4fb8-8d74-a1c57f4712a2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:13.871851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=83412e46-d0f7-473c-81fe-44457c7d732a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:13.892651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.894242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 20e04871-7ef2-48ae-877b-794fd77ff2d7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:13.905784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] No DVR routers for this DVR port 13d06243-5eeb-4ace-b456-59f332abe92e on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:13.913425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.924028 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-28994b6f-ab0a-44d0-939f-304e7f6b28ac req-10525315-ecea-4c98-be44-15c894713132 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.32 "DELETE /v2.0/ports/13d06243-5eeb-4ace-b456-59f332abe92e HTTP/1.1" status: 204 len: 173 time: 5.5855243 Nov 05 14:48:13.925107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:13.933867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'name': 'network-vif-deleted', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:48:13.937002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e74abb9-fb89-4af0-a683-9bdb9e87bc34" -d '{"events": [{"server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "name": "network-vif-deleted", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:48:13.962550 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:14.077038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:14.077584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.079325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:14.108285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.166436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Releasing vlan 634 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:14.168219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:14.180774 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:14.213818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:48:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83f213e9-1ace-4118-9002-eb882ae5148d x-openstack-request-id: req-83f213e9-1ace-4118-9002-eb882ae5148d {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:48:14.214402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dfe754d6-c757-4eb3-bbc6-cbfbece59184", "name": "network-vif-deleted", "tag": "13d06243-5eeb-4ace-b456-59f332abe92e", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:48:14.214823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-83f213e9-1ace-4118-9002-eb882ae5148d {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:48:14.215375 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfe754d6-c757-4eb3-bbc6-cbfbece59184', 'name': 'network-vif-deleted', 'tag': '13d06243-5eeb-4ace-b456-59f332abe92e', 'status': 'completed', 'code': 200} Nov 05 14:48:14.255435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 271c7e21-4444-45a0-8a1f-614588c74471 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:14.264118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.282596 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cc5a2577-2e20-4a0b-9266-4ba3ab24c2f0 req-a77fea17-b287-472c-8860-549c6578725c tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/ports?device_id=dfe754d6-c757-4eb3-bbc6-cbfbece59184 HTTP/1.1" status: 200 len: 210 time: 0.0493908 Nov 05 14:48:14.311247 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:14.313375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['38fa4b1a-98e1-4a9e-beb5-613b9678eb9a']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:14.320877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.343385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a1d912ab-45ba-4c3b-8261-8952a5967b9f') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:14.344022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a1d912ab-45ba-4c3b-8261-8952a5967b9f') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:14.347373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.351246 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Checking router: 51c9704a-323f-4947-9153-8af2348f332c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:14.351523 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/networks/58e096c3-c0f8-415c-ae1a-d740c70eafa2 HTTP/1.1" status: 204 len: 168 time: 3.7883391 Nov 05 14:48:14.366345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 271c7e21-4444-45a0-8a1f-614588c74471 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:14.366539 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:14.367051 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:14.367999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42310) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:14.368154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.372643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'routes': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:14.377009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad701278-b901-4d41-ad4f-3f6eb07f1fbc tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Pushing event deleted for resources: {'Network': ['ID=58e096c3-c0f8-415c-ae1a-d740c70eafa2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:14.379840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.456369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70bfe402-4053-42d9-9ce9-ef249ac8329f None None] Network 06730b57-bbf8-4154-a487-3284984c861f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.489361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5338636-dabc-4c23-a890-2e0063e337f6 None None] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.494433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.506974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.507614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 647 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:14.508152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:14.511789 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:14.582140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-651e93a1-85a9-480b-ac52-b674f2775044 None None] Network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.590600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86ebaff7-65c7-44b8-ba40-ad26164f448f None None] Network 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.611768 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:14.641862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3e1ff26-3927-4d7f-8709-1804f69b122c None None] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.818869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb370925-4c76-4cc2-ab6d-3b1086721e14 None None] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:14.925655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.extraroute_db [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Added routes are [] {{(pid=113581) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:48:14.928819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.extraroute_db [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Removed routes are [] {{(pid=113581) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:48:14.930181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.939416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.953906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d3e1ff26-3927-4d7f-8709-1804f69b122c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:14.960643 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:14.969345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/38fa4b1a-98e1-4a9e-beb5-613b9678eb9a HTTP/1.1" status: 204 len: 168 time: 3.1767612 Nov 05 14:48:14.974815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42312) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:14.980119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-2101531000'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:14.998270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6264123-ae8f-4a0d-ae23-dabd3a32b9dc None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:15.018042 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:15.054285 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5dd1f40-de29-41b4-91bb-9ec16c1a99a8 None None] The sync data for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv is: [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:44:31Z', 'revision_number': 4, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '74689f1f-b8e2-419c-b7bb-20c6dc557b76', 'name': '', 'network_id': 'fc36919c-2228-49a8-98f4-75664fee44eb', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'mac_address': 'fa:16:3e:32:81:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_interface', 'standard_attr_id': 111, 'fixed_ips': [{'subnet_id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:29Z', 'updated_at': '2021-11-05T14:44:37Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'subnets': [{'id': 'c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:15.137890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9e24e6-ceb5-4528-8eeb-5d56c512a0ca tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=38fa4b1a-98e1-4a9e-beb5-613b9678eb9a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:15.158723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:15.162469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.176874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88a8c3fe-1a35-4b8f-affd-7b88cb40c1f9 None None] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-651e93a1-85a9-480b-ac52-b674f2775044 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:15.189326 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:15.221979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8:0:1::45 (06730b57-bbf8-4154-a487-3284984c861f/8a090c65-d7fb-4220-8814-b0198eb7fa87/0778d4d2-0468-43f2-bd27-245b395a2a33) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:15.231924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f1b57d8-71fc-4fd6-972b-55e635f5c7e9 None None] DHCP port deletion for 58e096c3-c0f8-415c-ae1a-d740c70eafa2 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:15.253125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5029d124-8387-42de-a254-0ab211248b46 None None] Network 8c4e3da2-f9ab-4d15-9adb-0a9654713c40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:15.271244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Allocated IP 172.20.0.6 (86b0fe83-8f1f-4f5a-96f1-49f97741c68b/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:15.299483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.309946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.327299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:15.367063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.458407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42322) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:15.467749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 14f376dc-94df-47af-b41b-575261751bcd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:15.530007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.530381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment ac4e5841-73ba-45cd-a52a-4227effbcd7b of type vlan for network eb43032a-4715-403c-8c61-4554522e4ffa Nov 05 14:48:15.609362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:15.633602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:15.635497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=66450838-5872-4508-8f2f-b18bf8d25df9,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5029d124-8387-42de-a254-0ab211248b46 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:15.641019 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:15.645659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:15.646272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.664489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-88a8c3fe-1a35-4b8f-affd-7b88cb40c1f9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:15.686903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:15.701608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 711c5642-fb28-4fa7-a9c6-15f78cc03028 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:15.707030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ddaff80-086a-429c-add8-744b3dffdfa3 None None] New status for floating IP 1d474aed-25dd-44fe-aa9b-abe75b9570eb: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:48:15.728952 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.735504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:15.744757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.749670 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e1760ba4-2c6c-4c31-bbf8-936dccb55526 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 704 time: 1.3806314 Nov 05 14:48:15.753695 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Sync routers for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:15.767962 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:15.768914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:15.770967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42324) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:15.790455 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8a47bd0-0b62-448f-8e45-6a2fd92d1479 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.5148618 Nov 05 14:48:15.798261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42326) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:15.812203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'name': 'tempest-NetworksTestDHCPv6-2071980710'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:15.838197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Provisioning complete for port 90660ae6-0b86-4692-8397-89de23c5c0c1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:15.838197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.857111 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e10501d2-fb1c-4bd7-9ffc-ca2e73088507 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 205 time: 0.0820136 Nov 05 14:48:15.859618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42328) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:15.865715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.911082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:15.917865 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:15.922543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.resource_extend [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:48:16.006501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.047900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf33dcb0-7116-4a9a-9c02-46d8b44c94d5 None None] Network 38fa4b1a-98e1-4a9e-beb5-613b9678eb9a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-70bfe402-4053-42d9-9ce9-ef249ac8329f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.062043 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.077863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.082964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f5338636-dabc-4c23-a890-2e0063e337f6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.084425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.090841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b68a223-466b-4add-9b80-7cf280ac6c20 None None] Network 06730b57-bbf8-4154-a487-3284984c861f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:16.092233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:16.093153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cf33dcb0-7116-4a9a-9c02-46d8b44c94d5 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:16.095205 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.121000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cef03a15-7f69-4add-b4aa-210ba96caa3b None None] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fb370925-4c76-4cc2-ab6d-3b1086721e14 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.124232 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.148661 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:16.159040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.168179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.171873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-600ad68e-ecd5-43a8-b6b8-4d353884b776 None None] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:16.174640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.175280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Provisioning complete for port 20e04871-7ef2-48ae-877b-794fd77ff2d7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:16.175679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.184108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.200632 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Checking router: 14f376dc-94df-47af-b41b-575261751bcd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:16.212606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Routers {'14f376dc-94df-47af-b41b-575261751bcd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:16.213227 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['14f376dc-94df-47af-b41b-575261751bcd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:16.213649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:16.233136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.236415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.239868 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "DELETE /v2.0/security-groups/40e045d3-0c39-49ee-9afb-128e4a54e42c HTTP/1.1" status: 204 len: 168 time: 0.7680352 Nov 05 14:48:16.259563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42330) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.263979 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.2855008 Nov 05 14:48:16.287402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42332) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.292106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a973f23-b06a-4e2b-83a0-faee65d5ef38 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=40e045d3-0c39-49ee-9afb-128e4a54e42c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:16.308109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': 'eb43032a-4715-403c-8c61-4554522e4ffa', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:16.316373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 711c5642-fb28-4fa7-a9c6-15f78cc03028 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:16.316809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.322819 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] Set router 14f376dc-94df-47af-b41b-575261751bcd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:16.381406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-a6753fcb-521f-4cc4-97a5-152f6c0e805a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] show failed (client error): The resource could not be found. Nov 05 14:48:16.385418 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a6753fcb-521f-4cc4-97a5-152f6c0e805a tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "GET /v2.0/security-groups/40e045d3-0c39-49ee-9afb-128e4a54e42c HTTP/1.1" status: 404 len: 347 time: 0.1125095 Nov 05 14:48:16.392341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42334) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.395531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbda384-427d-4f4f-ac1c-a0e57b86a24f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=eb43032a-4715-403c-8c61-4554522e4ffa,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:16.421328 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e94870d-c143-4775-9173-8daabce7151a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:16.421708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:16.430720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network eb43032a-4715-403c-8c61-4554522e4ffa details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:16.459233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:16.461138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=0778d4d2-0468-43f2-bd27-245b395a2a33,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:16.470326 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e94870d-c143-4775-9173-8daabce7151a None None] The sync data for ids ['14f376dc-94df-47af-b41b-575261751bcd'] in dv-neutron-816850-1-hyperv is: [{'id': '14f376dc-94df-47af-b41b-575261751bcd', 'name': 'tempest-RoutersIpV6Test-router-996496667', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:02Z', 'updated_at': '2021-11-05T14:48:07Z', 'revision_number': 11, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:16.493843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.496797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.497439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:16.503011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] In _notify_port_updated(), no bound segment for port 0778d4d2-0468-43f2-bd27-245b395a2a33 on network 06730b57-bbf8-4154-a487-3284984c861f {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:48:16.509163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:16.509827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.514642 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ad506f0f-4e35-4a33-9ae9-4acf949df4c4 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/ports/0778d4d2-0468-43f2-bd27-245b395a2a33 HTTP/1.1" status: 200 len: 1010 time: 3.6352386 Nov 05 14:48:16.514642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.522736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42336) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2b68a223-466b-4add-9b80-7cf280ac6c20 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.536930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cef03a15-7f69-4add-b4aa-210ba96caa3b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.549243 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.557783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90e94c5c-8463-4c1f-bc80-8c98a9c62bd0 None None] Network 06730b57-bbf8-4154-a487-3284984c861f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-600ad68e-ecd5-43a8-b6b8-4d353884b776 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.571330 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.598589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Deleting port 20e04871-7ef2-48ae-877b-794fd77ff2d7 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:16.598966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.608644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.609459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 14f376dc-94df-47af-b41b-575261751bcd {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:16.618659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.627108 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6d62f058-e532-432b-94ce-3070f5a5e5be tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 204 len: 168 time: 0.7635791 Nov 05 14:48:16.628038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42338) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.638404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-376540420', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:16.712231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:16.715910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.723327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.724779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.726011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event updated for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:16.756233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 0778d4d2-0468-43f2-bd27-245b395a2a33 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:16.756609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.771285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:16.771912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.824418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port df8146e1-ec8d-4995-bb95-8971b515eb88 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-90e94c5c-8463-4c1f-bc80-8c98a9c62bd0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:16.836123 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:16.843479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.858262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.871538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Provisioning complete for port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:16.872385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.880625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] For port 20e04871-7ef2-48ae-877b-794fd77ff2d7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=20e04871-7ef2-48ae-877b-794fd77ff2d7,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:16.881225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.899132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.900580 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-45db4c62-b80f-44f3-9532-c790b3a5712b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.2686107 Nov 05 14:48:16.903985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42340) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:16.913249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Request body: {'router': {'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:16.919372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:16.923171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:16.934702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event updated for resources: {'Port': ['ID=4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:16.941863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Calling delete_port for 20e04871-7ef2-48ae-877b-794fd77ff2d7 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:16.955593 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aba8f5b8-2272-4523-b3cf-05bedddd8174 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 3.8217540 Nov 05 14:48:17.025790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42342) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:17.038658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-1592829518', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:17.084635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:17.090205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.106116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:17.135600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 0778d4d2-0468-43f2-bd27-245b395a2a33 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:17.159687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Deleting port 26349d09-e999-4803-9bc7-71ebfce01836 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:17.160076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.162503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device eb5a9024-36d1-46c2-99bd-b5a62d5258c3 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:17.203840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.235109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.236147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.240865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] Pushing event deleted for resources: {'Port': ['ID=20e04871-7ef2-48ae-877b-794fd77ff2d7,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:17.251118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.266170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Provisioning complete for port 711c5642-fb28-4fa7-a9c6-15f78cc03028 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:17.266919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcca2c69-d203-41bd-82e5-290fc2954b2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.270564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.307886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77e5714b-dfdc-4625-9e7c-0864bf53b97b None None] No DVR routers for this DVR port 20e04871-7ef2-48ae-877b-794fd77ff2d7 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:17.334790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9efcb579-a3b1-40c0-8b3b-96194a95dbe7 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:17.349172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::356 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/66450838-5872-4508-8f2f-b18bf8d25df9/df8146e1-ec8d-4995-bb95-8971b515eb88) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:17.435014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:17.435014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9efcb579-a3b1-40c0-8b3b-96194a95dbe7 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:17.531323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:17.534724 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:48:17.537023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Router 8d4d629a-0a0f-4801-9cca-ede7d67bda53 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:48:17.546339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.622340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=0778d4d2-0468-43f2-bd27-245b395a2a33,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:17.679877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:17.701086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.702302 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9718bb6e-2c19-43dc-9868-89de91f360a7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "PUT /v2.0/routers/8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 200 len: 697 time: 0.7977951 Nov 05 14:48:17.725367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42344) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:17.765853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Sync routers for ids ['8d4d629a-0a0f-4801-9cca-ede7d67bda53'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:17.779798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-22e05483-63ee-4e9e-a2a2-1299a8f804b0 None None] Could not find standard attr ID for object d6cf7793-6c1b-4377-98a7-19c6cd75dbef. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:17.797653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Routers {'8d4d629a-0a0f-4801-9cca-ede7d67bda53'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:17.798164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['8d4d629a-0a0f-4801-9cca-ede7d67bda53'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:17.894716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-22e05483-63ee-4e9e-a2a2-1299a8f804b0 None None] Provisioning complete for port 711c5642-fb28-4fa7-a9c6-15f78cc03028 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:17.895457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-22e05483-63ee-4e9e-a2a2-1299a8f804b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.901843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Set router 8d4d629a-0a0f-4801-9cca-ede7d67bda53 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:17.906762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:17.907320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:17.917531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:18.018648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:18.018991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d84d7e40-6eaa-48ec-93b7-98c687ccf6d1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:18.019417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 20e04871-7ef2-48ae-877b-794fd77ff2d7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:18.021391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d4d629a-0a0f-4801-9cca-ede7d67bda53', 'name': 'tempest-RoutersIpV6Test-router-376540420', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:16Z', 'updated_at': '2021-11-05T14:48:17Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:18.056924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.085374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 20e04871-7ef2-48ae-877b-794fd77ff2d7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:18.085729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 20e04871-7ef2-48ae-877b-794fd77ff2d7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:18.107695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.108018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.123557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Checking router: 8d4d629a-0a0f-4801-9cca-ede7d67bda53 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:18.130892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-049748c1-7cac-48ea-98ec-7a0e6a3f06d2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:18.132110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.135904 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6f7f071e-fb06-4d06-b96e-0847b1ace0ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 1.1053843 Nov 05 14:48:18.144069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.149891 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ffe56cb-8d02-4ba5-9965-1fb1c0c3594f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/0778d4d2-0468-43f2-bd27-245b395a2a33 HTTP/1.1" status: 204 len: 168 time: 1.6236379 Nov 05 14:48:18.149891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42346) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.152383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-083b4fce-f563-4005-8be7-14e7cf5eca64 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-1564753525', 'prefixes': ['172.20.0.0/16']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:18.156373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42348) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.171503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Calling delete_port for 26349d09-e999-4803-9bc7-71ebfce01836 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:18.196908 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-84443005-2453-4010-9dd6-bcb7214fd191 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/routers/8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 200 len: 703 time: 0.4663124 Nov 05 14:48:18.197228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.198640 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-20ec0ae7-0eb8-4cf1-a77a-21ecb3c4ca12 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:18.201887 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20ec0ae7-0eb8-4cf1-a77a-21ecb3c4ca12 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/0778d4d2-0468-43f2-bd27-245b395a2a33 HTTP/1.1" status: 404 len: 333 time: 0.0397096 Nov 05 14:48:18.201887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42350) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.204167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42352) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.215387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Routers {'8d4d629a-0a0f-4801-9cca-ede7d67bda53'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:18.216134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['8d4d629a-0a0f-4801-9cca-ede7d67bda53'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:18.225439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.232133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc570380-f213-4d64-9c93-c67586126c0d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 200 len: 205 time: 0.0273018 Nov 05 14:48:18.233913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42354) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.271872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.327013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.336822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] Set router 8d4d629a-0a0f-4801-9cca-ede7d67bda53 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:18.428751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d4d629a-0a0f-4801-9cca-ede7d67bda53', 'name': 'tempest-RoutersIpV6Test-router-376540420', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:16Z', 'updated_at': '2021-11-05T14:48:17Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:18.437318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-083b4fce-f563-4005-8be7-14e7cf5eca64 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for subnetpool, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.441829 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-083b4fce-f563-4005-8be7-14e7cf5eca64 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 748 time: 0.2895420 Nov 05 14:48:18.450213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 8a090c65-d7fb-4220-8814-b0198eb7fa87 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:18.456789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42356) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.470673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-666e446c-d73a-4dfb-a743-8d33e4d75fab tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-2023745868') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:18.474385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.476598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7712f371-c8bb-4dc6-86de-e3edec907f1a None None] The sync data for ids ['8d4d629a-0a0f-4801-9cca-ede7d67bda53'] in dv-neutron-816850-1-hyperv is: [{'id': '8d4d629a-0a0f-4801-9cca-ede7d67bda53', 'name': 'tempest-RoutersIpV6Test-router-376540420', 'tenant_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:16Z', 'updated_at': '2021-11-05T14:48:17Z', 'revision_number': 2, 'project_id': 'f47c1e1d128a41dbac53e7ce0c8e5b5b', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:18.489584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-22e05483-63ee-4e9e-a2a2-1299a8f804b0 None None] Could not find standard attr ID for object 0778d4d2-0468-43f2-bd27-245b395a2a33. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:18.532815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.535151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.553931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=8b427c22-5e30-4a44-bafb-68989f9f3089,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:18.556513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:18.565097 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:18.585645 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:18.586256 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:18.588901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-049748c1-7cac-48ea-98ec-7a0e6a3f06d2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:18.601285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.601890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Fanout notify agent at l3_agent the message router_deleted on router 8d4d629a-0a0f-4801-9cca-ede7d67bda53 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:18.611412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.612537 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e934a07b-ffa0-458b-be67-863727cbdf59 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 204 len: 168 time: 0.3767641 Nov 05 14:48:18.616296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42358) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.626404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-503ae184-bae3-4624-a41b-1e5c3d9b1fed None None] Could not find standard attr ID for object 0778d4d2-0468-43f2-bd27-245b395a2a33. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:18.674602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1710f079-2d9f-45da-a107-995bf781cf44 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 200 len: 205 time: 0.0569501 Nov 05 14:48:18.677162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42360) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.711830 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-716e40ba-b1d1-4d94-b574-26bb399ff905 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1568017 Nov 05 14:48:18.718335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42362) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.725487 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:18.735123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:18.740778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.742383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.749239 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-8513ba8a-c50d-49c3-a2ea-f3b45d5634a2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:18.750298 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8513ba8a-c50d-49c3-a2ea-f3b45d5634a2 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/8d4d629a-0a0f-4801-9cca-ede7d67bda53 HTTP/1.1" status: 404 len: 336 time: 0.0703661 Nov 05 14:48:18.757885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42364) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.800289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3a50360-a579-4c35-9a06-4f9816fdc6a4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:18.801079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b3a50360-a579-4c35-9a06-4f9816fdc6a4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:18.806775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'ac4e5841-73ba-45cd-a52a-4227effbcd7b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'eb43032a-4715-403c-8c61-4554522e4ffa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:18.806775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: eb43032a-4715-403c-8c61-4554522e4ffa, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:18.808450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b3a50360-a579-4c35-9a06-4f9816fdc6a4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/b821e8d9-71a6-4f8a-9f12-735b1439a1e6 HTTP/1.1" status: 404 len: 337 time: 0.0492520 Nov 05 14:48:18.809408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42366) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.819513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:18.848499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:18.858427 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-a09d7a88-9bfe-4529-9146-27c09d1c7c37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:18.859195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a09d7a88-9bfe-4529-9146-27c09d1c7c37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:18.862807 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a09d7a88-9bfe-4529-9146-27c09d1c7c37 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/6c19ebe2-7077-4835-9f1a-e3750940caf5 HTTP/1.1" status: 404 len: 337 time: 0.0522881 Nov 05 14:48:18.865856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42368) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.876820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.905598 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e85e8aa-9d7d-49ea-8afe-782a9fcfdabe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:18.906062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e85e8aa-9d7d-49ea-8afe-782a9fcfdabe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:18.912005 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9e85e8aa-9d7d-49ea-8afe-782a9fcfdabe tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/08e17274-b197-46e0-912c-f6754806a9e1 HTTP/1.1" status: 404 len: 337 time: 0.0450616 Nov 05 14:48:18.913797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42370) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.925764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:18.931978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:18.932641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:18.948678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-1fc34d26-92bf-48e6-9376-0f7c83044ad1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:18.949171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1fc34d26-92bf-48e6-9376-0f7c83044ad1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:18.954625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1fc34d26-92bf-48e6-9376-0f7c83044ad1 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/6bb60fd7-5d44-43a7-aab2-e78614f10a7b HTTP/1.1" status: 404 len: 337 time: 0.0374775 Nov 05 14:48:18.954897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42372) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:18.958234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Pushing event deleted for resources: {'Port': ['ID=26349d09-e999-4803-9bc7-71ebfce01836,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:19.002504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-2b4ec7e4-c25c-4dba-9f85-c62657895348', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:19.004296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.013651 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c3eb01e8-04aa-42e7-9e48-9f792709cb97 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 200 len: 205 time: 0.0575361 Nov 05 14:48:19.018266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42374) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.025329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-86b0fe83-8f1f-4f5a-96f1-49f97741c68b', 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b', 'tenant_id': '9bd96d5f582546bbb7c280fd62f1e4c1', 'fixed_ips': [{'subnet_id': 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:19.026328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.031627 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:14Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:15Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:19.035537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '66450838-5872-4508-8f2f-b18bf8d25df9'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:19.036659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.041552 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 3.2396731 Nov 05 14:48:19.058199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42376) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.065402 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:19.066140 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Updating router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 port 352e7f58-dffc-48d3-beb6-394f50f52fa7 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:48:19.094499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-42330a89-66b5-4df7-ae91-8710ce727113 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:19.096951 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42330a89-66b5-4df7-ae91-8710ce727113 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/14f376dc-94df-47af-b41b-575261751bcd HTTP/1.1" status: 404 len: 336 time: 0.0777333 Nov 05 14:48:19.099580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42378) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.117508 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.130666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network eb43032a-4715-403c-8c61-4554522e4ffa is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:19.157608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85b04da7-ebf5-4dd8-86da-c6e960b39c08 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=0f311556-941e-4003-8a09-cc61a2768eb9 HTTP/1.1" status: 200 len: 205 time: 0.0554805 Nov 05 14:48:19.159030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42380) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.165409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb998e42-0ff4-4f3b-bda5-96444fb21fe7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=df8146e1-ec8d-4995-bb95-8971b515eb88,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:19.217592 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-ce250765-24ef-4fab-aaa1-d5d04a87faec tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:19.222013 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ce250765-24ef-4fab-aaa1-d5d04a87faec tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/0f311556-941e-4003-8a09-cc61a2768eb9 HTTP/1.1" status: 404 len: 336 time: 0.0617659 Nov 05 14:48:19.225755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42382) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.238150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, eb43032a-4715-403c-8c61-4554522e4ffa) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:19.271175 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-775fb693-d5af-4a8f-927d-5fa7c7f3cbac tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:19.271739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-775fb693-d5af-4a8f-927d-5fa7c7f3cbac tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:19.275143 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-775fb693-d5af-4a8f-927d-5fa7c7f3cbac tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/189d2f8e-7ed3-4fb9-8612-eb0a1fa59267 HTTP/1.1" status: 404 len: 337 time: 0.0476050 Nov 05 14:48:19.284246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42384) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.287808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:19.288509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.319220 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-90ed3509-c8d6-48b2-9e5c-c2e1b57aa519 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 200 len: 205 time: 0.0336220 Nov 05 14:48:19.321555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42386) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.350547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.354361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.355922 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6c3de697-0e63-4238-b5a4-b04c331bc678 tempest-ServerActionsTestJSON-13191221 tempest-ServerActionsTestJSON-13191221-project] 10.222.0.30 "DELETE /v2.0/floatingips/1d474aed-25dd-44fe-aa9b-abe75b9570eb HTTP/1.1" status: 204 len: 168 time: 2.9316115 Nov 05 14:48:19.376175 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-6b505a09-1d94-4f53-85b2-b527553535c4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:19.380314 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6b505a09-1d94-4f53-85b2-b527553535c4 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/36968538-15fc-4d1c-ae93-dde6a2ae4700 HTTP/1.1" status: 404 len: 336 time: 0.0548179 Nov 05 14:48:19.380314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42388) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.380823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42390) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.415209 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2c2d9a6d-87b5-49d4-96cb-57c687aa6867 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=5ae99c97-8514-42fa-92de-7eeebe3dfbcb HTTP/1.1" status: 200 len: 205 time: 0.0329034 Nov 05 14:48:19.417153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42392) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.429525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.440667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/66450838-5872-4508-8f2f-b18bf8d25df9/d8816d08-56e6-423f-8fe2-a77d8f35d844) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:19.465540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9000822-9611-414d-82e8-a17b4dfab7c1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:19.467643 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b9000822-9611-414d-82e8-a17b4dfab7c1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 930 time: 0.4080911 Nov 05 14:48:19.474282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2f3e6193-015f-4b9c-b746-b1a3a9f232f3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 3.1813543 Nov 05 14:48:19.474282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42394) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.492581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42396) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.514545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-8beebd08-92d0-4fd0-930b-e0da100509f3 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:19.515939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8beebd08-92d0-4fd0-930b-e0da100509f3 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/5ae99c97-8514-42fa-92de-7eeebe3dfbcb HTTP/1.1" status: 404 len: 336 time: 0.0976896 Nov 05 14:48:19.519637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42398) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.550287 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.555138 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-666e446c-d73a-4dfb-a743-8d33e4d75fab tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-2023745868 HTTP/1.1" status: 201 len: 201 time: 1.0871091 Nov 05 14:48:19.557845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42400) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.564242 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.565696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-889476d2-f7d6-4910-b7c2-318253ce18c0 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-1016194051') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:19.573062 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-28d2003b-1157-42eb-87c9-cce9775bc2e7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:19.573700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28d2003b-1157-42eb-87c9-cce9775bc2e7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:19.579074 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28d2003b-1157-42eb-87c9-cce9775bc2e7 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/fb35e709-9cba-47ef-a2f1-ae86ed17df14 HTTP/1.1" status: 404 len: 337 time: 0.0559149 Nov 05 14:48:19.602038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42402) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.626912 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Pushing event updated for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:19.644287 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.644727 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.645086 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.646030 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.646030 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.646292 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.646545 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.646898 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.647239 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.647724 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.648052 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.648368 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:19.670262 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1538eeda-2de4-4d47-9226-843ca11d827d tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=a4654b06-cabf-40ce-83c0-bb6280355252 HTTP/1.1" status: 200 len: 205 time: 0.0642083 Nov 05 14:48:19.677519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42404) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.681400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Allocated IP 172.20.0.2 (86b0fe83-8f1f-4f5a-96f1-49f97741c68b/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/68e2b805-6a5e-4cb5-861f-d93e4f139289) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:19.732996 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Attempting to bind port 352e7f58-dffc-48d3-beb6-394f50f52fa7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:19.733370 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Attempting to bind port 352e7f58-dffc-48d3-beb6-394f50f52fa7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:19.733730 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Attempting to bind port 352e7f58-dffc-48d3-beb6-394f50f52fa7 on network 2b4ec7e4-c25c-4dba-9f85-c62657895348 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:19.741163 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:19.741538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Checking segment: {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:19.741944 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.742400 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Bound using segment: {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:19.742883 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Bound port: 352e7f58-dffc-48d3-beb6-394f50f52fa7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:19.743260 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.754593 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-8aad0918-bc7b-49e6-8b1f-efb44652237b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:19.759460 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8aad0918-bc7b-49e6-8b1f-efb44652237b tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/a4654b06-cabf-40ce-83c0-bb6280355252 HTTP/1.1" status: 404 len: 336 time: 0.0808408 Nov 05 14:48:19.765220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42406) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.814562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.815847 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-e430c242-a74f-40cf-99d4-6b6ea26c4043 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:19.816317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e430c242-a74f-40cf-99d4-6b6ea26c4043 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:19.826220 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e430c242-a74f-40cf-99d4-6b6ea26c4043 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/16a9f494-fa90-4233-81bc-22127660c9b3 HTTP/1.1" status: 404 len: 337 time: 0.0548959 Nov 05 14:48:19.828300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42408) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.848602 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] For port 352e7f58-dffc-48d3-beb6-394f50f52fa7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:19.853540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] For port 352e7f58-dffc-48d3-beb6-394f50f52fa7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=352e7f58-dffc-48d3-beb6-394f50f52fa7,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:19.859630 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.861679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-889476d2-f7d6-4910-b7c2-318253ce18c0 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-1016194051 HTTP/1.1" status: 201 len: 201 time: 0.3007152 Nov 05 14:48:19.902215 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c8f06a68-e7a2-4c59-bcd3-f2ca64a659dd tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "GET /v2.0/ports?device_id=6bb16647-87d4-4381-abac-0ff972c8608b HTTP/1.1" status: 200 len: 205 time: 0.0718460 Nov 05 14:48:19.902697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42410) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.903022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42412) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.910033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-298963e5-40d8-4460-9abe-c1bd0ed9afbb tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-1010653130') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:19.932391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=8a090c65-d7fb-4220-8814-b0198eb7fa87,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:19.935872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.941117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b8291b1-1eca-415f-b709-5544247449cd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/8a090c65-d7fb-4220-8814-b0198eb7fa87 HTTP/1.1" status: 204 len: 168 time: 1.7352040 Nov 05 14:48:19.944367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42414) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:19.951146 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46853d95-775c-4a3d-839a-2b051ceb88ad None None] Pushing event updated for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:19.959981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.989702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:19.993454 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:19.994119 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:47:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:20.046062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.048316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Allocated IP 172.23.0.2 (2b4ec7e4-c25c-4dba-9f85-c62657895348/2c2e96ed-b727-4039-a867-c1c057b74aba/41b6ac2f-64d1-4303-8e72-a717d0ccb8ca) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:20.066224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-c766c417-4086-47e5-92f6-c4f823e88671 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] delete failed (client error): The resource could not be found. Nov 05 14:48:20.069616 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c766c417-4086-47e5-92f6-c4f823e88671 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/routers/6bb16647-87d4-4381-abac-0ff972c8608b HTTP/1.1" status: 404 len: 336 time: 0.0739586 Nov 05 14:48:20.105401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42416) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.113156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a7de548c-655d-4709-930c-a2fc407e6b09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.123645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 76087b71-9aa7-48ca-80b3-62e5718f6fcf {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:20.126784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Pushing event updated for resources: {'Port': ['ID=d8816d08-56e6-423f-8fe2-a77d8f35d844,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:20.137385 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:20.138699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port df8146e1-ec8d-4995-bb95-8971b515eb88 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:20.139149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.142082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.178844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:48:20.187550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:20.195565 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-9aa6cb80-6541-48c7-a7bf-4de110dda002 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:20.196159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9aa6cb80-6541-48c7-a7bf-4de110dda002 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:20.196371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:20.201802 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9aa6cb80-6541-48c7-a7bf-4de110dda002 tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/e9ae4875-a339-4982-9aaa-18acc17e2b5d HTTP/1.1" status: 404 len: 337 time: 0.0906706 Nov 05 14:48:20.207523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42418) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.208955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:20.246140 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-420aebce-54cf-4a54-844f-7c43371a0e8e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:20.246609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-420aebce-54cf-4a54-844f-7c43371a0e8e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:20.252703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.256487 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-420aebce-54cf-4a54-844f-7c43371a0e8e tempest-RoutersIpV6Test-184896981 tempest-RoutersIpV6Test-184896981-project] 10.222.0.30 "DELETE /v2.0/subnets/7dee6b6a-2a7c-408b-be07-1f6a83055699 HTTP/1.1" status: 404 len: 337 time: 0.0439329 Nov 05 14:48:20.263617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Removed routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:48:20.264121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.328814 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-298963e5-40d8-4460-9abe-c1bd0ed9afbb tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-1010653130 HTTP/1.1" status: 201 len: 201 time: 0.4207482 Nov 05 14:48:20.329494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42422) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.334677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-529a8687-7279-41d4-8cdb-aa808b3aeec9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1828202604') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:20.345611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Attempting to bind port d8816d08-56e6-423f-8fe2-a77d8f35d844 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:20.346258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Attempting to bind port d8816d08-56e6-423f-8fe2-a77d8f35d844 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:20.347304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Attempting to bind port d8816d08-56e6-423f-8fe2-a77d8f35d844 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:20.370648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:20.371962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:20.372578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.373141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:20.374206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Bound port: d8816d08-56e6-423f-8fe2-a77d8f35d844, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:20.375310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.463478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-529a8687-7279-41d4-8cdb-aa808b3aeec9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1828202604 HTTP/1.1" status: 201 len: 201 time: 0.1332824 Nov 05 14:48:20.464602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42424) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.470180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-0f852bc0-258b-437e-a4b1-87d9cbb60b4b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:20.484403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.509682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.551917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:14Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:19Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:20.579454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Pushing event updated for resources: {'Port': ['ID=68e2b805-6a5e-4cb5-861f-d93e4f139289,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:20.593362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.616144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:20.623263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:20.628622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.642020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:20.661127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] For port d8816d08-56e6-423f-8fe2-a77d8f35d844, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:20.668513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.697474 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cee3bda-4045-4f53-90d0-01a0001d6e19 None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:14Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:19Z', 'revision_number': 4, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:20.715410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:20.730242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] For port d8816d08-56e6-423f-8fe2-a77d8f35d844, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d8816d08-56e6-423f-8fe2-a77d8f35d844,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:20.744560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:20.765539 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0f852bc0-258b-437e-a4b1-87d9cbb60b4b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 200 len: 241 time: 0.2982931 Nov 05 14:48:20.772497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42428) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.779943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-e64cf3ca-8633-4694-9d80-6a6c7b6a744b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-2023745868') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:20.820279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.823431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42430) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:20.825744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:20.827634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Attempting to bind port 68e2b805-6a5e-4cb5-861f-d93e4f139289 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:20.827998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Attempting to bind port 68e2b805-6a5e-4cb5-861f-d93e4f139289 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:20.828356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Attempting to bind port 68e2b805-6a5e-4cb5-861f-d93e4f139289 on network 86b0fe83-8f1f-4f5a-96f1-49f97741c68b {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:20.860540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Pushing event updated for resources: {'Port': ['ID=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:20.876730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:20.877415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Checking segment: {'id': 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:20.878742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.879833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Bound using segment: {'id': 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:20.880566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Bound port: 68e2b805-6a5e-4cb5-861f-d93e4f139289, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '86b0fe83-8f1f-4f5a-96f1-49f97741c68b'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:20.881443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.882012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:20.989494 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e64cf3ca-8633-4694-9d80-6a6c7b6a744b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-2023745868 HTTP/1.1" status: 204 len: 168 time: 0.2139862 Nov 05 14:48:20.996584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42432) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.005492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-97c28365-c20f-47f1-8a4d-e3418264b19f tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-2023745868') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:21.008127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.068158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 352e7f58-dffc-48d3-beb6-394f50f52fa7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:21.130772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Attempting to bind port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:21.131061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Attempting to bind port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:21.131434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Attempting to bind port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca on network 2b4ec7e4-c25c-4dba-9f85-c62657895348 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:21.148077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5be290-1e5f-435e-aa43-29f6910ce8ad None None] Pushing event updated for resources: {'Port': ['ID=d8816d08-56e6-423f-8fe2-a77d8f35d844,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.166583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 47, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:21.166975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Checking segment: {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:21.167414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.167862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Bound using segment: {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:21.168353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Bound port: 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ce004ab-8a09-48e4-84fc-0892f0beb95d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:21.170961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.196342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.233667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] For port 68e2b805-6a5e-4cb5-861f-d93e4f139289, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:21.282471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] For port 68e2b805-6a5e-4cb5-861f-d93e4f139289, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68e2b805-6a5e-4cb5-861f-d93e4f139289,segment=NetworkSegment(b2e432e1-a1e7-4038-9d0e-ddfed0490bfc),segment_id=b2e432e1-a1e7-4038-9d0e-ddfed0490bfc)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:21.297785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=76087b71-9aa7-48ca-80b3-62e5718f6fcf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.298398 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-97c28365-c20f-47f1-8a4d-e3418264b19f tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-2023745868 HTTP/1.1" status: 204 len: 168 time: 0.3021395 Nov 05 14:48:21.303848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 352e7f58-dffc-48d3-beb6-394f50f52fa7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:21.304222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.306715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42436) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.306887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.310062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.329331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-f55d7511-a849-46ca-9a07-9dc17e905b59 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:21.342768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.346945 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bcb4e11d-55d9-4268-8f70-a925591556c1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/76087b71-9aa7-48ca-80b3-62e5718f6fcf HTTP/1.1" status: 204 len: 168 time: 1.3963447 Nov 05 14:48:21.360630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42438) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.453901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for df8146e1-ec8d-4995-bb95-8971b515eb88 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:21.471353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] For port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:21.478116 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f55d7511-a849-46ca-9a07-9dc17e905b59 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 200 len: 205 time: 0.1689174 Nov 05 14:48:21.480923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42440) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.488648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-6ced08cf-479e-451e-8a20-af15d11665dc tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:21.491638 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-554a4f28-0148-4dde-b031-5853467613d6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f47c1e1d128a41dbac53e7ce0c8e5b5b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4580820 Nov 05 14:48:21.495250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42442) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.506191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] For port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:21.525112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.529268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.539806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d871a2-ef16-466b-a3d1-3c6f4297d1f3 None None] Pushing event updated for resources: {'Port': ['ID=68e2b805-6a5e-4cb5-861f-d93e4f139289,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.635073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=8b427c22-5e30-4a44-bafb-68989f9f3089,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.645922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.674131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69ec5f5-d480-40db-b370-f29315ba0b7e None None] Pushing event updated for resources: {'Port': ['ID=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.721156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 352e7f58-dffc-48d3-beb6-394f50f52fa7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=352e7f58-dffc-48d3-beb6-394f50f52fa7,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:21.727108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.753045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.764447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ced08cf-479e-451e-8a20-af15d11665dc tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 200 len: 241 time: 0.2824681 Nov 05 14:48:21.767780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42444) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:21.780811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Deleting port 74689f1f-b8e2-419c-b7bb-20c6dc557b76 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:21.782134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.790283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-fec49a24-5ed9-47b4-8af5-7d737f365b23 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-1016194051') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:21.820048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.846445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:21.945760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.954612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:21.989555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.016279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.110924 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fec49a24-5ed9-47b4-8af5-7d737f365b23 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-1016194051 HTTP/1.1" status: 204 len: 168 time: 0.3325038 Nov 05 14:48:22.117488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42446) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.126454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-436124de-e0b0-468c-bd20-e918d92683b5 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-1016194051') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.136903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] For port 74689f1f-b8e2-419c-b7bb-20c6dc557b76, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=74689f1f-b8e2-419c-b7bb-20c6dc557b76,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:22.140041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.158868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Calling delete_port for 74689f1f-b8e2-419c-b7bb-20c6dc557b76 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:22.188958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eb43032a-4715-403c-8c61-4554522e4ffa']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.225429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.227411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ac4e5841-73ba-45cd-a52a-4227effbcd7b') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.227710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ac4e5841-73ba-45cd-a52a-4227effbcd7b') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.227957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.229134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f6f3c741-3496-4ab9-b584-938513edf569 HTTP/1.1" status: 204 len: 168 time: 0.7328997 Nov 05 14:48:22.254630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.256061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6f3c741-3496-4ab9-b584-938513edf569,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:22.266455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.267136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.267136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.267445 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.267772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.268191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.268406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.269394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.269394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.269394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.269740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.270033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-074452e4-1777-4c31-a962-de37fafa7876 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.292422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.314617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:22.317561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:22.317963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:22.322306 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:22.390805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eabee71-3d7d-4507-9221-63d7c745a56f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.394481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.411656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:22.412002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.596640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.598848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=df8146e1-ec8d-4995-bb95-8971b515eb88,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:22.632637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.641305 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/eb43032a-4715-403c-8c61-4554522e4ffa HTTP/1.1" status: 204 len: 168 time: 3.1419358 Nov 05 14:48:22.641305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=eb43032a-4715-403c-8c61-4554522e4ffa,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:22.641618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:22.641618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.652067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42454) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.656575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.656928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.657266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.657604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.657936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.658305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.658582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.658906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.659233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.659555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.659877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.660756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1f2aca-91a6-4880-94a2-02c6bb2de8e8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.670904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1330452759'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:22.699613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.700418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.701022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.701363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.701717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.702239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.702744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.703343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.703843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.704315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-436124de-e0b0-468c-bd20-e918d92683b5 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-1016194051 HTTP/1.1" status: 204 len: 168 time: 0.5875678 Nov 05 14:48:22.706538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.706884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.707763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:22.712304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.733375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-7c70b76e-5937-487f-8614-a7d9845b92cf tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.769480 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.772964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.779487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a9841d37-655a-4e89-a05a-e10b75e8f8f6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/df8146e1-ec8d-4995-bb95-8971b515eb88 HTTP/1.1" status: 204 len: 168 time: 3.3009493 Nov 05 14:48:22.781245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:22.786216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42462) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.795788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port eb5a9024-36d1-46c2-99bd-b5a62d5258c3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,segment=NetworkSegment(9f69a45a-2686-4fb8-8d74-a1c57f4712a2),segment_id=9f69a45a-2686-4fb8-8d74-a1c57f4712a2)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:22.796474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.807749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.809275 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-85eedfa4-6ee8-40bb-b9ac-c098f8d0287a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 934 time: 4.0827315 Nov 05 14:48:22.818619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42464) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.829172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:22.841800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for eb5a9024-36d1-46c2-99bd-b5a62d5258c3 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:22.855182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:22.857204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:22.883638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2459c771-3667-419b-a8ed-2be96f525931 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:22.886063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:22.887581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2459c771-3667-419b-a8ed-2be96f525931 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:22.891603 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2459c771-3667-419b-a8ed-2be96f525931 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1021166 Nov 05 14:48:22.893561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.896232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:22.911615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:22.979839 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-95d43916-01c7-43de-805f-16385295bc77 None None] For port d8816d08-56e6-423f-8fe2-a77d8f35d844, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d8816d08-56e6-423f-8fe2-a77d8f35d844,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:23.023164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Pushing event deleted for resources: {'Port': ['ID=74689f1f-b8e2-419c-b7bb-20c6dc557b76,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:23.091521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.099675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Could not find standard attr ID for object df8146e1-ec8d-4995-bb95-8971b515eb88. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:23.103802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 625} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:23.121950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c70b76e-5937-487f-8614-a7d9845b92cf tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 200 len: 205 time: 0.3914092 Nov 05 14:48:23.131050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42472) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.140022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-7798c731-762e-4d92-a107-05484b656f55 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.154955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 66450838-5872-4508-8f2f-b18bf8d25df9 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:23.164807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.165162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 5ca2c088-f693-4b88-bd02-9bcf7ea3e9db of type vlan for network 91236e0a-5e2a-4efa-bab0-9e98b8d647c7 Nov 05 14:48:23.174570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0cf8afe5-c17a-4109-bbef-f19a15012fa0 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 934 time: 0.3489895 Nov 05 14:48:23.182621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42474) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.187267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'routes': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:23.231533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:23.252593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.341473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:23.363622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.394451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.409199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Pushing event updated for resources: {'Port': ['ID=d8816d08-56e6-423f-8fe2-a77d8f35d844,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:23.471849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=eb5a9024-36d1-46c2-99bd-b5a62d5258c3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:23.473896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port eb5a9024-36d1-46c2-99bd-b5a62d5258c3 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:23.569721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.570212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.570705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.571434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.571896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.572614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.573389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.573874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.574334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.574765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.575218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.575641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d43916-01c7-43de-805f-16385295bc77 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:48:23.585242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.592639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42482) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.600665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.606903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:23.607527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.619752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.667570 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7798c731-762e-4d92-a107-05484b656f55 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 200 len: 241 time: 0.5353434 Nov 05 14:48:23.672162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42486) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.679311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-99d87eaf-e82a-4ff1-984c-249f2939c693 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-1010653130') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.698429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.718933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-db94b604-5f27-4bf7-b84e-2a071a1c73a5 None None] Provisioning complete for port 352e7f58-dffc-48d3-beb6-394f50f52fa7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:23.720898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db94b604-5f27-4bf7-b84e-2a071a1c73a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.725190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:23.725580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.726661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['06730b57-bbf8-4154-a487-3284984c861f']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.751239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.758684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9f69a45a-2686-4fb8-8d74-a1c57f4712a2') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.759211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9f69a45a-2686-4fb8-8d74-a1c57f4712a2') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.772909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.789692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.797434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 602 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:23.798216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:23.817425 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:23.831109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c55646cc-4c87-42e3-b63a-e5562936f7ba tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'default'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:23.831843 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-c55646cc-4c87-42e3-b63a-e5562936f7ba tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 05 14:48:23.832916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-c55646cc-4c87-42e3-b63a-e5562936f7ba tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:48:23.833925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c55646cc-4c87-42e3-b63a-e5562936f7ba tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2361143 Nov 05 14:48:23.840675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42488) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.844918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.852914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--1861521624'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:23.900638 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.2343106 Nov 05 14:48:23.906435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42490) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.921169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '91236e0a-5e2a-4efa-bab0-9e98b8d647c7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:23.935567 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-99d87eaf-e82a-4ff1-984c-249f2939c693 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-1010653130 HTTP/1.1" status: 204 len: 168 time: 0.2623434 Nov 05 14:48:23.944766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42492) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:23.955488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-9a6062d1-b3e8-455a-a1af-665db507b50b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-1010653130') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:23.976397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b26059db-94d9-47a4-8e8b-8c90c13e74e1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:23.994520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:23.996073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b7338b3-3a27-463a-8c9a-f00e7031c047 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=91236e0a-5e2a-4efa-bab0-9e98b8d647c7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:24.011320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.014613 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/06730b57-bbf8-4154-a487-3284984c861f HTTP/1.1" status: 204 len: 168 time: 2.6461487 Nov 05 14:48:24.021385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42494) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.042083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.056843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 91236e0a-5e2a-4efa-bab0-9e98b8d647c7 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:24.064108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e162041-27e1-4e98-baf1-d2d730289599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=06730b57-bbf8-4154-a487-3284984c861f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:24.067042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.125411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.177897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=66450838-5872-4508-8f2f-b18bf8d25df9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:24.187124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.192036 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73f45f3a-bf96-4713-a786-06775634a521 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/66450838-5872-4508-8f2f-b18bf8d25df9 HTTP/1.1" status: 204 len: 168 time: 1.2892919 Nov 05 14:48:24.201241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42496) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.291786 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e525d37c-fa5f-4620-b9f5-7bfab6afc5ba tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0891449 Nov 05 14:48:24.298444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9a6062d1-b3e8-455a-a1af-665db507b50b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-1010653130 HTTP/1.1" status: 204 len: 168 time: 0.3492527 Nov 05 14:48:24.303614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42498) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.303947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42500) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.310592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-f4a52d0c-fd23-4a7f-830a-a2497ad01c0c tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.380713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b26059db-94d9-47a4-8e8b-8c90c13e74e1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:24.404465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.446347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-db94b604-5f27-4bf7-b84e-2a071a1c73a5 None None] Provisioning complete for port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:24.447037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db94b604-5f27-4bf7-b84e-2a071a1c73a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.450775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:20Z', 'revision_number': 6, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.510633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42663c79-191b-486b-8db1-22c765bb0c9a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:24.517309 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-42663c79-191b-486b-8db1-22c765bb0c9a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.4729033 Nov 05 14:48:24.517514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bfb06b5-6617-4be4-9cef-4602e99a67be tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:24.517514 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9bfb06b5-6617-4be4-9cef-4602e99a67be tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2102079 Nov 05 14:48:24.522263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.522605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.524067 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f4a52d0c-fd23-4a7f-830a-a2497ad01c0c tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 200 len: 205 time: 0.2168050 Nov 05 14:48:24.527389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.529189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.537517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-dd3e0e02-5ed1-4d84-99da-23aeca87c7cd tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.542498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Router 51c9704a-323f-4947-9153-8af2348f332c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:24.543654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:24.549531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.575092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:24.586594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:24.587234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.592320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.593126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 352e7f58-dffc-48d3-beb6-394f50f52fa7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:24.606209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:24.609732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.612043 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd3e0e02-5ed1-4d84-99da-23aeca87c7cd tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 200 len: 241 time: 0.0815210 Nov 05 14:48:24.612658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.622172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-f57783f7-98cd-487a-b562-5f5bf69a335d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1828202604') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.625425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=95d9e0f2-42d7-4819-aadb-66478d3badce,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:24.711345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f57783f7-98cd-487a-b562-5f5bf69a335d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1828202604 HTTP/1.1" status: 204 len: 168 time: 0.0940681 Nov 05 14:48:24.713551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42510) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.726856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-a1246e3e-f61e-4320-90e0-1b274b99463b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1828202604') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.754924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1f49f0e-e5ee-4319-b75c-2e6fd320a7a3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:24.759267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a1f49f0e-e5ee-4319-b75c-2e6fd320a7a3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2328379 Nov 05 14:48:24.760942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42512) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.771326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-456c4abc-23b1-4cc9-b8db-f03057160208 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.2459176 Nov 05 14:48:24.783382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42514) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.786387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.789328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1275823996'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:24.797222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:24.821459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:48:24.821777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Removed routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:48:24.827612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.830958 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55e66561-3704-4329-9d17-2f10e87df0f9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0634995 Nov 05 14:48:24.836012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42516) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.840370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:24.841633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:24.892906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:24.900044 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8d38b4ac-1585-4376-b0fc-111e39209973 admin admin] 10.222.0.30 "PUT /v2.0/routers/51c9704a-323f-4947-9153-8af2348f332c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5205383 Nov 05 14:48:24.906986 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Sync routers for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:24.908497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42518) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:24.929528 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:24.931029 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:24.932301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.951056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:24.954647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.987582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 352e7f58-dffc-48d3-beb6-394f50f52fa7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:24.988782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:24.994824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.073558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.087849 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:25.089811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.113805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 614} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:25.167368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.168027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 3b75bc18-ba3b-407f-bd29-b86e8d4ed81e of type vlan for network 57c279b6-6a29-4127-9498-31345cf36f07 Nov 05 14:48:25.210350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Provisioning complete for port 68e2b805-6a5e-4cb5-861f-d93e4f139289 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:25.210865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.239887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:25.243721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.252351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=fa57e13e-2b6e-4ca7-a62d-74c7674bac3f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:25.262958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.271090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 1.4267275 Nov 05 14:48:25.272159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c644f690-f100-4fff-a78a-f0d7c03260f6 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f617cf86-d115-48ce-9463-22b7f9c8a29a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:25.275327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42520) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:25.291886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'f617cf86-d115-48ce-9463-22b7f9c8a29a', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:25.298218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.322581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.341511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae6e9ad2-5e7d-4410-9617-1fcde4e35f1a None None] DHCP port deletion for 06730b57-bbf8-4154-a487-3284984c861f request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:25.356365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68e2b805-6a5e-4cb5-861f-d93e4f139289 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:25.372919 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:48:22Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:25.446114 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Checking router: 51c9704a-323f-4947-9153-8af2348f332c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:25.478288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': '5ca2c088-f693-4b88-bd02-9bcf7ea3e9db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': '91236e0a-5e2a-4efa-bab0-9e98b8d647c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:25.478288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 91236e0a-5e2a-4efa-bab0-9e98b8d647c7, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:25.487958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.resource_extend [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 05 14:48:25.493920 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Routers {'51c9704a-323f-4947-9153-8af2348f332c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:25.501033 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['51c9704a-323f-4947-9153-8af2348f332c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:25.523735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:20Z', 'revision_number': 6, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:25.526427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.580747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57dd98a3-cf77-455a-b83e-0389aebd390c None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:20Z', 'revision_number': 6, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:25.581861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.612384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 68e2b805-6a5e-4cb5-861f-d93e4f139289 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:25.612781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.623811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.640491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:25.641581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.665268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 91236e0a-5e2a-4efa-bab0-9e98b8d647c7 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:25.683949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.708929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] For port 68e2b805-6a5e-4cb5-861f-d93e4f139289, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68e2b805-6a5e-4cb5-861f-d93e4f139289,segment=NetworkSegment(b2e432e1-a1e7-4038-9d0e-ddfed0490bfc),segment_id=b2e432e1-a1e7-4038-9d0e-ddfed0490bfc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:25.722686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.794860 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] Set router 51c9704a-323f-4947-9153-8af2348f332c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:25.853168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 1.0683346 Nov 05 14:48:25.868127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Provisioning complete for port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:25.868894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.871362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42522) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:25.898079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a1246e3e-f61e-4320-90e0-1b274b99463b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1828202604 HTTP/1.1" status: 204 len: 168 time: 1.1786556 Nov 05 14:48:25.901214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42524) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:25.909818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-6ac81185-5eba-453f-8d69-96c3e0c664ff tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:25.924027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Pushing event updated for resources: {'Port': ['ID=68e2b805-6a5e-4cb5-861f-d93e4f139289,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:25.960419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:25.973154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:25.984418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '57c279b6-6a29-4127-9498-31345cf36f07', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:25.995767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 91236e0a-5e2a-4efa-bab0-9e98b8d647c7) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:26.033549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Provisioning complete for port 352e7f58-dffc-48d3-beb6-394f50f52fa7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:26.034260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.039708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6ac81185-5eba-453f-8d69-96c3e0c664ff tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 200 len: 205 time: 0.1373191 Nov 05 14:48:26.042938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42526) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.047640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.056606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:26.057201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.063434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-2b0dea54-1675-49a0-918c-b83832df157e tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:26.120634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d8816d08-56e6-423f-8fe2-a77d8f35d844 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:26.154691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Deleting port 19366c25-ca17-4e42-9cc2-78dc5af54481 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:26.155055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.250715 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:48:22Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:26.273274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3046b7d-6f51-45f8-ad36-ceb3b993f50c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=57c279b6-6a29-4127-9498-31345cf36f07,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:26.336856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] For port 19366c25-ca17-4e42-9cc2-78dc5af54481, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=19366c25-ca17-4e42-9cc2-78dc5af54481,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:26.337239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.340311 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e485ba8-fe42-4b01-b981-dae277c6692e None None] The sync data for ids ['51c9704a-323f-4947-9153-8af2348f332c'] in dv-neutron-816850-1-hyperv is: [{'id': '51c9704a-323f-4947-9153-8af2348f332c', 'name': 'tempest-ServerActionsTestJSON-816424850-router', 'tenant_id': '643f5fc30ebb419c9fb85748c2767795', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6'}], 'enable_snat': True}, 'gw_port_id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:44:22Z', 'updated_at': '2021-11-05T14:48:22Z', 'revision_number': 5, 'project_id': '643f5fc30ebb419c9fb85748c2767795', 'gw_port': {'id': '19366c25-ca17-4e42-9cc2-78dc5af54481', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:f3:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '51c9704a-323f-4947-9153-8af2348f332c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:44:23Z', 'updated_at': '2021-11-05T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:26.358680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Calling delete_port for 19366c25-ca17-4e42-9cc2-78dc5af54481 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:26.415953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.443814 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-44de8b96-81b9-4733-b3e4-5a622a844bc9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5319862 Nov 05 14:48:26.446242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42528) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.487178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 57c279b6-6a29-4127-9498-31345cf36f07 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:26.551488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2b0dea54-1675-49a0-918c-b83832df157e tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 204 len: 168 time: 0.4960415 Nov 05 14:48:26.553317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42530) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.558117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-368bfe23-c834-4b67-8440-e245876f97f3 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:26.604140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.652072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.674463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:26.680349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:26.680763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:26.681263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.695210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:26.705280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:26.705987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.709860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b9d6e27f-0560-4351-8ea3-a6388a5d50b9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:26.716590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=dc61f290-cd06-42ed-8982-77970397aacc,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:26.722088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Provisioning complete for port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:26.723522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17f75dc6-299a-4c8a-9ae0-78db16822bbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.734617 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-368bfe23-c834-4b67-8440-e245876f97f3 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 204 len: 168 time: 0.1803622 Nov 05 14:48:26.738611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.749036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.751089 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fbfc883e-83e1-4112-991b-01e040b99874 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.4663672 Nov 05 14:48:26.753250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-7aec3f6a-7a51-461d-afc8-48db6e63bc7d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:26.753575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.761293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:26.762416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-50aed5af-66a2-49f2-95cc-2be4dbd91867 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'f617cf86-d115-48ce-9463-22b7f9c8a29a', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:26.766783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.772008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.802404 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a399b99c-751c-440b-ac61-4089377ee09f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.9619451 Nov 05 14:48:26.813895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42536) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:26.821085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Pushing event deleted for resources: {'Port': ['ID=19366c25-ca17-4e42-9cc2-78dc5af54481,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:26.830338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'dc61f290-cd06-42ed-8982-77970397aacc', 'ip_address': '2001:db8::b5c0:3159:292b:c4fc'}], 'name': 'tempest-NetworksTestDHCPv6-679986727'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:26.884149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c9c57ac-3300-4834-8a9b-265866898cca None None] Network eb43032a-4715-403c-8c61-4554522e4ffa requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0c9c57ac-3300-4834-8a9b-265866898cca None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:26.920158 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:26.928845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58235605-53a2-4483-b987-6a04df7ca9c5 None None] Network 91236e0a-5e2a-4efa-bab0-9e98b8d647c7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:26.989573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:26.995553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bafc5d9-6487-4362-8f48-1d7ec5db2fcf None None] Network eb43032a-4715-403c-8c61-4554522e4ffa requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9bafc5d9-6487-4362-8f48-1d7ec5db2fcf None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:27.042552 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:27.102984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-50aed5af-66a2-49f2-95cc-2be4dbd91867 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.143234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-58235605-53a2-4483-b987-6a04df7ca9c5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:27.154389 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:27.174979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:27.179391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.180635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-182e198e-5ccf-4aab-af06-db5eb8561b39 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 700 time: 3.9970088 Nov 05 14:48:27.182065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04d71b6b-aa17-46db-875c-338a2ce01b48 None None] Network 91236e0a-5e2a-4efa-bab0-9e98b8d647c7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:27.205848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42538) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:27.255680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.261159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:27.273492 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7aec3f6a-7a51-461d-afc8-48db6e63bc7d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 204 len: 168 time: 0.5253687 Nov 05 14:48:27.279324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42540) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:27.303231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:27.303869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:27.339257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-03ad562f-5231-47ae-886c-7a7976bc65da tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:27.370294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.406024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76e8be3e-0457-42f5-b4d2-732407969112 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:27.409979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.412688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:27.417596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.475654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:27.482974 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-50aed5af-66a2-49f2-95cc-2be4dbd91867 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:48:27.489968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-50aed5af-66a2-49f2-95cc-2be4dbd91867 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.7294817 Nov 05 14:48:27.490138 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-360f48e4-c737-4623-8437-d4b0cebb9c78 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 700 time: 0.2791078 Nov 05 14:48:27.490228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:27.490228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.490405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42542) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:27.490625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42544) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:27.496323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.497202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 51c9704a-323f-4947-9153-8af2348f332c {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:27.502757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.504275 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f0cb457f-205c-463d-9383-5ca2c0db0e8f admin admin] 10.222.0.30 "DELETE /v2.0/routers/51c9704a-323f-4947-9153-8af2348f332c HTTP/1.1" status: 204 len: 168 time: 2.5940926 Nov 05 14:48:27.522251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42546) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:27.592803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-04d71b6b-aa17-46db-875c-338a2ce01b48 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:27.611788 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:27.628398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 1c48c25e-2cfa-43eb-902b-6b4db807ee4e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-76e8be3e-0457-42f5-b4d2-732407969112 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:27.640713 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:27.653959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:27.656718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5af48c4-5a8a-42d4-8d7b-7801c25dc980 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:27.777848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port 68e2b805-6a5e-4cb5-861f-d93e4f139289 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:27.778610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.811758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:27.812077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:27.874095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::b5c0:3159:292b:c4fc (b10e20e9-e25a-4832-bd50-e158aa6d5da9/dc61f290-cd06-42ed-8982-77970397aacc/1c48c25e-2cfa-43eb-902b-6b4db807ee4e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e5af48c4-5a8a-42d4-8d7b-7801c25dc980 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:27.897986 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:28.030979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.045247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.061742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68e2b805-6a5e-4cb5-861f-d93e4f139289 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:28.093058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.108646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=fa57e13e-2b6e-4ca7-a62d-74c7674bac3f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.112854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Deleting subnet c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:28.116758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.133963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:28.134712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.151961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.162581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.198468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:28.200816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e49814c-6c0c-4152-ad67-d22feb7c4c77 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:28.203767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:28.211789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:28.215793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.226520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:28.226520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.242463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.4144950 Nov 05 14:48:28.242463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a3420ae-090c-400e-a7a6-087eb9550512 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=1c48c25e-2cfa-43eb-902b-6b4db807ee4e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.243541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.247755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:24Z', 'revision_number': 7, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.283165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:28.294695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-03ad562f-5231-47ae-886c-7a7976bc65da tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 204 len: 168 time: 0.9679964 Nov 05 14:48:28.300498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42552) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.306708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-b7fcde5f-6aa0-472a-bd9c-a0db872e1dc9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-1894411444') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.307472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=85779a9a-b126-4421-9e17-0b73e75facb1,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.319661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d3eff4e-92e7-4a19-a6c4-081e0fe77c05 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:28.327134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d3eff4e-92e7-4a19-a6c4-081e0fe77c05 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:28.329666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 68e2b805-6a5e-4cb5-861f-d93e4f139289 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:28.329981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.332383 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6d3eff4e-92e7-4a19-a6c4-081e0fe77c05 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1607 time: 0.0854528 Nov 05 14:48:28.335108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42554) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.353984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:28.354725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.371899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.375203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.473400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91236e0a-5e2a-4efa-bab0-9e98b8d647c7']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.483826 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b7fcde5f-6aa0-472a-bd9c-a0db872e1dc9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-1894411444 HTTP/1.1" status: 201 len: 201 time: 0.1807246 Nov 05 14:48:28.484777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42556) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.487254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 1c48c25e-2cfa-43eb-902b-6b4db807ee4e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:28.487597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.503022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-b94c4342-8c8e-4fba-9f99-2b80a28955ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-1910262295') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.538133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5ca2c088-f693-4b88-bd02-9bcf7ea3e9db') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.538410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5ca2c088-f693-4b88-bd02-9bcf7ea3e9db') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:28.577336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:28.577647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: 57c279b6-6a29-4127-9498-31345cf36f07, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:28.590410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.602846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.618451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 1c48c25e-2cfa-43eb-902b-6b4db807ee4e owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:28.652642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.655759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.693359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.695995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.699708 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/f617cf86-d115-48ce-9463-22b7f9c8a29a HTTP/1.1" status: 204 len: 168 time: 1.2057629 Nov 05 14:48:28.699708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 625 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:28.699708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.700124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42558) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.706495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:28.708610 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:28.765162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 57c279b6-6a29-4127-9498-31345cf36f07 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:28.769512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port 352e7f58-dffc-48d3-beb6-394f50f52fa7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:28.770043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.777711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-16a052be-9e3f-4b03-819c-6067fc7f38df tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0763850 Nov 05 14:48:28.782372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42560) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.788346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--501238218'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:28.801667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd32e0bc-ff87-4ec8-9f0d-4d78278e0151 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f617cf86-d115-48ce-9463-22b7f9c8a29a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.831050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 57c279b6-6a29-4127-9498-31345cf36f07) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:28.848597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:28.849514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.858823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.874638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.878441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/91236e0a-5e2a-4efa-bab0-9e98b8d647c7 HTTP/1.1" status: 204 len: 168 time: 2.4196765 Nov 05 14:48:28.884261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.885440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42562) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.892421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-563744049'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:28.896541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.920156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.932541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d8816d08-56e6-423f-8fe2-a77d8f35d844 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:28.939153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0499f26-0c21-4a7d-8f1b-4b20b487f571 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=91236e0a-5e2a-4efa-bab0-9e98b8d647c7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.945528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c7f575a-5ff7-4de0-8d55-7f071ccd523d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.0727618 Nov 05 14:48:28.948624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.951573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42564) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.957960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=1c48c25e-2cfa-43eb-902b-6b4db807ee4e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:28.959968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '57c279b6-6a29-4127-9498-31345cf36f07', 'name': 'tempest-PortsIpV6TestJSON-1672069380'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:28.964985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:28.968755 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4d866b29-6b49-4df9-ae81-7ed1a8bcba4d admin admin] 10.222.0.30 "DELETE /v2.0/subnets/c6a7fcd2-d568-4b7c-9b67-4d95cab7d7c9 HTTP/1.1" status: 204 len: 168 time: 1.4455061 Nov 05 14:48:28.974204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b94c4342-8c8e-4fba-9f99-2b80a28955ae tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-1910262295 HTTP/1.1" status: 201 len: 201 time: 0.4784322 Nov 05 14:48:28.991737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42566) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:28.992357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42568) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.024632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-1bb50d04-0777-4685-8383-de9bf87bd61e tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-285255260') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.038639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.044579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3fdc96bb-b046-4884-9154-e4733664bfe9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/1c48c25e-2cfa-43eb-902b-6b4db807ee4e HTTP/1.1" status: 204 len: 168 time: 0.7065110 Nov 05 14:48:29.047828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42570) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.061248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:29.064637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.108416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.122549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.154531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.156683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e49814c-6c0c-4152-ad67-d22feb7c4c77 None None] Unable to find a vacant binding_index for network 57c279b6-6a29-4127-9498-31345cf36f07 and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:48:29.158986 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.3754270 Nov 05 14:48:29.159591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42572) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.166022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Could not find standard attr ID for object df8146e1-ec8d-4995-bb95-8971b515eb88. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:29.168148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2deef7a3-8028-4066-9941-0c744a6cfbc7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:29.169710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2deef7a3-8028-4066-9941-0c744a6cfbc7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:29.173867 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2deef7a3-8028-4066-9941-0c744a6cfbc7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1220958 Nov 05 14:48:29.174029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e49814c-6c0c-4152-ad67-d22feb7c4c77 None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 57c279b6-6a29-4127-9498-31345cf36f07) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:29.175377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:29.176224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.176417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8c5871b3-1b34-41b8-ba35-4bfec4291ecb tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'c0ddbccd-fa41-4307-ac38-348fc4e66fea', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:29.177050 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-8c5871b3-1b34-41b8-ba35-4bfec4291ecb tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 05 14:48:29.177521 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-8c5871b3-1b34-41b8-ba35-4bfec4291ecb tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:29.181383 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8c5871b3-1b34-41b8-ba35-4bfec4291ecb tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0170927 Nov 05 14:48:29.185513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42574) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.186471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42576) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.198946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:29.205947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebff426-941e-4c7e-8636-43dfe4c1a86b tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c0ddbccd-fa41-4307-ac38-348fc4e66fea,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:29.213034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.213828 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 227715b7-5861-4b81-b069-2048ab354a05 of type vlan for network d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 Nov 05 14:48:29.256254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port 271c7e21-4444-45a0-8a1f-614588c74471 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:29.256254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.265875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.291507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.296221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.302281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:29.302882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.355071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet dc61f290-cd06-42ed-8982-77970397aacc {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:29.360120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4731793 Nov 05 14:48:29.363880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42578) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.364051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.368797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': 'd03f4cb5-4ce6-4ef0-b435-fdc9d939fd64', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:29.372036 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1bb50d04-0777-4685-8383-de9bf87bd61e tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-285255260 HTTP/1.1" status: 201 len: 201 time: 0.3748674 Nov 05 14:48:29.375020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42580) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.381326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-54a374e2-fc3f-4834-9147-4453c66be62d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-619382489') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.442193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47178a6-56a0-4f54-954b-2a74ce56bca4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:29.456344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:29.459891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.464444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:29.475100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.484493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.510351 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54a374e2-fc3f-4834-9147-4453c66be62d tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-619382489 HTTP/1.1" status: 201 len: 201 time: 0.1308045 Nov 05 14:48:29.511450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42582) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.516016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-5803e684-04a7-4cc3-b3ee-486573aa38fa tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', {'tags': ['tempest-TagsExtTest-Tag-391444727', 'tempest-TagsExtTest-Tag-1608348425', 'tempest-TagsExtTest-Tag-163855164']}) {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.517247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.541629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:29.545498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.567630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:24Z', 'revision_number': 7, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.575345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 186724d5-f667-48e4-990e-8cfe43ab5e26 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:29.614359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.619386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14479c9f-7bb5-4dae-86b0-dd25e7e82d8a None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:24Z', 'revision_number': 7, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '352e7f58-dffc-48d3-beb6-394f50f52fa7', 'name': '', 'network_id': '2b4ec7e4-c25c-4dba-9f85-c62657895348', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:51:dd:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 782, 'fixed_ips': [{'subnet_id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:12Z', 'updated_at': '2021-11-05T14:48:21Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '2c2e96ed-b727-4039-a867-c1c057b74aba', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:29.627804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:48:29.628083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:48:29.661473 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5803e684-04a7-4cc3-b3ee-486573aa38fa tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 200 len: 316 time: 0.1471379 Nov 05 14:48:29.662271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42584) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.668713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-87df469f-25a4-4203-8201-8e5fc6f18aa6 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.715226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.757364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Deleting port 41bac42b-ddc9-478a-8ca0-434d858e2da0 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:29.760906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.776405 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:29.777042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb761e32-774c-4df1-9949-1e9130290b3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.782150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-57c279b6-6a29-4127-9498-31345cf36f07', 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '85779a9a-b126-4421-9e17-0b73e75facb1'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:29.783076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.858902 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-87df469f-25a4-4203-8201-8e5fc6f18aa6 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 204 len: 168 time: 0.1956158 Nov 05 14:48:29.863275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42586) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.873257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-957c8127-282f-486f-a3c5-9d9920d4bd2f tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-391444727') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:29.877689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.894178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device eb5a9024-36d1-46c2-99bd-b5a62d5258c3 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:29.915689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.918959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:29.920114 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/c0ddbccd-fa41-4307-ac38-348fc4e66fea HTTP/1.1" status: 204 len: 168 time: 0.7292378 Nov 05 14:48:29.935057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42588) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:29.935378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: eb5a9024-36d1-46c2-99bd-b5a62d5258c3 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:29.936216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device eb5a9024-36d1-46c2-99bd-b5a62d5258c3 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:29.936816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 74689f1f-b8e2-419c-b7bb-20c6dc557b76 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:29.967200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 74689f1f-b8e2-419c-b7bb-20c6dc557b76 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:29.967537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 74689f1f-b8e2-419c-b7bb-20c6dc557b76 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:29.992021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a88f87-d642-4f76-963b-b309c6c38b7c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0ddbccd-fa41-4307-ac38-348fc4e66fea,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.009881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] For port 41bac42b-ddc9-478a-8ca0-434d858e2da0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41bac42b-ddc9-478a-8ca0-434d858e2da0,segment=NetworkSegment(b07b665e-5721-4aed-9413-b39d3361eee5),segment_id=b07b665e-5721-4aed-9413-b39d3361eee5)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:30.010591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.041822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.049468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Calling delete_port for 41bac42b-ddc9-478a-8ca0-434d858e2da0 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:30.057668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=f4667038-5aff-4abc-8f86-0b98f3cbc42e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.065227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': '227715b7-5861-4b81-b069-2048ab354a05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': 'd03f4cb5-4ce6-4ef0-b435-fdc9d939fd64'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:30.065726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:30.077674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c49cfa75-38d4-42b6-8175-f3b75e3ab81d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1359830 Nov 05 14:48:30.078418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.083517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--892143936'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:30.088550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 19366c25-ca17-4e42-9cc2-78dc5af54481 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:30.102806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::e9 (57c279b6-6a29-4127-9498-31345cf36f07/85779a9a-b126-4421-9e17-0b73e75facb1/186724d5-f667-48e4-990e-8cfe43ab5e26) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:30.110753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 19366c25-ca17-4e42-9cc2-78dc5af54481 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:30.111492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 19366c25-ca17-4e42-9cc2-78dc5af54481 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:30.119021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-957c8127-282f-486f-a3c5-9d9920d4bd2f tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:30.120014 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-957c8127-282f-486f-a3c5-9d9920d4bd2f tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-391444727 HTTP/1.1" status: 404 len: 328 time: 0.2557123 Nov 05 14:48:30.123291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42592) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.127499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-e4aee279-6c3d-498e-9f46-51eb97abd23b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-1608348425') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.128103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.129349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-922b86d1-07f4-49af-9ba2-6eb0b188dbd1 None None] Could not find standard attr ID for object df8146e1-ec8d-4995-bb95-8971b515eb88. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:30.132548 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/dc61f290-cd06-42ed-8982-77970397aacc HTTP/1.1" status: 204 len: 168 time: 0.9423649 Nov 05 14:48:30.135356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.138682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a3c294-9b6b-4d33-beb2-e850f9dccc3a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=dc61f290-cd06-42ed-8982-77970397aacc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.162481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:30.195098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.198386 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-829d3bb3-e2d9-471e-a2f6-3332316bd734 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0448456 Nov 05 14:48:30.209377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42596) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.213242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:30.217296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:30.223656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:30.224259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.264192 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a4dc0aa-c2ae-4a1b-a817-9b4832809ce8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 0.8992109 Nov 05 14:48:30.268941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42598) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.345641 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-e4aee279-6c3d-498e-9f46-51eb97abd23b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:30.346700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4aee279-6c3d-498e-9f46-51eb97abd23b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-1608348425 HTTP/1.1" status: 404 len: 329 time: 0.2224972 Nov 05 14:48:30.353075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42600) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.360818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.366359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-d3c9619e-926b-4063-9b30-6b1ae9f4de0b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5', 'tempest-TagsExtTest-Tag-163855164') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.386994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.419359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.453845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4b0b3925-fac2-4791-91e1-22c177a66895,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.464587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.491591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Pushing event deleted for resources: {'Port': ['ID=41bac42b-ddc9-478a-8ca0-434d858e2da0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.492400 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-d3c9619e-926b-4063-9b30-6b1ae9f4de0b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:30.496228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d3c9619e-926b-4063-9b30-6b1ae9f4de0b tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags/tempest-TagsExtTest-Tag-163855164 HTTP/1.1" status: 404 len: 328 time: 0.1359339 Nov 05 14:48:30.496375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] No DVR routers for this DVR port 41bac42b-ddc9-478a-8ca0-434d858e2da0 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:30.501022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42602) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.511253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-1dc87a39-76db-43a5-a946-6488c58f6900 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', {'tags': ['tempest-TagsExtTest-Tag-992235823', 'tempest-TagsExtTest-Tag-2058681443', 'tempest-TagsExtTest-Tag-127109325']}) {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.533401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.537488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3fdd8466-0247-4007-a233-1da4fd7e3fee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4550662 Nov 05 14:48:30.537783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42604) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.539696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:30.543277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.545651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4d70a746-ea36-49f2-bf27-d453f88cb52e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': '4b0b3925-fac2-4791-91e1-22c177a66895', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:30.547130 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-4d70a746-ea36-49f2-bf27-d453f88cb52e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 05 14:48:30.547628 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-4d70a746-ea36-49f2-bf27-d453f88cb52e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:30.548625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4d70a746-ea36-49f2-bf27-d453f88cb52e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0098155 Nov 05 14:48:30.551906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42606) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.563455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.649389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.662904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.680510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.704374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=f4667038-5aff-4abc-8f86-0b98f3cbc42e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.708667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.727585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.776344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 352e7f58-dffc-48d3-beb6-394f50f52fa7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:30.776711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.787556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.810401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.820008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.822628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.824052 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/4b0b3925-fac2-4791-91e1-22c177a66895 HTTP/1.1" status: 204 len: 168 time: 0.2712729 Nov 05 14:48:30.825961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '227715b7-5861-4b81-b069-2048ab354a05') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.826262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '227715b7-5861-4b81-b069-2048ab354a05') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:30.831393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42608) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.849872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.852818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d9c5ef-d661-49a5-942b-f6959c70ec98 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b0b3925-fac2-4791-91e1-22c177a66895,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:30.882741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.897478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 638 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:30.897882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:30.901221 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:30.951824 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9d64a4ac-c7c4-4a28-969e-16cdf2477de3 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1145723 Nov 05 14:48:30.959480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:30.966068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--696982269'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:30.990646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:30.998826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.006534 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 HTTP/1.1" status: 204 len: 168 time: 0.7307279 Nov 05 14:48:31.006534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42612) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.010957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-18313787'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.026659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.030106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0643ab1-f188-4b33-a997-e845241488d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.058377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:31.061860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.103499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:31.107314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc36919c-2228-49a8-98f4-75664fee44eb']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:31.125312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.125656 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment d11c5f62-9f45-47d2-89ee-f3e0a9319596 of type vlan for network cfcab3d0-89bd-4ad0-b4a1-47d92af092ba Nov 05 14:48:31.145074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.146001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1dc87a39-76db-43a5-a946-6488c58f6900 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 200 len: 316 time: 0.6439497 Nov 05 14:48:31.154865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42614) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.164441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-654fbe0b-055c-4b14-87b9-2ce9b088aadc tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:31.167378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b07b665e-5721-4aed-9413-b39d3361eee5') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:31.167675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b07b665e-5721-4aed-9413-b39d3361eee5') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:31.168246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.205126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.211261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.228988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Allocated IP 2001:db8::2 (57c279b6-6a29-4127-9498-31345cf36f07/85779a9a-b126-4421-9e17-0b73e75facb1/7d17f9e1-7324-4239-9a4f-9d60b9c038c1) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:31.299127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.323820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Releasing vlan 641 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:31.324242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:31.330291 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:31.388960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 57c279b6-6a29-4127-9498-31345cf36f07 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:31.397935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.407299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.427597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 352e7f58-dffc-48d3-beb6-394f50f52fa7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=352e7f58-dffc-48d3-beb6-394f50f52fa7,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:31.428082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.433842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:31.435687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=186724d5-f667-48e4-990e-8cfe43ab5e26,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.444510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:31.449375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:31.450033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.450780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Network 57c279b6-6a29-4127-9498-31345cf36f07 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:31.458394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:31.462781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:31.471474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Pushing event updated for resources: {'Port': ['ID=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.501103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 352e7f58-dffc-48d3-beb6-394f50f52fa7 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:31.506199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.520884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.530886 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dfd4b0fe-f036-4c83-b761-507178f797a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.5724483 Nov 05 14:48:31.531097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.531228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.531869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.5716851 Nov 05 14:48:31.537052 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] 10.222.0.30 "DELETE /v2.0/networks/fc36919c-2228-49a8-98f4-75664fee44eb HTTP/1.1" status: 204 len: 168 time: 2.5406082 Nov 05 14:48:31.543707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42616) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.543707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42618) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.547549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Attempting to bind port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:31.547992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Attempting to bind port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:31.548376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Attempting to bind port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 on network 57c279b6-6a29-4127-9498-31345cf36f07 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:31.557091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-44b2fa58-bbc0-497e-8686-743c4b3667d3 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'dbec4747-fdf9-40d7-83fb-0df595b2e982', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.557312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:31.557836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Checking segment: {'id': '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:31.558368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.558716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Bound using segment: {'id': '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:31.559313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Bound port: 7d17f9e1-7324-4239-9a4f-9d60b9c038c1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': '57c279b6-6a29-4127-9498-31345cf36f07'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:31.559705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.567656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876ee36a-2356-41da-a5dc-e757f5d64113 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dbec4747-fdf9-40d7-83fb-0df595b2e982,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.573371 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-44b2fa58-bbc0-497e-8686-743c4b3667d3 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 05 14:48:31.574009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-44b2fa58-bbc0-497e-8686-743c4b3667d3 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:31.575074 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-44b2fa58-bbc0-497e-8686-743c4b3667d3 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0214608 Nov 05 14:48:31.580736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42622) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.583376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '57c279b6-6a29-4127-9498-31345cf36f07', 'name': 'tempest-PortsIpV6TestJSON-636783108'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.595790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-85403c6c-32ae-435d-97c7-199ad903cb23 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'dbec4747-fdf9-40d7-83fb-0df595b2e982', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.599890 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-85403c6c-32ae-435d-97c7-199ad903cb23 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 05 14:48:31.600541 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-85403c6c-32ae-435d-97c7-199ad903cb23 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:31.604252 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85403c6c-32ae-435d-97c7-199ad903cb23 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0167234 Nov 05 14:48:31.604678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42624) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.611651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7caf365d-264c-4ad7-adeb-7469ede1e2d9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'dbec4747-fdf9-40d7-83fb-0df595b2e982', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.612864 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-7caf365d-264c-4ad7-adeb-7469ede1e2d9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 05 14:48:31.614108 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-7caf365d-264c-4ad7-adeb-7469ede1e2d9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:31.615479 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7caf365d-264c-4ad7-adeb-7469ede1e2d9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0097885 Nov 05 14:48:31.616858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.622805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:31.623552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.627630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42626) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.637515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-58c4d95a-50eb-41c5-b446-dc09924c71ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'dbec4747-fdf9-40d7-83fb-0df595b2e982', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.638735 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-58c4d95a-50eb-41c5-b446-dc09924c71ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 05 14:48:31.639230 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-58c4d95a-50eb-41c5-b446-dc09924c71ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:31.641123 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-58c4d95a-50eb-41c5-b446-dc09924c71ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0096424 Nov 05 14:48:31.656284 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42628) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.662588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] For port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:31.670499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] For port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,segment=NetworkSegment(3b75bc18-ba3b-407f-bd29-b86e8d4ed81e),segment_id=3b75bc18-ba3b-407f-bd29-b86e8d4ed81e)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:31.678175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.684805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25d7040-7c5c-4626-ac9f-54a6f4507922 admin admin] Pushing event deleted for resources: {'Network': ['ID=fc36919c-2228-49a8-98f4-75664fee44eb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.693362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.707988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.7011621 Nov 05 14:48:31.712881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42630) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.717106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-654fbe0b-055c-4b14-87b9-2ce9b088aadc tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 204 len: 168 time: 0.5599194 Nov 05 14:48:31.720517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': 'cfcab3d0-89bd-4ad0-b4a1-47d92af092ba', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:31.724142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42632) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.755184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-f8b0a00b-f9ac-42e3-8e9f-966796ed68a2 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-992235823') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:31.780482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42634) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.789446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1214bc-3855-4da6-af32-019fff7ed560 None None] Pushing event updated for resources: {'Port': ['ID=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.792929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:31.794628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:31.811891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971e4188-e2cc-4e04-a094-3a15b0df7f53 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=cfcab3d0-89bd-4ad0-b4a1-47d92af092ba,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.833429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network cfcab3d0-89bd-4ad0-b4a1-47d92af092ba details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:31.861838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:31.862749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.881961 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0ddc0f14-5fbf-4a34-83b7-545dee5b23c5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=643f5fc30ebb419c9fb85748c2767795&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0913520 Nov 05 14:48:31.884819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.887590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42636) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:31.914792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=11204b5e-1e58-4357-91a5-02b709c7f8ec,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:31.938367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:31.942006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.946112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:31.978859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b820c244-6994-4e32-b5aa-29935ad10bd2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.7614880 Nov 05 14:48:31.991948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42638) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.008671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '11204b5e-1e58-4357-91a5-02b709c7f8ec', 'ip_address': '2001:db8::919c:b4d7:82b5:eaf3'}], 'name': 'tempest-NetworksTestDHCPv6-538059869'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:32.017390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f8b0a00b-f9ac-42e3-8e9f-966796ed68a2 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:32.025027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f8b0a00b-f9ac-42e3-8e9f-966796ed68a2 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-992235823 HTTP/1.1" status: 404 len: 328 time: 0.2938039 Nov 05 14:48:32.029721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42640) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.036004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-567cec72-b8ec-40ef-8af5-c2f751227b4c tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-2058681443') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:32.093223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:32.097191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.135032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.137757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.138927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/dbec4747-fdf9-40d7-83fb-0df595b2e982 HTTP/1.1" status: 204 len: 168 time: 0.4815795 Nov 05 14:48:32.139645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.145573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42642) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.166836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:32.239259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9f5aed-3e93-4fd4-b26f-2dcfecd2ba0f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbec4747-fdf9-40d7-83fb-0df595b2e982,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:32.260179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.272419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:32.276627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.279418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-567cec72-b8ec-40ef-8af5-c2f751227b4c tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:32.280673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-567cec72-b8ec-40ef-8af5-c2f751227b4c tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-2058681443 HTTP/1.1" status: 404 len: 329 time: 0.2480669 Nov 05 14:48:32.286222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42644) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.293011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-502aff04-f457-4f2c-8b3f-a819c7e96521 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d', 'tempest-TagsExtTest-Tag-127109325') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:32.303063 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f00546f4-f1ae-4d40-88c2-d882c3f40b8d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1541724 Nov 05 14:48:32.320820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42646) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.353707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--293219912'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:32.366254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=352e7f58-dffc-48d3-beb6-394f50f52fa7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:32.405407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:32.457964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.460716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.462174 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/53618845-9a6d-4f05-aead-32f3c4c8242c HTTP/1.1" status: 204 len: 168 time: 0.5736394 Nov 05 14:48:32.466938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.470336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-502aff04-f457-4f2c-8b3f-a819c7e96521 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:32.471376 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-502aff04-f457-4f2c-8b3f-a819c7e96521 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags/tempest-TagsExtTest-Tag-127109325 HTTP/1.1" status: 404 len: 328 time: 0.1820180 Nov 05 14:48:32.481685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42650) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.491408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-b77c2fba-e6f9-4da4-9a6a-631502f7e7c3 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', {'tags': ['tempest-TagsExtTest-Tag-337191962', 'tempest-TagsExtTest-Tag-322162458', 'tempest-TagsExtTest-Tag-1239998879']}) {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:32.517020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef72756-0325-401a-a5c6-3e5b1ee39cf0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53618845-9a6d-4f05-aead-32f3c4c8242c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:32.527260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::352 (57c279b6-6a29-4127-9498-31345cf36f07/85779a9a-b126-4421-9e17-0b73e75facb1/ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:32.532978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.559845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:32.562023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.647742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=89448f85-c382-4833-91b3-3e338de730ba,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:32.669973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'd11c5f62-9f45-47d2-89ee-f3e0a9319596', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'cfcab3d0-89bd-4ad0-b4a1-47d92af092ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:32.670443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: cfcab3d0-89bd-4ad0-b4a1-47d92af092ba, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:32.674742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b77c2fba-e6f9-4da4-9a6a-631502f7e7c3 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 200 len: 316 time: 0.1877935 Nov 05 14:48:32.680194 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42652) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.686725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.701751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network cfcab3d0-89bd-4ad0-b4a1-47d92af092ba is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:32.706452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-165cbc07-1b86-4d1d-915f-2c0a218235f6 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:32.715535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, cfcab3d0-89bd-4ad0-b4a1-47d92af092ba) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:32.736718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:32.737482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.744252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,segment=NetworkSegment(3b75bc18-ba3b-407f-bd29-b86e8d4ed81e),segment_id=3b75bc18-ba3b-407f-bd29-b86e8d4ed81e)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:32.750875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.761814 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8eddfde6-be2e-4a06-8071-9b90751c1d55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.0429122 Nov 05 14:48:32.762220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42654) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:32.808695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.831132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:32.930346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.931064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:32.938874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port d477ac7c-42b7-4320-8cc5-815ca6f78796 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:33.014324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.030090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.091370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.100698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.199728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8b29c13-3ef8-4c81-bd42-06fcb170a2c7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:33.209415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.210665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.8631794 Nov 05 14:48:33.216397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42666) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.218646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=89448f85-c382-4833-91b3-3e338de730ba,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:33.237092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5768ff96-55d7-4131-ad23-e7a1e11b35d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.238602 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-5768ff96-55d7-4131-ad23-e7a1e11b35d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 05 14:48:33.239731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-5768ff96-55d7-4131-ad23-e7a1e11b35d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.245307 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5768ff96-55d7-4131-ad23-e7a1e11b35d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0276749 Nov 05 14:48:33.249064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.249638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42668) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.255276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-41a264e0-966a-4d1e-a699-2c51afcc4345 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.262860 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-165cbc07-1b86-4d1d-915f-2c0a218235f6 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 204 len: 168 time: 0.5720212 Nov 05 14:48:33.275078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42670) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.277895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e59d3d27-1e4c-400d-8a0e-24d376ec9e68 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d80bb356-d838-45af-9fd8-2cd6e6d2bae2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:33.283941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-4bda83bd-5473-418c-ad52-cda5f274f2d7 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-337191962') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:33.298658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.320738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7f297a8d-b108-4308-b0bf-155b0c654030 None None] Provisioning complete for port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:33.321405 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f297a8d-b108-4308-b0bf-155b0c654030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.330528 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-41a264e0-966a-4d1e-a699-2c51afcc4345 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.335459 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-41a264e0-966a-4d1e-a699-2c51afcc4345 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0845125 Nov 05 14:48:33.336070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42672) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.338494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cfcab3d0-89bd-4ad0-b4a1-47d92af092ba']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:33.350062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-84733e53-17fd-49ca-bd08-02213fc07fbc tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.350554 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-84733e53-17fd-49ca-bd08-02213fc07fbc tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 05 14:48:33.351062 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-84733e53-17fd-49ca-bd08-02213fc07fbc tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.354298 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-84733e53-17fd-49ca-bd08-02213fc07fbc tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0130789 Nov 05 14:48:33.368973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42674) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.375147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-73a05520-d6e0-4e4f-a64a-96a791475388 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.381084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd11c5f62-9f45-47d2-89ee-f3e0a9319596') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:33.381316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd11c5f62-9f45-47d2-89ee-f3e0a9319596') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:33.393744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.418152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.419305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::919c:b4d7:82b5:eaf3 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/11204b5e-1e58-4357-91a5-02b709c7f8ec/d477ac7c-42b7-4320-8cc5-815ca6f78796) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:33.424755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:33.425184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.426211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8b29c13-3ef8-4c81-bd42-06fcb170a2c7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:33.428911 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:33.493004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-73a05520-d6e0-4e4f-a64a-96a791475388 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.494894 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73a05520-d6e0-4e4f-a64a-96a791475388 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.1242828 Nov 05 14:48:33.508560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42682) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.514234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-92433540-b90f-445c-9839-cc7c01ee383c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.514944 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-92433540-b90f-445c-9839-cc7c01ee383c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 05 14:48:33.515654 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-92433540-b90f-445c-9839-cc7c01ee383c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.517051 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-92433540-b90f-445c-9839-cc7c01ee383c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0072618 Nov 05 14:48:33.520684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42684) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.527593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-575c50f2-7419-404f-a8bd-aabc67403bcd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.547414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.559718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.563817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/cfcab3d0-89bd-4ad0-b4a1-47d92af092ba HTTP/1.1" status: 204 len: 168 time: 0.8007593 Nov 05 14:48:33.568243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42688) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.595768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-528232027'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.604775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c12ab23-e258-4928-b501-f17aa76c18d1 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=cfcab3d0-89bd-4ad0-b4a1-47d92af092ba,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:33.624548 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-575c50f2-7419-404f-a8bd-aabc67403bcd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Project 19cc9806746a4ff085411da966435f5e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:48:33.632491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:33.642837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.673324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 625} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:33.683988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.684442 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment c6a7d21c-3079-481e-8f4a-2c2caf2203da of type vlan for network 56b362ed-c41f-4f72-a34a-6ebd2abf21f2 Nov 05 14:48:33.686274 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-575c50f2-7419-404f-a8bd-aabc67403bcd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.690088 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-575c50f2-7419-404f-a8bd-aabc67403bcd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1655056 Nov 05 14:48:33.695321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42690) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.701386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a1dbd2e1-c8b5-492d-b36d-38288ae9366d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.702045 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-a1dbd2e1-c8b5-492d-b36d-38288ae9366d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 05 14:48:33.702554 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-a1dbd2e1-c8b5-492d-b36d-38288ae9366d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.706566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a1dbd2e1-c8b5-492d-b36d-38288ae9366d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0072393 Nov 05 14:48:33.706792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42692) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.711880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ec3e1774-7fc6-4b5d-89ad-9de254d00963 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.759924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.777082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-ec3e1774-7fc6-4b5d-89ad-9de254d00963 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Project 19cc9806746a4ff085411da966435f5e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:48:33.800409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.807036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:33.807725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:33.816909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-ec3e1774-7fc6-4b5d-89ad-9de254d00963 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.820871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ec3e1774-7fc6-4b5d-89ad-9de254d00963 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.1102345 Nov 05 14:48:33.833598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42696) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.868998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2124f312-9f1c-45bc-8570-7132a6c0cb20 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'd80bb356-d838-45af-9fd8-2cd6e6d2bae2', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.908711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=56b362ed-c41f-4f72-a34a-6ebd2abf21f2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:33.915871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-2124f312-9f1c-45bc-8570-7132a6c0cb20 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Project 19cc9806746a4ff085411da966435f5e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:48:33.935873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9f20012b-7fa4-41be-9fe3-411717e33ab4 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.3588583 Nov 05 14:48:33.935873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-2124f312-9f1c-45bc-8570-7132a6c0cb20 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:33.935873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2124f312-9f1c-45bc-8570-7132a6c0cb20 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0680020 Nov 05 14:48:33.935873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42700) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.936367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42702) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:33.937742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 56b362ed-c41f-4f72-a34a-6ebd2abf21f2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:33.938181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '56b362ed-c41f-4f72-a34a-6ebd2abf21f2', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:33.940354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9071402a-3cb6-4cbf-bcfb-fabb5648acfe None None] DHCP port deletion for fc36919c-2228-49a8-98f4-75664fee44eb request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:33.979018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.050229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:34.060479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.080355 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-4bda83bd-5473-418c-ad52-cda5f274f2d7 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:34.081437 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4bda83bd-5473-418c-ad52-cda5f274f2d7 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-337191962 HTTP/1.1" status: 404 len: 328 time: 0.8011127 Nov 05 14:48:34.094266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42704) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.101117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-8abbb219-bc85-4d53-ac0a-7505cb7bfbe9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-322162458') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.127159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 57c279b6-6a29-4127-9498-31345cf36f07 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:34.130364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '11204b5e-1e58-4357-91a5-02b709c7f8ec'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': 'd8816d08-56e6-423f-8fe2-a77d8f35d844'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:48:34.130998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:34.146963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:34.159673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:34.165421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.167139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:34.167985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.204350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:34.213327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.227926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.232718 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-21ce3649-c890-4c82-b55f-a0252e8c18b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.6801584 Nov 05 14:48:34.240327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42710) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.327980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:34.355037 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-8abbb219-bc85-4d53-ac0a-7505cb7bfbe9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:34.356081 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8abbb219-bc85-4d53-ac0a-7505cb7bfbe9 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-322162458 HTTP/1.1" status: 404 len: 328 time: 0.2608550 Nov 05 14:48:34.363792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.366386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42714) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.370702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-ca956224-eae3-4a3f-b8f9-591b85ae50e0 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76', 'tempest-TagsExtTest-Tag-1239998879') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.399733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:34.400512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.444390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:34.457317 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1afa5e0c-c79f-4119-ae1c-1cda9587ea8f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9646118 Nov 05 14:48:34.458419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.458549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.460450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:34.477804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:34.478758 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.485537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f5c8f83-46ac-47fb-a71f-673eb23c0196 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:34.488056 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f5c8f83-46ac-47fb-a71f-673eb23c0196 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3Ae9 HTTP/1.1" status: 200 len: 928 time: 0.2391407 Nov 05 14:48:34.519587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42720) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.544689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.547651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.549242 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/d80bb356-d838-45af-9fd8-2cd6e6d2bae2 HTTP/1.1" status: 204 len: 168 time: 0.5812654 Nov 05 14:48:34.550002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=d477ac7c-42b7-4320-8cc5-815ca6f78796,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:34.552439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42724) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.558749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:34.565817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/11204b5e-1e58-4357-91a5-02b709c7f8ec/d8816d08-56e6-423f-8fe2-a77d8f35d844) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:34.586508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:34.600024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:34.606350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:34.607649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.628127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff3b188-cd77-4d28-8ff8-e589b38a62e1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d80bb356-d838-45af-9fd8-2cd6e6d2bae2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:34.638495 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-ca956224-eae3-4a3f-b8f9-591b85ae50e0 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:34.639565 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca956224-eae3-4a3f-b8f9-591b85ae50e0 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags/tempest-TagsExtTest-Tag-1239998879 HTTP/1.1" status: 404 len: 329 time: 0.2726789 Nov 05 14:48:34.643076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.648652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-e8750c8c-a051-4444-b469-c269c62f25fd tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', {'tags': ['tempest-TagsExtTest-Tag-1454316046', 'tempest-TagsExtTest-Tag-1557728850', 'tempest-TagsExtTest-Tag-1636623684']}) {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.677180 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:34.678702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42728) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.708370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 2c2e96ed-b727-4039-a867-c1c057b74aba {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:34.715177 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f592b572-43de-412e-a6b0-50cc03d9129f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1516826 Nov 05 14:48:34.717842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e8750c8c-a051-4444-b469-c269c62f25fd tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "PUT /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 200 len: 318 time: 0.0737119 Nov 05 14:48:34.720310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42732) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.724806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-6f56b2ef-8427-4a55-b747-c491d244acf4 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.728351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.730442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.744551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] For port d8816d08-56e6-423f-8fe2-a77d8f35d844, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d8816d08-56e6-423f-8fe2-a77d8f35d844,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:34.758288 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fcfc30cb-2111-4bd4-85c9-532d9e25204a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.7621202 Nov 05 14:48:34.768012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42736) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.777693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--212803520'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:34.782199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.853254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.858681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41bac42b-ddc9-478a-8ca0-434d858e2da0 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:34.867460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-1883248690', 'router:external': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:34.880685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.882726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:34.887577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 41bac42b-ddc9-478a-8ca0-434d858e2da0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:34.887932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41bac42b-ddc9-478a-8ca0-434d858e2da0 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:34.907765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43f15a04-ab53-4a7e-8b57-174ba14e08ec tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:34.914575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43f15a04-ab53-4a7e-8b57-174ba14e08ec tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:34.919534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-43f15a04-ab53-4a7e-8b57-174ba14e08ec tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1686 time: 0.1272826 Nov 05 14:48:34.921213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.957595 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6f56b2ef-8427-4a55-b747-c491d244acf4 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 204 len: 168 time: 0.2362206 Nov 05 14:48:34.967438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f603b067-1a3b-4a1a-b439-971c066d0b7b None None] Pushing event updated for resources: {'Port': ['ID=d8816d08-56e6-423f-8fe2-a77d8f35d844,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:34.970710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42740) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:34.970971 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:32Z', 'revision_number': 8, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:34.981810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-aac5761d-96fd-473a-9623-03cac4ff3917 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1454316046') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.004570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:35.017579 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:35.018174 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.027293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Made reservation on behalf of b797ddb0bdfc4d42860490426465674e for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:35.029263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.042045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.056420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.107423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.118994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-aac5761d-96fd-473a-9623-03cac4ff3917 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:35.124467 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aac5761d-96fd-473a-9623-03cac4ff3917 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1454316046 HTTP/1.1" status: 404 len: 329 time: 0.1500533 Nov 05 14:48:35.125971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42742) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.128306 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:35.129206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.139291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-0ff749fc-017c-447f-ad04-7f83172e726a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1557728850') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.191858 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-0ff749fc-017c-447f-ad04-7f83172e726a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:35.195496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ff749fc-017c-447f-ad04-7f83172e726a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1557728850 HTTP/1.1" status: 404 len: 329 time: 0.0650337 Nov 05 14:48:35.199351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42744) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.203466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.205385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-1cf23739-3c80-458d-8e7a-59a013b5cb86 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff', 'tempest-TagsExtTest-Tag-1636623684') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.215660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:35.216058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.219697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.221565 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.4922543 Nov 05 14:48:35.230535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42746) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.246550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-11cd423b-78a7-4a99-94c7-bf904f782fe9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'aeb6c5bb-a9c4-457f-8a4d-1d8dbc33ce18', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:35.256125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f703b2a3-59c2-45dc-9d3e-4659cb273a0a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aeb6c5bb-a9c4-457f-8a4d-1d8dbc33ce18,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:35.264639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.266703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-1cf23739-3c80-458d-8e7a-59a013b5cb86 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] show failed (client error): The resource could not be found. Nov 05 14:48:35.271254 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1cf23739-3c80-458d-8e7a-59a013b5cb86 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags/tempest-TagsExtTest-Tag-1636623684 HTTP/1.1" status: 404 len: 329 time: 0.0671093 Nov 05 14:48:35.279248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42748) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.282296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port d477ac7c-42b7-4320-8cc5-815ca6f78796 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:35.282645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.295187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-0c6a3b88-c2e8-4e0e-9e77-c0aaaf7be3d5 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '985781ea-83b1-42ef-b73c-085f333fbaff') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.315649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.332070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=fe47108c-6f8b-46e6-9e53-84dcda8efb72,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:35.387689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'c6a7d21c-3079-481e-8f4a-2c2caf2203da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': '56b362ed-c41f-4f72-a34a-6ebd2abf21f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:35.388077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 56b362ed-c41f-4f72-a34a-6ebd2abf21f2, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:35.398684 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-17137722-e830-4a74-8bea-335c4753d915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:32Z', 'revision_number': 8, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.410718 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0c6a3b88-c2e8-4e0e-9e77-c0aaaf7be3d5 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff/tags HTTP/1.1" status: 204 len: 168 time: 0.1235278 Nov 05 14:48:35.414420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 616} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:35.422856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42750) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.436787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-b3af81fb-9248-437b-bf4b-3aa55d1e5052 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', 'fa9a3484-56ee-4842-97bf-6c1d0cbc5c76') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:35.450756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-11cd423b-78a7-4a99-94c7-bf904f782fe9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The resource could not be found. Nov 05 14:48:35.454909 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-11cd423b-78a7-4a99-94c7-bf904f782fe9 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.2102733 Nov 05 14:48:35.461537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42752) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.466496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.473111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-152cd57a-11fb-4679-b4a9-1398a8953a3a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'aeb6c5bb-a9c4-457f-8a4d-1d8dbc33ce18', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '66d884eb-e9da-404e-899a-dc77f0a03aa0'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:35.499999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for d477ac7c-42b7-4320-8cc5-815ca6f78796 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:35.545763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14b7f7df-458f-4ca5-b9d4-f595bcc253e5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:35.551032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.551379 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Added segment 7807b354-e4a5-4ee9-b60a-3ec7fd3c5904 of type vlan for network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 Nov 05 14:48:35.575227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.593043 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17137722-e830-4a74-8bea-335c4753d915 None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:32Z', 'revision_number': 8, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': '711c5642-fb28-4fa7-a9c6-15f78cc03028', 'name': '', 'network_id': '1fb97d8a-9f3b-438a-9a84-527e5990548d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:db:62:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 755, 'fixed_ips': [{'subnet_id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:03Z', 'updated_at': '2021-11-05T14:48:11Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '0408f5e3-09a3-44a0-8caa-8475b072368f', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:35.641934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-152cd57a-11fb-4679-b4a9-1398a8953a3a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The resource could not be found. Nov 05 14:48:35.643062 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-152cd57a-11fb-4679-b4a9-1398a8953a3a tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.1799464 Nov 05 14:48:35.647044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42754) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.758340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.762826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a669363-d61e-4f5f-a887-a0204a7f2094 None None] Network 57c279b6-6a29-4127-9498-31345cf36f07 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:35.772340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.813314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.823519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=d477ac7c-42b7-4320-8cc5-815ca6f78796,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:35.842307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c954362-5a86-45c5-8871-f46a45ebfc8a None None] Network d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:35.850542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b53aaaa-bdc1-453f-9b65-78617475b42f None None] Network cfcab3d0-89bd-4ad0-b4a1-47d92af092ba requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:35.856999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.860401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58314a4e-f742-4488-9b79-5ba5a93385d8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/d477ac7c-42b7-4320-8cc5-815ca6f78796 HTTP/1.1" status: 204 len: 168 time: 0.9372065 Nov 05 14:48:35.866922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42756) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9c954362-5a86-45c5-8871-f46a45ebfc8a None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.877285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:35.931369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.935154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.936444 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/aeb6c5bb-a9c4-457f-8a4d-1d8dbc33ce18 HTTP/1.1" status: 204 len: 168 time: 0.2871785 Nov 05 14:48:35.945684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42758) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:35.961017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aad333f2-89e0-4427-8be6-c45821ba4a09 None None] Network d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:35.967392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69eb1110-4228-44d5-b134-0cab5e1c9963 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5a669363-d61e-4f5f-a887-a0204a7f2094 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:35.979007 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-aad333f2-89e0-4427-8be6-c45821ba4a09 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.980844 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:35.982589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-173c0ca7-c6c1-46ef-9589-1e605487744b None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:35.983097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-173c0ca7-c6c1-46ef-9589-1e605487744b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7b53aaaa-bdc1-453f-9b65-78617475b42f None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:35.985082 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:35.991460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69eb1110-4228-44d5-b134-0cab5e1c9963 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:35.997155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-69eb1110-4228-44d5-b134-0cab5e1c9963 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1292384 Nov 05 14:48:36.000281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8987d1be-6141-4f58-a17f-c5cb1430fa39 None None] Network 57c279b6-6a29-4127-9498-31345cf36f07 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.008728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.008973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.023328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b71588-549c-4502-804f-e334fb87e9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aeb6c5bb-a9c4-457f-8a4d-1d8dbc33ce18,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:36.078088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 56b362ed-c41f-4f72-a34a-6ebd2abf21f2 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:36.099980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:36.104120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=2c2e96ed-b727-4039-a867-c1c057b74aba,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:36.114609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.117953 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d75fa7c4-9fbc-4674-9911-6312ff915dad tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/2c2e96ed-b727-4039-a867-c1c057b74aba HTTP/1.1" status: 204 len: 168 time: 1.6561506 Nov 05 14:48:36.118688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 56b362ed-c41f-4f72-a34a-6ebd2abf21f2) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:36.122590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:36.123178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.140684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.154854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-227dba29-0a64-445b-9097-9e7dc025aa1f None None] Network cfcab3d0-89bd-4ad0-b4a1-47d92af092ba requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.168145 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd89531d-4ea4-4536-8115-646182f616e9 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.2338049 Nov 05 14:48:36.171385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.174119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42766) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-227dba29-0a64-445b-9097-9e7dc025aa1f None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:36.185294 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:36.187997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c48c877-34ad-4479-956d-73514ced7c28 None None] Network 56b362ed-c41f-4f72-a34a-6ebd2abf21f2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.276550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.280284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b3af81fb-9248-437b-bf4b-3aa55d1e5052 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76/tags HTTP/1.1" status: 204 len: 168 time: 0.8561966 Nov 05 14:48:36.289836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6bd61ae-0eb8-4a43-b36c-44285944eebb None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.289974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42768) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.294600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-b0971df3-b721-4acf-835d-9b383565ad74 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6c48c877-34ad-4479-956d-73514ced7c28 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:36.301111 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:36.303858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d8816d08-56e6-423f-8fe2-a77d8f35d844 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:36.342202 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9939ecde-5238-4c6b-8b11-6f510a68599e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.3953485 Nov 05 14:48:36.348425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42770) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.358523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bf128008-08fd-47ec-b3f1-8a50f31c90ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'e3ba0c97-cee9-4994-bfab-82a1a408e155', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:36.371773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b359222-d5be-4ee6-8910-53756df6eb42 None None] Network 56b362ed-c41f-4f72-a34a-6ebd2abf21f2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.380655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 11204b5e-1e58-4357-91a5-02b709c7f8ec {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:36.382033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.383136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:36.383719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.383934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.432904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:36.433582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.505090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.507418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,segment=NetworkSegment(9ce004ab-8a09-48e4-84fc-0892f0beb95d),segment_id=9ce004ab-8a09-48e4-84fc-0892f0beb95d)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:36.507418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.517079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d37bfd8f-0dda-442d-ad8c-e53f811ddcb4 None None] Network 2b4ec7e4-c25c-4dba-9f85-c62657895348 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:36.522121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:36.557643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Network': ['ID=c08818cc-8e35-4c79-a6c9-74c2608ef7e6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:36.570208 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b0971df3-b721-4acf-835d-9b383565ad74 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d/tags HTTP/1.1" status: 204 len: 168 time: 0.2793078 Nov 05 14:48:36.576013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42772) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.582185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-49799d5e-c28e-4323-a6c2-6637438dd8b2 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', 'cd57bf86-8d2e-4939-b60e-8b8752eaf6e5') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:36.608141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8987d1be-6141-4f58-a17f-c5cb1430fa39 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:36.618483 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:36.619544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.620357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d8816d08-56e6-423f-8fe2-a77d8f35d844 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:36.620749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.644927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.663406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.699355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.725353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:36.762665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.767763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.774232 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6bb567f9-d71c-4433-82db-9fdb3d23bada tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb HTTP/1.1" status: 204 len: 168 time: 2.2528651 Nov 05 14:48:36.777946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42774) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.816691 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c177de8b-19be-47e2-82fc-a0477d646193 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:36.821470 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c177de8b-19be-47e2-82fc-a0477d646193 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb HTTP/1.1" status: 404 len: 333 time: 0.0419123 Nov 05 14:48:36.823206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42776) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.834675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:36.866084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:36.869753 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-49799d5e-c28e-4323-a6c2-6637438dd8b2 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5/tags HTTP/1.1" status: 204 len: 168 time: 0.2908118 Nov 05 14:48:36.879873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d6e20da8-b671-47de-85cf-4dafdb5987dd tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 2.1961017 Nov 05 14:48:36.879873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42778) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.896451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42780) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:36.902196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'subnet': {'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b6bd61ae-0eb8-4a43-b36c-44285944eebb None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:36.918563 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9b359222-d5be-4ee6-8910-53756df6eb42 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:36.964183 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:36.970708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.021406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.026944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=fe47108c-6f8b-46e6-9e53-84dcda8efb72,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.031935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42782) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.035675 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/11204b5e-1e58-4357-91a5-02b709c7f8ec HTTP/1.1" status: 204 len: 168 time: 0.9946501 Nov 05 14:48:37.039568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-36269097-4ea3-4673-91f4-981060d71ef8 None None] Could not find standard attr ID for object 1c48c25e-2cfa-43eb-902b-6b4db807ee4e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:37.044589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064427f4-c9ca-498e-bccc-9562dd19fcc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=11204b5e-1e58-4357-91a5-02b709c7f8ec,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.048796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Made reservation on behalf of b797ddb0bdfc4d42860490426465674e for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:37.052311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.058214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=41b6ac2f-64d1-4303-8e72-a717d0ccb8ca,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.072029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 352e7f58-dffc-48d3-beb6-394f50f52fa7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:37.075570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-36269097-4ea3-4673-91f4-981060d71ef8 None None] Provisioning complete for port 186724d5-f667-48e4-990e-8cfe43ab5e26 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:37.075958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-36269097-4ea3-4673-91f4-981060d71ef8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.095004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.115004 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-bf128008-08fd-47ec-b3f1-8a50f31c90ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The resource could not be found. Nov 05 14:48:37.116482 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf128008-08fd-47ec-b3f1-8a50f31c90ee tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.7620704 Nov 05 14:48:37.122562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42784) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.129297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--132128159'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:37.152200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-36269097-4ea3-4673-91f4-981060d71ef8 None None] Port 186724d5-f667-48e4-990e-8cfe43ab5e26 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:37.153858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da3540b3-14d3-4eba-b615-c4561235f995 None None] DHCP port deletion for 2b4ec7e4-c25c-4dba-9f85-c62657895348 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:37.173429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2b4ec7e4-c25c-4dba-9f85-c62657895348']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.188080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ce004ab-8a09-48e4-84fc-0892f0beb95d') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.188551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ce004ab-8a09-48e4-84fc-0892f0beb95d') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.191196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 352e7f58-dffc-48d3-beb6-394f50f52fa7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:37.191835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 352e7f58-dffc-48d3-beb6-394f50f52fa7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:37.201920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.207205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-431e3795-b1e2-4101-8f06-0f7812fa9627 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1691709 Nov 05 14:48:37.215631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42786) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.225591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:37.250171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.287304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.302735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8990a12c-1148-43ba-bce5-cb4aa1955916 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for subnetpool, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.303875 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8990a12c-1148-43ba-bce5-cb4aa1955916 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnetpools/985781ea-83b1-42ef-b73c-085f333fbaff HTTP/1.1" status: 204 len: 168 time: 0.4198339 Nov 05 14:48:37.307730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.314245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['56b362ed-c41f-4f72-a34a-6ebd2abf21f2']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.315155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.320171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 186724d5-f667-48e4-990e-8cfe43ab5e26 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:37.320542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.334744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 635 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:37.335195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.335560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c6a7d21c-3079-481e-8f4a-2c2caf2203da') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.335856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c6a7d21c-3079-481e-8f4a-2c2caf2203da') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:37.338960 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:37.383440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.422336 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.422545 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be25fff5-46ab-422b-b658-0ab7f1b1dc13 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "GET /v2.0/ports?device_id=fa9a3484-56ee-4842-97bf-6c1d0cbc5c76 HTTP/1.1" status: 200 len: 205 time: 0.1060343 Nov 05 14:48:37.426223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42790) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.426690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-873e8de5-b0dc-4c88-9c30-4d44a6f5c89b None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:37.462679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.483735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.489517 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/2b4ec7e4-c25c-4dba-9f85-c62657895348 HTTP/1.1" status: 204 len: 168 time: 1.3429856 Nov 05 14:48:37.509204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 625 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:37.509615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:37.514747 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:37.517378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5781adb-0737-45be-88e2-d13457e8b800 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=2b4ec7e4-c25c-4dba-9f85-c62657895348,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.521628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cd52a475-5cf9-4695-b731-6abdd9792287 None None] Could not find standard attr ID for object d477ac7c-42b7-4320-8cc5-815ca6f78796. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:37.529952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42792) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.541617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cd52a475-5cf9-4695-b731-6abdd9792287 None None] Could not find standard attr ID for object ec19eef8-c8f5-465b-bdd9-5c3aeb4a0cdb. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:37.586986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:37.599450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.627877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.645403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.680826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:37.734013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Deleting port d8816d08-56e6-423f-8fe2-a77d8f35d844 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:37.734483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.747932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.751594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 186724d5-f667-48e4-990e-8cfe43ab5e26 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:37.760083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.762783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.766931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.775272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/56b362ed-c41f-4f72-a34a-6ebd2abf21f2 HTTP/1.1" status: 204 len: 168 time: 1.5998352 Nov 05 14:48:37.777464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42794) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:37.788935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1508442684'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:37.803830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] For port d8816d08-56e6-423f-8fe2-a77d8f35d844, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d8816d08-56e6-423f-8fe2-a77d8f35d844,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:37.804318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.820885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Calling delete_port for d8816d08-56e6-423f-8fe2-a77d8f35d844 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:37.874532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a82362-f4a3-49f4-992c-61ca83266c05 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=56b362ed-c41f-4f72-a34a-6ebd2abf21f2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.887546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b58e69b8-c415-4f77-bbe7-6ac6db674515,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.911572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:37.939899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] Pushing event deleted for resources: {'Port': ['ID=d8816d08-56e6-423f-8fe2-a77d8f35d844,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:37.942477 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c5fa02b-d800-47b7-afdb-82276cbbaf59 None None] No DVR routers for this DVR port d8816d08-56e6-423f-8fe2-a77d8f35d844 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:37.971251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc6e5fd9-9c98-4af6-9743-5f7612542933 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:37.997486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.004901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.006857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:38.010072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.033948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.034943 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf9d41e8-22ae-40ac-b753-1e53e5d57ecd tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.9111533 Nov 05 14:48:38.039176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42796) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.050058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--986692144'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:38.083468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.108412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc6e5fd9-9c98-4af6-9743-5f7612542933 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:38.113452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:38.142286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.142739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Fanout notify agent at l3_agent the message router_deleted on router fa9a3484-56ee-4842-97bf-6c1d0cbc5c76 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:38.144591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:38.144949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 41b6ac2f-64d1-4303-8e72-a717d0ccb8ca not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:38.145579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d8816d08-56e6-423f-8fe2-a77d8f35d844 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:38.153111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:38.153900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.162012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.165284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aa8e21e0-afe2-4eb7-b7d6-8ff511bc4a35 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/routers/fa9a3484-56ee-4842-97bf-6c1d0cbc5c76 HTTP/1.1" status: 204 len: 168 time: 0.7110162 Nov 05 14:48:38.168700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42798) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.172682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d8816d08-56e6-423f-8fe2-a77d8f35d844 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:38.172828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d8816d08-56e6-423f-8fe2-a77d8f35d844 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:38.190564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:38.198630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:38.199220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.217308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:38.217500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=e706d5bb-3762-4326-8986-774b1aaab6da,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:38.265197 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c91d608b-2bc7-4c87-a29b-bf0226e965f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.0457869 Nov 05 14:48:38.265844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42800) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.272146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'e706d5bb-3762-4326-8986-774b1aaab6da', 'ip_address': '2001:db8::2903:2c4a:280f:577a'}], 'name': 'tempest-NetworksTestDHCPv6-2107429443'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:38.276947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.277292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment af29999c-50fe-4137-9f8f-46dfb394f153 of type vlan for network 41cf805a-e57a-4fde-b138-22847feba6b2 Nov 05 14:48:38.326641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.342430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.350291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.390819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=186724d5-f667-48e4-990e-8cfe43ab5e26,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:38.437801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Deleting port 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:38.438141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.467994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.472298 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9b56ebe5-e568-4eec-89f0-f6e07b9cbfbc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/186724d5-f667-48e4-990e-8cfe43ab5e26 HTTP/1.1" status: 204 len: 168 time: 1.6438830 Nov 05 14:48:38.475439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': 'e706d5bb-3762-4326-8986-774b1aaab6da'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:38.476712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.500724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.515767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.522501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:38.523119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.581808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ab4631fe-b159-4a26-b2d3-66f2fd93a869 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:38.583437 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ab4631fe-b159-4a26-b2d3-66f2fd93a869 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/186724d5-f667-48e4-990e-8cfe43ab5e26 HTTP/1.1" status: 404 len: 333 time: 0.0797040 Nov 05 14:48:38.640905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.644003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/e706d5bb-3762-4326-8986-774b1aaab6da/8ef94c94-0a58-442f-8680-1e3888860263) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:38.664979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:48:38.665459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.680179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.719781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.734466 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.9504561 Nov 05 14:48:38.746796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42806) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.760806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'New_network'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:38.767433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.768720 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 0.7222493 Nov 05 14:48:38.779859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42808) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:38.784641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a214bf49-bad7-4d25-b432-b42351b1f6da tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'b58e69b8-c415-4f77-bbe7-6ac6db674515', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '517f7475-4f92-4baf-abf3-da24a988d779'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:38.812910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.821526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.821790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9261c646-e388-4fc8-ad19-f8543ff51f77 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=517f7475-4f92-4baf-abf3-da24a988d779,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:38.862679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:38.872500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:38.874832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:38.886619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Pushing event updated for resources: {'Port': ['ID=8ef94c94-0a58-442f-8680-1e3888860263,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:38.945031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Attempting to bind port 8ef94c94-0a58-442f-8680-1e3888860263 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:38.945691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Attempting to bind port 8ef94c94-0a58-442f-8680-1e3888860263 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:38.945691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Attempting to bind port 8ef94c94-0a58-442f-8680-1e3888860263 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:38.946250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:38.951912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:38.953030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:38.953030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.953243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:38.953939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Bound port: 8ef94c94-0a58-442f-8680-1e3888860263, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:38.954083 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-a214bf49-bad7-4d25-b432-b42351b1f6da tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:38.954187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:38.958422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a214bf49-bad7-4d25-b432-b42351b1f6da tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.1743622 Nov 05 14:48:38.966624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42810) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.024750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] For port 8ef94c94-0a58-442f-8680-1e3888860263, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:39.028268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] For port 8ef94c94-0a58-442f-8680-1e3888860263, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8ef94c94-0a58-442f-8680-1e3888860263,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:39.033436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.082571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5285b88d-01cf-40e0-a3dd-bb26a87e1fd0 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=41cf805a-e57a-4fde-b138-22847feba6b2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.095233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 41cf805a-e57a-4fde-b138-22847feba6b2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:39.103258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d985238-f6b7-4173-802e-697fa1c5eb47 None None] Pushing event updated for resources: {'Port': ['ID=8ef94c94-0a58-442f-8680-1e3888860263,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.116134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.156786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.177558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.179230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 85779a9a-b126-4421-9e17-0b73e75facb1 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:39.181616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Calling delete_port for 4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:39.182203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 2dfc8537-16e5-4887-9cf9-489d02451b20 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:39.199628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.205032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Subnet': ['ID=8eec5ce6-d5eb-4929-adc5-4286018c3a1a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.275935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.319739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Checking segment: {'id': '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:39.320248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network hostable DHCP agents. Network: c08818cc-8e35-4c79-a6c9-74c2608ef7e6, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:39.381698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.454655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.457963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.460852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/517f7475-4f92-4baf-abf3-da24a988d779 HTTP/1.1" status: 204 len: 168 time: 0.4908009 Nov 05 14:48:39.465653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.469743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:39.489542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 711c5642-fb28-4fa7-a9c6-15f78cc03028 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:39.489885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.503374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec93c5ab-5f09-4d94-8c18-101430d2948e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=517f7475-4f92-4baf-abf3-da24a988d779,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.519806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.541833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, c08818cc-8e35-4c79-a6c9-74c2608ef7e6) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:39.546540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:39.547060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.551996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::2903:2c4a:280f:577a (b10e20e9-e25a-4832-bd50-e158aa6d5da9/e706d5bb-3762-4326-8986-774b1aaab6da/2dfc8537-16e5-4887-9cf9-489d02451b20) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:39.602847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.621407 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bcee5d71-75f8-410a-9f1e-e087d8e988f5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 2.7238305 Nov 05 14:48:39.624923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.632843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42814) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.641472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-649365739', 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:39.655945 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c622e2d4-f35e-4531-b63e-ae74ed2aa48e tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4538 time: 0.1850901 Nov 05 14:48:39.669033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 41cf805a-e57a-4fde-b138-22847feba6b2 is not hosted by any dhcp agent {{(pid=113581) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 05 14:48:39.672397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42816) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.674416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:39.674997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.676811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "PUT /v2.0/networks/41cf805a-e57a-4fde-b138-22847feba6b2 HTTP/1.1" status: 200 len: 723 time: 0.9248967 Nov 05 14:48:39.686640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42818) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.701294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 711c5642-fb28-4fa7-a9c6-15f78cc03028, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=711c5642-fb28-4fa7-a9c6-15f78cc03028,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:39.701666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.714535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '41cf805a-e57a-4fde-b138-22847feba6b2', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:39.718838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.772340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event deleted for resources: {'Port': ['ID=4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.780108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a36bde-f834-4952-ab5b-cdd3e8714113 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=41cf805a-e57a-4fde-b138-22847feba6b2,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.794423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 41cf805a-e57a-4fde-b138-22847feba6b2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:39.825825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 711c5642-fb28-4fa7-a9c6-15f78cc03028 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:39.835099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Made reservation on behalf of b797ddb0bdfc4d42860490426465674e for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:39.837494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.845253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.880407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.883771 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7bc444f5-8b27-4eab-83ca-57e93515b35a tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/ports/4ae9ffd8-52cf-4f85-b8c2-4883d4d6010d HTTP/1.1" status: 204 len: 168 time: 1.7098572 Nov 05 14:48:39.885225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=85779a9a-b126-4421-9e17-0b73e75facb1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:39.887514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42820) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.898665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.901803 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf81683d-ad91-4e4a-9cb5-cb1204cbd4ce tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/85779a9a-b126-4421-9e17-0b73e75facb1 HTTP/1.1" status: 204 len: 168 time: 1.2504809 Nov 05 14:48:39.915596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42822) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:39.948383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Deleting subnet cd57bf86-8d2e-4939-b60e-8b8752eaf6e5 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:39.952273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:39.956817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] device_id is not set on port 8f33357e-d526-4617-ac0f-6a5c50bf2871 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:39.993830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.094174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.102040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.153927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8ef94c94-0a58-442f-8680-1e3888860263 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:40.167143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:40.170731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.179145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.210534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event deleted for resources: {'Subnet': ['ID=cd57bf86-8d2e-4939-b60e-8b8752eaf6e5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.213586 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-621110'] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.217036 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-637f4286-06ad-44fb-9e05-95c494d20246 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/subnets/cd57bf86-8d2e-4939-b60e-8b8752eaf6e5 HTTP/1.1" status: 204 len: 168 time: 0.3267565 Nov 05 14:48:40.219494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42824) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:40.230493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 8ef94c94-0a58-442f-8680-1e3888860263 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:40.230868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.242602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.246229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.261954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.314780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.326376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.375067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Deleting port 68e2b805-6a5e-4cb5-861f-d93e4f139289 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:40.375402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.379715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 8ef94c94-0a58-442f-8680-1e3888860263, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8ef94c94-0a58-442f-8680-1e3888860263,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:40.387119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af848407-6ac1-40cc-919b-c11cf40a5713 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:40.413215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.442926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 2001:db8::3e6 (c08818cc-8e35-4c79-a6c9-74c2608ef7e6/8eec5ce6-d5eb-4929-adc5-4286018c3a1a/8f33357e-d526-4617-ac0f-6a5c50bf2871) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:40.465982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] For port 68e2b805-6a5e-4cb5-861f-d93e4f139289, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68e2b805-6a5e-4cb5-861f-d93e4f139289,segment=NetworkSegment(b2e432e1-a1e7-4038-9d0e-ddfed0490bfc),segment_id=b2e432e1-a1e7-4038-9d0e-ddfed0490bfc)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:40.467038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.490176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a0ca2059-72b0-4022-b3b2-6e41896a1ef7 None None] Provisioning complete for port 8ef94c94-0a58-442f-8680-1e3888860263 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:40.490551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a0ca2059-72b0-4022-b3b2-6e41896a1ef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.498070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Calling delete_port for 68e2b805-6a5e-4cb5-861f-d93e4f139289 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:40.508449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=8ef94c94-0a58-442f-8680-1e3888860263,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.508635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.511080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.515211 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/b58e69b8-c415-4f77-bbe7-6ac6db674515 HTTP/1.1" status: 204 len: 168 time: 0.8389127 Nov 05 14:48:40.515376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42826) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:40.587937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.589851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987538a5-5190-4929-9009-eda5201779ed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b58e69b8-c415-4f77-bbe7-6ac6db674515,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.620862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af848407-6ac1-40cc-919b-c11cf40a5713 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:40.628585 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e1478f4a-532e-4e8a-a044-851ae52b714d tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1081548 Nov 05 14:48:40.629672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42828) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:40.635601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--2064011781'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:40.680243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.684192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.719186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event deleted for resources: {'Port': ['ID=68e2b805-6a5e-4cb5-861f-d93e4f139289,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.726231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] No DVR routers for this DVR port 68e2b805-6a5e-4cb5-861f-d93e4f139289 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:40.732712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.748613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:40.783244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=2dfc8537-16e5-4887-9cf9-489d02451b20,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.785856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:40.802980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:40.808904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:40.809729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.815452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:40.815848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.833790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.865201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86b0fe83-8f1f-4f5a-96f1-49f97741c68b']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:40.883288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:40.883626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b2e432e1-a1e7-4038-9d0e-ddfed0490bfc') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:40.889572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=711c5642-fb28-4fa7-a9c6-15f78cc03028,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:40.897080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.901293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.909400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.933584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.935134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.952660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:40.953098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.958615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:40.960515 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3291838 Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:40.960784 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:40.965801 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a7bcc2c7-5435-4ab2-b3b5-a8ee58b9e83c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 2.6990614 Nov 05 14:48:40.975920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42830) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:40.976265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42832) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:41.010360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84a0e5b6-f4b1-453e-a451-1107f067698f tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be250283-c348-4bec-a0e4-86c64fe54aab,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:41.014470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e07b539e-efa9-476b-8c78-cb3b232efbed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'be250283-c348-4bec-a0e4-86c64fe54aab', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:41.033350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.043362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.046788 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] 10.222.0.30 "DELETE /v2.0/networks/86b0fe83-8f1f-4f5a-96f1-49f97741c68b HTTP/1.1" status: 204 len: 168 time: 0.8261306 Nov 05 14:48:41.059081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7b4f1c-d4f5-4a1a-81a4-e85523350190 tempest-TagsExtTest-499669418 tempest-TagsExtTest-499669418-project] Pushing event deleted for resources: {'Network': ['ID=86b0fe83-8f1f-4f5a-96f1-49f97741c68b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:41.130250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,segment=NetworkSegment(3b75bc18-ba3b-407f-bd29-b86e8d4ed81e),segment_id=3b75bc18-ba3b-407f-bd29-b86e8d4ed81e)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:41.130623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.135217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.156602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=3a9ea4f6-8003-4844-b87a-685a48d7d64d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:41.201990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:41.347662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42838) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:41.499250 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-59f68317-5c06-4ddd-a57a-b0f32bddbb41 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9bd96d5f582546bbb7c280fd62f1e4c1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1498575 Nov 05 14:48:41.504820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42842) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:41.516670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f976a60-b2e3-4905-842f-3df4cbbc4910 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:41.573219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.583323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd125e60-e551-470c-80e0-725328866cdf None None] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:41.590166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53dd5b9a-5551-4e38-b57c-38b9431459a2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:41.596233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53dd5b9a-5551-4e38-b57c-38b9431459a2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:41.598671 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-53dd5b9a-5551-4e38-b57c-38b9431459a2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1687 time: 0.6202006 Nov 05 14:48:41.602028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42844) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:41.605706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.676043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Provisioning complete for port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:41.676370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.685505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8f976a60-b2e3-4905-842f-3df4cbbc4910 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:41.714817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:41.751041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-bd125e60-e551-470c-80e0-725328866cdf None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:41.751512 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:41.754191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.757840 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4ee06c66-8093-4d91-9b78-74d45807fa2d HTTP/1.1" status: 204 len: 168 time: 0.2457926 Nov 05 14:48:41.762449 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-e07b539e-efa9-476b-8c78-cb3b232efbed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:41.764928 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e07b539e-efa9-476b-8c78-cb3b232efbed tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.7872701 Nov 05 14:48:41.771190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 2dfc8537-16e5-4887-9cf9-489d02451b20 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:41.771532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:41.772944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': 'af29999c-50fe-4137-9f8f-46dfb394f153', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '41cf805a-e57a-4fde-b138-22847feba6b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:41.773312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 41cf805a-e57a-4fde-b138-22847feba6b2, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:41.774411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42848) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:41.797423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db4e3a0-b11f-41e8-bdc4-9e0c949e8570 None None] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:41.819428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-996bc7cf-bc6f-4624-885c-e0f73fb7c197 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group_rule': {'security_group_id': 'be250283-c348-4bec-a0e4-86c64fe54aab', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:41.829756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9427e161-3275-4fc8-9b42-9d32570ced10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ee06c66-8093-4d91-9b78-74d45807fa2d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:41.868566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edcd00e8-5f83-4551-b2b1-7d66c28aad3d None None] Network 57c279b6-6a29-4127-9498-31345cf36f07 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:41.960213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 41cf805a-e57a-4fde-b138-22847feba6b2 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:41.983470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 41cf805a-e57a-4fde-b138-22847feba6b2) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:41.998338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:42.002444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.011811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-996bc7cf-bc6f-4624-885c-e0f73fb7c197 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:42.013708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-996bc7cf-bc6f-4624-885c-e0f73fb7c197 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.2241929 Nov 05 14:48:42.021690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5944b9dc-ad9b-4410-8b39-b1b1aea8c5c5 None None] Network 41cf805a-e57a-4fde-b138-22847feba6b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:42.028050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42850) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.075551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.126091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.150339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 2dfc8537-16e5-4887-9cf9-489d02451b20 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:42.204022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Could not find standard attr ID for object 186724d5-f667-48e4-990e-8cfe43ab5e26. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:42.313414 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-44a9b8e8-2683-4b52-9ed4-8108187943a5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6166663 Nov 05 14:48:42.314518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.318896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42852) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.328178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.339574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:42.347913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:42.361164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2db4e3a0-b11f-41e8-bdc4-9e0c949e8570 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:42.362149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:42.368507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:42.376539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:42.377759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:42.379110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5944b9dc-ad9b-4410-8b39-b1b1aea8c5c5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:42.398776 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:42.403893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8ef94c94-0a58-442f-8680-1e3888860263 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:42.410204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Provisioning complete for port 8ef94c94-0a58-442f-8680-1e3888860263 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:42.410482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.428093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=8f33357e-d526-4617-ac0f-6a5c50bf2871,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:42.438902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68c69ce2-accc-4841-b567-121ec3d187c4 None None] Network 41cf805a-e57a-4fde-b138-22847feba6b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:42.454960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.504184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:42.509125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7dd2a752-b9eb-437f-a113-7817567a57cf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 2.8731086 Nov 05 14:48:42.509125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=7d17f9e1-7324-4239-9a4f-9d60b9c038c1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:42.512743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42854) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.541620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bdbcb98-7c31-4f38-9331-f17fedc2f24b None None] DHCP port deletion for 86b0fe83-8f1f-4f5a-96f1-49f97741c68b request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:42.547924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.569645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9931214'] for subnet, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.583311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['57c279b6-6a29-4127-9498-31345cf36f07']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:42.622989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.626454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.631134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/be250283-c348-4bec-a0e4-86c64fe54aab HTTP/1.1" status: 204 len: 168 time: 0.5987477 Nov 05 14:48:42.640872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42856) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.667228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db80dad0-5037-4122-97d6-d229cab16260 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be250283-c348-4bec-a0e4-86c64fe54aab,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:42.688035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:42.688342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3b75bc18-ba3b-407f-bd29-b86e8d4ed81e') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:42.713092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.739941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.750754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.762642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:42.769214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 614 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:42.770118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.781504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d610b920-6e8d-4b14-b9b7-f9aa6156a2ce tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2504702 Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:42.782577 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:42.785275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42858) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.788440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:42.795005 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3506b266-274f-46ae-9ef4-f3ff555e6eca tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.1460142 Nov 05 14:48:42.799659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=2dfc8537-16e5-4887-9cf9-489d02451b20,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-68c69ce2-accc-4841-b567-121ec3d187c4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:42.801252 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:42.802188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42860) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.815063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'tempest-secgroup--1508706478'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:42.828497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 8ef94c94-0a58-442f-8680-1e3888860263 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:42.828873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.857782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:42.858440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:42.868115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.869385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Deleting port 8f33357e-d526-4617-ac0f-6a5c50bf2871 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:42.869733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.875280 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a453b360-8c3e-4974-b3bf-9b92a078bf34 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/2dfc8537-16e5-4887-9cf9-489d02451b20 HTTP/1.1" status: 204 len: 168 time: 1.2722378 Nov 05 14:48:42.878804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42862) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.941722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.949303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.951067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:42.953277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/57c279b6-6a29-4127-9498-31345cf36f07 HTTP/1.1" status: 204 len: 168 time: 3.0354242 Nov 05 14:48:42.953940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a0a26430-b403-4990-b551-d8a12428631e None None] Could not find standard attr ID for object 2dfc8537-16e5-4887-9cf9-489d02451b20. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:42.968134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42864) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:42.980764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-2040048477'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:43.003112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfa0f8c9-1bde-4be1-a83e-485520542e55 None None] DHCP port deletion for 57c279b6-6a29-4127-9498-31345cf36f07 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:43.005769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-9638471'] for subnet, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.007655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 0408f5e3-09a3-44a0-8caa-8475b072368f {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:43.021599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:43.023146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.026905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4fb8244-3e48-4843-83f6-cd41a8be9d9c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=57c279b6-6a29-4127-9498-31345cf36f07,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.054842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f52afb65-944d-4d3e-bba2-233d6bb25c92 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:43.056797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f52afb65-944d-4d3e-bba2-233d6bb25c92 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:43.061437 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f52afb65-944d-4d3e-bba2-233d6bb25c92 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1798568 Nov 05 14:48:43.061576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42866) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.075280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:43.076307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.080571 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "PUT /v2.0/subnets/3a9ea4f6-8003-4844-b87a-685a48d7d64d HTTP/1.1" status: 200 len: 806 time: 0.7570217 Nov 05 14:48:43.083985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42868) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.134603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d06e477-378d-4c87-a96b-5957db240db7 None None] Network 41cf805a-e57a-4fde-b138-22847feba6b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:43.161680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f38c6b-6ae1-4ee3-9c6a-a9a6c4a7d79e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=3a9ea4f6-8003-4844-b87a-685a48d7d64d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.168161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0cda5d19-658d-44eb-93ae-4b11ece54d12 None None] Could not find standard attr ID for object 2dfc8537-16e5-4887-9cf9-489d02451b20. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:43.194197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.239587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.246860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.250023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.254990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet e706d5bb-3762-4326-8986-774b1aaab6da {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:43.258171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.259922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.285591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:43.289830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.293879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event updated for resources: {'SecurityGroup': ['ID=68ed4861-4e37-4b64-9f75-08a824f59fea,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.298467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.302872 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f9a92b3c-e9dc-41c4-933f-927a63d99614 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.4951460 Nov 05 14:48:43.304980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42870) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.309653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3a36c725-13d4-4245-b862-34e9048fa7d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Request body: {'security_group': {'name': 'default'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:43.310251 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-3a36c725-13d4-4245-b862-34e9048fa7d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 05 14:48:43.310793 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-3a36c725-13d4-4245-b862-34e9048fa7d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] update failed (client error): There was a conflict when trying to complete your request. Nov 05 14:48:43.313767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Calling delete_port for 8f33357e-d526-4617-ac0f-6a5c50bf2871 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:43.315134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a36c725-13d4-4245-b862-34e9048fa7d1 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "PUT /v2.0/security-groups/68ed4861-4e37-4b64-9f75-08a824f59fea HTTP/1.1" status: 409 len: 330 time: 0.0087941 Nov 05 14:48:43.315929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42872) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8d06e477-378d-4c87-a96b-5957db240db7 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:43.353278 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:43.383777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.386406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18c89f3c-f66f-4417-b5a6-83c65dbc561f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:43.391765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.413586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 633} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:43.444170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.470479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.517707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.521446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.526822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.527320 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment 0e9e85c7-2ef9-485b-82ff-07d30935b057 of type vlan for network 0fd8a209-139c-4879-af4b-8c70d7c19cda Nov 05 14:48:43.528807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:40Z', 'revision_number': 9, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:43.563441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:43.568280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=3a9ea4f6-8003-4844-b87a-685a48d7d64d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.583218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18c89f3c-f66f-4417-b5a6-83c65dbc561f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:43.585098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:43.585716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:43.619676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.623041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.644219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.667451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41cf805a-e57a-4fde-b138-22847feba6b2']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:43.677097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af29999c-50fe-4137-9f8f-46dfb394f153') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:43.677449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af29999c-50fe-4137-9f8f-46dfb394f153') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:43.687121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.689430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.693088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=0408f5e3-09a3-44a0-8caa-8475b072368f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.701773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.708522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:43.708773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.734336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.738371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:43.740765 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d95c4472-5959-424b-85d7-01f5dde357a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/0408f5e3-09a3-44a0-8caa-8475b072368f HTTP/1.1" status: 204 len: 168 time: 0.9445262 Nov 05 14:48:43.741376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42874) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:43.766736 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:43.791285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.800946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.805496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/41cf805a-e57a-4fde-b138-22847feba6b2 HTTP/1.1" status: 204 len: 168 time: 0.7176421 Nov 05 14:48:43.808389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42876) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.814084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.819579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.820749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:43.821343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.822123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.825922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/68ed4861-4e37-4b64-9f75-08a824f59fea HTTP/1.1" status: 204 len: 168 time: 0.5062480 Nov 05 14:48:43.834158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.839132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42878) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.857522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d62285-269e-4811-a05e-2a730855605b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=41cf805a-e57a-4fde-b138-22847feba6b2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.862148 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-fbacb7e7-0d5f-4037-91bf-84d2c4fc9c23 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:43.863351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fbacb7e7-0d5f-4037-91bf-84d2c4fc9c23 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:43.870245 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fbacb7e7-0d5f-4037-91bf-84d2c4fc9c23 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/41cf805a-e57a-4fde-b138-22847feba6b2 HTTP/1.1" status: 404 len: 339 time: 0.0572677 Nov 05 14:48:43.874892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a18fa3bb-64f4-4d12-9320-32ba83464593 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=68ed4861-4e37-4b64-9f75-08a824f59fea,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.878185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42880) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.891626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1178805497', 'description': 'd1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:43.938270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9641838 Nov 05 14:48:43.939380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Port': ['ID=8f33357e-d526-4617-ac0f-6a5c50bf2871,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:43.941831 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a3fb9b23-fa22-471c-b408-105646abd8c2 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2996 time: 0.0941231 Nov 05 14:48:43.942489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.942823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42884) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:43.957267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:43.964620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:43.967103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.969771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.992811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:43.996332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ca43ed4a-8e56-4dba-ada8-4662ef130eaa tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/ports/8f33357e-d526-4617-ac0f-6a5c50bf2871 HTTP/1.1" status: 204 len: 168 time: 1.4826512 Nov 05 14:48:44.000261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42886) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.005845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6', 'external_fixed_ips': [{'subnet_id': '8eec5ce6-d5eb-4929-adc5-4286018c3a1a', 'ip_address': '2001:db8::3e6'}]}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:44.010441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.016451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d188e5f6-f373-4f87-b369-af14bfc56120 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=0fd8a209-139c-4879-af4b-8c70d7c19cda,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:44.031317 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-7e0137fc-6128-4f9c-9a8d-5ec6ca1fe9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] delete failed (client error): The resource could not be found. Nov 05 14:48:44.035994 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7e0137fc-6128-4f9c-9a8d-5ec6ca1fe9d8 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "DELETE /v2.0/security-groups/08d04fa0-86c8-4c81-9fd8-7d3953986e5d HTTP/1.1" status: 404 len: 347 time: 0.0869327 Nov 05 14:48:44.037497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42888) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.050536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=e706d5bb-3762-4326-8986-774b1aaab6da,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:44.068877 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-fb44e252-cbb7-4f92-a7a3-9564263f392c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] show failed (client error): The resource could not be found. Nov 05 14:48:44.069929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fb44e252-cbb7-4f92-a7a3-9564263f392c tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-groups/d5593abb-3769-42d4-95da-64207e4f57e4 HTTP/1.1" status: 404 len: 347 time: 0.0326076 Nov 05 14:48:44.075539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42890) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.078710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.083578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-223a2c69-452f-4df9-9eae-3cd52a87db53 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/e706d5bb-3762-4326-8986-774b1aaab6da HTTP/1.1" status: 204 len: 168 time: 1.0153921 Nov 05 14:48:44.087189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:44.089814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42892) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.090838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:44.105998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.106355 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 82cf0ae8-7f6f-4a6f-b69d-ec8f07ec5dcf of type vlan for network 6aa64f9a-ae56-45db-b47d-8ec48c7b79dd Nov 05 14:48:44.143552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.144979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.151617 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4f3bc67d-deb1-4062-808f-584c452f1366 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0575182 Nov 05 14:48:44.154301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42894) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.163418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-09f8f5da-2c44-4c6a-b21a-bd3872a1ab55 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] show failed (client error): The resource could not be found. Nov 05 14:48:44.164500 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-09f8f5da-2c44-4c6a-b21a-bd3872a1ab55 tempest-NegativeSecGroupIPv6Test-643978064 tempest-NegativeSecGroupIPv6Test-643978064-project] 10.222.0.30 "GET /v2.0/security-group-rules/e0d137af-bc86-40dd-8e0e-b4ae3a1916c3 HTTP/1.1" status: 404 len: 356 time: 0.0501442 Nov 05 14:48:44.193075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.221549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:44.221929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:44.225316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.231993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ca6bf5c-8735-4832-a9b6-e5cc6bebe409 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:44.289421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.295412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:44.295715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7dbe44b-d11c-4166-a7b6-9c6abda90a3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:44.296130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.298377 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c7dbe44b-d11c-4166-a7b6-9c6abda90a3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1420295 Nov 05 14:48:44.299892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 90660ae6-0b86-4692-8397-89de23c5c0c1 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:44.300268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.303719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.304513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42898) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.309453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:44.309854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7d17f9e1-7324-4239-9a4f-9d60b9c038c1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:44.310373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68e2b805-6a5e-4cb5-861f-d93e4f139289 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:44.360525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 68e2b805-6a5e-4cb5-861f-d93e4f139289 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:44.360962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68e2b805-6a5e-4cb5-861f-d93e4f139289 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:44.405380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:40Z', 'revision_number': 9, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:44.436811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 0.5575249 Nov 05 14:48:44.444976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42902) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.450625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d4382875-c41f-4b2c-9a38-c7ea010a5b22 None None] Provisioning complete for port 8ef94c94-0a58-442f-8680-1e3888860263 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:44.450806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d4382875-c41f-4b2c-9a38-c7ea010a5b22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.457551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8df4fca6-367d-4f9a-9489-f586999695b6 None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:40Z', 'revision_number': 9, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'd34e9d04-9129-4153-8e65-c2625f1d8dab', 'name': '', 'network_id': '86b74c83-f53f-4a3a-9f3f-2e22dd8234dc', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:b1:87:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 710, 'fixed_ips': [{'subnet_id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:54Z', 'updated_at': '2021-11-05T14:48:00Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': '9982b8d7-8946-4c79-ab2e-d9340565a4f3', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:44.472257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43ed6242-804e-44a3-9b86-83333256627d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:44.477090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-43ed6242-804e-44a3-9b86-83333256627d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1680155 Nov 05 14:48:44.478428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1755920-55dd-40e2-9fc7-4fad7151d96b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=6aa64f9a-ae56-45db-b47d-8ec48c7b79dd,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:44.488892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.497323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 6aa64f9a-ae56-45db-b47d-8ec48c7b79dd details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:44.577420 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6f52dc25-0e7e-4c7a-b597-a101ea2251fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0857582 Nov 05 14:48:44.578037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42906) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.583028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ca6bf5c-8735-4832-a9b6-e5cc6bebe409 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:44.587944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:44.594524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42908) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.605000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b90eef2-8583-44e2-8f8b-42a153c3b451 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:44.608915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b90eef2-8583-44e2-8f8b-42a153c3b451 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks?id=6aa64f9a-ae56-45db-b47d-8ec48c7b79dd HTTP/1.1" status: 200 len: 761 time: 0.1629398 Nov 05 14:48:44.615488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42912) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:44.633254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'description': 'd2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:44.653571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 90660ae6-0b86-4692-8397-89de23c5c0c1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=90660ae6-0b86-4692-8397-89de23c5c0c1,segment=NetworkSegment(8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246),segment_id=8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:44.654149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.762780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 90660ae6-0b86-4692-8397-89de23c5c0c1 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:44.778753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.792041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:44.795519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.812067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:44.942129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=a56d5c9c-6ad1-46b6-81ff-d9a509668036,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:44.983674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0cd057f7-adf4-4e17-9ca7-74b545b087a5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=19cc9806746a4ff085411da966435f5e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3879597 Nov 05 14:48:44.986411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': '0e9e85c7-2ef9-485b-82ff-07d30935b057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:44.987036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: 0fd8a209-139c-4879-af4b-8c70d7c19cda, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:44.991240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42914) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:45.052832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:45.091158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0fd8a209-139c-4879-af4b-8c70d7c19cda) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:45.094078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-670acec7-d145-4680-b28f-70e953539db7 None None] Network 1fb97d8a-9f3b-438a-9a84-527e5990548d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:45.108715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:45.109554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.129827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.147451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baa19686-a2c3-498d-9b99-c01417f75dc8 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:45.150553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e890b501-5b66-4149-a96e-aa669912231c None None] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:45.175141 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3327bb7d-9ea6-490f-a35d-8808fc3e35a0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2308507 Nov 05 14:48:45.175852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42916) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:45.184426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda', 'name': 'tempest-PortsIpV6TestJSON-28512652', 'fixed_ips': [{'subnet_id': 'a56d5c9c-6ad1-46b6-81ff-d9a509668036', 'ip_address': '2001:db8::10'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:45.246512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.262798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.344385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e890b501-5b66-4149-a96e-aa669912231c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:45.350805 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:45.361244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:45.366712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.367181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=a768bb05-bb78-4925-8fda-9c0baf327757,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:45.372758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b9cc65-7ca1-4561-beee-b844fec1be4a None None] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:45.382917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:45.387507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:45.388354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.402684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=90660ae6-0b86-4692-8397-89de23c5c0c1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:45.409458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.430045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.432900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.434309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/95d9e0f2-42d7-4819-aadb-66478d3badce HTTP/1.1" status: 204 len: 168 time: 0.4397111 Nov 05 14:48:45.443163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:45.472575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a9dfe5-495b-4edc-85af-b285b611355e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95d9e0f2-42d7-4819-aadb-66478d3badce,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:45.487723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 6aa64f9a-ae56-45db-b47d-8ec48c7b79dd is not hosted by any dhcp agent {{(pid=113580) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 05 14:48:45.493112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b58a453a-e5bb-430f-8ef1-af62c6eab18a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9117663 Nov 05 14:48:45.493942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:45.494721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42920) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:45.494911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.495292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:45.501025 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "PUT /v2.0/networks/6aa64f9a-ae56-45db-b47d-8ec48c7b79dd HTTP/1.1" status: 200 len: 758 time: 0.8804035 Nov 05 14:48:45.516428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:45.517939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port 90660ae6-0b86-4692-8397-89de23c5c0c1 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:45.524843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-383e5f0f-61a0-47ac-a216-757411e5db3d None None] DHCP port deletion for 1fb97d8a-9f3b-438a-9a84-527e5990548d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-88b9cc65-7ca1-4561-beee-b844fec1be4a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:45.543644 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:45.547700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'a768bb05-bb78-4925-8fda-9c0baf327757', 'ip_address': '2001:db8::f2d:92e9:8152:bfc7'}], 'name': 'tempest-NetworksTestDHCPv6-1158668855'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:45.581835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Deleting port 8ef94c94-0a58-442f-8680-1e3888860263 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:45.582207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.679433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.692586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635d8317-3919-42b9-ac17-77222bcc9aff tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=6aa64f9a-ae56-45db-b47d-8ec48c7b79dd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:45.696048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] For port 8ef94c94-0a58-442f-8680-1e3888860263, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8ef94c94-0a58-442f-8680-1e3888860263,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:45.696576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.710361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Calling delete_port for 8ef94c94-0a58-442f-8680-1e3888860263 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:45.713436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 6aa64f9a-ae56-45db-b47d-8ec48c7b79dd details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:45.732589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:45.781368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:45.787300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.840905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19e35908-a9b5-465e-a57e-31601581c895 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:45.846554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-19e35908-a9b5-465e-a57e-31601581c895 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks?id=6aa64f9a-ae56-45db-b47d-8ec48c7b79dd HTTP/1.1" status: 200 len: 761 time: 0.3258495 Nov 05 14:48:45.846767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42930) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:45.852100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1fb97d8a-9f3b-438a-9a84-527e5990548d']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:45.862296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-307725138'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:45.868972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:45.869343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8a3fdd89-b2ed-4d6f-99e2-7546d8f2b246') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:45.883879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.886442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.907093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.915907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.929213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.944676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] Pushing event deleted for resources: {'Port': ['ID=8ef94c94-0a58-442f-8680-1e3888860263,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:45.953482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fad027ad-84de-4e70-8cc9-7c5d07945a60 None None] No DVR routers for this DVR port 8ef94c94-0a58-442f-8680-1e3888860263 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:45.961234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:45.966087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.976321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ad0802e-1d11-4ae5-b76f-fc030112f15f None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:45.992909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 618 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:45.993312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:45.996608 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:45.999777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.086869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port e4b43ad4-9025-4e60-8b0d-925df9b5185f yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:46.092277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6ad0802e-1d11-4ae5-b76f-fc030112f15f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:46.111722 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:46.122581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-169000b6-86f9-4d1b-b5b6-bc73b1d41bca None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:46.127224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::10 (0fd8a209-139c-4879-af4b-8c70d7c19cda/a56d5c9c-6ad1-46b6-81ff-d9a509668036/7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:46.140222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.163266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.170908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.171252 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 934fde34-3f6c-4554-af13-cb5fe22b3cc7 of type vlan for network 899fb5b0-b250-4010-9901-de7d213987b3 Nov 05 14:48:46.171573 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/1fb97d8a-9f3b-438a-9a84-527e5990548d HTTP/1.1" status: 204 len: 168 time: 2.4239035 Nov 05 14:48:46.175966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42936) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:46.186316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 90660ae6-0b86-4692-8397-89de23c5c0c1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:46.214878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 90660ae6-0b86-4692-8397-89de23c5c0c1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:46.215482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 90660ae6-0b86-4692-8397-89de23c5c0c1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:46.215650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 711c5642-fb28-4fa7-a9c6-15f78cc03028 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:46.257147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 711c5642-fb28-4fa7-a9c6-15f78cc03028 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:46.257532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 711c5642-fb28-4fa7-a9c6-15f78cc03028 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:46.257959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8ef94c94-0a58-442f-8680-1e3888860263 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:46.267288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be0212a6-c62f-4174-a24f-0e6e0da86514 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=1fb97d8a-9f3b-438a-9a84-527e5990548d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:46.290962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 8ef94c94-0a58-442f-8680-1e3888860263 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:46.291313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8ef94c94-0a58-442f-8680-1e3888860263 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:46.407419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 2001:db8::3e6 (c08818cc-8e35-4c79-a6c9-74c2608ef7e6/8eec5ce6-d5eb-4929-adc5-4286018c3a1a/cfc6399e-50e8-478e-8d83-921e806c0725) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:46.416303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-169000b6-86f9-4d1b-b5b6-bc73b1d41bca None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:46.544554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42946) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:46.613362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.615659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.713588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7c7c1dbc-18a0-4af2-885c-8efd81ed77f3 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-502378214', 'prefixes': ['172.20.0.0/16']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:46.720387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0fd8a209-139c-4879-af4b-8c70d7c19cda', 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': 'a56d5c9c-6ad1-46b6-81ff-d9a509668036'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:46.721508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.722438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.738924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': 'a768bb05-bb78-4925-8fda-9c0baf327757'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:46.739950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.750971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.756491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:46.757322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.791510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=cfc6399e-50e8-478e-8d83-921e806c0725,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:46.803287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:46.812446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:46.825081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:46.843710 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.9918063 Nov 05 14:48:46.847773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f2d:92e9:8152:bfc7 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/a768bb05-bb78-4925-8fda-9c0baf327757/e4b43ad4-9025-4e60-8b0d-925df9b5185f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:46.864354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42950) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:46.874547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': '899fb5b0-b250-4010-9901-de7d213987b3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:46.900579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d8ff76d-df87-4d39-8449-98bae2be869a tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=899fb5b0-b250-4010-9901-de7d213987b3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:46.905376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:46.917114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 899fb5b0-b250-4010-9901-de7d213987b3 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:47.004698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.009179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7c1dbc-18a0-4af2-885c-8efd81ed77f3 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] Publish callbacks [] for subnetpool, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.010379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c7c1dbc-18a0-4af2-885c-8efd81ed77f3 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 736 time: 0.4644465 Nov 05 14:48:47.015434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42952) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.113767 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f16e69b6-cf6c-479e-a172-423f64451a68 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "GET /v2.0/subnetpools/2bfce80e-3069-44ff-80e4-8858926351ca HTTP/1.1" status: 200 len: 731 time: 0.0928490 Nov 05 14:48:47.117891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42954) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.126745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-740e3d58-04ff-4acc-86c2-3e1b0c6a9de4 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-1106008521'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:47.134537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:47.137893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.197050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.209941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.222437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Allocated IP 2001:db8::2 (0fd8a209-139c-4879-af4b-8c70d7c19cda/a56d5c9c-6ad1-46b6-81ff-d9a509668036/a4e00959-a9a0-49a7-9b7c-3345e0dd02f0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:47.352786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:47.359808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.369770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:47.371724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:47.374051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:47.380230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:47.380908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.396507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.401954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port d34e9d04-9129-4153-8e65-c2625f1d8dab {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:47.402264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.405272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.410658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-740e3d58-04ff-4acc-86c2-3e1b0c6a9de4 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] Publish callbacks [] for subnetpool, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.414398 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-740e3d58-04ff-4acc-86c2-3e1b0c6a9de4 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "PUT /v2.0/subnetpools/2bfce80e-3069-44ff-80e4-8858926351ca HTTP/1.1" status: 200 len: 684 time: 0.2910786 Nov 05 14:48:47.415558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42956) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.436821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-378ea568-686f-4abc-be60-2a2aca4b370e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 2.2562671 Nov 05 14:48:47.443370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42958) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.454579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda', 'name': 'tempest-PortsIpV6TestJSON-56196781', 'fixed_ips': [{'subnet_id': 'a56d5c9c-6ad1-46b6-81ff-d9a509668036', 'ip_address': '2001:db8::f'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:47.455313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:47.458429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:47.463168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:47.466480 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Pushing event updated for resources: {'Port': ['ID=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:47.533591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.567014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Attempting to bind port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:47.567535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Attempting to bind port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '0e9e85c7-2ef9-485b-82ff-07d30935b057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:47.567993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Attempting to bind port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 on network 0fd8a209-139c-4879-af4b-8c70d7c19cda {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:47.576192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.578183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:47.578666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Checking segment: {'id': '0e9e85c7-2ef9-485b-82ff-07d30935b057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:47.579158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.579643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Bound using segment: {'id': '0e9e85c7-2ef9-485b-82ff-07d30935b057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:47.580231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Bound port: a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e9e85c7-2ef9-485b-82ff-07d30935b057', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '0fd8a209-139c-4879-af4b-8c70d7c19cda'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:47.580808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.605988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/a768bb05-bb78-4925-8fda-9c0baf327757/812cb9a1-7299-4389-992c-e158c9ab11b8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:47.626878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:47.629941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c2dc7e8a-d29a-4854-a31c-9c9ab6cb1876 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] Publish callbacks [] for subnetpool, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.633660 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c2dc7e8a-d29a-4854-a31c-9c9ab6cb1876 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "DELETE /v2.0/subnetpools/2bfce80e-3069-44ff-80e4-8858926351ca HTTP/1.1" status: 204 len: 168 time: 0.2146316 Nov 05 14:48:47.637740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42960) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.641666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:47.653256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:47.659188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:47.660059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.671872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.685983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=e4b43ad4-9025-4e60-8b0d-925df9b5185f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:47.688604 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-7210d0dd-8dd4-4d8c-9dc6-33ac3d784760 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] show failed (client error): The resource could not be found. Nov 05 14:48:47.692341 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7210d0dd-8dd4-4d8c-9dc6-33ac3d784760 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "GET /v2.0/subnetpools/2bfce80e-3069-44ff-80e4-8858926351ca HTTP/1.1" status: 404 len: 346 time: 0.0494061 Nov 05 14:48:47.714217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42962) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.722457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] For port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:47.745802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] For port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,segment=NetworkSegment(0e9e85c7-2ef9-485b-82ff-07d30935b057),segment_id=0e9e85c7-2ef9-485b-82ff-07d30935b057)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:47.746098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2eb0fea7-0332-49e4-aa79-a2296439f382 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.2009356 Nov 05 14:48:47.748449 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-171a17be-e80f-4be6-942c-c8c92666c801 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] delete failed (client error): The resource could not be found. Nov 05 14:48:47.755637 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-171a17be-e80f-4be6-942c-c8c92666c801 tempest-SubnetPoolsTestJSON-1158963593 tempest-SubnetPoolsTestJSON-1158963593-project] 10.222.0.30 "DELETE /v2.0/subnetpools/2bfce80e-3069-44ff-80e4-8858926351ca HTTP/1.1" status: 404 len: 346 time: 0.0354047 Nov 05 14:48:47.755637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42964) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:47.762638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'a768bb05-bb78-4925-8fda-9c0baf327757', 'ip_address': '2001:db8::f2d:92e9:8152:bfc7'}], 'name': 'tempest-NetworksTestDHCPv6-934768716'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:47.763957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.782490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=72b0642a-5468-4ccf-b702-6925a3868b6b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:47.838157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1081fc1e-30c2-4c5a-b9c7-9112a40a1903 None None] Pushing event updated for resources: {'Port': ['ID=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:47.847829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': '934fde34-3f6c-4554-af13-cb5fe22b3cc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '899fb5b0-b250-4010-9901-de7d213987b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:47.847829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: 899fb5b0-b250-4010-9901-de7d213987b3, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:47.911194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network 899fb5b0-b250-4010-9901-de7d213987b3 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:47.928178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 899fb5b0-b250-4010-9901-de7d213987b3) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:47.935958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:47.936800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.975790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port d34e9d04-9129-4153-8e65-c2625f1d8dab, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d34e9d04-9129-4153-8e65-c2625f1d8dab,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:47.976170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.976551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:47.990549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.990959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.998633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:47.999967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for d34e9d04-9129-4153-8e65-c2625f1d8dab owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:48.001672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7b47ddde-66fa-46ff-becc-58cb41f78378 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1348696 Nov 05 14:48:48.009283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42968) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:48.048148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 18399f03-b15b-44b1-8d1a-002a31b65c29 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:48.053956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:48.067285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:48.073763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:48.077317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:48.186871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Attempting to bind port 812cb9a1-7299-4389-992c-e158c9ab11b8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:48.187236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Attempting to bind port 812cb9a1-7299-4389-992c-e158c9ab11b8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:48.187596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Attempting to bind port 812cb9a1-7299-4389-992c-e158c9ab11b8 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:48.191425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.195526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:48.195896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:48.196297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.196957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:48.197723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Bound port: 812cb9a1-7299-4389-992c-e158c9ab11b8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:48.198601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.246501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42972) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:48.274537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:48.277851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:48.284067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.303381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.311930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:48.364405 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): There was a conflict when trying to complete your request. Nov 05 14:48:48.365151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:48.387068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d781f2-40ec-4c2e-b690-afd6cf1daac4 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:48.398167 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20dd530f-a8e6-4fde-9f7d-4b9702bfa26c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 409 len: 388 time: 0.6434903 Nov 05 14:48:48.401107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42976) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:48.455110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-134c4e59-f4c3-496b-ac2a-23670442633f admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.466005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.493330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39c90525-db6e-47f0-9089-43d4b6a98a00 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:48.500867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39c90525-db6e-47f0-9089-43d4b6a98a00 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:48.505332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-39c90525-db6e-47f0-9089-43d4b6a98a00 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.1003408 Nov 05 14:48:48.506572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42978) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:48.547273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 76b399ca-85e9-4df4-8e81-f616b76b52c3 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:48.560206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.650743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router ca4eba97-ffbb-44b0-a588-acfeac9244dc is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:48:48.679123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port e4b43ad4-9025-4e60-8b0d-925df9b5185f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:48.679455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.736324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-134c4e59-f4c3-496b-ac2a-23670442633f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.742259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-134c4e59-f4c3-496b-ac2a-23670442633f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.797531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134c4e59-f4c3-496b-ac2a-23670442633f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e106637-bf4a-4ccf-9287-8277c681aa8e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:48.807386 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-134c4e59-f4c3-496b-ac2a-23670442633f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=51eeeb5c3579420d8ea83173d6e7a4a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5590167 Nov 05 14:48:48.814106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42980) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:48.869286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.890384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for e4b43ad4-9025-4e60-8b0d-925df9b5185f owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:48.895903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.899425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.957920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.966087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:48.974955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::f (0fd8a209-139c-4879-af4b-8c70d7c19cda/a56d5c9c-6ad1-46b6-81ff-d9a509668036/76b399ca-85e9-4df4-8e81-f616b76b52c3) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:48.979580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=72b0642a-5468-4ccf-b702-6925a3868b6b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:49.022128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:49.035723 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Sync routers for ids ['ca4eba97-ffbb-44b0-a588-acfeac9244dc'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:49.053528 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Routers {'ca4eba97-ffbb-44b0-a588-acfeac9244dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:49.054449 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ca4eba97-ffbb-44b0-a588-acfeac9244dc'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:49.075461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.078374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.079274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=d34e9d04-9129-4153-8e65-c2625f1d8dab,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:49.083148 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2e106637-bf4a-4ccf-9287-8277c681aa8e HTTP/1.1" status: 204 len: 168 time: 0.2647588 Nov 05 14:48:49.123921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.126883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1f80f0-f879-45dd-bd96-62a39ee5e0a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e106637-bf4a-4ccf-9287-8277c681aa8e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:49.184994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=e4b43ad4-9025-4e60-8b0d-925df9b5185f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:49.190944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.200549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.204903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d0132a09-0af1-415e-8a8b-2f91c4ec358e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 5.2028337 Nov 05 14:48:49.211273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42984) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:49.223691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.228989 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-385c9ae1-6158-4d59-9a69-239b603f9a4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/e4b43ad4-9025-4e60-8b0d-925df9b5185f HTTP/1.1" status: 204 len: 168 time: 0.7210245 Nov 05 14:48:49.234933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 42986) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:49.289675 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Set router ca4eba97-ffbb-44b0-a588-acfeac9244dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:49.355403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] Provisioning complete for port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:49.356233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.454922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['899fb5b0-b250-4010-9901-de7d213987b3']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:49.503342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '934fde34-3f6c-4554-af13-cb5fe22b3cc7') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:49.504013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '934fde34-3f6c-4554-af13-cb5fe22b3cc7') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:49.518133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.566362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] For port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,segment=NetworkSegment(0e9e85c7-2ef9-485b-82ff-07d30935b057),segment_id=0e9e85c7-2ef9-485b-82ff-07d30935b057)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:49.572264 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca4eba97-ffbb-44b0-a588-acfeac9244dc', 'name': '', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6', 'external_fixed_ips': [{'subnet_id': '8eec5ce6-d5eb-4929-adc5-4286018c3a1a', 'ip_address': '2001:db8::3e6'}], 'enable_snat': True}, 'gw_port_id': 'cfc6399e-50e8-478e-8d83-921e806c0725', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:44Z', 'updated_at': '2021-11-05T14:48:47Z', 'revision_number': 3, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port': {'id': 'cfc6399e-50e8-478e-8d83-921e806c0725', 'name': '', 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:a4:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca4eba97-ffbb-44b0-a588-acfeac9244dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 876, 'fixed_ips': [{'subnet_id': '8eec5ce6-d5eb-4929-adc5-4286018c3a1a', 'ip_address': '2001:db8::3e6', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:45Z', 'updated_at': '2021-11-05T14:48:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '8eec5ce6-d5eb-4929-adc5-4286018c3a1a', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:49.572955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.602087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.604900 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Checking router: ca4eba97-ffbb-44b0-a588-acfeac9244dc for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:49.605234 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Updating router ca4eba97-ffbb-44b0-a588-acfeac9244dc port cfc6399e-50e8-478e-8d83-921e806c0725 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:48:49.634029 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.636888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3d0bf09-79c9-4f8c-911a-8edc9a25c1aa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:49.638514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3d0bf09-79c9-4f8c-911a-8edc9a25c1aa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:49.640157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a3d0bf09-79c9-4f8c-911a-8edc9a25c1aa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.3975198 Nov 05 14:48:49.642849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 42998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:49.653444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267bf647-41db-45d0-97ff-32969d00c7c0 None None] Pushing event updated for resources: {'Port': ['ID=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:49.745488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.749715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet a768bb05-bb78-4925-8fda-9c0baf327757 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:49.754641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.773947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:49.774346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:49.777515 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:49.797570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.800186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.828219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.828389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2ae48ce-c6e7-46f0-a29b-99451eebfe95 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:49.869131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.938170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:49.938632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:49.996371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.023755 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.031266 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.071021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.077870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.108735 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Attempting to bind port cfc6399e-50e8-478e-8d83-921e806c0725 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:50.109774 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Attempting to bind port cfc6399e-50e8-478e-8d83-921e806c0725 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:50.110298 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Attempting to bind port cfc6399e-50e8-478e-8d83-921e806c0725 on network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:50.114187 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9453deab-ce24-4bee-b648-18c43e261630 None None] Pushing event updated for resources: {'Port': ['ID=cfc6399e-50e8-478e-8d83-921e806c0725,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:50.121831 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:50.122540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Checking segment: {'id': '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:50.123857 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.124494 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Bound using segment: {'id': '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:50.125123 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Bound port: cfc6399e-50e8-478e-8d83-921e806c0725, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'c08818cc-8e35-4c79-a6c9-74c2608ef7e6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:50.125665 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.126064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2ae48ce-c6e7-46f0-a29b-99451eebfe95 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:50.162930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.174186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/899fb5b0-b250-4010-9901-de7d213987b3 HTTP/1.1" status: 204 len: 168 time: 2.1630228 Nov 05 14:48:50.183730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.185581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.189270 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/a768bb05-bb78-4925-8fda-9c0baf327757 HTTP/1.1" status: 204 len: 168 time: 0.5447817 Nov 05 14:48:50.190069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43008) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.194773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43010) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.205875 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] For port cfc6399e-50e8-478e-8d83-921e806c0725, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:50.206648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7db2cb-afbd-497e-b4a1-28959ec06ba1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=a768bb05-bb78-4925-8fda-9c0baf327757,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:50.210001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] For port cfc6399e-50e8-478e-8d83-921e806c0725, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cfc6399e-50e8-478e-8d83-921e806c0725,segment=NetworkSegment(7807b354-e4a5-4ee9-b60a-3ec7fd3c5904),segment_id=7807b354-e4a5-4ee9-b60a-3ec7fd3c5904)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:50.221186 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.238517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f1334e-a601-4b8e-8eff-016810f96e31 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=899fb5b0-b250-4010-9901-de7d213987b3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:50.246313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43012) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.298970 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-f1aecdb9-2859-4442-aa64-9833c3fa8f7e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] GET failed (client error): The resource could not be found. Nov 05 14:48:50.301228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f1aecdb9-2859-4442-aa64-9833c3fa8f7e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets/72b0642a-5468-4ccf-b702-6925a3868b6b HTTP/1.1" status: 404 len: 337 time: 0.1097591 Nov 05 14:48:50.301427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.310060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43016) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.323669 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9453deab-ce24-4bee-b648-18c43e261630 None None] Pushing event updated for resources: {'Port': ['ID=cfc6399e-50e8-478e-8d83-921e806c0725,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:50.356065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-acca4583-68cd-407e-a04f-8fa3de9be84b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1561921 Nov 05 14:48:50.356309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43018) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.371075 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Routers {'ca4eba97-ffbb-44b0-a588-acfeac9244dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:50.372226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:50.373003 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ca4eba97-ffbb-44b0-a588-acfeac9244dc'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:50.537858 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] Set router ca4eba97-ffbb-44b0-a588-acfeac9244dc gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:50.562017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc332f9b-5b53-48f2-b3da-2a5ad3cf0e0c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:48:50.562940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc332f9b-5b53-48f2-b3da-2a5ad3cf0e0c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:50.568695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc332f9b-5b53-48f2-b3da-2a5ad3cf0e0c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/899fb5b0-b250-4010-9901-de7d213987b3 HTTP/1.1" status: 404 len: 339 time: 0.2481627 Nov 05 14:48:50.571267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43020) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.589405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-321526178'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:50.639613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:50.666575 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca4eba97-ffbb-44b0-a588-acfeac9244dc', 'name': '', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:44Z', 'updated_at': '2021-11-05T14:48:50Z', 'revision_number': 4, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:50.713511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:50.715099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:50.718889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.726087 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a69922a-8f39-4760-8b4d-aaf9ae786f66 None None] The sync data for ids ['ca4eba97-ffbb-44b0-a588-acfeac9244dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'ca4eba97-ffbb-44b0-a588-acfeac9244dc', 'name': '', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:44Z', 'updated_at': '2021-11-05T14:48:50Z', 'revision_number': 4, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:50.728709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=76b399ca-85e9-4df4-8e81-f616b76b52c3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:50.731372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:50.779742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:50.786023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:50.786662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.798985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2bb6d677-2934-48cf-b9f1-a5e8dd2992d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.822832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.835442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Deleting port cfc6399e-50e8-478e-8d83-921e806c0725 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:50.835822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.892986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Made reservation on behalf of b0648b2d4fc34e9181135dd8ddc22100 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:50.897552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.915632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a5d64a0f-cc93-4c45-9c0e-9e98e398447f tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 3.4689436 Nov 05 14:48:50.918665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43022) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:50.919537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.954594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:50.955240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:50.969050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:51.019024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:51.034802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.059702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d50ffa4b-8552-4d8f-8b0d-0c152736bb0b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.067085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d50ffa4b-8552-4d8f-8b0d-0c152736bb0b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.069518 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d50ffa4b-8552-4d8f-8b0d-0c152736bb0b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 1391 time: 0.4968939 Nov 05 14:48:51.073523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43024) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.124267 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d5d71cf9-17e2-43f0-b0a0-69b72ec20245 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 207 time: 0.0466433 Nov 05 14:48:51.125572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43026) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.138691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Provisioning complete for port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:51.138691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.188236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32ead88-8773-40d2-9cc7-ce2d297b2408 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:51.310810 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.316805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.323987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.325664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:51.330088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.336442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.338250 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e5e00f4e-15ac-4257-913d-cb385488e30b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3094 time: 0.2123048 Nov 05 14:48:51.342314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43028) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.455574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.481731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:51.482110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.533923 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-98178ab4-c48a-4779-a330-bd4d50a81ad7 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 681 time: 0.1904848 Nov 05 14:48:51.537270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:51.541128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43030) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.555998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:51.563440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.564036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.603900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=3c98a3c2-b492-4ae7-9611-f92b792136c3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:51.628987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fac5ba90-40f2-4648-b4dc-835f2307776b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.2681293 Nov 05 14:48:51.629981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43032) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.634836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '3c98a3c2-b492-4ae7-9611-f92b792136c3', 'ip_address': '2001:db8:0:1::7'}], 'name': 'tempest-NetworksTestDHCPv6-382604810'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:51.670472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32e4fcd5-16d2-4d61-915f-33dca4b7bdc6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.673136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32e4fcd5-16d2-4d61-915f-33dca4b7bdc6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.674968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-32e4fcd5-16d2-4d61-915f-33dca4b7bdc6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.1324985 Nov 05 14:48:51.682473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43034) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.767187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-345bbd70-974c-40fa-8d64-b6ff17e731c0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.768919 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-345bbd70-974c-40fa-8d64-b6ff17e731c0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 926 time: 0.8470390 Nov 05 14:48:51.772550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43036) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.799489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] For port cfc6399e-50e8-478e-8d83-921e806c0725, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cfc6399e-50e8-478e-8d83-921e806c0725,segment=NetworkSegment(7807b354-e4a5-4ee9-b60a-3ec7fd3c5904),segment_id=7807b354-e4a5-4ee9-b60a-3ec7fd3c5904)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:51.799932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.840371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d963d5-63ca-4c13-8601-c864b0e680e3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.841906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d963d5-63ca-4c13-8601-c864b0e680e3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.847664 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-90d963d5-63ca-4c13-8601-c864b0e680e3 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.1622531 Nov 05 14:48:51.855757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43038) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:51.872174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.873249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Calling delete_port for cfc6399e-50e8-478e-8d83-921e806c0725 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:51.902029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:51.963927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:51.974320 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8587d50f-7a55-4ff6-acc0-af5bf2cd73a7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7947502 Nov 05 14:48:51.976059 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:51.983826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:51.991410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c2c02ad-3989-43a4-8c3a-b4a34dd7ee0d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:51.991943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:51.992621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:52.010049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c2c02ad-3989-43a4-8c3a-b4a34dd7ee0d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:52.012017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43040) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:52.018257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c2c02ad-3989-43a4-8c3a-b4a34dd7ee0d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:52.021014 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3c2c02ad-3989-43a4-8c3a-b4a34dd7ee0d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2387 time: 0.2472339 Nov 05 14:48:52.040570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43042) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:52.102928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet 9982b8d7-8946-4c79-ab2e-d9340565a4f3 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:52.106092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.129411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:52.169253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:52.207050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.232407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 628} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:52.264990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port ca62305b-e782-423d-ae7c-02b3da031fa9 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:48:52.269059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7ab730d5-b5a9-40d7-8a98-760cac943420,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:52.288161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.298904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.299172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Added segment 438d558a-6621-49fc-97ca-624d7ac8096e of type vlan for network 3ab11433-8c1d-4840-a950-41ce9c494b6d Nov 05 14:48:52.386721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:52.387090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.415833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 76b399ca-85e9-4df4-8e81-f616b76b52c3 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:52.416179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.420801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.441514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-741239aa-7d8e-4bd7-aff2-88fe65ea92c5 None None] Network 899fb5b0-b250-4010-9901-de7d213987b3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:52.452667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ab9d555-549e-4b77-963e-28da20e890d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.456751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8da9de8-b602-45d4-a60e-47c10f122556 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:52.458212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b8da9de8-b602-45d4-a60e-47c10f122556 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks/cf4a56c9-bc0c-4cd4-aa24-69852b584c3e HTTP/1.1" status: 200 len: 799 time: 0.6015191 Nov 05 14:48:52.464175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43044) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-741239aa-7d8e-4bd7-aff2-88fe65ea92c5 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:52.493560 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:52.512945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Provisioning complete for port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:52.512945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.530166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4785962e-8af9-40ab-8e87-4fc3a50771aa None None] Network 899fb5b0-b250-4010-9901-de7d213987b3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:52.551105 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:48:52.551605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4785962e-8af9-40ab-8e87-4fc3a50771aa None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:48:52.566598 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:52.598779 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ecaf63ef-9936-4a25-80ed-624d11d2629a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 0.9674823 Nov 05 14:48:52.605110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43046) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:52.615780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:52.626592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.644817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:48Z', 'revision_number': 10, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:52.647608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 76b399ca-85e9-4df4-8e81-f616b76b52c3 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:52.692541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:52.701767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.705954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Provisioning complete for port 76b399ca-85e9-4df4-8e81-f616b76b52c3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:52.706324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.725367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.756012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.761807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:52.762420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.774951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:52.776004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:52.797975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Port 76b399ca-85e9-4df4-8e81-f616b76b52c3 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:52.856273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.903850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Pushing event updated for resources: {'Network': ['ID=3ab11433-8c1d-4840-a950-41ce9c494b6d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:52.910071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.910257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:52.910630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:52.923074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Port': ['ID=cfc6399e-50e8-478e-8d83-921e806c0725,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:52.980071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46a33fc7-1361-43ca-9e95-da2f3dbdda86 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:53.069361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8765c1a-33fe-405f-b6a5-e71d0b812b47 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:53.074693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f8765c1a-33fe-405f-b6a5-e71d0b812b47 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.4441521 Nov 05 14:48:53.078216 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1bdc16a3-999a-45ad-9330-25c632bfab87 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 775 time: 2.8113575 Nov 05 14:48:53.083417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43048) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.083785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43050) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.091613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-4fdf970b-4038-4daf-9b84-5090c0d7cfdf tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1827430353') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:53.099178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.109898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.116487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e2a10a5-85fa-4d17-9355-30be24c65246 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/networks/cf4a56c9-bc0c-4cd4-aa24-69852b584c3e?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 315 time: 0.6270919 Nov 05 14:48:53.124093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 3ab11433-8c1d-4840-a950-41ce9c494b6d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:53.159671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43052) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-46a33fc7-1361-43ca-9e95-da2f3dbdda86 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:53.204520 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:53.228406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97ea25b8-2baa-4a81-ba8e-ca379a488464 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:53.293709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.296805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=76b399ca-85e9-4df4-8e81-f616b76b52c3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:53.317724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.318292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Fanout notify agent at l3_agent the message router_deleted on router ca4eba97-ffbb-44b0-a588-acfeac9244dc {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:53.335616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-97ea25b8-2baa-4a81-ba8e-ca379a488464 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:53.336255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:53.338529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:53.339300 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c1a3e107-f1cb-4336-aea7-15aa1213ceaa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/76b399ca-85e9-4df4-8e81-f616b76b52c3 HTTP/1.1" status: 204 len: 168 time: 1.2951567 Nov 05 14:48:53.348000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.349187 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0c7b582a-89b7-4de2-93a6-038a2b211c12 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/routers/ca4eba97-ffbb-44b0-a588-acfeac9244dc HTTP/1.1" status: 204 len: 168 time: 4.1183913 Nov 05 14:48:53.355114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9f7153f-94e8-46bb-92a0-600a6a298ae3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:53.355998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9f7153f-94e8-46bb-92a0-600a6a298ae3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:53.356199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43054) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.356714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43056) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.365011 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b9f7153f-94e8-46bb-92a0-600a6a298ae3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2781765 Nov 05 14:48:53.378286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.384958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/9982b8d7-8946-4c79-ab2e-d9340565a4f3 HTTP/1.1" status: 204 len: 168 time: 1.3548875 Nov 05 14:48:53.385520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43058) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.385860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43060) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.389285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96ec2ee0-75c4-484c-8734-02f2c68c570a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=9982b8d7-8946-4c79-ab2e-d9340565a4f3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:53.398520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e1251a8-1f91-480b-84a0-3bf26b8ce667 None None] Network 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:53.444965 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-518fbbbd-3c78-4955-bfff-0dd1f28ce255 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:53.446816 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-518fbbbd-3c78-4955-bfff-0dd1f28ce255 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/76b399ca-85e9-4df4-8e81-f616b76b52c3 HTTP/1.1" status: 404 len: 333 time: 0.0889664 Nov 05 14:48:53.449792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43062) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.451495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9330fca3-5947-41ee-ab73-cfbe8e3d7e55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:53.456315 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9330fca3-5947-41ee-ab73-cfbe8e3d7e55 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets/8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2 HTTP/1.1" status: 200 len: 811 time: 0.2479999 Nov 05 14:48:53.485237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43064) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.576721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 3c98a3c2-b492-4ae7-9611-f92b792136c3 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:53.593006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.634830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Deleting subnet 8eec5ce6-d5eb-4929-adc5-4286018c3a1a {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:53.640097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.698955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43066) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.699674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4fdf970b-4038-4daf-9b84-5090c0d7cfdf tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "PUT /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1827430353 HTTP/1.1" status: 201 len: 201 time: 0.6115844 Nov 05 14:48:53.709340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-3891d65a-1bde-4f19-be51-fb78217f2942 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1827430353') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:53.726182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.733842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.765549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21bba443-60a3-46a4-856d-421d42bef0e5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:53.769237 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-21bba443-60a3-46a4-856d-421d42bef0e5 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "GET /v2.0/subnets/8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.2288985 Nov 05 14:48:53.774152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43068) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.781961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-527284254'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:53.793432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.804001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.826837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.857199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:53.857595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.916411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port 4609a411-ed2c-4358-82fa-e2711c3ba85f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:53.916895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.918152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.921159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.922723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:53.923510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Provisioning complete for port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:53.924005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25a9ef1f-c2fa-488f-aea1-b563af41acdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.926097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:53.981763 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3891d65a-1bde-4f19-be51-fb78217f2942 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1827430353 HTTP/1.1" status: 204 len: 168 time: 0.2789686 Nov 05 14:48:53.986972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43072) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:53.993744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=3c98a3c2-b492-4ae7-9611-f92b792136c3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:53.995633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.001123 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f334405d-cfa9-4259-b736-e2f81ec19101 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/3c98a3c2-b492-4ae7-9611-f92b792136c3 HTTP/1.1" status: 204 len: 168 time: 0.6028512 Nov 05 14:48:54.004664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43074) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.005521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-6fce519e-cba7-4610-91d2-e99178aaa72b tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.035268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:54.059944 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9c564d32-b55e-4008-93b1-e56aee232f28 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0572445 Nov 05 14:48:54.064093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43076) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.070009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:54.098696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.099047 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Added segment 43f39521-212b-47ca-91f4-99455eb7dd61 of type vlan for network c145bb83-022b-4aee-90fe-4b8ac2cb86de Nov 05 14:48:54.107722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.126728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:48Z', 'revision_number': 10, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.128515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.159403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port 4609a411-ed2c-4358-82fa-e2711c3ba85f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4609a411-ed2c-4358-82fa-e2711c3ba85f,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:54.159756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.176064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9f8570f-84b0-4e44-ba54-c9159433758f None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:48Z', 'revision_number': 10, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None, '_interfaces': [{'id': 'e61f38d5-4494-4ce4-b69f-400225dbfec1', 'name': '', 'network_id': '0d941fc7-e9da-40d5-a8b5-26174382c84d', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'mac_address': 'fa:16:3e:38:c5:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:47:43Z', 'updated_at': '2021-11-05T14:47:53Z', 'revision_number': 5, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'subnets': [{'id': 'aa8246cf-afad-4136-9822-e0e43b06086c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:48:54.179790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for 4609a411-ed2c-4358-82fa-e2711c3ba85f owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:54.181838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:54.187998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] DHCP port deletion for 86b74c83-f53f-4a3a-9f3f-2e22dd8234dc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:54.203472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=8eec5ce6-d5eb-4929-adc5-4286018c3a1a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:54.216563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.224286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.227902 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e91fbac3-ba97-4ed4-a4a0-422a7040f51a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/subnets/8eec5ce6-d5eb-4929-adc5-4286018c3a1a HTTP/1.1" status: 204 len: 168 time: 0.8654675 Nov 05 14:48:54.233270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43078) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.254425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6decd7e2-d251-41bc-aeab-2c5891a0c2fd None None] Provisioning complete for port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:54.254892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6decd7e2-d251-41bc-aeab-2c5891a0c2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.257273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:54.261167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.309197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Deleting port 4609a411-ed2c-4358-82fa-e2711c3ba85f {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:54.309925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.324905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6decd7e2-d251-41bc-aeab-2c5891a0c2fd None None] Port 7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:54.342912 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6fce519e-cba7-4610-91d2-e99178aaa72b tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags HTTP/1.1" status: 200 len: 238 time: 0.3485348 Nov 05 14:48:54.343488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43080) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.347907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-dc61fe98-11ae-4b8b-b2ed-a133b5ae330c tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', {'tags': ['tempest-TagsTest-Tag-144437662', 'tempest-TagsTest-Tag-1617102671', 'tempest-TagsTest-Tag-1207760529']}) {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.355008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6decd7e2-d251-41bc-aeab-2c5891a0c2fd None None] Could not find standard attr ID for object 76b399ca-85e9-4df4-8e81-f616b76b52c3. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:54.367997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6decd7e2-d251-41bc-aeab-2c5891a0c2fd None None] Could not find standard attr ID for object e4b43ad4-9025-4e60-8b0d-925df9b5185f. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:48:54.375331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.380979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:54.381561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.391575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] For port 4609a411-ed2c-4358-82fa-e2711c3ba85f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4609a411-ed2c-4358-82fa-e2711c3ba85f,segment=NetworkSegment(a0379f26-89d2-4e16-a3e0-05aaaa854d3e),segment_id=a0379f26-89d2-4e16-a3e0-05aaaa854d3e)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:54.392069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.396100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.406609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Calling delete_port for 4609a411-ed2c-4358-82fa-e2711c3ba85f owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:54.410759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.454684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=4609a411-ed2c-4358-82fa-e2711c3ba85f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:54.460414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port 4609a411-ed2c-4358-82fa-e2711c3ba85f on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:54.478259 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.7008119 Nov 05 14:48:54.479886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43082) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.487035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:54.508155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06470946-bb0a-49c4-be5f-15d5ac85516c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Network': ['ID=c145bb83-022b-4aee-90fe-4b8ac2cb86de,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:54.518757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.533117 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:48:54.533743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] No DVR routers for this DVR port 4609a411-ed2c-4358-82fa-e2711c3ba85f on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:54.538463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:54.611919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b9dd0b0-088b-4a9c-bc42-429cf62620d7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:54.622702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.668925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86b74c83-f53f-4a3a-9f3f-2e22dd8234dc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.686070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.686395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a0379f26-89d2-4e16-a3e0-05aaaa854d3e') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.702987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.710321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.717555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.733817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b9dd0b0-088b-4a9c-bc42-429cf62620d7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:54.735119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.740617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Made reservation on behalf of f15c91f02d964fe68931931339a6282b for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:54.744093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.747650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.759068 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc61fe98-11ae-4b8b-b2ed-a133b5ae330c tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "PUT /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags HTTP/1.1" status: 200 len: 308 time: 0.4149048 Nov 05 14:48:54.767436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 626 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:54.767828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.771276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43084) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:54.771527 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:54.809096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-415ef092-ed39-4625-b614-932d20348482 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-144437662') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.814693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa25b3f-136f-4360-9e3e-e4314ceb3501 None None] Pushing event deleted for resources: {'Port': ['ID=4609a411-ed2c-4358-82fa-e2711c3ba85f,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:54.836649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c08818cc-8e35-4c79-a6c9-74c2608ef7e6']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.856761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:54.860218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.860521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7807b354-e4a5-4ee9-b60a-3ec7fd3c5904') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:54.874317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.887800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:48:54.888719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:48:54.950047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.962497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:54.968760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cefaf8ab-eb34-42dd-9053-8fa0f64fe662 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e HTTP/1.1" status: 204 len: 168 time: 1.5177500 Nov 05 14:48:54.981134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43086) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.004858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.025568 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-72e81b42-bbea-4025-a288-2e9aed0ecc8c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:48:55.028928 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-72e81b42-bbea-4025-a288-2e9aed0ecc8c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/7c10d1f2-e0ee-41d3-b793-9edd6d0aa08e HTTP/1.1" status: 404 len: 333 time: 0.0464787 Nov 05 14:48:55.032989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Releasing vlan 616 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:55.033427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.040860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8acc58f6-06cf-4918-bb8c-aa9775e7bca2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:55.044720 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:55.073631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43088) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.089590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:55.125643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:55.141168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:55.141763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.156757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=33f8e1a1-1691-45cb-ac9d-aec04dbd05e1,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:55.157429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8acc58f6-06cf-4918-bb8c-aa9775e7bca2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:55.165656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet a56d5c9c-6ad1-46b6-81ff-d9a509668036 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:48:55.168190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.177772 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-415ef092-ed39-4625-b614-932d20348482 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "DELETE /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-144437662 HTTP/1.1" status: 204 len: 168 time: 0.3663394 Nov 05 14:48:55.177987 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-757afe14-71e9-4ee9-a120-e88c363f049d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1074724 Nov 05 14:48:55.178080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.178188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43090) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.178188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43092) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.182456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:55.191780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-41e822a5-eb8e-4878-9e97-0421846f5e07 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-144437662') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:55.199548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.208788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network c08818cc-8e35-4c79-a6c9-74c2608ef7e6 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 05 14:48:55.216242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.219992 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/networks/c08818cc-8e35-4c79-a6c9-74c2608ef7e6 HTTP/1.1" status: 204 len: 168 time: 0.9828765 Nov 05 14:48:55.220946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafc185d-99ce-42e0-983e-92f4a665468a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Network': ['ID=c08818cc-8e35-4c79-a6c9-74c2608ef7e6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:55.236837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.246631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.248873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43096) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.250660 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/86b74c83-f53f-4a3a-9f3f-2e22dd8234dc HTTP/1.1" status: 204 len: 168 time: 1.8507283 Nov 05 14:48:55.308193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bb8077-2234-4be4-a5f2-d31add13836d tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=86b74c83-f53f-4a3a-9f3f-2e22dd8234dc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:55.331185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.332634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.403279 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-41e822a5-eb8e-4878-9e97-0421846f5e07 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] show failed (client error): The resource could not be found. Nov 05 14:48:55.413758 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-41e822a5-eb8e-4878-9e97-0421846f5e07 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-144437662 HTTP/1.1" status: 404 len: 325 time: 0.2310960 Nov 05 14:48:55.413758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43098) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.430169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-d9653189-6d60-4272-89e6-7a487b515e70 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1617102671') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:55.511732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.558781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.610066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.613978 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-29e9db81-67b5-4149-ad65-b20051354798 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.4323816 Nov 05 14:48:55.613978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43104) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.616565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'name': 'tempest-router--1763853700', 'project_id': 'f32f28811ebb4995a55cfb786e914b99'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:55.619268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43106) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.636236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '812cb9a1-7299-4389-992c-e158c9ab11b8'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:48:55.665228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.718522 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d9653189-6d60-4272-89e6-7a487b515e70 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1617102671 HTTP/1.1" status: 204 len: 168 time: 0.2894943 Nov 05 14:48:55.723787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43108) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:55.743898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.760828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.761871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.769901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.tag.tag_plugin [None req-c49d7a72-f43a-442b-a9f5-7679b07041f4 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1207760529') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:55.816669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.858676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/33f8e1a1-1691-45cb-ac9d-aec04dbd05e1/812cb9a1-7299-4389-992c-e158c9ab11b8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:55.913158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=b12fdb19-95ce-48de-a4e8-bf18a500a380,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:55.922624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.926806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.936130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Checking segment: {'id': '43f39521-212b-47ca-91f4-99455eb7dd61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:55.936977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network hostable DHCP agents. Network: c145bb83-022b-4aee-90fe-4b8ac2cb86de, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:48:55.956264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.966259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.968983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=a56d5c9c-6ad1-46b6-81ff-d9a509668036,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:55.972323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:55.975258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:55.981692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e66e11e4-6e52-432b-8460-b75c32042a73 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/a56d5c9c-6ad1-46b6-81ff-d9a509668036 HTTP/1.1" status: 204 len: 168 time: 0.9068835 Nov 05 14:48:55.983957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43110) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.011139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.015555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.016786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b1d0ad50-4aec-4df5-9559-c862dce50e15 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.4033730 Nov 05 14:48:56.017977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.021035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43112) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.032877 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c49d7a72-f43a-442b-a9f5-7679b07041f4 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1207760529 HTTP/1.1" status: 204 len: 168 time: 0.3068972 Nov 05 14:48:56.035751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43114) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.041737 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-b2a704a0-89ee-4b5a-ac7e-0c5b293f50e0 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:56.097568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98820cc-7107-423b-a27f-e6c4f0f37282 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:56.103806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:48:56.131092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.144861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.158319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4609a411-ed2c-4358-82fa-e2711c3ba85f no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:56.164311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, c145bb83-022b-4aee-90fe-4b8ac2cb86de) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:56.186563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:56.187167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.195517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.201003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 4609a411-ed2c-4358-82fa-e2711c3ba85f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:56.201352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4609a411-ed2c-4358-82fa-e2711c3ba85f not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:56.201774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d34e9d04-9129-4153-8e65-c2625f1d8dab no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:56.224673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.236836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d34e9d04-9129-4153-8e65-c2625f1d8dab {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:56.237257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d34e9d04-9129-4153-8e65-c2625f1d8dab not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:56.316629 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5cfe9d8e-0265-4566-bb3e-7f5d2d0c62d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 1.8349252 Nov 05 14:48:56.320574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43116) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.329824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:56.421998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.427135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.511294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.511733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 99ea3027-da01-40c1-9580-d93ebc8c0d06 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:48:56.518786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.519701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e1a9621-1920-499d-aeb1-efea07352a16 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/routers/99ea3027-da01-40c1-9580-d93ebc8c0d06 HTTP/1.1" status: 204 len: 168 time: 0.4962218 Nov 05 14:48:56.604005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::1 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/33f8e1a1-1691-45cb-ac9d-aec04dbd05e1/5d293cb5-f18e-4d3e-9022-6f3aab039f74) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:56.669181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43120) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.704981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-269e9ad3-86f7-4d87-b3de-53a3d25f9664 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:56.750985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.807114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.818620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88778c13-71f3-4d4b-8dac-5beafab380dd None None] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:56.854288 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b2a704a0-89ee-4b5a-ac7e-0c5b293f50e0 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "DELETE /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags HTTP/1.1" status: 204 len: 168 time: 0.8174751 Nov 05 14:48:56.854976 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43124) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:56.868654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-f6566b0a-19f3-4fb9-8dd8-fd7d80d16d63 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1617102671') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:56.881326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:56.891180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:56.896293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:56.897152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.934968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9931214'] for subnet, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.938189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:56.938691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-269e9ad3-86f7-4d87-b3de-53a3d25f9664 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:56.944110 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:56.956228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-06b284de-ff88-4425-8fa1-0e4bf8be41ac None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:56.959900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-06b284de-ff88-4425-8fa1-0e4bf8be41ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:56.982996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:57.031564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f0dcec6-6baa-4dbc-babd-9d0e65268906 None None] Network 0fd8a209-139c-4879-af4b-8c70d7c19cda requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:57.063251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-584787868', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:57.119050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.120361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.134127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,segment=NetworkSegment(0e9e85c7-2ef9-485b-82ff-07d30935b057),segment_id=0e9e85c7-2ef9-485b-82ff-07d30935b057)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-88778c13-71f3-4d4b-8dac-5beafab380dd None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:57.134378 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:57.135273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.165351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.172433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:57.173481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a02ffc3-e237-40e5-bb2d-cba91f0b94e9 None None] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:57.198635 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-f6566b0a-19f3-4fb9-8dd8-fd7d80d16d63 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] show failed (client error): The resource could not be found. Nov 05 14:48:57.202932 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f6566b0a-19f3-4fb9-8dd8-fd7d80d16d63 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1617102671 HTTP/1.1" status: 404 len: 326 time: 0.3415859 Nov 05 14:48:57.210089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43126) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:57.216057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-f79dca88-faa1-43d5-850f-2d0ff3c02098 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d', 'tempest-TagsTest-Tag-1207760529') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:57.235507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4a02ffc3-e237-40e5-bb2d-cba91f0b94e9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:57.318454 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:57.402968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] DHCP port deletion for 0fd8a209-139c-4879-af4b-8c70d7c19cda request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:48:57.463578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5570a5f9-365b-4223-9357-914ce7f1036a None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:57.463954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5570a5f9-365b-4223-9357-914ce7f1036a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.482400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.515677 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-f79dca88-faa1-43d5-850f-2d0ff3c02098 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] show failed (client error): The resource could not be found. Nov 05 14:48:57.517048 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f79dca88-faa1-43d5-850f-2d0ff3c02098 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "GET /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags/tempest-TagsTest-Tag-1207760529 HTTP/1.1" status: 404 len: 326 time: 0.3059471 Nov 05 14:48:57.521225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43128) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:57.526289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.tag.tag_plugin [None req-66520071-ea05-43b0-b365-875b5220d008 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '3ab11433-8c1d-4840-a950-41ce9c494b6d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:57.529705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5570a5f9-365b-4223-9357-914ce7f1036a None None] Port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:57.530505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-9638471'] for subnet, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.535841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Deleting port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:57.536321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.554889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.602824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] For port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:57.603206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.622938 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Calling delete_port for a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:57.625948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.ipam_backend_mixin [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 was not found and therefore no delete operation was performed {{(pid=113582) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:48:57.628012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.652757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:57.654351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] Pushing event deleted for resources: {'Port': ['ID=a4e00959-a9a0-49a7-9b7c-3345e0dd02f0,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:57.661203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd90ade-1cb7-4ccf-97ad-986097370569 None None] No DVR routers for this DVR port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:57.665681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb993888-5c8d-44af-b4b2-b183bd8b51d4 None None] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:48:57.673301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:48:57.683009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port e61f38d5-4494-4ce4-b69f-400225dbfec1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:48:57.683348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.721709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:57.722469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.723830 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "PUT /v2.0/subnets/b12fdb19-95ce-48de-a4e8-bf18a500a380 HTTP/1.1" status: 200 len: 877 time: 1.3999717 Nov 05 14:48:57.736115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43130) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:57.739270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cae913-d3ff-4eb1-95e1-e6c6d5969779 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event updated for resources: {'Subnet': ['ID=b12fdb19-95ce-48de-a4e8-bf18a500a380,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-eb993888-5c8d-44af-b4b2-b183bd8b51d4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:48:57.755371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:48:57.764433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d04c30c8-94e5-4140-9a9d-b7707df3a9f0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:57.871439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d04c30c8-94e5-4140-9a9d-b7707df3a9f0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:57.926552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:57.989219 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-66520071-ea05-43b0-b365-875b5220d008 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "DELETE /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d/tags HTTP/1.1" status: 204 len: 168 time: 0.4664257 Nov 05 14:48:57.996021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43132) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:57.996599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0fd8a209-139c-4879-af4b-8c70d7c19cda']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.004084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port e61f38d5-4494-4ce4-b69f-400225dbfec1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e61f38d5-4494-4ce4-b69f-400225dbfec1,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:48:58.004449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.026073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.031433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0e9e85c7-2ef9-485b-82ff-07d30935b057') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.031714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0e9e85c7-2ef9-485b-82ff-07d30935b057') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.033578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for e61f38d5-4494-4ce4-b69f-400225dbfec1 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:48:58.047395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.072782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.085525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.126567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 633 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:58.126865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.134959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:48:58.157983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.158832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.190377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-c145bb83-022b-4aee-90fe-4b8ac2cb86de', 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de', 'tenant_id': 'f15c91f02d964fe68931931339a6282b', 'fixed_ips': [{'subnet_id': 'b12fdb19-95ce-48de-a4e8-bf18a500a380'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:48:58.191603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.192050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:58.209256 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:58.218152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:58.218530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.251746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.256121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.263160 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/0fd8a209-139c-4879-af4b-8c70d7c19cda HTTP/1.1" status: 204 len: 168 time: 2.2747095 Nov 05 14:48:58.266158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43134) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:58.271710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.289146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1097105123'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:58.305422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.320655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573391a2-90fb-4fdb-8ecf-8d0483d11d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=0fd8a209-139c-4879-af4b-8c70d7c19cda,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:58.352719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.365973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:58.392077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:58.395678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.505266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 642} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:48:58.521529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.521877 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Added segment d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f of type vlan for network 16ba37ba-cfa5-4979-adb6-ef4be077a592 Nov 05 14:48:58.535417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.576918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:58.586835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:58.589430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Allocated IP 172.20.0.3 (c145bb83-022b-4aee-90fe-4b8ac2cb86de/b12fdb19-95ce-48de-a4e8-bf18a500a380/208aef64-e86f-44be-a08b-0a5a6f5a8ab6) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:58.594566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ab11433-8c1d-4840-a950-41ce9c494b6d']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.620024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '438d558a-6621-49fc-97ca-624d7ac8096e') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.620743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '438d558a-6621-49fc-97ca-624d7ac8096e') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:58.651074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.663207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.695169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.711943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=e61f38d5-4494-4ce4-b69f-400225dbfec1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:58.713504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.722101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Releasing vlan 628 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:58.722806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.731304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:48:58.764865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:48:58.765219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a4e00959-a9a0-49a7-9b7c-3345e0dd02f0 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:58.786410 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:58.790347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.798531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:58.800051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.832951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.841154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.847780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Allocated IP 172.26.5.147 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/5cb35905-f436-47ee-87cc-0a8c0713c493) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:48:58.892406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Network c145bb83-022b-4aee-90fe-4b8ac2cb86de is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:58.898488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:58.901008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:58.911566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Pushing event updated for resources: {'Port': ['ID=208aef64-e86f-44be-a08b-0a5a6f5a8ab6,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:58.922176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.952150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.968159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Attempting to bind port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:48:58.968578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Attempting to bind port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '43f39521-212b-47ca-91f4-99455eb7dd61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:48:58.968952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Attempting to bind port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 on network c145bb83-022b-4aee-90fe-4b8ac2cb86de {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:48:58.974674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:48:58.975046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Checking segment: {'id': '43f39521-212b-47ca-91f4-99455eb7dd61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:48:58.975462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.975863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Bound using segment: {'id': '43f39521-212b-47ca-91f4-99455eb7dd61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:48:58.976721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Bound port: 208aef64-e86f-44be-a08b-0a5a6f5a8ab6, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43f39521-212b-47ca-91f4-99455eb7dd61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:48:58.977892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.978618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=b12fdb19-95ce-48de-a4e8-bf18a500a380,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:58.988074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.996029 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.7244213 Nov 05 14:48:58.997647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:58.998431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43136) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:59.003444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.009274 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] 10.222.0.30 "DELETE /v2.0/networks/3ab11433-8c1d-4840-a950-41ce9c494b6d HTTP/1.1" status: 204 len: 168 time: 1.0098383 Nov 05 14:48:59.048830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:48:59.052755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c9d9ff8-dbfa-4bef-85fe-53b5b89a4f78 tempest-TagsTest-1670442780 tempest-TagsTest-1670442780-project] Pushing event deleted for resources: {'Network': ['ID=3ab11433-8c1d-4840-a950-41ce9c494b6d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:59.058181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] For port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:48:59.061885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] For port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=208aef64-e86f-44be-a08b-0a5a6f5a8ab6,segment=NetworkSegment(43f39521-212b-47ca-91f4-99455eb7dd61),segment_id=43f39521-212b-47ca-91f4-99455eb7dd61)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:48:59.069219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.088506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:48:59.095166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:48:59.097641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event updated for resources: {'Port': ['ID=5cb35905-f436-47ee-87cc-0a8c0713c493,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:59.102269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:48:59.135467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4ccf93-64bb-46d9-b4ee-75dffc312957 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Network': ['ID=16ba37ba-cfa5-4979-adb6-ef4be077a592,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:59.145373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299c8cc4-62f9-41e7-8128-cb19f5e45663 None None] Pushing event updated for resources: {'Port': ['ID=208aef64-e86f-44be-a08b-0a5a6f5a8ab6,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:48:59.147600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Router 2c5f71a3-858d-4eeb-b981-4010027a4a3a is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:48:59.170200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:48:59.244059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.277387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.278645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9d847521-386c-4dd8-85bf-eb8c3ef0cc16 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:59.279266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9d847521-386c-4dd8-85bf-eb8c3ef0cc16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.314330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f71d9733-3619-453d-b971-859ba7fe3de7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:48:59.367074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c145bb83-022b-4aee-90fe-4b8ac2cb86de']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:59.367960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:48:59.374071 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e8a9366c-354a-4778-a501-27291523875c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "PUT /v2.0/routers/2c5f71a3-858d-4eeb-b981-4010027a4a3a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7528770 Nov 05 14:48:59.379604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43142) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:59.382185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Sync routers for ids ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:48:59.395969 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Routers {'2c5f71a3-858d-4eeb-b981-4010027a4a3a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:48:59.400052 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:59.432514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '43f39521-212b-47ca-91f4-99455eb7dd61') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:59.432757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '43f39521-212b-47ca-91f4-99455eb7dd61') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:59.464381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.473707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43144) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:59.473967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b69eb84-16bd-4c4b-8537-73810c19c277 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:59.477861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0b69eb84-16bd-4c4b-8537-73810c19c277 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports/5d293cb5-f18e-4d3e-9022-6f3aab039f74 HTTP/1.1" status: 200 len: 911 time: 0.0948987 Nov 05 14:48:59.478608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43146) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:59.485010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f71d9733-3619-453d-b971-859ba7fe3de7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:48:59.498498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.506628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:48:59.507234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.551500 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Set router 2c5f71a3-858d-4eeb-b981-4010027a4a3a gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:48:59.570627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:48:59.590721 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:48:59.605566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.api [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 05 14:48:59.605566 dv-neutron-816850-1-hyperv neutron-server[113581]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 05 14:48:59.605566 dv-neutron-816850-1-hyperv neutron-server[113581]: [parameters: {'id': 'c145bb83-022b-4aee-90fe-4b8ac2cb86de'}] Nov 05 14:48:59.605566 dv-neutron-816850-1-hyperv neutron-server[113581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=113581) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:48:59.607254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG oslo_db.api [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:48:59.613407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:48:59.618508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.639727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9d847521-386c-4dd8-85bf-eb8c3ef0cc16 None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:59.640205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9d847521-386c-4dd8-85bf-eb8c3ef0cc16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.677448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63d7cbb3-c36f-47b7-86c5-7179b76c011e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:59.684008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63d7cbb3-c36f-47b7-86c5-7179b76c011e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:48:59.685605 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-63d7cbb3-c36f-47b7-86c5-7179b76c011e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.2061481 Nov 05 14:48:59.688503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43150) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:48:59.821016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9d847521-386c-4dd8-85bf-eb8c3ef0cc16 None None] Port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:48:59.831975 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:48:57Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': '5d293cb5-f18e-4d3e-9022-6f3aab039f74', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:49:e4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 906, 'fixed_ips': [{'subnet_id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:56Z', 'updated_at': '2021-11-05T14:48:57Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:48:59.867108 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Checking router: 2c5f71a3-858d-4eeb-b981-4010027a4a3a for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:48:59.867625 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Updating router 2c5f71a3-858d-4eeb-b981-4010027a4a3a port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:48:59.900078 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.935955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.944599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:48:59.954657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:48:59.991399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c209fae3-48df-4cdc-8521-27501440e58a None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:48:59.991999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c209fae3-48df-4cdc-8521-27501440e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.031178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42d75954-1292-458f-8611-20fdedde1af6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b0648b2d4fc34e9181135dd8ddc22100&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4461839 Nov 05 14:49:00.038137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:00.067301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=5c05a157-422b-4380-a664-7bdaeb7d66a7,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:00.131632 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.162483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c209fae3-48df-4cdc-8521-27501440e58a None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:00.163590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c209fae3-48df-4cdc-8521-27501440e58a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.216373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c209fae3-48df-4cdc-8521-27501440e58a None None] Port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:00.287534 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.294606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.345332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-603324e1-97d7-4d29-81b9-85a3e54be975 None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:00.345843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-603324e1-97d7-4d29-81b9-85a3e54be975 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.394780 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3aa9b7-c70e-49b2-972a-8cc0053bc7ca None None] Pushing event updated for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:00.441147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-603324e1-97d7-4d29-81b9-85a3e54be975 None None] Port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:00.481686 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Attempting to bind port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:00.483720 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Attempting to bind port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:00.484530 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Attempting to bind port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:00.506217 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:00.506799 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:00.507372 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.507933 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:00.509470 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Bound port: 5d293cb5-f18e-4d3e-9022-6f3aab039f74, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:00.510040 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.682768 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] For port 5d293cb5-f18e-4d3e-9022-6f3aab039f74, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:00.685750 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] For port 5d293cb5-f18e-4d3e-9022-6f3aab039f74, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d293cb5-f18e-4d3e-9022-6f3aab039f74,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:00.691876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Checking segment: {'id': 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:00.692528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network hostable DHCP agents. Network: 16ba37ba-cfa5-4979-adb6-ef4be077a592, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:00.692739 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.708219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:00.714447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.720974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:00.728438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43154) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:00.729497 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-419bfbd6-2bb9-4d19-a344-b66ca2a74474 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4612973 Nov 05 14:49:00.750592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:00.751671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.753791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:00.759402 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3aa9b7-c70e-49b2-972a-8cc0053bc7ca None None] Pushing event updated for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:00.770023 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Routers {'2c5f71a3-858d-4eeb-b981-4010027a4a3a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:00.770861 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:00.772313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Router 20bf511d-a5f6-41cd-941e-30fbb72f1d25 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:00.802221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:00.806045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.808826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.812717 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7ab730d5-b5a9-40d7-8a98-760cac943420 HTTP/1.1" status: 204 len: 168 time: 0.7701688 Nov 05 14:49:00.819494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting subnet aa8246cf-afad-4136-9822-e0e43b06086c {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:00.826878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cfc5ad7-2e0b-4ba6-9465-6aaf426f472c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ab730d5-b5a9-40d7-8a98-760cac943420,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:00.835950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 16ba37ba-cfa5-4979-adb6-ef4be077a592) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:00.841510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:00.842274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.859261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Deleting port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:00.859618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.892939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8640ed6-dddb-42ae-83c9-b5f57416b70f None None] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:00.916667 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20673d40-41c3-4b7f-86cc-42d71121f129 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8724461 Nov 05 14:49:00.922909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43158) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:00.928660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-1068192273', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:00.932951 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] Set router 2c5f71a3-858d-4eeb-b981-4010027a4a3a gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:00.946125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.954673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.956318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:00.981518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] For port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=208aef64-e86f-44be-a08b-0a5a6f5a8ab6,segment=NetworkSegment(43f39521-212b-47ca-91f4-99455eb7dd61),segment_id=43f39521-212b-47ca-91f4-99455eb7dd61)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:00.981887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.017248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:01.019988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.030548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Calling delete_port for 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:01.124235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.125836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.167145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:01.175772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:01.176389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.208694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.216676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:01.225387 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:48:57Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': '5d293cb5-f18e-4d3e-9022-6f3aab039f74', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:49:e4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 906, 'fixed_ips': [{'subnet_id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:56Z', 'updated_at': '2021-11-05T14:49:00Z', 'revision_number': 4, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.232209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] Sync routers for ids ['20bf511d-a5f6-41cd-941e-30fbb72f1d25'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:01.241873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.243300 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-91eeb4a2-beea-417f-a650-0458f84a21bc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.3194489 Nov 05 14:49:01.246103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43164) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:01.252004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592', 'name': 'tempest-PortsIpV6TestJSON-280001742'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:01.259986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.261426 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bca37e8e-5610-4cc6-8151-4c5b0574dbe5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 4.5908105 Nov 05 14:49:01.271207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43166) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:01.281682 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] Routers {'20bf511d-a5f6-41cd-941e-30fbb72f1d25'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:01.282306 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['20bf511d-a5f6-41cd-941e-30fbb72f1d25'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.328017 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.336013 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09fe6625-dd83-4e41-a269-4538d3c00af7 None None] The sync data for ids ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'] in dv-neutron-816850-1-hyperv is: [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:48:57Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': '5d293cb5-f18e-4d3e-9022-6f3aab039f74', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:49:e4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 906, 'fixed_ips': [{'subnet_id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:48:56Z', 'updated_at': '2021-11-05T14:49:00Z', 'revision_number': 4, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '33f8e1a1-1691-45cb-ac9d-aec04dbd05e1', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:01.349577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.353406 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] Routers {'20bf511d-a5f6-41cd-941e-30fbb72f1d25'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:01.354170 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['20bf511d-a5f6-41cd-941e-30fbb72f1d25'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.354513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:01.355156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.402969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.407737 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.408525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc9455bf-b4c3-4248-8efd-ea07ea1060f1 None None] The sync data for ids ['20bf511d-a5f6-41cd-941e-30fbb72f1d25'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:01.461325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No DVR routers for this DVR port 208aef64-e86f-44be-a08b-0a5a6f5a8ab6 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:49:01.463626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.468769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Port': ['ID=208aef64-e86f-44be-a08b-0a5a6f5a8ab6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a8640ed6-dddb-42ae-83c9-b5f57416b70f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:01.534261 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:01.564569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:01.567352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09dfee18-cd94-4604-98cc-3d348844b20a None None] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:01.637151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.654886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.682249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.685675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Subnet': ['ID=aa8246cf-afad-4136-9822-e0e43b06086c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:01.697829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c145bb83-022b-4aee-90fe-4b8ac2cb86de']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.699587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.702251 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-11a597d1-2506-49f7-9492-8a0ef678cf9a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/20bf511d-a5f6-41cd-941e-30fbb72f1d25 HTTP/1.1" status: 200 len: 924 time: 0.4284739 Nov 05 14:49:01.703016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:01.703699 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7a2d4a08-1b45-44a4-92ea-6f4b35a64ac1 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/aa8246cf-afad-4136-9822-e0e43b06086c HTTP/1.1" status: 204 len: 168 time: 0.9742668 Nov 05 14:49:01.705675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43174) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:01.709397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.717030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43176) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:01.741950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-14e6a6ec-de8c-4371-8ec4-0c17d1239a79 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=20bf511d-a5f6-41cd-941e-30fbb72f1d25 HTTP/1.1" status: 200 len: 205 time: 0.0333834 Nov 05 14:49:01.742559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '43f39521-212b-47ca-91f4-99455eb7dd61') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.742559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '43f39521-212b-47ca-91f4-99455eb7dd61') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:01.750255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43180) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:01.773035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.827093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:01.827452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.914164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port d6a71746-5092-43a6-afa1-8cd649f1670d yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:01.946301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.963515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 5d293cb5-f18e-4d3e-9022-6f3aab039f74, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d293cb5-f18e-4d3e-9022-6f3aab039f74,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:01.963865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:01.985479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 5d293cb5-f18e-4d3e-9022-6f3aab039f74 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:01.991553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-992a8b49-3743-4ef2-ba23-8dc72d4fc37a None None] Network 0d941fc7-e9da-40d5-a8b5-26174382c84d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:01.997886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f743e4cf-1379-469f-b309-689312dcfab3 None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:02.014232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.058725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:49:02.059143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:49:02.072660 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-09dfee18-cd94-4604-98cc-3d348844b20a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:02.087665 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:02.110435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] For port 5d293cb5-f18e-4d3e-9022-6f3aab039f74, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d293cb5-f18e-4d3e-9022-6f3aab039f74,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:02.122413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.201866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.215388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7e686f-ff2a-4ec9-9cb6-15cc6f65e254 None None] Pushing event updated for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:02.270361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-04aef0f2-a980-4249-bf48-a14e9bc681ea None None] Provisioning complete for port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:02.271023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-04aef0f2-a980-4249-bf48-a14e9bc681ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.304920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.313293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.315405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.327026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.330663 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/c145bb83-022b-4aee-90fe-4b8ac2cb86de HTTP/1.1" status: 204 len: 168 time: 4.5863619 Nov 05 14:49:02.352884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-04aef0f2-a980-4249-bf48-a14e9bc681ea None None] Could not find standard attr ID for object 5d293cb5-f18e-4d3e-9022-6f3aab039f74. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:02.357182 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.plugins.ml2.db [None req-04aef0f2-a980-4249-bf48-a14e9bc681ea None None] No ports have port_id starting with 5d293cb5-f18e-4d3e-9022-6f3aab039f74 Nov 05 14:49:02.362645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43190) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:02.400905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] DHCP port deletion for 0d941fc7-e9da-40d5-a8b5-26174382c84d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:49:02.436616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=5d293cb5-f18e-4d3e-9022-6f3aab039f74,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:02.480401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b127e7-6374-481d-8f4c-0b622e219c36 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=c145bb83-022b-4aee-90fe-4b8ac2cb86de,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:02.552012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::69 (16ba37ba-cfa5-4979-adb6-ef4be077a592/5c05a157-422b-4380-a664-7bdaeb7d66a7/d6a71746-5092-43a6-afa1-8cd649f1670d) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:02.556433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d293cb5-f18e-4d3e-9022-6f3aab039f74 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:02.596949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5d293cb5-f18e-4d3e-9022-6f3aab039f74 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:02.597602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d293cb5-f18e-4d3e-9022-6f3aab039f74 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:304}} Nov 05 14:49:02.602465 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-673229d5-6f77-4979-aa30-d0e1d85c2ea6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:02.602945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-673229d5-6f77-4979-aa30-d0e1d85c2ea6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:02.610261 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-673229d5-6f77-4979-aa30-d0e1d85c2ea6 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/b12fdb19-95ce-48de-a4e8-bf18a500a380 HTTP/1.1" status: 404 len: 337 time: 0.2449846 Nov 05 14:49:02.611084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43194) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:02.638395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Deleting port f17709b5-1600-41e7-8b16-322e95b4eb0b {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:02.639239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.644576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Port 5d293cb5-f18e-4d3e-9022-6f3aab039f74 not found, will not notify nova. {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:314}} Nov 05 14:49:02.679578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-99337d32-8b59-492f-aa39-7f025c44838e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:02.680174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-99337d32-8b59-492f-aa39-7f025c44838e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:02.685868 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-99337d32-8b59-492f-aa39-7f025c44838e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/c145bb83-022b-4aee-90fe-4b8ac2cb86de HTTP/1.1" status: 404 len: 339 time: 0.0714612 Nov 05 14:49:02.686537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:02.688838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.732009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-8b549dc7-adff-431b-957a-d39742e840cd tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:02.732493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8b549dc7-adff-431b-957a-d39742e840cd tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:02.740251 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8b549dc7-adff-431b-957a-d39742e840cd tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/72b0642a-5468-4ccf-b702-6925a3868b6b HTTP/1.1" status: 404 len: 337 time: 0.0507967 Nov 05 14:49:02.741069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43198) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:02.744402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] For port f17709b5-1600-41e7-8b16-322e95b4eb0b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17709b5-1600-41e7-8b16-322e95b4eb0b,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:02.745158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.746223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.766283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Deleting port f17709b5-1600-41e7-8b16-322e95b4eb0b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:02.767193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.773625 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4322ad64-cf4e-4118-9fa1-91a924910441 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:02.774190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4322ad64-cf4e-4118-9fa1-91a924910441 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:02.776741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Calling delete_port for f17709b5-1600-41e7-8b16-322e95b4eb0b owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:02.788625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43202) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:02.793297 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4322ad64-cf4e-4118-9fa1-91a924910441 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/899fb5b0-b250-4010-9901-de7d213987b3 HTTP/1.1" status: 404 len: 339 time: 0.0417581 Nov 05 14:49:02.891774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:02.921434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] Pushing event deleted for resources: {'Port': ['ID=f17709b5-1600-41e7-8b16-322e95b4eb0b,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:02.930479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a528bb5c-9621-42f3-8081-40b48c07a44e None None] No DVR routers for this DVR port f17709b5-1600-41e7-8b16-322e95b4eb0b on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:49:02.944307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8fa615d-0d37-4075-8b78-b160c12daad0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:02.996575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] For port f17709b5-1600-41e7-8b16-322e95b4eb0b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f17709b5-1600-41e7-8b16-322e95b4eb0b,segment=NetworkSegment(846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d),segment_id=846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:02.997964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.009611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Router 2c5f71a3-858d-4eeb-b981-4010027a4a3a has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:03.035930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Calling delete_port for f17709b5-1600-41e7-8b16-322e95b4eb0b owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:03.059706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8fa615d-0d37-4075-8b78-b160c12daad0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:03.060885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.135417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.142659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port 5cb35905-f436-47ee-87cc-0a8c0713c493 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:03.143305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.144414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:03.151832 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0503e96b-10c9-413c-9f31-a390c0ef1b70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "PUT /v2.0/routers/2c5f71a3-858d-4eeb-b981-4010027a4a3a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4622595 Nov 05 14:49:03.154520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43212) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.219599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c44463b7-a986-4cdd-91c5-63300d33eb46 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:03.222418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c44463b7-a986-4cdd-91c5-63300d33eb46 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:03.224103 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c44463b7-a986-4cdd-91c5-63300d33eb46 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0685256 Nov 05 14:49:03.227263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43214) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.277320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43216) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.303737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 33f8e1a1-1691-45cb-ac9d-aec04dbd05e1 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:03.307453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.323647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.351624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.356317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.371995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-16ba37ba-cfa5-4979-adb6-ef4be077a592', 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '5c05a157-422b-4380-a664-7bdaeb7d66a7'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:03.372897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.382230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6aa64f9a-ae56-45db-b47d-8ec48c7b79dd']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.419189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.425500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Port': ['ID=f17709b5-1600-41e7-8b16-322e95b4eb0b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:03.431797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.443039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '82cf0ae8-7f6f-4a6f-b69d-ec8f07ec5dcf') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.443486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '82cf0ae8-7f6f-4a6f-b69d-ec8f07ec5dcf') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.466471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No DVR routers for this DVR port f17709b5-1600-41e7-8b16-322e95b4eb0b on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:49:03.466683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.534880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.547005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1592655332', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:03.565013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for 5cb35905-f436-47ee-87cc-0a8c0713c493 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:03.568672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.594776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Allocated IP 2001:db8::2 (16ba37ba-cfa5-4979-adb6-ef4be077a592/5c05a157-422b-4380-a664-7bdaeb7d66a7/f42080c8-dfa3-4326-8c61-36ae89e92c51) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:03.601342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:03.604883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.608443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=33f8e1a1-1691-45cb-ac9d-aec04dbd05e1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:03.622714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.629702 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ff22c9c9-fb2c-437b-8538-13797964206a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/33f8e1a1-1691-45cb-ac9d-aec04dbd05e1 HTTP/1.1" status: 204 len: 168 time: 0.4013898 Nov 05 14:49:03.630696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.632500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43220) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.655791 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.660518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:03.673503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:03.676135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 638 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:49:03.676792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:49:03.719109 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:49:03.725346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:03.732861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:03.733705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.737578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Sync routers for ids ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:03.744289 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-05f431de-22b4-477c-8ce6-e54adb4af0ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.1085320 Nov 05 14:49:03.746700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43222) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.767909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Routers {'2c5f71a3-858d-4eeb-b981-4010027a4a3a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:03.769075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.778599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.781193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=d6a71746-5092-43a6-afa1-8cd649f1670d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:03.824499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.836917 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73220601-f746-4b61-9737-f18938653bd5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.5893407 Nov 05 14:49:03.842090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d941fc7-e9da-40d5-a8b5-26174382c84d']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.845226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43224) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:03.856766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Set router 2c5f71a3-858d-4eeb-b981-4010027a4a3a gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:03.865939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.866635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '846d3aaf-8849-4a8d-9f4f-85b5a5d26f1d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.885027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.899091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.917307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:49:02Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.945054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.947265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Checking router: 2c5f71a3-858d-4eeb-b981-4010027a4a3a for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:03.976221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.979464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:03.982741 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/6aa64f9a-ae56-45db-b47d-8ec48c7b79dd HTTP/1.1" status: 204 len: 168 time: 1.1900187 Nov 05 14:49:03.984265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Routers {'2c5f71a3-858d-4eeb-b981-4010027a4a3a'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:03.985006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:03.994351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:04.001830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43226) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.016151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.019805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.020669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2356e9-d73f-4f1c-8794-6002b28ba079 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=6aa64f9a-ae56-45db-b47d-8ec48c7b79dd,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.054342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.061250 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-5ed99873-0922-4bef-b89e-b94bade4acae tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.061944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5ed99873-0922-4bef-b89e-b94bade4acae tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.064407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] Set router 2c5f71a3-858d-4eeb-b981-4010027a4a3a gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:04.066158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ed99873-0922-4bef-b89e-b94bade4acae tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/3a9ea4f6-8003-4844-b87a-685a48d7d64d HTTP/1.1" status: 404 len: 337 time: 0.0616479 Nov 05 14:49:04.076567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43228) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.101489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Releasing vlan 600 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:49:04.101890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:49:04.106852 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:49:04.118695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.121741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-34a76ef4-dd8b-4aff-b41b-48095609108c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.122489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34a76ef4-dd8b-4aff-b41b-48095609108c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.126881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-34a76ef4-dd8b-4aff-b41b-48095609108c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/41cf805a-e57a-4fde-b138-22847feba6b2 HTTP/1.1" status: 404 len: 339 time: 0.0474136 Nov 05 14:49:04.128782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.129411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:49:02Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:04.133342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43230) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.139279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.139866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Fanout notify agent at l3_agent the message router_deleted on router 2c5f71a3-858d-4eeb-b981-4010027a4a3a {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:04.148180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.149318 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-77df0aed-6e03-4f8d-a9df-9e9e89172fc8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/routers/2c5f71a3-858d-4eeb-b981-4010027a4a3a HTTP/1.1" status: 204 len: 168 time: 0.4038672 Nov 05 14:49:04.161502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43232) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.161837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:04.166529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:04.171446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93af1870-b978-4c0f-8a49-9b21b9b3f5b3 None None] The sync data for ids ['2c5f71a3-858d-4eeb-b981-4010027a4a3a'] in dv-neutron-816850-1-hyperv is: [{'id': '2c5f71a3-858d-4eeb-b981-4010027a4a3a', 'name': 'tempest-NetworksTestDHCPv6-router-1767057949', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:48:55Z', 'updated_at': '2021-11-05T14:49:02Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:04.177443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Pushing event updated for resources: {'Port': ['ID=f42080c8-dfa3-4326-8c61-36ae89e92c51,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.177840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:04.222232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 647} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:04.224798 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a7dd0fa-6066-44bc-97b3-2f38f812f5b8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.225300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4a7dd0fa-6066-44bc-97b3-2f38f812f5b8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.229088 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4a7dd0fa-6066-44bc-97b3-2f38f812f5b8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/fe47108c-6f8b-46e6-9e53-84dcda8efb72 HTTP/1.1" status: 404 len: 337 time: 0.0909135 Nov 05 14:49:04.244351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Attempting to bind port f42080c8-dfa3-4326-8c61-36ae89e92c51 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:04.245477 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Attempting to bind port f42080c8-dfa3-4326-8c61-36ae89e92c51 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:04.246306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Attempting to bind port f42080c8-dfa3-4326-8c61-36ae89e92c51 on network 16ba37ba-cfa5-4979-adb6-ef4be077a592 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:04.253062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:04.253773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Checking segment: {'id': 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:04.254179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.254571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Bound using segment: {'id': 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:04.255048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Bound port: f42080c8-dfa3-4326-8c61-36ae89e92c51, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': '16ba37ba-cfa5-4979-adb6-ef4be077a592'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:04.255642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.271832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.300717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.301056 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31 of type vlan for network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc Nov 05 14:49:04.323856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3fed972-454a-4431-a947-2fd343868812 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.324168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3fed972-454a-4431-a947-2fd343868812 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.327495 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d3fed972-454a-4431-a947-2fd343868812 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/56b362ed-c41f-4f72-a34a-6ebd2abf21f2 HTTP/1.1" status: 404 len: 339 time: 0.0546961 Nov 05 14:49:04.333023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c875a63f-b449-4c0d-8012-d0bacbd6e9ea,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.335138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] For port f42080c8-dfa3-4326-8c61-36ae89e92c51, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:04.336146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43236) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.339245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] For port f42080c8-dfa3-4326-8c61-36ae89e92c51, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f42080c8-dfa3-4326-8c61-36ae89e92c51,segment=NetworkSegment(d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f),segment_id=d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:04.345847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.417027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-2ec3f360-20db-4b44-a562-7cdcfdbbd29f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.417441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2ec3f360-20db-4b44-a562-7cdcfdbbd29f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.418523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f08a3027-87c8-4531-b405-9950be14c028 None None] Pushing event updated for resources: {'Port': ['ID=f42080c8-dfa3-4326-8c61-36ae89e92c51,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.420545 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2ec3f360-20db-4b44-a562-7cdcfdbbd29f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/89448f85-c382-4833-91b3-3e338de730ba HTTP/1.1" status: 404 len: 337 time: 0.0622163 Nov 05 14:49:04.422522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.440311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43238) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.468545 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-5beee8cf-4171-4916-8d38-516f30617758 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.469215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5beee8cf-4171-4916-8d38-516f30617758 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.474950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5beee8cf-4171-4916-8d38-516f30617758 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/cfcab3d0-89bd-4ad0-b4a1-47d92af092ba HTTP/1.1" status: 404 len: 339 time: 0.0311303 Nov 05 14:49:04.476681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43240) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.478664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:04.482308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.577424 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef5935f1-aac5-4f03-95e8-6169c237f05e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.577894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ef5935f1-aac5-4f03-95e8-6169c237f05e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.581016 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ef5935f1-aac5-4f03-95e8-6169c237f05e tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/f4667038-5aff-4abc-8f86-0b98f3cbc42e HTTP/1.1" status: 404 len: 337 time: 0.1033127 Nov 05 14:49:04.584271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43242) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.584936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.590722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:04.591541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.686921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17709b5-1600-41e7-8b16-322e95b4eb0b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:04.716950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f17709b5-1600-41e7-8b16-322e95b4eb0b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:04.717244 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.4346769 Nov 05 14:49:04.717347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f17709b5-1600-41e7-8b16-322e95b4eb0b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:04.717347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e61f38d5-4494-4ce4-b69f-400225dbfec1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:04.722104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43244) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.725389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-a1bf4b04-df83-4537-bbbe-bd690ff1bd14 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.726030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a1bf4b04-df83-4537-bbbe-bd690ff1bd14 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.731538 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a1bf4b04-df83-4537-bbbe-bd690ff1bd14 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/d03f4cb5-4ce6-4ef0-b435-fdc9d939fd64 HTTP/1.1" status: 404 len: 339 time: 0.1346433 Nov 05 14:49:04.735997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43246) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.748493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: e61f38d5-4494-4ce4-b69f-400225dbfec1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:04.748994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e61f38d5-4494-4ce4-b69f-400225dbfec1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:04.778455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985e8849-76aa-4693-8a24-2d459b62fa76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=965643a3-ab1e-4f60-b0a0-5bd33b3145bc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.784677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-2631306f-3a2e-4f8f-8566-54144bee881f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.785088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2631306f-3a2e-4f8f-8566-54144bee881f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.786342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-926573290', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:04.788881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2631306f-3a2e-4f8f-8566-54144bee881f tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/fa57e13e-2b6e-4ca7-a62d-74c7674bac3f HTTP/1.1" status: 404 len: 337 time: 0.0489593 Nov 05 14:49:04.791066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43248) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.791537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:04.805865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.830979 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6f87334-03ca-473c-9979-aa3424538824 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.832259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6f87334-03ca-473c-9979-aa3424538824 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.838509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a6f87334-03ca-473c-9979-aa3424538824 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/91236e0a-5e2a-4efa-bab0-9e98b8d647c7 HTTP/1.1" status: 404 len: 339 time: 0.0442531 Nov 05 14:49:04.838720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.839743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.843345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/networks/0d941fc7-e9da-40d5-a8b5-26174382c84d HTTP/1.1" status: 204 len: 168 time: 3.1253202 Nov 05 14:49:04.851492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43252) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.862422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'routes': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:04.878757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e73f4a29-342d-49a4-ae43-382af21b82f4 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Pushing event deleted for resources: {'Network': ['ID=0d941fc7-e9da-40d5-a8b5-26174382c84d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.885941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.901938 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-663f1837-d816-4e86-b604-e54c4fa20c70 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.902393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-663f1837-d816-4e86-b604-e54c4fa20c70 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.907959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-663f1837-d816-4e86-b604-e54c4fa20c70 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/8b427c22-5e30-4a44-bafb-68989f9f3089 HTTP/1.1" status: 404 len: 337 time: 0.0631733 Nov 05 14:49:04.918171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.919219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:04.927058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43254) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:04.936738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=5cb35905-f436-47ee-87cc-0a8c0713c493,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:04.992843 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-811453dd-d255-4ec1-85a7-7d6013d4f86d tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:04.993477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-811453dd-d255-4ec1-85a7-7d6013d4f86d tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:04.996659 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-811453dd-d255-4ec1-85a7-7d6013d4f86d tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/eb43032a-4715-403c-8c61-4554522e4ffa HTTP/1.1" status: 404 len: 339 time: 0.0683422 Nov 05 14:49:05.007108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43256) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.074838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.110353 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-740b2975-fcc1-440d-95cd-712e2e3ee39c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:05.110811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-740b2975-fcc1-440d-95cd-712e2e3ee39c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:05.114522 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-740b2975-fcc1-440d-95cd-712e2e3ee39c tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/83412e46-d0f7-473c-81fe-44457c7d732a HTTP/1.1" status: 404 len: 337 time: 0.1055202 Nov 05 14:49:05.117945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.120503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43258) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.192083 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8b4e97b-173c-4adc-b492-ba8325e1744b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:05.192950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a8b4e97b-173c-4adc-b492-ba8325e1744b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:05.200316 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a8b4e97b-173c-4adc-b492-ba8325e1744b tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/38fa4b1a-98e1-4a9e-beb5-613b9678eb9a HTTP/1.1" status: 404 len: 339 time: 0.0712776 Nov 05 14:49:05.200316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.245085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43260) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.396350 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-de54ad8c-780b-4c93-816a-b59f55ba4843 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:05.396831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de54ad8c-780b-4c93-816a-b59f55ba4843 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:05.399864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-de54ad8c-780b-4c93-816a-b59f55ba4843 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/308e13f1-d31d-4998-a6c2-4d4fa01fd29e HTTP/1.1" status: 404 len: 337 time: 0.1528797 Nov 05 14:49:05.405366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43262) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.450956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Added routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Nov 05 14:49:05.451269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.extraroute_db [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Removed routes are [] {{(pid=113580) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Nov 05 14:49:05.451613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.453427 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-8d109f25-8ed2-4664-b996-5c23c0295a13 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:05.454028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8d109f25-8ed2-4664-b996-5c23c0295a13 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:05.457196 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8d109f25-8ed2-4664-b996-5c23c0295a13 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/8c4e3da2-f9ab-4d15-9adb-0a9654713c40 HTTP/1.1" status: 404 len: 339 time: 0.0508630 Nov 05 14:49:05.463858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43264) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.473994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.481823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.499520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.550830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f405ae31-9040-4639-82da-6aaa8c8ab7ce None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:05.599959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.618355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.620816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router 20bf511d-a5f6-41cd-941e-30fbb72f1d25 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:05.623191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:05.631635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.633716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c3c7e2a3-c4f7-4552-bd50-3340ae8ff5eb tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/20bf511d-a5f6-41cd-941e-30fbb72f1d25 HTTP/1.1" status: 204 len: 168 time: 3.8824234 Nov 05 14:49:05.634238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Deleting subnet 8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:05.645895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43266) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.655293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] Provisioning complete for port f42080c8-dfa3-4326-8c61-36ae89e92c51 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:05.655669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.670657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:05.672408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.681487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:05.682085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.683647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'name': 'tempest-snat-router-790099175', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:05.703465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f405ae31-9040-4639-82da-6aaa8c8ab7ce None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:05.743272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=64c672d2-220d-4e2a-8a91-e208f7489004,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:05.747343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.754981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.777643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.778815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.809843 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5099ab74-56fd-4b7b-a7a4-97bf1b300166 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.6448066 Nov 05 14:49:05.809843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.814324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43268) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:05.819822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:05.822208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.882396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:05.890837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] For port f42080c8-dfa3-4326-8c61-36ae89e92c51, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f42080c8-dfa3-4326-8c61-36ae89e92c51,segment=NetworkSegment(d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f),segment_id=d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:05.898208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.911389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.974856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.980275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:05.981837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.006226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:06.014046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.018303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ba3f44b9-57e3-48e0-ad34-0e1d36f007fc tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 701 time: 1.1645696 Nov 05 14:49:06.018955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43270) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:06.020708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.020873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.022268 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Sync routers for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:06.032939 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:06.034444 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:06.074676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6841b483-e276-4673-9857-a005542297b6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 205 time: 0.0498457 Nov 05 14:49:06.077628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43272) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:06.154296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff6c787-89c4-4311-ae3b-ea55d68c3e5d None None] Pushing event updated for resources: {'Port': ['ID=f42080c8-dfa3-4326-8c61-36ae89e92c51,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:06.199624 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:06.203418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.243830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f42080c8-dfa3-4326-8c61-36ae89e92c51 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:06.275489 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:06.303499 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Checking router: ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:06.318525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.321416 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Routers {'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:06.323093 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:06.346469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f42080c8-dfa3-4326-8c61-36ae89e92c51 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:06.346859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.352901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.386549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.389621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=d6a71746-5092-43a6-afa1-8cd649f1670d,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:06.407261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.429180 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] Set router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:06.446219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.461836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/subnets/8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2 HTTP/1.1" status: 204 len: 168 time: 0.9960451 Nov 05 14:49:06.462214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94720e50-5787-4f5a-a569-a8badedcf0b2 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Subnet': ['ID=8203f8c0-b2a7-460a-bfe0-c37b1c94ebb2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:06.471004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43274) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:06.495689 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:06.507536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d293cb5-f18e-4d3e-9022-6f3aab039f74 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:06.540613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.544660 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0ea2cd00-07d3-45bd-a8a4-2e77df83e955 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.7266192 Nov 05 14:49:06.551614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5d293cb5-f18e-4d3e-9022-6f3aab039f74 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:06.552151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d293cb5-f18e-4d3e-9022-6f3aab039f74 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:06.556350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43276) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:06.558479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.561140 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f6bb032-10e4-4c9d-b702-4b1453bf7c1e None None] The sync data for ids ['ec6a1ceb-04d6-4b5e-9c66-702e74c28da8'] in dv-neutron-816850-1-hyperv is: [{'id': 'ec6a1ceb-04d6-4b5e-9c66-702e74c28da8', 'name': 'tempest-RoutersTest-router-1057398300', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:47:40Z', 'updated_at': '2021-11-05T14:48:58Z', 'revision_number': 11, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:06.568667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.581204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.608958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.693007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.753943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.754441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:06.764038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.770985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-03f5b836-793b-44e1-ae57-38deb171190f tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 204 len: 168 time: 0.6910799 Nov 05 14:49:06.790923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43278) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:06.796573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-97753200', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:06.805220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.890867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.157 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/dbed45f6-5a06-4297-8146-dbb3a29f0ec6) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:06.900611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.901259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:06.978541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Deleting port 271c7e21-4444-45a0-8a1f-614588c74471 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:06.979046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.003443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.045405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.058499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.060399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b361d2ad-77e2-4595-b9d2-e754c3fbe62d None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:07.076087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] For port 271c7e21-4444-45a0-8a1f-614588c74471, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=271c7e21-4444-45a0-8a1f-614588c74471,segment=NetworkSegment(0408f50a-cd3d-4543-8801-f4470d128538),segment_id=0408f50a-cd3d-4543-8801-f4470d128538)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:07.076443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.126899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d315773-b0e7-4b60-8394-81f1badcba83 None None] Network cf4a56c9-bc0c-4cd4-aa24-69852b584c3e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:07.146502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Calling delete_port for 271c7e21-4444-45a0-8a1f-614588c74471 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:07.226036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3fae89ff-0598-4d4f-b87c-88c98b3acb20 None None] Provisioning complete for port f42080c8-dfa3-4326-8c61-36ae89e92c51 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:07.226710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3fae89ff-0598-4d4f-b87c-88c98b3acb20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b361d2ad-77e2-4595-b9d2-e754c3fbe62d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:07.275674 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:07.295377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c178eb4-03c8-4ac1-a8ab-252fb0dc9c18 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0c178eb4-03c8-4ac1-a8ab-252fb0dc9c18 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:07.383490 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:07.464807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3fae89ff-0598-4d4f-b87c-88c98b3acb20 None None] Provisioning complete for port d6a71746-5092-43a6-afa1-8cd649f1670d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:07.465361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3fae89ff-0598-4d4f-b87c-88c98b3acb20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.524129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3fae89ff-0598-4d4f-b87c-88c98b3acb20 None None] Port d6a71746-5092-43a6-afa1-8cd649f1670d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:07.542166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd74f9d1-c36c-4d14-a2e6-72be0c28905a None None] DHCP port deletion for cf4a56c9-bc0c-4cd4-aa24-69852b584c3e request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:49:07.591741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.665236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-35ac7af4-2e70-49ac-9758-3bf3537b5ef7 None None] Provisioning complete for port d6a71746-5092-43a6-afa1-8cd649f1670d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:07.667101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.668758 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-95c70dbe-947d-4b52-84bc-850155b359fd tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.8759217 Nov 05 14:49:07.672283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-35ac7af4-2e70-49ac-9758-3bf3537b5ef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.682556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:07.690424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Request body: {'router': {'admin_state_up': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:07.706486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.718053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9520267-198a-4be8-8bce-50d1ae81abf8 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:07.740254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Port': ['ID=271c7e21-4444-45a0-8a1f-614588c74471,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:07.747561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] No DVR routers for this DVR port 271c7e21-4444-45a0-8a1f-614588c74471 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:49:07.750914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-35ac7af4-2e70-49ac-9758-3bf3537b5ef7 None None] Port d6a71746-5092-43a6-afa1-8cd649f1670d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:07.774246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::1 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/64c672d2-220d-4e2a-8a91-e208f7489004/e0b391b6-2a11-4888-b3af-15a60da139d2) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:07.810377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9520267-198a-4be8-8bce-50d1ae81abf8 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:07.827477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.870127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.878791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.905521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-343ddcde-3437-4b69-9c79-dcbfea83de44 None None] Provisioning complete for port d6a71746-5092-43a6-afa1-8cd649f1670d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:07.906216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-343ddcde-3437-4b69-9c79-dcbfea83de44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.908730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf4a56c9-bc0c-4cd4-aa24-69852b584c3e']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:07.926956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0408f50a-cd3d-4543-8801-f4470d128538') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:07.927230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0408f50a-cd3d-4543-8801-f4470d128538') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:07.941896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.958178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.965004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-343ddcde-3437-4b69-9c79-dcbfea83de44 None None] Port d6a71746-5092-43a6-afa1-8cd649f1670d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:07.965230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.978610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Releasing vlan 636 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:49:07.979310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:49:07.981973 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:49:07.984670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.058382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.069200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.075162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] 10.222.0.30 "DELETE /v2.0/networks/cf4a56c9-bc0c-4cd4-aa24-69852b584c3e HTTP/1.1" status: 204 len: 168 time: 1.6001277 Nov 05 14:49:08.088291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f76db7-30fb-4f16-87ee-57afd84508d8 tempest-NetworksTest-650061071 tempest-NetworksTest-650061071-project] Pushing event deleted for resources: {'Network': ['ID=cf4a56c9-bc0c-4cd4-aa24-69852b584c3e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.100216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.166438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:08.166668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f42080c8-dfa3-4326-8c61-36ae89e92c51 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:08.168395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:08.173147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:08.173694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.193878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.219941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.229171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.229706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '64c672d2-220d-4e2a-8a91-e208f7489004'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '812cb9a1-7299-4389-992c-e158c9ab11b8'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:49:08.255896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.265758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.277167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f42080c8-dfa3-4326-8c61-36ae89e92c51 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:08.277650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.391515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.396205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:08.415413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:08.428036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:08.432327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.469873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 172.26.5.16 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/3798a300-d4cb-4ade-ad05-b687bdf61770) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:08.538913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/64c672d2-220d-4e2a-8a91-e208f7489004/812cb9a1-7299-4389-992c-e158c9ab11b8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:08.558067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.569568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43286) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:08.629422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.630210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.633553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 271c7e21-4444-45a0-8a1f-614588c74471 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:08.664622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 271c7e21-4444-45a0-8a1f-614588c74471 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:08.665323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 271c7e21-4444-45a0-8a1f-614588c74471 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:08.733881 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:08.753889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Router 1ce7d474-d8cb-4d5c-833c-a55b79e5d92c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:08.765968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.771043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.775381 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2748794e-dab6-4345-a74e-263399b2d2d8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f15c91f02d964fe68931931339a6282b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2022498 Nov 05 14:49:08.776304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43290) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:08.807789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=d6a71746-5092-43a6-afa1-8cd649f1670d,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.841850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.851129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.851925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.871437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd30439-918d-4c05-83a8-bcfd5f8efae6 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.899781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.969379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.973180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:08.979483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:08.987123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:09.001182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.005852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc8e9110-4a25-40a5-ae60-7b8811089e32 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "PUT /v2.0/routers/1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 200 len: 692 time: 1.3193924 Nov 05 14:49:09.007577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Sync routers for ids ['1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:09.007734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43292) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.021721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Routers {'1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:09.022356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:09.059896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network 16ba37ba-cfa5-4979-adb6-ef4be077a592 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:09.070943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:09.110325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:09.110549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Set router 1ce7d474-d8cb-4d5c-833c-a55b79e5d92c gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:09.119101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6312da9f-c715-45c4-8a64-60e8afa603a6 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/routers/1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 200 len: 698 time: 0.1103489 Nov 05 14:49:09.121973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43294) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.122627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:09.182516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1ce7d474-d8cb-4d5c-833c-a55b79e5d92c', 'name': 'tempest-RoutersTest-router-97753200', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:09.182875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.184790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.199883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-37e81c09-e84b-4b84-a321-cd685f416c06 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 200 len: 205 time: 0.0784478 Nov 05 14:49:09.200676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43296) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.203099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.205940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.209580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/709d6f57-657c-4fb0-b565-0baea87db68a HTTP/1.1" status: 204 len: 168 time: 0.4298313 Nov 05 14:49:09.222602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Checking router: 1ce7d474-d8cb-4d5c-833c-a55b79e5d92c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:09.232857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Routers {'1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:09.233724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:09.280409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:09.305736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:09.311639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=3798a300-d4cb-4ade-ad05-b687bdf61770,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:09.314595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:09.373505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0871109f-f186-4a5e-b022-b9a43c72a3f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=709d6f57-657c-4fb0-b565-0baea87db68a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:09.452625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.503868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] Set router 1ce7d474-d8cb-4d5c-833c-a55b79e5d92c gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:09.574520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1ce7d474-d8cb-4d5c-833c-a55b79e5d92c', 'name': 'tempest-RoutersTest-router-97753200', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:09.645104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ece3c37-cf1c-42b3-bf56-ccf66c23e0e4 None None] The sync data for ids ['1ce7d474-d8cb-4d5c-833c-a55b79e5d92c'] in dv-neutron-816850-1-hyperv is: [{'id': '1ce7d474-d8cb-4d5c-833c-a55b79e5d92c', 'name': 'tempest-RoutersTest-router-97753200', 'tenant_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': 'bbde0bc4197d4a3abf61fecd96fbf9c9', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:09.713107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.715912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.722895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a762afc-ec57-4315-8af9-4da0bc44f703 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:09.796962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.797660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Fanout notify agent at l3_agent the message router_deleted on router 1ce7d474-d8cb-4d5c-833c-a55b79e5d92c {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:09.807863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.815173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8fae3954-381a-4d30-901e-0f621c1f219c tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 204 len: 168 time: 0.6069036 Nov 05 14:49:09.815980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43308) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.855259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c1744374-c88d-4121-9819-05f8aac8f2fb None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:09.855899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1744374-c88d-4121-9819-05f8aac8f2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:09.867549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8e42db45-fb0e-4757-ad63-2df39dcb1a67 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 200 len: 205 time: 0.0468373 Nov 05 14:49:09.868250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43312) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.926612 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f2cc516c-d128-4c92-bebb-05ccd18f1d26 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:09.931768 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f2cc516c-d128-4c92-bebb-05ccd18f1d26 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/1ce7d474-d8cb-4d5c-833c-a55b79e5d92c HTTP/1.1" status: 404 len: 336 time: 0.0549409 Nov 05 14:49:09.932397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43314) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.938927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a762afc-ec57-4315-8af9-4da0bc44f703 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:09.971043 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b5ef621-91ab-40a4-97c1-1c1396f10295 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:09.971502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3b5ef621-91ab-40a4-97c1-1c1396f10295 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:09.978528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3b5ef621-91ab-40a4-97c1-1c1396f10295 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/2c2e96ed-b727-4039-a867-c1c057b74aba HTTP/1.1" status: 404 len: 337 time: 0.0441687 Nov 05 14:49:09.978911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:09.989316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:10.072337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Router 85ee3714-cf48-4297-9200-eff9ba8ff95e is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:10.079568 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c025610-d2e3-4ae5-8dd3-123eb26dd33e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:10.079568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c025610-d2e3-4ae5-8dd3-123eb26dd33e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:10.085428 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2c025610-d2e3-4ae5-8dd3-123eb26dd33e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/0408f5e3-09a3-44a0-8caa-8475b072368f HTTP/1.1" status: 404 len: 337 time: 0.1002715 Nov 05 14:49:10.094209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43322) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.137506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:10.147001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-aae82c15-30fe-4757-bcc1-6c0b292ab520 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:10.147791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aae82c15-30fe-4757-bcc1-6c0b292ab520 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:10.155648 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aae82c15-30fe-4757-bcc1-6c0b292ab520 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/9982b8d7-8946-4c79-ab2e-d9340565a4f3 HTTP/1.1" status: 404 len: 337 time: 0.0595801 Nov 05 14:49:10.156525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43326) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.175455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.206963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4da8c9d6-2270-4d3f-ab0c-c4293576253b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:10.207480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4da8c9d6-2270-4d3f-ab0c-c4293576253b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:10.217072 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4da8c9d6-2270-4d3f-ab0c-c4293576253b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/aa8246cf-afad-4136-9822-e0e43b06086c HTTP/1.1" status: 404 len: 337 time: 0.0572033 Nov 05 14:49:10.218223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43330) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.241016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:10.251167 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Sync routers for ids ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:10.268307 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Routers {'d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:10.268960 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.290519 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4d6f0c10-8073-441b-a1de-43baa20c775c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "PUT /v2.0/routers/d4048807-5f13-4206-9a9b-0d4c0cb0fbbd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7269213 Nov 05 14:49:10.291524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:10.292171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.297586 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61a89c82-9fd5-425a-837e-0321dba95211 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 200 len: 205 time: 0.0758052 Nov 05 14:49:10.298198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43332) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.298534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43334) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.308034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:10.326923 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fb61d12a-15b9-4ab4-8fb0-e40d1134597b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/routers/85ee3714-cf48-4297-9200-eff9ba8ff95e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4782569 Nov 05 14:49:10.329914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] Sync routers for ids ['85ee3714-cf48-4297-9200-eff9ba8ff95e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:10.330575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43336) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.330575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43338) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.374396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] Routers {'85ee3714-cf48-4297-9200-eff9ba8ff95e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:10.375023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['85ee3714-cf48-4297-9200-eff9ba8ff95e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.397344 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Set router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:10.399053 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-071e10c6-bf94-49e4-82df-6bcd02661439 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:10.400365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-071e10c6-bf94-49e4-82df-6bcd02661439 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/ec6a1ceb-04d6-4b5e-9c66-702e74c28da8 HTTP/1.1" status: 404 len: 336 time: 0.0917075 Nov 05 14:49:10.411353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43342) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.421837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.449635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] Routers {'85ee3714-cf48-4297-9200-eff9ba8ff95e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:10.450499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['85ee3714-cf48-4297-9200-eff9ba8ff95e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.463954 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b8ea95c-4497-4f76-9e0d-4d936099fde2 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 HTTP/1.1" status: 200 len: 205 time: 0.0510128 Nov 05 14:49:10.466351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43344) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.493651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.494949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d58b885b-8ef3-4f8e-9767-7d79b100f915 None None] The sync data for ids ['85ee3714-cf48-4297-9200-eff9ba8ff95e'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:10.509578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f423606-f45c-4011-80f1-03f29429ed24 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:10.511186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5f423606-f45c-4011-80f1-03f29429ed24 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports/e0b391b6-2a11-4888-b3af-15a60da139d2 HTTP/1.1" status: 200 len: 911 time: 0.2037225 Nov 05 14:49:10.518280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43346) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.605557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-34e75a99-e196-4d18-91a6-bece99ea8e8b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:10.609812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-34e75a99-e196-4d18-91a6-bece99ea8e8b tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/6f09333b-8a7d-4c45-a7b6-f77c9c0ce730 HTTP/1.1" status: 404 len: 336 time: 0.1384151 Nov 05 14:49:10.610510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43348) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.620105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1069323615-network', 'tenant_id': '747df015bfd341929de773100c6c68ae'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:10.650442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b98811fa-7d21-4735-ba17-128b9214d2e8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:10.655670 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b98811fa-7d21-4735-ba17-128b9214d2e8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?device_id=85ee3714-cf48-4297-9200-eff9ba8ff95e HTTP/1.1" status: 200 len: 987 time: 0.3157377 Nov 05 14:49:10.658736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43350) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.659073 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-dd35c306-fa2b-41ba-8ae2-4ccdfbda3bd7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:10.659532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dd35c306-fa2b-41ba-8ae2-4ccdfbda3bd7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:10.671334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd35c306-fa2b-41ba-8ae2-4ccdfbda3bd7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/33b01162-f96a-4dd7-afd3-3f31bda2f001 HTTP/1.1" status: 404 len: 337 time: 0.0567727 Nov 05 14:49:10.671569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43352) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.681679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ead25a86-bd6e-43c0-a1d4-f5a2cd07afb1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:10.688014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ead25a86-bd6e-43c0-a1d4-f5a2cd07afb1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:10.692702 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ead25a86-bd6e-43c0-a1d4-f5a2cd07afb1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1678948 Nov 05 14:49:10.698672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43354) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.723688 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': 'e0b391b6-2a11-4888-b3af-15a60da139d2', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:2a:e8:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'device_owner': 'network:router_interface', 'standard_attr_id': 929, 'fixed_ips': [{'subnet_id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:10.758091 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Checking router: d4048807-5f13-4206-9a9b-0d4c0cb0fbbd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:10.758803 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Updating router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd port e0b391b6-2a11-4888-b3af-15a60da139d2 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:10.776446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.781029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Made reservation on behalf of 747df015bfd341929de773100c6c68ae for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:10.781197 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-08989b2a-42b8-45c9-a5a8-c7ccde537047 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 200 len: 205 time: 0.1083694 Nov 05 14:49:10.781782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43356) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:10.783496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.795055 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.839946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:10.949381 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-9b5d9223-f856-43dd-82f1-879cc24f7978 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:10.955736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b5d9223-f856-43dd-82f1-879cc24f7978 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/d9899e1d-cca2-46ee-a15f-19b76977fd0a HTTP/1.1" status: 404 len: 336 time: 0.1370828 Nov 05 14:49:10.982996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43358) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.028207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-334ca47b-48d2-4c15-a2f5-a653f811bd9e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 HTTP/1.1" status: 200 len: 205 time: 0.0440671 Nov 05 14:49:11.028967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43360) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.034306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:11.077057 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-7537e7cc-5a7a-486f-9f26-2e8efd13664a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:11.081229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7537e7cc-5a7a-486f-9f26-2e8efd13664a tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/caaf257c-8f3f-4ae8-9b2e-c7dffebc03d2 HTTP/1.1" status: 404 len: 336 time: 0.0499566 Nov 05 14:49:11.084066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43362) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.120798 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9d35465-653f-4432-aa8a-caf9c4b82535 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:11.121255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c9d35465-653f-4432-aa8a-caf9c4b82535 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:11.129071 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c9d35465-653f-4432-aa8a-caf9c4b82535 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/841b00df-9663-4f2d-9b64-5d0b3f368de5 HTTP/1.1" status: 404 len: 337 time: 0.0438898 Nov 05 14:49:11.151094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43364) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.187800 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.198637 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.253264 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-57aa2b2b-c532-47d0-8e4d-d0c680c13a33 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=78ebd504-ad5b-4336-918b-6990db8c7d29 HTTP/1.1" status: 200 len: 205 time: 0.0993285 Nov 05 14:49:11.256077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43366) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.261907 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45917b21-7ac0-44f4-9452-b16624a18b20 None None] Pushing event updated for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:11.343584 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-3b73746a-a3b6-4c8c-9869-a0c5d72739f8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:11.347598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3b73746a-a3b6-4c8c-9869-a0c5d72739f8 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/78ebd504-ad5b-4336-918b-6990db8c7d29 HTTP/1.1" status: 404 len: 336 time: 0.0877748 Nov 05 14:49:11.350708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43368) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.353048 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Attempting to bind port e0b391b6-2a11-4888-b3af-15a60da139d2 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:11.353522 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Attempting to bind port e0b391b6-2a11-4888-b3af-15a60da139d2 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:11.353981 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Attempting to bind port e0b391b6-2a11-4888-b3af-15a60da139d2 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:11.359613 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:11.360123 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:11.360778 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.361292 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:11.363755 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Bound port: e0b391b6-2a11-4888-b3af-15a60da139d2, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:11.364552 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.386729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.402135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba9bb30a-4bf6-4e51-8195-cbc470948551 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:11.402669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ba9bb30a-4bf6-4e51-8195-cbc470948551 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:11.412127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ba9bb30a-4bf6-4e51-8195-cbc470948551 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/cd1012a5-c0e9-473b-8ac4-dccf8b779985 HTTP/1.1" status: 404 len: 337 time: 0.0575211 Nov 05 14:49:11.412791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:11.413261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.414102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43370) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.414852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.440083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.466873 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] For port e0b391b6-2a11-4888-b3af-15a60da139d2, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:11.471506 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] For port e0b391b6-2a11-4888-b3af-15a60da139d2, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e0b391b6-2a11-4888-b3af-15a60da139d2,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:11.477822 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.505879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.528835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 644} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:11.546415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.547009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Added segment de99c3ed-af20-4d87-a556-619f37cf0e36 of type vlan for network 45055355-0dd4-4c48-858a-f131e1d1f8bc Nov 05 14:49:11.568778 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45917b21-7ac0-44f4-9452-b16624a18b20 None None] Pushing event updated for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:11.582801 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Routers {'d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:11.583819 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:11.636863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fef020cf-6344-42a0-9cd3-94ec3dcb949e tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "GET /v2.0/ports?device_id=9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 HTTP/1.1" status: 200 len: 205 time: 0.1262703 Nov 05 14:49:11.637080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Provisioning complete for port e0b391b6-2a11-4888-b3af-15a60da139d2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:11.637080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.643711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:11.646472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43372) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:11.649964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.804892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.833425 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:11.864808 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:11.865424 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:11.866252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fd95c45-4104-46e4-9dba-a0f1d40c3da6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:11.922123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] For port e0b391b6-2a11-4888-b3af-15a60da139d2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e0b391b6-2a11-4888-b3af-15a60da139d2,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:11.928618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.940930 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] Set router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:11.954487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:11.957147 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-08f61ed8-545e-4919-ab97-4f0de9206ac9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 7.2218401 Nov 05 14:49:11.969216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43374) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:12.024250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.027845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:12.028419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.070037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-485b637f-b89e-4d5c-a643-85155a2340f1 None None] Pushing event updated for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:12.096666 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-07eb751c-413a-4fb0-bf3a-5d4e621a2bf3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] delete failed (client error): The resource could not be found. Nov 05 14:49:12.097702 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-07eb751c-413a-4fb0-bf3a-5d4e621a2bf3 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/routers/9ef6a9b4-47ee-4e82-b9c6-0d9f0a7018d0 HTTP/1.1" status: 404 len: 336 time: 0.4485245 Nov 05 14:49:12.100671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43378) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:12.121867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ce42bff-93f6-4ef7-b6bd-53c80c783afc None None] Provisioning complete for port d6a71746-5092-43a6-afa1-8cd649f1670d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:12.122565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ce42bff-93f6-4ef7-b6bd-53c80c783afc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.130725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-fba37c11-03d0-402e-a6a4-cc4d4fb78855 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:12.131580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fba37c11-03d0-402e-a6a4-cc4d4fb78855 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:12.134765 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fba37c11-03d0-402e-a6a4-cc4d4fb78855 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/8b92d01e-3e77-4037-8c4e-09b9e3932ed7 HTTP/1.1" status: 404 len: 337 time: 0.0331297 Nov 05 14:49:12.137316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43380) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:12.155653 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:12.174133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.8424642 Nov 05 14:49:12.175005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43382) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:12.205973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-3400ce2f-b504-4885-a435-dd08855cd5b7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] DELETE failed (client error): The resource could not be found. Nov 05 14:49:12.206443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3400ce2f-b504-4885-a435-dd08855cd5b7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:12.209566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3400ce2f-b504-4885-a435-dd08855cd5b7 tempest-RoutersTest-1080540294 tempest-RoutersTest-1080540294-project] 10.222.0.30 "DELETE /v2.0/subnets/ed286e7f-a02b-4e69-b788-bed1ea0ec76a HTTP/1.1" status: 404 len: 337 time: 0.0713058 Nov 05 14:49:12.218723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1ce42bff-93f6-4ef7-b6bd-53c80c783afc None None] Port d6a71746-5092-43a6-afa1-8cd649f1670d cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:12.250375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ce42bff-93f6-4ef7-b6bd-53c80c783afc None None] Provisioning complete for port e0b391b6-2a11-4888-b3af-15a60da139d2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:12.250895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ce42bff-93f6-4ef7-b6bd-53c80c783afc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.254773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router 66be7d57-6b5f-4e71-855d-2589261aa403 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:12.275030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Request body: {'subnet': {'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1069323615-subnet', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:12.376679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Made reservation on behalf of 747df015bfd341929de773100c6c68ae for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:12.379358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.397996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port e0b391b6-2a11-4888-b3af-15a60da139d2 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:12.398419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.494941 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': 'e0b391b6-2a11-4888-b3af-15a60da139d2', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:2a:e8:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'device_owner': 'network:router_interface', 'standard_attr_id': 929, 'fixed_ips': [{'subnet_id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:11Z', 'revision_number': 4, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:12.500402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-32fbe57c-e027-4649-a1ff-4917e4ff5128 None None] Provisioning complete for port e0b391b6-2a11-4888-b3af-15a60da139d2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:12.501146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-32fbe57c-e027-4649-a1ff-4917e4ff5128 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.536024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port e0b391b6-2a11-4888-b3af-15a60da139d2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e0b391b6-2a11-4888-b3af-15a60da139d2,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:12.536738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.557455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for e0b391b6-2a11-4888-b3af-15a60da139d2 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:12.572715 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd37c6df-2080-41e3-a60e-6d94aff23c1c None None] The sync data for ids ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'] in dv-neutron-816850-1-hyperv is: [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 2, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None, '_interfaces': [{'id': 'e0b391b6-2a11-4888-b3af-15a60da139d2', 'name': '', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'mac_address': 'fa:16:3e:2a:e8:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'device_owner': 'network:router_interface', 'standard_attr_id': 929, 'fixed_ips': [{'subnet_id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:11Z', 'revision_number': 4, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'subnets': [{'id': '64c672d2-220d-4e2a-8a91-e208f7489004', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:12.611767 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:12.641101 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:12.641596 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Updating router c9eda620-b56d-4879-9d5c-3b17badf0d55 port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:12.680741 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.703562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43388) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:12.835390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-279083e0-2bec-44e3-aabf-aeee35609d8a None None] Provisioning complete for port e0b391b6-2a11-4888-b3af-15a60da139d2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:12.835792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-279083e0-2bec-44e3-aabf-aeee35609d8a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.852485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:12.900320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=e0b391b6-2a11-4888-b3af-15a60da139d2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:12.954850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-279083e0-2bec-44e3-aabf-aeee35609d8a None None] Could not find standard attr ID for object e0b391b6-2a11-4888-b3af-15a60da139d2. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:12.975262 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.plugins.ml2.db [None req-279083e0-2bec-44e3-aabf-aeee35609d8a None None] No ports have port_id starting with e0b391b6-2a11-4888-b3af-15a60da139d2 Nov 05 14:49:13.083567 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db7e8c4d-835d-4689-b195-b452ab6a8dde tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 1.1027887 Nov 05 14:49:13.087374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43392) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.098932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0fff69ee-039c-412a-a9d1-29b3fb6e4d23 None None] Could not find standard attr ID for object e0b391b6-2a11-4888-b3af-15a60da139d2. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:13.123811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9cac2f-e249-4b76-8580-e101ff7eaaeb admin admin] Pushing event updated for resources: {'Network': ['ID=45055355-0dd4-4c48-858a-f131e1d1f8bc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:13.138899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.139965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:13.221798 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.234787 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.235044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.290792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7e713c5c-a590-4e2d-b11e-86ed1b3d0fa3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bbde0bc4197d4a3abf61fecd96fbf9c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5863240 Nov 05 14:49:13.297867 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6965cc-fea4-4191-b8dc-bd8622510985 None None] Pushing event updated for resources: {'Port': ['ID=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:13.299850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43394) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.338104 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Attempting to bind port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:13.339774 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Attempting to bind port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:13.340169 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Attempting to bind port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:13.357608 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:13.357981 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:13.361024 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.362252 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:13.365859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Bound port: dbed45f6-5a06-4297-8146-dbb3a29f0ec6, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:13.368487 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.463528 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] For port dbed45f6-5a06-4297-8146-dbb3a29f0ec6, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:13.467961 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] For port dbed45f6-5a06-4297-8146-dbb3a29f0ec6, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:13.472742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a38ef8e-567b-4274-9f50-142c48873c89 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:13.475027 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.477963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3a38ef8e-567b-4274-9f50-142c48873c89 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3897138 Nov 05 14:49:13.478583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43396) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.540536 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:13.541679 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:13.555721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:13.568563 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8b0ea9e6-a9ae-43bb-b5b0-30b7db28a673 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0800836 Nov 05 14:49:13.573999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Sync routers for ids ['66be7d57-6b5f-4e71-855d-2589261aa403'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:13.577487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43398) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.590468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Routers {'66be7d57-6b5f-4e71-855d-2589261aa403'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:13.591038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['66be7d57-6b5f-4e71-855d-2589261aa403'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:13.596756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1368084472', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:13.604554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca6965cc-fea4-4191-b8dc-bd8622510985 None None] Pushing event updated for resources: {'Port': ['ID=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:13.632473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.634309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28787d3d-9e5f-452f-8e56-2bd503121505 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 7.9850426 Nov 05 14:49:13.637167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.639378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43400) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.710539 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:13.753429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:13.787234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.811738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.826132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Set router 66be7d57-6b5f-4e71-855d-2589261aa403 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:13.837773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a738c6ea-0bb8-45cf-87bb-1b3689e6e451,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:13.881983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:13.882279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Network hostable DHCP agents. Network: 45055355-0dd4-4c48-858a-f131e1d1f8bc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:13.898804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port d6a71746-5092-43a6-afa1-8cd649f1670d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:13.899284 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.903397 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c28870cc-fd2e-4990-97de-a400f5f6a9ad tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/66be7d57-6b5f-4e71-855d-2589261aa403 HTTP/1.1" status: 200 len: 907 time: 0.2556205 Nov 05 14:49:13.907571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43402) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.922961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'name': 'tempest-snat-router-790099175', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': True}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:13.932516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:13.941082 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-470504f2-c487-433d-9f33-1b0a261206d9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "PUT /v2.0/routers/d4048807-5f13-4206-9a9b-0d4c0cb0fbbd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2413735 Nov 05 14:49:13.941680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43404) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:13.953688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:13.957327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:13.980932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:13.999523 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:14.006837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 45055355-0dd4-4c48-858a-f131e1d1f8bc) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:14.017678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.019870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.027217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:14.027914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.030292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5e22966-f0fc-4b16-b9b3-bb9f3646b5de None None] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:14.060027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.067115 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13c1fbed-6291-42fa-a4de-6173e4b9448e None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:14.080199 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9cf9ac1b-7a16-43bd-866d-d9f299c5b246 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.8227983 Nov 05 14:49:14.080927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43406) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:14.094517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:14.110128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for d6a71746-5092-43a6-afa1-8cd649f1670d owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:14.147750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17a0333d-06ea-477f-8571-dc80ebb25397 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:14.149657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17a0333d-06ea-477f-8571-dc80ebb25397 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:14.151728 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-17a0333d-06ea-477f-8571-dc80ebb25397 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2085409 Nov 05 14:49:14.168201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43408) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:14.190240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e5e22966-f0fc-4b16-b9b3-bb9f3646b5de None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:14.208312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:14.226996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-383648c7-5392-4468-9519-2599e0680946 None None] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:14.277177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.286756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'name': 'tempest-snat-router-790099175', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16'}], 'enable_snat': False}, 'gw_port_id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:05Z', 'updated_at': '2021-11-05T14:49:10Z', 'revision_number': 3, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port': {'id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:cc:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'device_owner': 'network:router_gateway', 'standard_attr_id': 930, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:14.287278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.287544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.288615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.291872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.291872 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/50f23811-a493-49d4-9fd2-80f166253d4a HTTP/1.1" status: 204 len: 168 time: 0.9857535 Nov 05 14:49:14.319141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Checking router: 66be7d57-6b5f-4e71-855d-2589261aa403 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:14.319493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Updating router 66be7d57-6b5f-4e71-855d-2589261aa403 port 3798a300-d4cb-4ade-ad05-b687bdf61770 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-383648c7-5392-4468-9519-2599e0680946 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:14.365001 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:14.372306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.395050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7dd53d-7b58-4850-b0a3-d3f575802744 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50f23811-a493-49d4-9fd2-80f166253d4a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:14.407080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2241dd9a-38e1-4e5a-8d15-2259658c25de None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:14.425926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 64c672d2-220d-4e2a-8a91-e208f7489004 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:14.447514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.470095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=3381e8ef-646f-402d-992f-758c603f54be,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:14.496949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:14.499885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 965643a3-ab1e-4f60-b0a0-5bd33b3145bc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:14.551971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:14.563017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 965643a3-ab1e-4f60-b0a0-5bd33b3145bc) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:14.575074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:14.577089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.617008 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0b43d4e2-3c1b-466e-889e-4e48946fc75e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.0302782 Nov 05 14:49:14.617967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43414) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:14.665160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.705948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.720026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.830618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2241dd9a-38e1-4e5a-8d15-2259658c25de None None] Unable to find a vacant binding_index for network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:49:14.847833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2241dd9a-38e1-4e5a-8d15-2259658c25de None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 965643a3-ab1e-4f60-b0a0-5bd33b3145bc) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:14.940729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:14.987998 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Sync routers for ids ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:15.013563 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Routers {'d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:15.014574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:15.171576 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Set router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:15.252157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.297685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.419911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=d6a71746-5092-43a6-afa1-8cd649f1670d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:15.470373 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:12Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:15.495834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.496954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.513888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Checking router: d4048807-5f13-4206-9a9b-0d4c0cb0fbbd for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:15.526872 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Routers {'d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:15.528289 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:15.528849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.623426 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] Set router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:15.691661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.697435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43432) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:15.706018 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:12Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:15.707964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Attempting to bind port 3798a300-d4cb-4ade-ad05-b687bdf61770 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:15.708349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Attempting to bind port 3798a300-d4cb-4ade-ad05-b687bdf61770 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:15.708891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Attempting to bind port 3798a300-d4cb-4ade-ad05-b687bdf61770 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:15.722485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322c0ca1-9bfa-4fe8-99a0-55b89482b63f None None] Pushing event updated for resources: {'Port': ['ID=3798a300-d4cb-4ade-ad05-b687bdf61770,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:15.732093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:15.732498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:15.732912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.733309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:15.733778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Bound port: 3798a300-d4cb-4ade-ad05-b687bdf61770, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:15.734160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.765010 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b559252c-b06d-4925-b7ac-ffdb6cd999dd None None] The sync data for ids ['d4048807-5f13-4206-9a9b-0d4c0cb0fbbd'] in dv-neutron-816850-1-hyperv is: [{'id': 'd4048807-5f13-4206-9a9b-0d4c0cb0fbbd', 'name': 'tempest-NetworksTestDHCPv6-router-553890033', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:12Z', 'revision_number': 3, 'project_id': '6c1eac42b2854d16bc0940ee811229be', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:15.769864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-45055355-0dd4-4c48-858a-f131e1d1f8bc', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:15.770371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.806643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:15.807650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.810775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.911916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-1313318461', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:15.920642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] For port 3798a300-d4cb-4ade-ad05-b687bdf61770, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:15.947601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] For port 3798a300-d4cb-4ade-ad05-b687bdf61770, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3798a300-d4cb-4ade-ad05-b687bdf61770,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:15.960502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:15.961707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.030632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.056016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (965643a3-ab1e-4f60-b0a0-5bd33b3145bc/3381e8ef-646f-402d-992f-758c603f54be/96d615f3-eea3-46d2-b255-96f704d51534) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:16.062727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.071156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.122857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Allocated IP 172.20.0.2 (45055355-0dd4-4c48-858a-f131e1d1f8bc/a738c6ea-0bb8-45cf-87bb-1b3689e6e451/b5219506-82cf-4af9-bed1-f22b9d3e4cb0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:16.134634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.136093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1ccb80ba-442e-4013-b621-0f17656cf913 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 712 time: 0.4390895 Nov 05 14:49:16.139267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43436) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:16.144832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1418897261'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:16.179625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322c0ca1-9bfa-4fe8-99a0-55b89482b63f None None] Pushing event updated for resources: {'Port': ['ID=3798a300-d4cb-4ade-ad05-b687bdf61770,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:16.182433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Routers {'66be7d57-6b5f-4e71-855d-2589261aa403'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:16.183089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['66be7d57-6b5f-4e71-855d-2589261aa403'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:16.258363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.263511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:16.267562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.304386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.316326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.381313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:16.390437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dbed45f6-5a06-4297-8146-dbb3a29f0ec6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:16.390928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:16.397688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:16.405285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:16.466042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.509824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Allocated IP 172.20.0.2 (965643a3-ab1e-4f60-b0a0-5bd33b3145bc/3381e8ef-646f-402d-992f-758c603f54be/ca6f2f02-df01-42fa-a18b-094bdc2e7a68) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:16.518804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] Set router 66be7d57-6b5f-4e71-855d-2589261aa403 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:16.537913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.547186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=64c672d2-220d-4e2a-8a91-e208f7489004,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:16.578356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.581170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.586190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.587533 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bde226ea-6b5d-4c1f-b4cd-9755918b9d75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/64c672d2-220d-4e2a-8a91-e208f7489004 HTTP/1.1" status: 204 len: 168 time: 2.4171171 Nov 05 14:49:16.589167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.600319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 626} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:16.602330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43438) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:16.627790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.628442 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Added segment 98084bfc-d850-4b12-b946-4f9d3cfd95b1 of type vlan for network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 Nov 05 14:49:16.643431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.695105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'SecurityGroup': ['ID=51ba82bb-f567-431c-b673-80dbbd240fa7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:16.701448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.717208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.731295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.737279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.741443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:16.742017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.754720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.777404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.783271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:16.783893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:16.847936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:16.865065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:16.875573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:16.880365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.7402873 Nov 05 14:49:16.889943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43440) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:16.897203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'subnet': {'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:16.913444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Router 85ee3714-cf48-4297-9200-eff9ba8ff95e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:16.937110 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5bc19cfa-1e4d-403f-b202-31c9fb634fc2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.3289490 Nov 05 14:49:16.940816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43442) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:16.961874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Pushing event updated for resources: {'Port': ['ID=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:17.053204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 172.26.5.186 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/933f27f1-f3e1-48d1-948a-bef6bc0325c3) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:17.056377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.067329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Attempting to bind port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:17.067704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Attempting to bind port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:17.068058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Attempting to bind port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:17.080748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.104355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.120140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:17.120712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:17.120971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.121395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Bound using segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:17.121967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Bound port: b5219506-82cf-4af9-bed1-f22b9d3e4cb0, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:17.122394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.124384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.179155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:17.186138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port dbed45f6-5a06-4297-8146-dbb3a29f0ec6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:17.188303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:17.213499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] Sync routers for ids ['85ee3714-cf48-4297-9200-eff9ba8ff95e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:17.216369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:17.219566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:17.224491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4fb3d1a-7df0-41fc-92e1-ec3bf826681b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/routers/85ee3714-cf48-4297-9200-eff9ba8ff95e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5592487 Nov 05 14:49:17.226670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'name': 'tempest-snat-router-790099175', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16'}], 'enable_snat': False}, 'gw_port_id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:05Z', 'updated_at': '2021-11-05T14:49:10Z', 'revision_number': 3, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port': {'id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:cc:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'device_owner': 'network:router_gateway', 'standard_attr_id': 930, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:17.228621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Pushing event updated for resources: {'Port': ['ID=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:17.231850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.252581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43444) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.307876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c019e296-add0-4351-8439-550eeefde0cd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Network': ['ID=eeefa8c9-20cd-4d8f-bb76-d2922b8a4290,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:17.309113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-d67cc03a-d47c-4c99-bad8-e734a37ecfe5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:49:17.313268 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d67cc03a-d47c-4c99-bad8-e734a37ecfe5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/d6a71746-5092-43a6-afa1-8cd649f1670d HTTP/1.1" status: 404 len: 333 time: 0.0551677 Nov 05 14:49:17.313996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43446) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.391046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.394536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.435162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e0b391b6-2a11-4888-b3af-15a60da139d2 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:17.436901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:17.439374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.457112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.457980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Fanout notify agent at l3_agent the message router_deleted on router d4048807-5f13-4206-9a9b-0d4c0cb0fbbd {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:17.467736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.468870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3d9f11-da39-4661-86db-dbe591db8313 None None] The sync data for ids ['66be7d57-6b5f-4e71-855d-2589261aa403'] in dv-neutron-816850-1-hyperv is: [{'id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'name': 'tempest-snat-router-790099175', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16'}], 'enable_snat': False}, 'gw_port_id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:05Z', 'updated_at': '2021-11-05T14:49:10Z', 'revision_number': 3, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port': {'id': '3798a300-d4cb-4ade-ad05-b687bdf61770', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:cc:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '66be7d57-6b5f-4e71-855d-2589261aa403', 'device_owner': 'network:router_gateway', 'standard_attr_id': 930, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:07Z', 'updated_at': '2021-11-05T14:49:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:17.473078 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-05125ae2-90bc-444d-b89d-aabfa4226504 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/routers/d4048807-5f13-4206-9a9b-0d4c0cb0fbbd HTTP/1.1" status: 204 len: 168 time: 0.5196884 Nov 05 14:49:17.474003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43448) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.495431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.566767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eb0a9f6-1c4c-4219-8b45-9978d320fe1b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:17.568100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:17.571463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1eb0a9f6-1c4c-4219-8b45-9978d320fe1b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0906971 Nov 05 14:49:17.572537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.574032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43450) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.629204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.664913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] Routers {'85ee3714-cf48-4297-9200-eff9ba8ff95e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:17.665941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['85ee3714-cf48-4297-9200-eff9ba8ff95e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:17.679584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:17.685444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: e0b391b6-2a11-4888-b3af-15a60da139d2 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:17.686109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e0b391b6-2a11-4888-b3af-15a60da139d2 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:17.729340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:17.732504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-249f91f3-15f4-4efb-ac07-466cb473bc6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:17.735234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.737357 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-249f91f3-15f4-4efb-ac07-466cb473bc6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1623685 Nov 05 14:49:17.739250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43452) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.740583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.745321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:17.754546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:17.756369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:17.764912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=933f27f1-f3e1-48d1-948a-bef6bc0325c3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:17.769055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Allocated IP 172.26.5.60 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/2c88dc94-fc32-4605-b14c-15e05ccc5589) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:17.776877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] For port b5219506-82cf-4af9-bed1-f22b9d3e4cb0, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:17.790692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Attempting to bind port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:17.791065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Attempting to bind port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:17.791431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Attempting to bind port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 on network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:17.797882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] For port b5219506-82cf-4af9-bed1-f22b9d3e4cb0, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:17.801809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] Routers {'85ee3714-cf48-4297-9200-eff9ba8ff95e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:17.802519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['85ee3714-cf48-4297-9200-eff9ba8ff95e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:17.817826 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-81b27329-478f-41bc-91a9-f7d215936379 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0731788 Nov 05 14:49:17.826834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43454) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.834160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:17.852392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.856307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:17.856732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Checking segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:17.857108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.857533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Bound using segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:17.858029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Bound port: ca6f2f02-df01-42fa-a18b-094bdc2e7a68, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:17.858351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.862114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:17.862777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35ab88c6-62aa-4ce3-8eb1-0bccfa6555b6 None None] The sync data for ids ['85ee3714-cf48-4297-9200-eff9ba8ff95e'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:17.909806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.910362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Fanout notify agent at l3_agent the message router_deleted on router 85ee3714-cf48-4297-9200-eff9ba8ff95e {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:17.921771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:17.925467 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a3724a6b-7368-4838-aad1-3605a2d81baa tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/routers/85ee3714-cf48-4297-9200-eff9ba8ff95e HTTP/1.1" status: 204 len: 168 time: 0.6073408 Nov 05 14:49:17.930304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43456) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:17.972259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.017891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.036103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] For port ca6f2f02-df01-42fa-a18b-094bdc2e7a68, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:18.039755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] For port ca6f2f02-df01-42fa-a18b-094bdc2e7a68, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:18.070148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ace08a-dfce-4531-95af-be2e7789c3a9 None None] Pushing event updated for resources: {'Port': ['ID=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:18.078901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.193887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 5c05a157-422b-4380-a664-7bdaeb7d66a7 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:18.213333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.225414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.263523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.278391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:18.293924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:18.303054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d5a678-802b-4651-82c6-ca4035f5b445 None None] Pushing event updated for resources: {'Port': ['ID=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:18.304346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.345664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.424745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dbed45f6-5a06-4297-8146-dbb3a29f0ec6 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:18.485253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.570591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:18.571221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.611338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.651780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.692320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3798a300-d4cb-4ade-ad05-b687bdf61770 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:18.721326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.738618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Subnet': ['ID=7f49ab69-3400-44cd-810e-98bdaf3cf7f7,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:18.779219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3798a300-d4cb-4ade-ad05-b687bdf61770 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:18.779631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.840049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:18.841063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Checking segment: {'id': '98084bfc-d850-4b12-b946-4f9d3cfd95b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:18.841432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network hostable DHCP agents. Network: eeefa8c9-20cd-4d8f-bb76-d2922b8a4290, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:18.854228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:18.868221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:18.872886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:18.879549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:18.889974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.912966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:18.913885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Pushing event updated for resources: {'Port': ['ID=2c88dc94-fc32-4605-b14c-15e05ccc5589,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:18.931418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:18.961192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 3798a300-d4cb-4ade-ad05-b687bdf61770, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3798a300-d4cb-4ade-ad05-b687bdf61770,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:18.969615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.004921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, eeefa8c9-20cd-4d8f-bb76-d2922b8a4290) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:19.019924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:19.020532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.056903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=3798a300-d4cb-4ade-ad05-b687bdf61770,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:19.077117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fe1a79b0-ee15-40b0-8027-8cdac2e05788 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.1861272 Nov 05 14:49:19.085367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43458) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:19.098373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'network': {'name': 'tempest-router-network01--34197209'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:19.110062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.157796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.165148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/5c05a157-422b-4380-a664-7bdaeb7d66a7 HTTP/1.1" status: 204 len: 168 time: 1.2323480 Nov 05 14:49:19.171477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:19.174868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a31686-8ac9-433f-b96b-c68f16434a24 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=5c05a157-422b-4380-a664-7bdaeb7d66a7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:19.256057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:19.256871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:19.260320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.303098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.357892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:19.386694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.387200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Added segment a4318642-c0d1-436d-8b41-d942637f20d0 of type vlan for network 817c1122-6b1d-4ea9-8ba7-c09f43796853 Nov 05 14:49:19.511454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] Provisioning complete for port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:19.511649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:19.512183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.524848 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:19.534055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e5346e3a-ec2e-4708-b1ea-f5911568d236 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/c9eda620-b56d-4879-9d5c-3b17badf0d55/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9119136 Nov 05 14:49:19.544274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43462) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:19.545695 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:19.546480 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:19.572225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.645304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.670884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port f42080c8-dfa3-4326-8c61-36ae89e92c51 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:19.671224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.701848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] For port b5219506-82cf-4af9-bed1-f22b9d3e4cb0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:19.708149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.757006 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:19.775902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41518742-a90e-4bb9-be23-f0a6f0504323 None None] Pushing event updated for resources: {'Port': ['ID=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:19.778649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.784769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:19.785070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.880166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:49:19.890459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d8442ab-3821-408b-9ff5-aff9ad53e71a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:19.913017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.8260841 Nov 05 14:49:19.922233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43464) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:19.930265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'network': {'name': 'tempest-router-network02--649068749'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:19.945747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port f42080c8-dfa3-4326-8c61-36ae89e92c51, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f42080c8-dfa3-4326-8c61-36ae89e92c51,segment=NetworkSegment(d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f),segment_id=d58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:19.946108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.957720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:19.958200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:19.966129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f38368e-99e0-4295-8096-cd459e21ef94 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Network': ['ID=817c1122-6b1d-4ea9-8ba7-c09f43796853,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:19.995814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for f42080c8-dfa3-4326-8c61-36ae89e92c51 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:20.008578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:20.028201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:20.031872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.034974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.035443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.035893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.036348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.036827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.037273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.038435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.038896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.039359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.041319 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3f79f9e-7e97-4d12-b375-55f3f4541066 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 6308 time: 0.4813957 Nov 05 14:49:20.044155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43466) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:20.096600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.165058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5257b8c3-af8c-4a9a-8346-dced7b7fde69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.185559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d8442ab-3821-408b-9ff5-aff9ad53e71a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:20.209235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:20.260043 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:20.262235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Updating router c9eda620-b56d-4879-9d5c-3b17badf0d55 port 96d615f3-eea3-46d2-b255-96f704d51534 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:20.275826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 628} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:20.291988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.292846 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Added segment 6760743a-817c-4af3-bc4d-6c64c33bf41c of type vlan for network 55b25de1-89c8-4f5a-9068-ca3a407223db Nov 05 14:49:20.296601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.312136 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.358718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.407448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ca6f2f02-df01-42fa-a18b-094bdc2e7a68 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:20.415969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.426165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.427815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.439519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.441547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] For port ca6f2f02-df01-42fa-a18b-094bdc2e7a68, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:20.444872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.447307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.447797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.448221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.448680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.449117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.449544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.449973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:20.454487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.456849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ed1802ee-a9ed-41f4-9fb3-076c62707b2f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4597 time: 0.4116437 Nov 05 14:49:20.459157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43468) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:20.564710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Provisioning complete for port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:20.565089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.653841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b4fc8d1-1e66-463b-811b-f5eaf3524de2 None None] Pushing event updated for resources: {'Port': ['ID=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:20.677661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:20.678333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.734182 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.742050 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.755705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router d9268fea-abee-42f7-985f-355c640f1989 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:20.806560 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Pushing event updated for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:20.818815 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.819355 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.819803 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.820244 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.820957 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.821400 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.822087 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.822516 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.822975 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.823396 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.823850 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.824265 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:20.879019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3798a300-d4cb-4ade-ad05-b687bdf61770 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:20.885833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-eeefa8c9-20cd-4d8f-bb76-d2922b8a4290', 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290', 'tenant_id': '3b26d4f4e40d40b98d8455e0b2c4ec13', 'fixed_ips': [{'subnet_id': '7f49ab69-3400-44cd-810e-98bdaf3cf7f7'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:20.886719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.924531 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Attempting to bind port 96d615f3-eea3-46d2-b255-96f704d51534 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:20.925164 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Attempting to bind port 96d615f3-eea3-46d2-b255-96f704d51534 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:20.925700 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Attempting to bind port 96d615f3-eea3-46d2-b255-96f704d51534 on network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:20.931650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.0055356 Nov 05 14:49:20.933646 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:20.934418 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Checking segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:20.935027 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.936311 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Bound using segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:20.936970 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Bound port: 96d615f3-eea3-46d2-b255-96f704d51534, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:20.937674 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:20.950187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43470) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:20.958105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'subnet': {'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:21.033657 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] For port 96d615f3-eea3-46d2-b255-96f704d51534, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:21.038610 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] For port 96d615f3-eea3-46d2-b255-96f704d51534, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=96d615f3-eea3-46d2-b255-96f704d51534,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:21.045240 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.061220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:21.086668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf842b01-d3e4-4622-945b-4be1bdf234f1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Network': ['ID=55b25de1-89c8-4f5a-9068-ca3a407223db,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:21.128971 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:21.133350 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:21.134903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 55b25de1-89c8-4f5a-9068-ca3a407223db details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:21.160388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.172218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e5911b-83da-4e92-8d48-5aa0db1007e0 None None] Pushing event updated for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:21.192808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:21.202016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.208611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3798a300-d4cb-4ade-ad05-b687bdf61770 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:21.209179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.224615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.225603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.227965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Sync routers for ids ['d9268fea-abee-42f7-985f-355c640f1989'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:21.262048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.264301 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-74dd9ae0-f507-43a2-8883-9e23a75f8ddc tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 7.3451211 Nov 05 14:49:21.267456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port f42080c8-dfa3-4326-8c61-36ae89e92c51 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:49:21.276636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Allocated IP 2001:db8::2 (eeefa8c9-20cd-4d8f-bb76-d2922b8a4290/7f49ab69-3400-44cd-810e-98bdaf3cf7f7/520724fb-889b-44ff-8b19-6b3ab8762057) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:21.304625 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:21.325153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43472) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:21.326488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=f42080c8-dfa3-4326-8c61-36ae89e92c51,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:21.350175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.351357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Routers {'d9268fea-abee-42f7-985f-355c640f1989'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:21.351699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d9268fea-abee-42f7-985f-355c640f1989'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:21.374830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:21.514791 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-48efe3c8-761c-4b66-b59b-408b4b332e53 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/d9268fea-abee-42f7-985f-355c640f1989 HTTP/1.1" status: 200 len: 907 time: 0.1595635 Nov 05 14:49:21.515660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:21.520610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.523295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43474) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:21.536194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:21.624435 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:21Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:21.662331 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d130126-ea10-4e99-93cc-07aa23028a06 None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:21Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:21.690120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:21.691031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.699175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.755353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=10']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:21.765513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=412fdc86-72fe-42be-a9d6-a604f13e9214,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:21.795431 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6859058a-4ca7-45ea-920b-750af96f4ad5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 3.9657822 Nov 05 14:49:21.800896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43476) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:21.811385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:21.901132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Set router d9268fea-abee-42f7-985f-355c640f1989 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:21.935385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Router 87aa76eb-2649-4160-9608-307c31d98562 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:21.982436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0178095b-a745-4b2b-8cc3-7bc90bcfc139 None None] Provisioning complete for port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:21.982720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0178095b-a745-4b2b-8cc3-7bc90bcfc139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:21.985007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5219506-82cf-4af9-bed1-f22b9d3e4cb0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:22.013935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.054616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16ba37ba-cfa5-4979-adb6-ef4be077a592']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.087127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.094230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.094548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd58fbf89-6b0c-40c7-8f6a-9569b3cbfa1f') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.105619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.112799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:22.113297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.116865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.131606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.147920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.176403 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-78bc7aed-4dc0-4f72-aca3-562b4ec0ea51 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 4271 time: 1.7107592 Nov 05 14:49:22.191024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:22.203094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.218158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Checking segment: {'id': 'a4318642-c0d1-436d-8b41-d942637f20d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:22.218522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network hostable DHCP agents. Network: 817c1122-6b1d-4ea9-8ba7-c09f43796853, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:22.223117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Subnet': ['ID=b92dc52e-57cd-4c0a-a15b-0685140cd283,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:22.224443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:22.227159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 642 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:49:22.227942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:49:22.232834 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:49:22.241364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:22.303065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:22.316386 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:22.330678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:22.337378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.338047 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:22.338652 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:48:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.338800 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-92fa7545-b5ec-4280-8f38-3ae01ce15f91 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 8.2534144 Nov 05 14:49:22.342105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43482) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:22.377738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Deleting port 933f27f1-f3e1-48d1-948a-bef6bc0325c3 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:22.378107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.430024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.441814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.445170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/16ba37ba-cfa5-4979-adb6-ef4be077a592 HTTP/1.1" status: 204 len: 168 time: 3.2722044 Nov 05 14:49:22.449231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Pushing event updated for resources: {'Port': ['ID=520724fb-889b-44ff-8b19-6b3ab8762057,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:22.450917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43484) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:22.453383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:22.454133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.467785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 817c1122-6b1d-4ea9-8ba7-c09f43796853) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:22.516922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Attempting to bind port 520724fb-889b-44ff-8b19-6b3ab8762057 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:22.518163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Attempting to bind port 520724fb-889b-44ff-8b19-6b3ab8762057 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '98084bfc-d850-4b12-b946-4f9d3cfd95b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:22.518745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Attempting to bind port 520724fb-889b-44ff-8b19-6b3ab8762057 on network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:22.521167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ce573eb-395b-409d-b4ca-58e93fd85625 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.536204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.551919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:22.553126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.554582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Calling delete_port for 933f27f1-f3e1-48d1-948a-bef6bc0325c3 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:22.556874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:22.557522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Checking segment: {'id': '98084bfc-d850-4b12-b946-4f9d3cfd95b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:22.558219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.559428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Bound using segment: {'id': '98084bfc-d850-4b12-b946-4f9d3cfd95b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:22.560203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Bound port: 520724fb-889b-44ff-8b19-6b3ab8762057, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '98084bfc-d850-4b12-b946-4f9d3cfd95b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': 'eeefa8c9-20cd-4d8f-bb76-d2922b8a4290'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:22.560825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.574276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cead85-35ee-4849-aadb-7992dc1c80ab tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=16ba37ba-cfa5-4979-adb6-ef4be077a592,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:22.636268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93a9028d-6ec4-41d5-bfbf-c0c60ac5734b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:22.640888 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-93a9028d-6ec4-41d5-bfbf-c0c60ac5734b tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/7eb70a75-dc91-43e4-a84d-332680a5220e HTTP/1.1" status: 200 len: 844 time: 0.1857727 Nov 05 14:49:22.641881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43486) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:22.649105 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:22.653937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9268fea-abee-42f7-985f-355c640f1989', 'name': 'tempest-snat-router-790099175', 'tenant_id': 'b797ddb0bdfc4d42860490426465674e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.186'}], 'enable_snat': True}, 'gw_port_id': '933f27f1-f3e1-48d1-948a-bef6bc0325c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:18Z', 'revision_number': 3, 'project_id': 'b797ddb0bdfc4d42860490426465674e', 'gw_port': {'id': '933f27f1-f3e1-48d1-948a-bef6bc0325c3', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:da:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9268fea-abee-42f7-985f-355c640f1989', 'device_owner': 'network:router_gateway', 'standard_attr_id': 952, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.694567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Checking router: d9268fea-abee-42f7-985f-355c640f1989 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:22.695063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Updating router d9268fea-abee-42f7-985f-355c640f1989 port 933f27f1-f3e1-48d1-948a-bef6bc0325c3 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:22.726411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bbd2f35c-4ca8-4b3d-9a03-cd62670189dd tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7749794 Nov 05 14:49:22.730255 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be34b369-8496-48ca-8797-075b08e2b063 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/7eb70a75-dc91-43e4-a84d-332680a5220e?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0780110 Nov 05 14:49:22.731094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43488) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:22.738785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'subnet': {'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:22.745581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43490) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:22.762483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:22.834897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.843270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] For port 520724fb-889b-44ff-8b19-6b3ab8762057, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:22.866742 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:19Z', 'revision_number': 3, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:22.897185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:22.897559 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Updating router 87aa76eb-2649-4160-9608-307c31d98562 port 2c88dc94-fc32-4605-b14c-15e05ccc5589 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:22.929442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] For port 520724fb-889b-44ff-8b19-6b3ab8762057, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=520724fb-889b-44ff-8b19-6b3ab8762057,segment=NetworkSegment(98084bfc-d850-4b12-b946-4f9d3cfd95b1),segment_id=98084bfc-d850-4b12-b946-4f9d3cfd95b1)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:22.934606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:22.944655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.153197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.163146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.163544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac7cf3a-6532-47d0-9ce8-073be07c8608 None None] Pushing event updated for resources: {'Port': ['ID=520724fb-889b-44ff-8b19-6b3ab8762057,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:23.199494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Port': ['ID=933f27f1-f3e1-48d1-948a-bef6bc0325c3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:23.253445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:23.274806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.286041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.286041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.286505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.286722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.287024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.288234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.288234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.288234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.288595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.288695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.289582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.289582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:23.327196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 96d615f3-eea3-46d2-b255-96f704d51534 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:23.480772 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.493076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.503148 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.580087 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Attempting to bind port 2c88dc94-fc32-4605-b14c-15e05ccc5589 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:23.580869 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Attempting to bind port 2c88dc94-fc32-4605-b14c-15e05ccc5589 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:23.581459 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Attempting to bind port 2c88dc94-fc32-4605-b14c-15e05ccc5589 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:23.592266 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 48, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:23.596514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:23.597840 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.598817 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:23.599302 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Bound port: 2c88dc94-fc32-4605-b14c-15e05ccc5589, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:23.599864 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.693788 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] For port 2c88dc94-fc32-4605-b14c-15e05ccc5589, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:23.704000 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] For port 2c88dc94-fc32-4605-b14c-15e05ccc5589, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2c88dc94-fc32-4605-b14c-15e05ccc5589,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:23.709902 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.771593 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:23.772642 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:23.785565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:23.786078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.791679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:23.801467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.901329 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:23.901628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:23.929625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:23.936480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:23.937074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.941845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43496) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:23.950072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-972414840', 'description': 'tempest-secgroup-smoke-972414840 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:23.950508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:49:23.950864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:49:23.964337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:23.981089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=87967cb5-16aa-49ed-9935-26fdde4030e3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:23.995249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.002565 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c8851-8984-4505-9e75-459f93c535da None None] Pushing event updated for resources: {'Port': ['ID=2c88dc94-fc32-4605-b14c-15e05ccc5589,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.039814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.066463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:24.084139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:24.090194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.090894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:24.091495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.106140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 96d615f3-eea3-46d2-b255-96f704d51534, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=96d615f3-eea3-46d2-b255-96f704d51534,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:24.113887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.115948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ca6f2f02-df01-42fa-a18b-094bdc2e7a68 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:24.117644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=3943c90d-7859-4ab9-bc0d-30891fe19e0a,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.140115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.140502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.140814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.141151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.141546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.142726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.142851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.143204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.143515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.143926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.144265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.144633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.155989 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ea5b3592-892e-432c-ac2b-eaa92ba6af76 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3975978 Nov 05 14:49:24.162750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43498) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:24.167164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'security_group': {'name': 'tempest-secgroup-1611952754'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:24.191311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.193711 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c8851-8984-4505-9e75-459f93c535da None None] Pushing event updated for resources: {'Port': ['ID=2c88dc94-fc32-4605-b14c-15e05ccc5589,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.195249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.224992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:24.225378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.226996 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:19Z', 'revision_number': 3, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:24.251892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.264653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.265085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.265450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.265790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.266123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.266456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.267546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.267796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.268042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.268558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.268558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.268813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.269136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:49:24.291190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44780cc3-4c11-441a-8a07-87476c38901c None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:19Z', 'revision_number': 3, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:24.295363 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d238d98e-9e5d-4456-b92d-21523ad4e959 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.4936113 Nov 05 14:49:24.300651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43500) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:24.303599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.304372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Fanout notify agent at l3_agent the message router_deleted on router d9268fea-abee-42f7-985f-355c640f1989 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:24.309689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.313390 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1397866b-0a63-43b5-8b1f-675197e17389 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/routers/d9268fea-abee-42f7-985f-355c640f1989 HTTP/1.1" status: 204 len: 168 time: 2.7761710 Nov 05 14:49:24.313569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:bb:d1:13', 'name': 'tempest-NetworksTestDHCPv6-1635803175'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:24.315409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43502) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:24.362177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:24.424807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:24.425518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.477693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Port 933f27f1-f3e1-48d1-948a-bef6bc0325c3 not found while updating agent binding for router d9268fea-abee-42f7-985f-355c640f1989. {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Nov 05 14:49:24.501941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.507767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Routers set() bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:24.508268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Router IDs set() for agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 05 14:49:24.509423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_agentschedulers_db [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'d9268fea-abee-42f7-985f-355c640f1989'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent'). {{(pid=113582) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Nov 05 14:49:24.509805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21c114b-fc1e-4954-8c39-38719b967f52 None None] The sync data for ids ['d9268fea-abee-42f7-985f-355c640f1989'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:24.523070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.529168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.534606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.569211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47fcff7a-3ae1-433f-8294-891325add414,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.591028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.598028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.600083 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9dde09bf-c87c-4551-b14d-5c2fd21486f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.6574855 Nov 05 14:49:24.604199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:24.612513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:24.735421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Subnet': ['ID=e4fc3864-f092-4d1a-a53b-effd12f3389b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:24.740735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.833505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Deleting port 3798a300-d4cb-4ade-ad05-b687bdf61770 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:24.834026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.836300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.838629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.861530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.879306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-219ecdad-ddbc-40b5-a0ce-6112878ffc00 None None] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:24.922773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Checking segment: {'id': '6760743a-817c-4af3-bc4d-6c64c33bf41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:24.923341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network hostable DHCP agents. Network: 55b25de1-89c8-4f5a-9068-ca3a407223db, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:24.939634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.958153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] For port 3798a300-d4cb-4ade-ad05-b687bdf61770, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3798a300-d4cb-4ade-ad05-b687bdf61770,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:24.961123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:24.987416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Calling delete_port for 3798a300-d4cb-4ade-ad05-b687bdf61770 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:25.018288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:25.020943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d65bb6d-8528-4a5f-a252-e3776d17cabc None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.028296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f69a9115-f3db-45f1-aa4d-92749c8c842c None None] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.041540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c96d3b0b-1e41-4dff-b112-64cfdbbf6aac None None] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.044912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-698beb46-43b2-43cf-af59-4f667c2aafab None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.219451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network 55b25de1-89c8-4f5a-9068-ca3a407223db is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:25.239925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.241524 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.0778177 Nov 05 14:49:25.245729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:25.253839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'security_group': {'name': 'tempest-secgroup-1769097657'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:25.259951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a57c0e-39cb-4e1c-8497-6f6f88ec7053 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=14a9a011-f95c-43f5-b7bc-b5fd52cc7af6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:25.302546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 55b25de1-89c8-4f5a-9068-ca3a407223db) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:25.307900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:25.308519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.317132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.327880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.349430 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a79c5c54-4bf5-4e68-9843-271a0c67805e tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.6151483 Nov 05 14:49:25.356444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:25.410122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Allocated IP 172.20.0.1 (45055355-0dd4-4c48-858a-f131e1d1f8bc/a738c6ea-0bb8-45cf-87bb-1b3689e6e451/9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:25.416158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.431981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.447430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event deleted for resources: {'Port': ['ID=3798a300-d4cb-4ade-ad05-b687bdf61770,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:25.472528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.496153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2c88dc94-fc32-4605-b14c-15e05ccc5589 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:25.532349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b246814-8f8a-4f6c-889a-7c6f19a58642,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:25.541047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.542282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-adf71f0b-9bc9-488a-bc40-2b42ba69bccc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9337637 Nov 05 14:49:25.546617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6254e87c-489e-4580-872f-ba991a37edf1 None None] Network 55b25de1-89c8-4f5a-9068-ca3a407223db requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.548326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43510) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:25.555038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:25.560116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-234bd6ce-fc74-4c51-813f-15df6696180d None None] DHCP port deletion for 16ba37ba-cfa5-4979-adb6-ef4be077a592 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:49:25.580374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 2a04edba-bc8e-40e7-9635-82b241595a08 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:25.651696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Provisioning complete for port 520724fb-889b-44ff-8b19-6b3ab8762057 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:25.652301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-219ecdad-ddbc-40b5-a0ce-6112878ffc00 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:25.658216 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:25.682729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c96d3b0b-1e41-4dff-b112-64cfdbbf6aac None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:25.700279 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:25.719457 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.734228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0928aa92-7913-4fff-9795-40225e142460 None None] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.842508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.843921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.847455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.855165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-deb1ff5a-50fc-49e5-ae38-5182d3e42cdf None None] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0928aa92-7913-4fff-9795-40225e142460 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:25.859760 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:25.898574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.948797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d49ae8e2-712f-4375-8978-8cd5054f5b53,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:25.952356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:25.966500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 172.20.0.11 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/87967cb5-16aa-49ed-9935-26fdde4030e3/2a04edba-bc8e-40e7-9635-82b241595a08) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:25.968851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:25.976993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:25.984851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:25.986622 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8657e391-e7b7-475d-b6d1-6f31e15b2f7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4364510 Nov 05 14:49:25.987409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Pushing event updated for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:26.008233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43512) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:26.018367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.023607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:febb:d113 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/412fdc86-72fe-42be-a9d6-a604f13e9214/2a04edba-bc8e-40e7-9635-82b241595a08) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:26.035072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6254e87c-489e-4580-872f-ba991a37edf1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.039156 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9d65bb6d-8528-4a5f-a252-e3776d17cabc None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.044005 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f69a9115-f3db-45f1-aa4d-92749c8c842c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.050676 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.057654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.062174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.066674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.070489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5af2120-b676-4676-b71f-327a23ca6c6a None None] Network 55b25de1-89c8-4f5a-9068-ca3a407223db requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:26.081556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.086846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d049c587-6c6f-4e17-9f3f-7cccae2ff87b None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:26.089540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fd90374-9233-4596-b0dd-c21e350af0af None None] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:26.183345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.222011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2fd90374-9233-4596-b0dd-c21e350af0af None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.223668 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.227100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2c88dc94-fc32-4605-b14c-15e05ccc5589 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:26.227760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.277567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.283611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.285028 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1760 time: 1.0381792 Nov 05 14:49:26.290456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.290981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 66be7d57-6b5f-4e71-855d-2589261aa403 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:26.298415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.299580 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e9ea32e8-d508-40b4-a512-f0f194ab91df tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "DELETE /v2.0/routers/66be7d57-6b5f-4e71-855d-2589261aa403 HTTP/1.1" status: 204 len: 168 time: 1.9819865 Nov 05 14:49:26.307391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43514) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:26.307722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43516) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:26.316807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-2079730032', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-698beb46-43b2-43cf-af59-4f667c2aafab None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.318275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.343672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-972048823', 'security_groups': ['c3f9f413-c3d9-402b-ba81-b7cfbdc45155'], 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '3943c90d-7859-4ab9-bc0d-30891fe19e0a'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:26.349501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b844bc1a-a0b8-456b-b093-a5ec1881efda tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c3f9f413-c3d9-402b-ba81-b7cfbdc45155,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c5af2120-b676-4676-b71f-327a23ca6c6a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.441710 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-deb1ff5a-50fc-49e5-ae38-5182d3e42cdf None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.450042 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d049c587-6c6f-4e17-9f3f-7cccae2ff87b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.556536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.589519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b87aa92-282e-4bd1-ad17-e38282f2a0b9 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:26.760930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.826845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 2c88dc94-fc32-4605-b14c-15e05ccc5589, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2c88dc94-fc32-4605-b14c-15e05ccc5589,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:26.835387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.844077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.845786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 96d615f3-eea3-46d2-b255-96f704d51534 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0b87aa92-282e-4bd1-ad17-e38282f2a0b9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:26.900371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:26.934621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:26.986359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] For port 520724fb-889b-44ff-8b19-6b3ab8762057, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=520724fb-889b-44ff-8b19-6b3ab8762057,segment=NetworkSegment(98084bfc-d850-4b12-b946-4f9d3cfd95b1),segment_id=98084bfc-d850-4b12-b946-4f9d3cfd95b1)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:26.993769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=2c88dc94-fc32-4605-b14c-15e05ccc5589,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:26.997711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.013708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.036121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.036584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.093624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.105822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Provisioning complete for port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.106195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.131288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.140008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab4bb0c-790b-4325-ac4a-d912a0d1b7db None None] Pushing event updated for resources: {'Port': ['ID=520724fb-889b-44ff-8b19-6b3ab8762057,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:27.154939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=2a04edba-bc8e-40e7-9635-82b241595a08,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:27.180884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:27.185109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.186039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.190388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.210913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:27.211123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 520724fb-889b-44ff-8b19-6b3ab8762057 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:27.214259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:27.292474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:27.293112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.305578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 520724fb-889b-44ff-8b19-6b3ab8762057 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.306098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.337225 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6aa4c5c0-b989-41ec-a3f7-3e491a56124f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 3.0318236 Nov 05 14:49:27.341702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43518) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:27.390992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.399471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.399726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.415130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:27.415326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-311e2e0e-4840-46e6-ae07-7b7e62e25d60 None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.415712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-311e2e0e-4840-46e6-ae07-7b7e62e25d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.433887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.438028 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4104667 Nov 05 14:49:27.460258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43520) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:27.472718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:27.490884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0c8bc18-d5b5-4989-9016-36ccd919320f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:27.498714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76737d1e-76b5-48cf-9c24-ca5d2d9501b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=904a525a-940c-47ab-9b01-72e1bf2a7a7c,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:27.498962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0c8bc18-d5b5-4989-9016-36ccd919320f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:27.501741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d0c8bc18-d5b5-4989-9016-36ccd919320f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1786 time: 0.1584196 Nov 05 14:49:27.511500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43522) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:27.587964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1c64f7e-77af-40c6-9cee-f14754fdb311 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:27.591027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2c88dc94-fc32-4605-b14c-15e05ccc5589 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:27.596657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.600158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Pushing event updated for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:27.601944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Allocated IP 2001:db8::1 (817c1122-6b1d-4ea9-8ba7-c09f43796853/b92dc52e-57cd-4c0a-a15b-0685140cd283/b2f21901-3fc5-4898-bec8-9458e31e6e1b) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:27.618082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.691671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-311e2e0e-4840-46e6-ae07-7b7e62e25d60 None None] Provisioning complete for port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.692043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-311e2e0e-4840-46e6-ae07-7b7e62e25d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.760959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.763061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.766032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-311e2e0e-4840-46e6-ae07-7b7e62e25d60 None None] Port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:27.770147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2c88dc94-fc32-4605-b14c-15e05ccc5589 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:27.770750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.774168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.786956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.805381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 2a04edba-bc8e-40e7-9635-82b241595a08 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:27.805642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.811619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e736743e-d45c-48e8-be11-f5b5ae9d6acb,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:27.816593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:27.830198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:27.835056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1c64f7e-77af-40c6-9cee-f14754fdb311 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:27.836422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.840099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-12eb905e-99a9-48c3-9ce1-d8c87312efe9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3745971 Nov 05 14:49:27.852545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43524) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:27.856225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:27.864404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:27.973647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:27.979998 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:49:27.997183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.019688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 2a04edba-bc8e-40e7-9635-82b241595a08 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:28.027909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.040526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:28.126005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 520724fb-889b-44ff-8b19-6b3ab8762057 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:28.131512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-46224f80-911e-4be4-9dc9-8a5a84b3167c None None] Provisioning complete for port 2a04edba-bc8e-40e7-9635-82b241595a08 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:28.131512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-46224f80-911e-4be4-9dc9-8a5a84b3167c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.168102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.232302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:28.233783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.245428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7d2cf0ec-593f-43e2-a5b7-7bcf056540a0 admin admin] 10.222.0.30 "PUT /v2.0/routers/87aa76eb-2649-4160-9608-307c31d98562/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8939295 Nov 05 14:49:28.246004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:28.260948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:28.262747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-46224f80-911e-4be4-9dc9-8a5a84b3167c None None] Port 2a04edba-bc8e-40e7-9635-82b241595a08 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:28.266379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:28.270955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::157 (a79abec6-87fd-477e-a6d8-3655432a4a0a/3943c90d-7859-4ab9-bc0d-30891fe19e0a/f0f2c8a2-0c64-4a49-a808-bab7787a4ab9) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:28.275207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.282428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:28.283046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.286478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:28.287115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:28.344603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Port': ['ID=b2f21901-3fc5-4898-bec8-9458e31e6e1b,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:28.344875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 520724fb-889b-44ff-8b19-6b3ab8762057 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:28.345677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.375772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.424232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5acc80b-6741-4500-ad63-2ca0196a5723,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:28.471422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=2a04edba-bc8e-40e7-9635-82b241595a08,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:28.498228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:28.522689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.523891 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-febb989a-0316-4b25-bced-9d0e92f85dcc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.6691294 Nov 05 14:49:28.549349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43530) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:28.557854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '47fcff7a-3ae1-433f-8294-891325add414', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:28.567997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.628316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.632698 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3f7dcde-894a-4df8-907c-92a2a40093a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/2a04edba-bc8e-40e7-9635-82b241595a08 HTTP/1.1" status: 204 len: 168 time: 1.1199801 Nov 05 14:49:28.635108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:28.642183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-55b25de1-89c8-4f5a-9068-ca3a407223db', 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db', 'tenant_id': '3b26d4f4e40d40b98d8455e0b2c4ec13', 'fixed_ips': [{'subnet_id': 'e4fc3864-f092-4d1a-a53b-effd12f3389b'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:28.644085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.647148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-817c1122-6b1d-4ea9-8ba7-c09f43796853', 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853', 'tenant_id': '3b26d4f4e40d40b98d8455e0b2c4ec13', 'fixed_ips': [{'subnet_id': 'b92dc52e-57cd-4c0a-a15b-0685140cd283'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:28.647971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.648101 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.650254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a79abec6-87fd-477e-a6d8-3655432a4a0a', 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'tenant_id': '4ff2ceda9c9e4667b7921b128d51fb22', 'fixed_ips': [{'subnet_id': '3943c90d-7859-4ab9-bc0d-30891fe19e0a'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:28.651034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.742469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-617a1cfd-ef15-4cbb-9b74-17836e24e495 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:28.746455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-617a1cfd-ef15-4cbb-9b74-17836e24e495 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:28.747748 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:49:28.749177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-617a1cfd-ef15-4cbb-9b74-17836e24e495 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:28.750859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-617a1cfd-ef15-4cbb-9b74-17836e24e495 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1120806 Nov 05 14:49:28.753979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:28.769407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.816408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.876277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 412fdc86-72fe-42be-a9d6-a604f13e9214 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:28.897329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.919018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.961234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.967777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:28.994097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f42080c8-dfa3-4326-8c61-36ae89e92c51 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:29.053717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f42080c8-dfa3-4326-8c61-36ae89e92c51 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:29.054069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f42080c8-dfa3-4326-8c61-36ae89e92c51 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:29.054473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3798a300-d4cb-4ade-ad05-b687bdf61770 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:49:29.099037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=f0f2c8a2-0c64-4a49-a808-bab7787a4ab9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:29.136697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.172077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 3798a300-d4cb-4ade-ad05-b687bdf61770 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:49:29.173162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3798a300-d4cb-4ade-ad05-b687bdf61770 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:49:29.230128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.272976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=412fdc86-72fe-42be-a9d6-a604f13e9214,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:29.277923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Allocated IP 172.26.5.158 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/15152b06-bb58-4fce-a016-5ee8347fc6ef) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:29.278138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.282426 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-20bba2f1-dd81-46f7-b723-20a45e8a8722 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/412fdc86-72fe-42be-a9d6-a604f13e9214 HTTP/1.1" status: 204 len: 168 time: 0.5266109 Nov 05 14:49:29.283638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43546) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:29.286088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43548) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:29.292779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-738994026-network', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:29.304942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:29.306965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.320547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:29.334922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Allocated IP 2001:db8::2 (a79abec6-87fd-477e-a6d8-3655432a4a0a/3943c90d-7859-4ab9-bc0d-30891fe19e0a/2be4439b-204a-411e-8526-cf2a0f1f66b0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:29.372659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 87967cb5-16aa-49ed-9935-26fdde4030e3 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:29.373980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:29.377434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Made reservation on behalf of 2db7c5f71a2f486a87a72e6ff069379a for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:29.380437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.380745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:29.381372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.383205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.389274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.413809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.439579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c7ffd6e-8a4b-46b2-ba36-099255a5f78f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:29.452298 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1d5f53f7-e7a9-4e64-a36f-15b245e94ce0 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.1419036 Nov 05 14:49:29.455906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:29.466965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Allocated IP 2001:db8::2 (55b25de1-89c8-4f5a-9068-ca3a407223db/e4fc3864-f092-4d1a-a53b-effd12f3389b/bae07728-6a5f-414a-baa7-a1896eab25c9) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:29.468599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.469847 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa763061-ee2f-411e-af4e-f3b5194ad693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.9197106 Nov 05 14:49:29.475259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:29.511090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.527255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Allocated IP 2001:db8::2 (817c1122-6b1d-4ea9-8ba7-c09f43796853/b92dc52e-57cd-4c0a-a15b-0685140cd283/724cfc50-8a61-40a1-bcc8-66dd4b261382) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:29.573775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.589039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:27Z', 'revision_number': 2, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:29.665859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.671839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.701210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:29.701819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Updating router 87aa76eb-2649-4160-9608-307c31d98562 port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:29.715685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 615} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:29.719672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.748374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2c79e0d9-b58c-4b36-a71e-72d9051bb27a None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:29.749049 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c79e0d9-b58c-4b36-a71e-72d9051bb27a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.754632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=87967cb5-16aa-49ed-9935-26fdde4030e3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:29.760431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50eac81d-9a30-44aa-a3c7-8baa685b8c92,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:29.785316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.785674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Added segment ba199014-4316-4a72-be9f-2e9a347a8e16 of type vlan for network bde16d5a-a42f-4260-868f-719b54772c0d Nov 05 14:49:29.800346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.805028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dfb88cd5-dd3d-4345-940c-0f12a799b30c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/87967cb5-16aa-49ed-9935-26fdde4030e3 HTTP/1.1" status: 204 len: 168 time: 0.5068667 Nov 05 14:49:29.821095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43570) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:29.868939 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c4abde44-eb8d-468e-a3fd-9e05490749cc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0463858 Nov 05 14:49:29.877556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.878173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43572) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:29.885601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:29.887585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.912346 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-04b2be6d-758e-4e0d-a7f4-20f8783bdf06 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-972414840&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.1631560 Nov 05 14:49:29.916886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.933163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:29.971899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.012948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.014140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:30.014522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.083110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.092061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.092860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.102454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.148763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:30.152178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.157134 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8723474 Nov 05 14:49:30.171424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43574) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:30.193768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea78617-b2d3-4331-be27-c318c1f97461 admin admin] Pushing event updated for resources: {'Network': ['ID=bde16d5a-a42f-4260-868f-719b54772c0d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.215303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-235b77b4-2694-4fba-a465-e93b10880895 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:30.216958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-235b77b4-2694-4fba-a465-e93b10880895 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 797 time: 0.2853341 Nov 05 14:49:30.219710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Request body: {'subnet': {'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-738994026-subnet', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:30.233866 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-57bfc719-0834-4514-9ee9-13ce5d9abe0b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0102806 Nov 05 14:49:30.240707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:30.241696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network bde16d5a-a42f-4260-868f-719b54772c0d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:30.257636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:30.270047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:30.271246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:30.274849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.278258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:30.287250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Port': ['ID=b2f21901-3fc5-4898-bec8-9458e31e6e1b,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.291762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:30.334231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.375203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:30.387742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.397332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.439136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Made reservation on behalf of 2db7c5f71a2f486a87a72e6ff069379a for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:30.441482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.514711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.547318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event updated for resources: {'Port': ['ID=15152b06-bb58-4fce-a016-5ee8347fc6ef,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.574909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.ipam_backend_mixin [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 3943c90d-7859-4ab9-bc0d-30891fe19e0a (CIDR: 2001:db8::/64) Nov 05 14:49:30.577983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:30.583930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-c779ff17-c3b3-49d6-8573-e45a8ccc7c2c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3420804 Nov 05 14:49:30.592181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.594220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:30.596843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:30.618601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:30.619614 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:49:30.619908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:30.637042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Pushing event updated for resources: {'Port': ['ID=724cfc50-8a61-40a1-bcc8-66dd4b261382,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.662418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:30.678306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2c79e0d9-b58c-4b36-a71e-72d9051bb27a None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:30.678729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c79e0d9-b58c-4b36-a71e-72d9051bb27a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.732346 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-e5570361-6abc-49ae-a168-8f02447fce85 service neutron] 10.222.0.30 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359150 Nov 05 14:49:30.757097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-220bbe47-4e7f-4447-b56e-cc0939597d68 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.2857730 Nov 05 14:49:30.757651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43578) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:30.775264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Network 55b25de1-89c8-4f5a-9068-ca3a407223db is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:30.800110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Attempting to bind port 2be4439b-204a-411e-8526-cf2a0f1f66b0 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:30.800504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Attempting to bind port 2be4439b-204a-411e-8526-cf2a0f1f66b0 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'f8efc8e7-db86-4936-ba27-aa89e0b79b73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:30.800876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Attempting to bind port 2be4439b-204a-411e-8526-cf2a0f1f66b0 on network a79abec6-87fd-477e-a6d8-3655432a4a0a {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:30.810950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:30.813360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:30.825934 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:30.844113 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-3da3f937-d73b-4333-8716-b08134cb327f service neutron] 10.222.0.30 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1048214 Nov 05 14:49:30.857500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:30.857958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Checking segment: {'id': 'f8efc8e7-db86-4936-ba27-aa89e0b79b73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:30.858280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.858677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Bound using segment: {'id': 'f8efc8e7-db86-4936-ba27-aa89e0b79b73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:30.859164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Bound port: 2be4439b-204a-411e-8526-cf2a0f1f66b0, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f8efc8e7-db86-4936-ba27-aa89e0b79b73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:30.859543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.867682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Pushing event updated for resources: {'Port': ['ID=bae07728-6a5f-414a-baa7-a1896eab25c9,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:30.872429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Attempting to bind port 724cfc50-8a61-40a1-bcc8-66dd4b261382 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:30.872823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Attempting to bind port 724cfc50-8a61-40a1-bcc8-66dd4b261382 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'a4318642-c0d1-436d-8b41-d942637f20d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:30.873184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Attempting to bind port 724cfc50-8a61-40a1-bcc8-66dd4b261382 on network 817c1122-6b1d-4ea9-8ba7-c09f43796853 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:30.932678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:30.932974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Checking segment: {'id': 'a4318642-c0d1-436d-8b41-d942637f20d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:30.933424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:30.933861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Bound using segment: {'id': 'a4318642-c0d1-436d-8b41-d942637f20d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:30.934433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Bound port: 724cfc50-8a61-40a1-bcc8-66dd4b261382, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a4318642-c0d1-436d-8b41-d942637f20d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '817c1122-6b1d-4ea9-8ba7-c09f43796853'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:30.934858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.036976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Attempting to bind port bae07728-6a5f-414a-baa7-a1896eab25c9 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:31.037346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Attempting to bind port bae07728-6a5f-414a-baa7-a1896eab25c9 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '6760743a-817c-4af3-bc4d-6c64c33bf41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:31.037709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Attempting to bind port bae07728-6a5f-414a-baa7-a1896eab25c9 on network 55b25de1-89c8-4f5a-9068-ca3a407223db {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:31.112687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:31.113071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Checking segment: {'id': '6760743a-817c-4af3-bc4d-6c64c33bf41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:31.113484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.113885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Bound using segment: {'id': '6760743a-817c-4af3-bc4d-6c64c33bf41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:31.114375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Bound port: bae07728-6a5f-414a-baa7-a1896eab25c9, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6760743a-817c-4af3-bc4d-6c64c33bf41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 628, 'network_id': '55b25de1-89c8-4f5a-9068-ca3a407223db'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:31.115038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.120134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f75d6567-3e98-4c6f-8b12-58305ffdd033 req-23054dfc-a875-43e0-917c-2e7697dd101e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 210 time: 0.0881371 Nov 05 14:49:31.232365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:31.275169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] For port 724cfc50-8a61-40a1-bcc8-66dd4b261382, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:31.279100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.290301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:31.292358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.305415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.309705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] For port 724cfc50-8a61-40a1-bcc8-66dd4b261382, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=724cfc50-8a61-40a1-bcc8-66dd4b261382,segment=NetworkSegment(a4318642-c0d1-436d-8b41-d942637f20d0),segment_id=a4318642-c0d1-436d-8b41-d942637f20d0)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:31.318595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.340522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:31.344364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.350577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.369832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.371528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Router 7538d7ea-0474-4aa1-9cce-b31ff268f948 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:31.401498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] For port bae07728-6a5f-414a-baa7-a1896eab25c9, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:31.410107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] For port bae07728-6a5f-414a-baa7-a1896eab25c9, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bae07728-6a5f-414a-baa7-a1896eab25c9,segment=NetworkSegment(6760743a-817c-4af3-bc4d-6c64c33bf41c),segment_id=6760743a-817c-4af3-bc4d-6c64c33bf41c)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:31.441027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.468940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ed07cc-df05-4ffc-9125-d67b4ad2382b None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:31.533094 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:49:31.568661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2e71e7a1-f932-4523-a8ac-7f5facc8c11b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:31.600073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Attempting to bind port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:31.600535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Attempting to bind port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:31.600906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Attempting to bind port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:31.603206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8938dc-634d-47e2-99d7-0ddedc021e34 None None] Pushing event updated for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:31.612673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:49:31.649685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:31.650060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:31.650474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.650870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Bound using segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:31.651358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Bound port: 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:31.651829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.745732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dae14f3d-5075-4381-a6aa-f02d94e31cb7 None None] Pushing event updated for resources: {'Port': ['ID=724cfc50-8a61-40a1-bcc8-66dd4b261382,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:31.794565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] For port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:31.825021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] For port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:31.855473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:31.868172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ead69a1-c188-4197-b0ec-30af78dcb4d4 None None] Pushing event updated for resources: {'Port': ['ID=bae07728-6a5f-414a-baa7-a1896eab25c9,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:31.928901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:31.929650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.015474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8938dc-634d-47e2-99d7-0ddedc021e34 None None] Pushing event updated for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:32.106435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:32.236528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c653e32-c51d-445a-adc2-b079e5749cca req-c074a285-1fba-460e-b1fa-d9e8eedefadc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 210 time: 0.0322483 Nov 05 14:49:32.366725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:31Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.486210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Checking segment: {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:32.486490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Network hostable DHCP agents. Network: bde16d5a-a42f-4260-868f-719b54772c0d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:32.559147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61ce9681-760f-46f0-9872-88211a1532c6 None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:31Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:32.696449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:32.710055 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] Sync routers for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:32.717325 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-94943974-1d9b-45ca-a9bd-d5e73d3c2459 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3525419 Nov 05 14:49:32.718270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43598) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:32.722523 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:32.723380 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.771688 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.782106 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:32.782758 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.790850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Network bde16d5a-a42f-4260-868f-719b54772c0d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:32.841004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:32.841923 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38696b25-def3-4e02-86e0-f3cc131db4af None None] The sync data for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:32.861415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:32.893646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-9e631248-d19b-4a03-94a7-0c037c0d7477 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:32.895211 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-9e631248-d19b-4a03-94a7-0c037c0d7477 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 797 time: 0.5622058 Nov 05 14:49:32.895870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, bde16d5a-a42f-4260-868f-719b54772c0d) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:32.931082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:32.931674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:32.985221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.058677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43600) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:33.058970 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5cb7f16d-c88c-4096-a974-944385afb558 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.8427649 Nov 05 14:49:33.064142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:33.104211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.105260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.105654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Provisioning complete for port 724cfc50-8a61-40a1-bcc8-66dd4b261382 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:33.106186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.205102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.240517 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-353b5fd1-4fc9-4fb5-8945-3dcc940a4f5d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 379 time: 0.3305249 Nov 05 14:49:33.247516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.256059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['47fcff7a-3ae1-433f-8294-891325add414']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:33.274422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.339730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] For port 724cfc50-8a61-40a1-bcc8-66dd4b261382, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=724cfc50-8a61-40a1-bcc8-66dd4b261382,segment=NetworkSegment(a4318642-c0d1-436d-8b41-d942637f20d0),segment_id=a4318642-c0d1-436d-8b41-d942637f20d0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:33.349950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.431368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Provisioning complete for port b2f21901-3fc5-4898-bec8-9458e31e6e1b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:33.431745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.477760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Pushing event updated for resources: {'Port': ['ID=724cfc50-8a61-40a1-bcc8-66dd4b261382,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:33.523670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-afd9e411-cd96-4f6a-ac84-9b51170b7f0c None None] Port b2f21901-3fc5-4898-bec8-9458e31e6e1b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:33.575610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.621116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f207fdf7-b83b-4a82-a1d4-7679a3115ef9 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:49:33.628347 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f207fdf7-b83b-4a82-a1d4-7679a3115ef9 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.9081323 Nov 05 14:49:33.630013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43604) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:33.723830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=2bd90bc7-9513-48fa-8b2f-64e5612245e5,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:33.768934 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:33.795360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.807231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:33.877674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:33.900877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] Provisioning complete for port bae07728-6a5f-414a-baa7-a1896eab25c9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:33.901987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.911441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.947256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.948985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:33.961088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:33.961466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.046674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5c4d2db9-8396-4066-95a9-5515d21fbcd8 req-81f709b7-039f-46dc-96be-9addba926cfd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 210 time: 0.3839972 Nov 05 14:49:34.051528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:34.056024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=13']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:34.105102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4686140-2e2b-4a68-8cc8-ab8d0a7b12b2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:34.162226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.176097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:34.183996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:34.184775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.202888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] For port bae07728-6a5f-414a-baa7-a1896eab25c9, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bae07728-6a5f-414a-baa7-a1896eab25c9,segment=NetworkSegment(6760743a-817c-4af3-bc4d-6c64c33bf41c),segment_id=6760743a-817c-4af3-bc4d-6c64c33bf41c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:34.218570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.221690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:34.229157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Router d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:34.231423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:34.237941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=b2527de8-ac81-4260-9913-f74a88c7062b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:34.252150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:34.252922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.261485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.262346 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d36ec95c-11db-4b0f-8501-cd083bf1e0e7 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 3.4936864 Nov 05 14:49:34.265795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43606) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:34.272977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1399893176', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '2bd90bc7-9513-48fa-8b2f-64e5612245e5'}], 'security_groups': ['14a9a011-f95c-43f5-b7bc-b5fd52cc7af6']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:34.278999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.287192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.11 (965643a3-ab1e-4f60-b0a0-5bd33b3145bc/3381e8ef-646f-402d-992f-758c603f54be/4f1ce27a-19c7-41ae-8be6-8a86912c76bc) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:34.302451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:34.313890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.334351 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e759f4ef-42d6-41c2-853e-2ac2b6eda972 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 4.4549165 Nov 05 14:49:34.359341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43608) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:34.369402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.370179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 724cfc50-8a61-40a1-bcc8-66dd4b261382 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:34.371489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:34.391075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:34.392053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.504445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6683e0c3-1561-4765-a347-9a252be7ba9b None None] Pushing event updated for resources: {'Port': ['ID=bae07728-6a5f-414a-baa7-a1896eab25c9,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:34.515722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.655920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4686140-2e2b-4a68-8cc8-ab8d0a7b12b2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:34.660787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:34.673435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 724cfc50-8a61-40a1-bcc8-66dd4b261382 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:34.673812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.715527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:34.716175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.822748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Allocated IP 172.26.5.156 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/23c75c34-c49e-48dd-99c4-e2f41cb6108a) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:34.835238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:34.858896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] Sync routers for ids ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:34.922196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.926738 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8c30302b-4c42-4c59-af6d-30fa1c47645a tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 8.6125979 Nov 05 14:49:34.929491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:34.940217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:34.948229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:34.955400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] Routers {'d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:34.956122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:34.981349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bae07728-6a5f-414a-baa7-a1896eab25c9 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:34.990000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.034065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:35.037676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.044815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:35.078039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] Routers {'d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:35.078748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:35.134192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:35.134895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6164775-5a35-486c-943b-961e36f93ddf None None] The sync data for ids ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:35.143266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.195246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:35.195851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.199556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.263794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bae07728-6a5f-414a-baa7-a1896eab25c9 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:35.264123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.294338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:35.318642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.322752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:35.323136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-914ea2c2-f634-4cd8-98da-f305224c0fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.351788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7c07b2-1e30-4a06-bf06-d67bb8b5e30e req-1d55b489-60c6-4e48-b895-d5d317519dab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:35.352807 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e7c07b2-1e30-4a06-bf06-d67bb8b5e30e req-1d55b489-60c6-4e48-b895-d5d317519dab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 932 time: 0.1657014 Nov 05 14:49:35.356747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:35.372073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:35.379162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:35.383956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:35.440078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:35.451697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:35.453785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:35.498699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Pushing event updated for resources: {'Port': ['ID=23c75c34-c49e-48dd-99c4-e2f41cb6108a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:35.537794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:35.538460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.589457 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting port b2f21901-3fc5-4898-bec8-9458e31e6e1b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:35.589802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.628657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e7c07b2-1e30-4a06-bf06-d67bb8b5e30e req-3769c75a-41b0-4ca5-8e7f-3be7e37bbc12 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2427094 Nov 05 14:49:35.631066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:35.693773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Update dhcp port {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'fixed_ips': [{'subnet_id': '3943c90d-7859-4ab9-bc0d-30891fe19e0a', 'ip_address': '2001:db8::2'}, {'subnet_id': '2bd90bc7-9513-48fa-8b2f-64e5612245e5'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '2be4439b-204a-411e-8526-cf2a0f1f66b0'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:49:35.708686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.738693 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-ea6d8291-24e4-4d66-81e5-33da54f67086 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4900794 Nov 05 14:49:35.752214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.773191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Request body: {'port': {'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:35.820542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:35.820906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:35.934574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.017642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.043262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:36.071352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.101312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Delete allocated IP 2001:db8::157 (a79abec6-87fd-477e-a6d8-3655432a4a0a/3943c90d-7859-4ab9-bc0d-30891fe19e0a) {{(pid=113581) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:49:36.105719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:36.114909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Calling delete_port for b2f21901-3fc5-4898-bec8-9458e31e6e1b owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:36.124388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=33d79753-cab7-45b2-8878-491209ca8695,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:36.130110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:36.130704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.134506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8:0:1::12e (a79abec6-87fd-477e-a6d8-3655432a4a0a/2bd90bc7-9513-48fa-8b2f-64e5612245e5/f0f2c8a2-0c64-4a49-a808-bab7787a4ab9) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:36.138711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.263106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.325456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:36.331358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.384047 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6fe724ef-d64b-4651-9bee-e0793ce99ed7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0227594 Nov 05 14:49:36.395300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43614) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:36.400346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:2a:a2:d6', 'name': 'tempest-NetworksTestDHCPv6-936955453'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:36.406224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:36.555390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bae07728-6a5f-414a-baa7-a1896eab25c9 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:36.582830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-bde16d5a-a42f-4260-868f-719b54772c0d', 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'fixed_ips': [{'subnet_id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:36.585652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.726848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-79e0a8af-296d-4a77-b7f9-a572cbfe50d4 None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:36.727231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79e0a8af-296d-4a77-b7f9-a572cbfe50d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.852501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:36.870581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bae07728-6a5f-414a-baa7-a1896eab25c9 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:36.871054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:36.997483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Allocated IP 172.20.0.2 (bde16d5a-a42f-4260-868f-719b54772c0d/2e71e7a1-f932-4523-a8ac-7f5facc8c11b/7597b659-dde2-40d5-944e-6c7302e11125) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:37.050614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.055436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.099417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:37.117408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Port': ['ID=b2f21901-3fc5-4898-bec8-9458e31e6e1b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:37.134207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.143900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-79e0a8af-296d-4a77-b7f9-a572cbfe50d4 None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:37.144419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79e0a8af-296d-4a77-b7f9-a572cbfe50d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.352292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:37.353003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.428083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.428935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75f7fd6-1d8a-4f5a-b05c-f18d50aea0a0 req-13e45dd9-2783-499a-b57c-da81a4f151bd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:37.441078 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a75f7fd6-1d8a-4f5a-b05c-f18d50aea0a0 req-13e45dd9-2783-499a-b57c-da81a4f151bd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 932 time: 0.6754105 Nov 05 14:49:37.443105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.507648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.520908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.533807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Network bde16d5a-a42f-4260-868f-719b54772c0d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:37.562083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:37.566136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 4d605aed-24aa-429d-954c-139e65b87aaf yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:37.589082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:37.591038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=f0f2c8a2-0c64-4a49-a808-bab7787a4ab9,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:37.595362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Pushing event updated for resources: {'Port': ['ID=7597b659-dde2-40d5-944e-6c7302e11125,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:37.619608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:37.657335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ba59370f-9f7e-4b5b-b9d6-284346c60046 None None] Provisioning complete for port 724cfc50-8a61-40a1-bcc8-66dd4b261382 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:37.657705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ba59370f-9f7e-4b5b-b9d6-284346c60046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.695164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] In _notify_port_updated(), no bound segment for port f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 on network a79abec6-87fd-477e-a6d8-3655432a4a0a {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:49:37.701019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:37.701660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.706241 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9c5966d3-106c-4caf-ae49-9bdf495348b3 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/ports/f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 HTTP/1.1" status: 200 len: 931 time: 3.4365923 Nov 05 14:49:37.709321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43618) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:37.710097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.724090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Allocated IP 2001:db8:0:1::2 (a79abec6-87fd-477e-a6d8-3655432a4a0a/2bd90bc7-9513-48fa-8b2f-64e5612245e5/2be4439b-204a-411e-8526-cf2a0f1f66b0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:37.744189 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a75f7fd6-1d8a-4f5a-b05c-f18d50aea0a0 req-3ddc0b35-a818-4539-8bc0-db4ce4bba6f4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3018603 Nov 05 14:49:37.757042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Attempting to bind port 7597b659-dde2-40d5-944e-6c7302e11125 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:37.757256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Attempting to bind port 7597b659-dde2-40d5-944e-6c7302e11125 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:37.757846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Attempting to bind port 7597b659-dde2-40d5-944e-6c7302e11125 on network bde16d5a-a42f-4260-868f-719b54772c0d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:37.764896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.779229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4f1ce27a-19c7-41ae-8be6-8a86912c76bc {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:49:37.779229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.781072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:37.781363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Checking segment: {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:37.781691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.782214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Bound using segment: {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:37.783005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Bound port: 7597b659-dde2-40d5-944e-6c7302e11125, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:37.783654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.788155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.840500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:37.840733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Transition to ACTIVE for port object 4f1ce27a-19c7-41ae-8be6-8a86912c76bc will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:49:37.840844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.855624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:37.976758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:37.997637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] For port 7597b659-dde2-40d5-944e-6c7302e11125, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:38.000469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ba59370f-9f7e-4b5b-b9d6-284346c60046 None None] Could not find standard attr ID for object b2f21901-3fc5-4898-bec8-9458e31e6e1b. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:38.023122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] For port 7597b659-dde2-40d5-944e-6c7302e11125, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7597b659-dde2-40d5-944e-6c7302e11125,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:38.040820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.052373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:38.073216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.097167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ba59370f-9f7e-4b5b-b9d6-284346c60046 None None] Provisioning complete for port bae07728-6a5f-414a-baa7-a1896eab25c9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:38.097836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ba59370f-9f7e-4b5b-b9d6-284346c60046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.104606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.110304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Pushing event updated for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:38.116181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:38.116857 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.140804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Router 7538d7ea-0474-4aa1-9cce-b31ff268f948 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:38.157155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 724cfc50-8a61-40a1-bcc8-66dd4b261382 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:38.182865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 172.20.0.7 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/33d79753-cab7-45b2-8878-491209ca8695/4d605aed-24aa-429d-954c-139e65b87aaf) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:38.193685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Router affa76f7-e71b-4e66-bc82-992ceed4fa91 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:38.194463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Attempting to bind port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:38.194817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Attempting to bind port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:38.195150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Attempting to bind port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc on network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:38.200923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fe2a:a2d6 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/b2527de8-ac81-4260-9913-f74a88c7062b/4d605aed-24aa-429d-954c-139e65b87aaf) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:38.229768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc on network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:49:38.230080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Attempting to bind port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc on network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:38.270338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147a6c3f-cf25-4372-babc-dd7f37805b12 None None] Pushing event updated for resources: {'Port': ['ID=7597b659-dde2-40d5-944e-6c7302e11125,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:38.277023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:38.288900 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] Sync routers for ids ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:38.295298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.296811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d84a6b83-308c-4dda-be66-500dac8cb95e tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "PUT /v2.0/routers/d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 200 len: 926 time: 3.3623645 Nov 05 14:49:38.297915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:38.298724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Checking segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:38.299200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Bound using segment: {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:38.299647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Bound port: 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 647, 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:38.299994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.307295 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] Routers {'d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:38.307935 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.315677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43620) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:38.382028 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.384904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc48371-b21f-47f8-ac67-6045b07b7e23 None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:38.398191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:38.404420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 724cfc50-8a61-40a1-bcc8-66dd4b261382 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:38.405300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.411733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:38.412992 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] Routers {'d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:38.414719 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.520108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:38.531547 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.534098 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e97d2909-effb-4f83-a62f-fe8831dcf2a5 None None] The sync data for ids ['d8fe5343-b5a8-47ba-a92f-c81dd0d9a861'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:38.553425 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-00598144-c09c-44ad-be1f-8ded3acf4d6f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9157658 Nov 05 14:49:38.554254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43622) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:38.563838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.572475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] Sync routers for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:38.598872 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17d8aa1f-9121-476a-9892-170593548b70 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:38.599383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17d8aa1f-9121-476a-9892-170593548b70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.607375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:38.608138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.632438 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-76e40e71-5d01-47c3-ae64-c4b134d9ea7c tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] delete failed (client error): The resource could not be found. Nov 05 14:49:38.643593 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-76e40e71-5d01-47c3-ae64-c4b134d9ea7c tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/routers/tempest-non_exist_router-1857078845 HTTP/1.1" status: 404 len: 335 time: 0.0828807 Nov 05 14:49:38.643845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.650106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43624) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:38.667647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f920c561-2ce3-4340-a94a-03f5d9de1a69 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'router': {'external_gateway_info': {'network_id': '7538d7ea-0474-4aa1-9cce-b31ff268f948'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:38.668791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.713067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:38.713375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:38.714764 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] 10.222.0.32 "PUT /v2.0/ports/4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 1094 time: 2.9591167 Nov 05 14:49:38.724853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:38.725772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:38.738655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:49:38.741513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a34ac015-d43e-4f89-be64-328718618a99" -d '{"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:49:38.817056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:38.922320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-612b70f4-0e6d-4167-9be7-f3b8f2f24350 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 200 len: 926 time: 0.5058386 Nov 05 14:49:38.924797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:49:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-828531a5-fe9c-4925-9a2a-3df6e505b85f x-openstack-request-id: req-828531a5-fe9c-4925-9a2a-3df6e505b85f {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:49:38.925138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:49:38.925401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-828531a5-fe9c-4925-9a2a-3df6e505b85f {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:49:38.925807 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'status': 'completed', 'code': 200} Nov 05 14:49:38.936259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43630) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:38.972200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-4c04ecd3-d115-4d4f-8724-b8293f328f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:38.973851 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-4c04ecd3-d115-4d4f-8724-b8293f328f3f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1097 time: 0.2029531 Nov 05 14:49:38.974695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-768f134d-07f7-4515-87ba-86e5521273b9 service neutron] Pushing event updated for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:39.053505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:39.067183 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Sync routers for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:39.078554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:39.083691 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:39.093675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:39.094339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ffd72e0-0d8f-4355-a1cb-7383b4dc6e98 None None] The sync data for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:39.102981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:39.135717 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-9d572609-e894-4869-acb2-037e877e473c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 217 time: 0.1529374 Nov 05 14:49:39.271711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-2244ea7c-ee15-4305-abc7-430d420f4dae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:39.273641 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-2244ea7c-ee15-4305-abc7-430d420f4dae service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.1305840 Nov 05 14:49:39.289913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137b3806-488d-4791-92ae-4671e1475472 req-b36dde94-3309-4c55-8622-759d2a53005d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:39.291524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-137b3806-488d-4791-92ae-4671e1475472 req-b36dde94-3309-4c55-8622-759d2a53005d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 944 time: 0.3648102 Nov 05 14:49:39.326061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:39.326443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.337075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17d8aa1f-9121-476a-9892-170593548b70 None None] Provisioning complete for port 520724fb-889b-44ff-8b19-6b3ab8762057 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:39.337519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17d8aa1f-9121-476a-9892-170593548b70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.427332 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:39.445016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.473175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-b4aa12f4-2a67-4083-a23f-00cda21ead29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:39.474755 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-b4aa12f4-2a67-4083-a23f-00cda21ead29 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1822960 Nov 05 14:49:39.521598 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-137b3806-488d-4791-92ae-4671e1475472 req-441b4cf9-4df5-4fce-8e4c-a02826d67801 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1368787 Nov 05 14:49:39.551497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.554507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8844036-5fec-4547-91cb-f4d07e9a9b2d tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:39.556122 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8844036-5fec-4547-91cb-f4d07e9a9b2d tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=d8fe5343-b5a8-47ba-a92f-c81dd0d9a861&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.6141973 Nov 05 14:49:39.562902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.564331 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-86e5ced1-183f-4590-a399-0f449166ea71 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 6.5045719 Nov 05 14:49:39.567736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43634) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:39.568139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43636) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:39.593992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:39.603004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.637714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-72a4ea96-3815-43e9-9134-5e8c57ae710b service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1524990 Nov 05 14:49:39.666265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:39.666639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.694162 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:35Z', 'revision_number': 3, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:39.742093 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Checking router: affa76f7-e71b-4e66-bc82-992ceed4fa91 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:39.742445 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Updating router affa76f7-e71b-4e66-bc82-992ceed4fa91 port 23c75c34-c49e-48dd-99c4-e2f41cb6108a binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:39.774829 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.784221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:39.784640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.787794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7597b659-dde2-40d5-944e-6c7302e11125 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:39.806917 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d566cf02-1a0e-4b3c-956a-bc3ce4d27888 req-e95e0b0d-31e9-4a9d-ac8a-b23eccacb20c service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1574128 Nov 05 14:49:39.892182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:39.892586 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:39.954171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ac015-d43e-4f89-be64-328718618a99 req-06bb2776-24cb-49f9-9b96-2c18fcd15332 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:39.956255 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-06bb2776-24cb-49f9-9b96-2c18fcd15332 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1097 time: 0.0974102 Nov 05 14:49:39.976572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-909818a6-8103-4fad-8368-f133db261a1b None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:39.978871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad03543e-cc83-4721-8ec2-ccf575da055a None None] Network bde16d5a-a42f-4260-868f-719b54772c0d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:40.120532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Could not find standard attr ID for object f0f2c8a2-0c64-4a49-a808-bab7787a4ab9. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:40.220179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:40.220587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.235935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ac015-d43e-4f89-be64-328718618a99 req-24655acf-9621-47e3-a7b8-297b9e68af4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:40.237790 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-24655acf-9621-47e3-a7b8-297b9e68af4d service neutron] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 898 time: 0.2726192 Nov 05 14:49:40.261464 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.276557 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.286368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3cd46816-171c-4c6e-98d3-83fef5caa99d None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:40.350564 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-6eabf450-3aef-4680-b58e-25ae88f3c6a3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 217 time: 0.1022239 Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ad03543e-cc83-4721-8ec2-ccf575da055a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:40.353684 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-909818a6-8103-4fad-8368-f133db261a1b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:40.388922 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:40.398540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-817575ac-5bc9-4f00-8e42-c050bd34a536 None None] Pushing event updated for resources: {'Port': ['ID=23c75c34-c49e-48dd-99c4-e2f41cb6108a,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:40.401083 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Attempting to bind port 23c75c34-c49e-48dd-99c4-e2f41cb6108a on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:40.401443 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Attempting to bind port 23c75c34-c49e-48dd-99c4-e2f41cb6108a by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:40.401795 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Attempting to bind port 23c75c34-c49e-48dd-99c4-e2f41cb6108a on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:40.413555 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:40.413920 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:40.427071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88d6708a-3d39-4a6e-b57d-1845a5400d74 None None] Network bde16d5a-a42f-4260-868f-719b54772c0d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:40.437382 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.444124 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:40.444741 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Bound port: 23c75c34-c49e-48dd-99c4-e2f41cb6108a, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:40.445136 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.482753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ac015-d43e-4f89-be64-328718618a99 req-716ecd8a-92c3-4df3-85b5-b8d9829111a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:40.484519 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-716ecd8a-92c3-4df3-85b5-b8d9829111a6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.1215301 Nov 05 14:49:40.504385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f920c561-2ce3-4340-a94a-03f5d9de1a69 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.553958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-641b644d-0299-4d30-b884-981159f0e8a6 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:40.556871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.557002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09ca779a-98f8-44b9-bc7e-565ca3b3fd54 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:40.561966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-09ca779a-98f8-44b9-bc7e-565ca3b3fd54 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.9558880 Nov 05 14:49:40.563758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=4d605aed-24aa-429d-954c-139e65b87aaf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:40.585942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43640) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:40.600851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.607301 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] For port 23c75c34-c49e-48dd-99c4-e2f41cb6108a, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:40.611330 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] For port 23c75c34-c49e-48dd-99c4-e2f41cb6108a, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23c75c34-c49e-48dd-99c4-e2f41cb6108a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:40.612191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 HTTP/1.1" status: 204 len: 168 time: 2.8998253 Nov 05 14:49:40.612318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43642) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:40.623014 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.636171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:40.670363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 724cfc50-8a61-40a1-bcc8-66dd4b261382 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:40.670928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:40.677030 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-20e03280-29f1-41c3-b7a2-ca3299cff190 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:49:40.681788 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20e03280-29f1-41c3-b7a2-ca3299cff190 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/f0f2c8a2-0c64-4a49-a808-bab7787a4ab9 HTTP/1.1" status: 404 len: 333 time: 0.0643463 Nov 05 14:49:40.683126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43644) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:40.684354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc5eaa09-5b0a-469e-b0a8-fa6696c56674 None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:40.776042 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:40.776384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34ac015-d43e-4f89-be64-328718618a99 req-a97dd5c8-7895-4fa1-86e2-bd32bbcaf900 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:40.777959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-a97dd5c8-7895-4fa1-86e2-bd32bbcaf900 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2840898 Nov 05 14:49:40.787314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:40.795127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cf15de63-6569-4895-be3e-4c70dd8a3ef4 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 200 len: 205 time: 0.1507237 Nov 05 14:49:40.796703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b2839c-6aaf-4ef7-8f06-ad312f920c21 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=f0f2c8a2-0c64-4a49-a808-bab7787a4ab9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:40.799103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43648) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:40.801812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-641b644d-0299-4d30-b884-981159f0e8a6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:40.802753 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:40.817452 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-88d6708a-3d39-4a6e-b57d-1845a5400d74 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:40.879766 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:40.926434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f920c561-2ce3-4340-a94a-03f5d9de1a69 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] update failed (client error): The resource could not be found. Nov 05 14:49:40.932565 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f920c561-2ce3-4340-a94a-03f5d9de1a69 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948 HTTP/1.1" status: 404 len: 339 time: 2.2765234 Nov 05 14:49:40.935016 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-817575ac-5bc9-4f00-8e42-c050bd34a536 None None] Pushing event updated for resources: {'Port': ['ID=23c75c34-c49e-48dd-99c4-e2f41cb6108a,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:40.937209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 7597b659-dde2-40d5-944e-6c7302e11125, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7597b659-dde2-40d5-944e-6c7302e11125,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:40.950339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.029290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43650) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:41.046601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-492593065'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:41.092366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=7597b659-dde2-40d5-944e-6c7302e11125,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cc5eaa09-5b0a-469e-b0a8-fa6696c56674 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:41.135439 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:41.160538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:41.162716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Could not find standard attr ID for object b2f21901-3fc5-4898-bec8-9458e31e6e1b. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:41.183758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:41.185882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.206411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:41.208155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.225707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:41.236757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.314328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca56df88-f32f-49ae-b4a4-38920aaec1a2 req-81fa260d-c91c-4167-acb1-24f58b617420 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:41.316521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca56df88-f32f-49ae-b4a4-38920aaec1a2 req-81fa260d-c91c-4167-acb1-24f58b617420 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 944 time: 0.5348325 Nov 05 14:49:41.383253 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e5731b0-bc8c-413e-a520-a161eaed6ef8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 4.9865811 Nov 05 14:49:41.389112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43652) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:41.393075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:41.393559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.477735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:49:41.499656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.523151 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca56df88-f32f-49ae-b4a4-38920aaec1a2 req-544d9a77-b7f9-4381-b1f4-f6e8b16da6cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1891716 Nov 05 14:49:41.528527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.529089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Added segment 5b5f0566-9a1e-48e9-bdad-974d03d242cb of type vlan for network d420ae72-e4fa-429b-b3f8-f1864c828421 Nov 05 14:49:41.536824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Could not find standard attr ID for object f0f2c8a2-0c64-4a49-a808-bab7787a4ab9. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:41.564001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 96d615f3-eea3-46d2-b255-96f704d51534 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:41.565928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.577876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.613244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3de62463-9c95-41fc-a183-b03431ea2294 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:41.620679 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:35Z', 'revision_number': 3, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:41.621610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3de62463-9c95-41fc-a183-b03431ea2294 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:41.625087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3de62463-9c95-41fc-a183-b03431ea2294 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1784 time: 0.2283006 Nov 05 14:49:41.629264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43654) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:41.699298 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cac6b01-a93a-4b91-9bf5-9877ade66018 None None] The sync data for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv is: [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:35Z', 'revision_number': 3, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:41.699578 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-fe5eb2c5-c078-4a70-8f1f-ccb96028ae8f service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9137297 Nov 05 14:49:41.741568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.746568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.784182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port bae07728-6a5f-414a-baa7-a1896eab25c9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:41.785103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.867155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 4f1ce27a-19c7-41ae-8be6-8a86912c76bc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:49:41.923848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.924085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.929066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.929892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:41.930673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:41.935042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43656) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:41.935695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/security-groups/c3f9f413-c3d9-402b-ba81-b7cfbdc45155 HTTP/1.1" status: 204 len: 168 time: 1.2508659 Nov 05 14:49:41.977435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d74e4fa3-8c13-4bf7-ae50-81a836e5e9fd tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3f9f413-c3d9-402b-ba81-b7cfbdc45155,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:42.119559 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a34ac015-d43e-4f89-be64-328718618a99 req-ce8273b0-626d-4693-a43d-6c2d8695da4f service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4118927 Nov 05 14:49:42.156189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.194693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.1597216 Nov 05 14:49:42.200095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43658) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:42.209237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 4d605aed-24aa-429d-954c-139e65b87aaf {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:42.209575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.216785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:42.216979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.236100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'subnet': {'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:42.279414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:42.301997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.312478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc3b828-294d-4112-8f7e-47f94c07b7e8 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Network': ['ID=d420ae72-e4fa-429b-b3f8-f1864c828421,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:42.315450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:42.323583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 647, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:49:42.340271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d420ae72-e4fa-429b-b3f8-f1864c828421 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:49:42.346623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.384494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port 15152b06-bb58-4fce-a016-5ee8347fc6ef {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:42.385173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.389526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Made reservation on behalf of 3b26d4f4e40d40b98d8455e0b2c4ec13 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:42.406534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.456360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.573193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.606273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d8e75d9-ccb5-4269-ac22-d442fe6534de None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:42.614441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 4d605aed-24aa-429d-954c-139e65b87aaf owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:42.619638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:42.620156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.640543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.643434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.647035 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/security-groups/14a9a011-f95c-43f5-b7bc-b5fd52cc7af6 HTTP/1.1" status: 204 len: 168 time: 0.7008686 Nov 05 14:49:42.657808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43662) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:42.677776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.691722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.737823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f1ce27a-19c7-41ae-8be6-8a86912c76bc {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:49:42.769456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Subnet': ['ID=485c56d2-f225-45e1-86b5-bf585611fecc,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:42.790981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:42.802376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.821350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 3943c90d-7859-4ab9-bc0d-30891fe19e0a {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:42.824152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa65db89-8ad3-42a6-88ca-39a462171eb5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=14a9a011-f95c-43f5-b7bc-b5fd52cc7af6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:42.830156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.873721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Checking segment: {'id': '5b5f0566-9a1e-48e9-bdad-974d03d242cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:42.873721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network hostable DHCP agents. Network: d420ae72-e4fa-429b-b3f8-f1864c828421, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:49:42.893160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18726934-a5b2-4e53-b022-d91b4874aad5 req-036c2cb7-97e3-4e83-a1ef-f9833f3ac508 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:42.903643 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18726934-a5b2-4e53-b022-d91b4874aad5 req-036c2cb7-97e3-4e83-a1ef-f9833f3ac508 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 944 time: 0.2359746 Nov 05 14:49:42.905718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Allocated IP 172.20.0.1 (bde16d5a-a42f-4260-868f-719b54772c0d/2e71e7a1-f932-4523-a8ac-7f5facc8c11b/1e2801d3-ca3e-4985-a965-861f5c8326b0) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:42.923833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:42.950063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:42.955906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d8e75d9-ccb5-4269-ac22-d442fe6534de None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:42.967119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port 520724fb-889b-44ff-8b19-6b3ab8762057 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:42.967589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.002222 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18726934-a5b2-4e53-b022-d91b4874aad5 req-34581908-a762-4c19-bf3f-9942e977f634 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0926344 Nov 05 14:49:43.009636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.042842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for 15152b06-bb58-4fce-a016-5ee8347fc6ef owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:43.100112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['4f1ce27a-19c7-41ae-8be6-8a86912c76bc'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:49:43.147281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network d420ae72-e4fa-429b-b3f8-f1864c828421 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:49:43.168475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d420ae72-e4fa-429b-b3f8-f1864c828421) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:43.180162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:43.180917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.264568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23c75c34-c49e-48dd-99c4-e2f41cb6108a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:43.270532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.275473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.296377 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd653bca-a2ab-4151-8e92-da0acf6fddc4 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.0703366 Nov 05 14:49:43.299240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43664) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:43.305803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5033a951-9333-4a0b-9cae-b3ac5d54b90f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'router': {'external_gateway_info': {'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:43.334180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.378777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=4d605aed-24aa-429d-954c-139e65b87aaf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:43.417855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.456768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Provisioning complete for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:43.457135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f4beb5a-88a7-482d-95d1-7d6652d4c6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.465914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.520925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 23c75c34-c49e-48dd-99c4-e2f41cb6108a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:43.521294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.531287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=3943c90d-7859-4ab9-bc0d-30891fe19e0a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:43.542980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Network bde16d5a-a42f-4260-868f-719b54772c0d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:43.548638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.557067 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-75a5c9d3-1dfa-4f2b-bea8-b41ccfb12a48 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/3943c90d-7859-4ab9-bc0d-30891fe19e0a HTTP/1.1" status: 204 len: 168 time: 0.8905210 Nov 05 14:49:43.557067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:43.558850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43666) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:43.567912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.569337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:43.577215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:43.589390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Pushing event updated for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:43.634028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5033a951-9333-4a0b-9cae-b3ac5d54b90f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.637231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=15152b06-bb58-4fce-a016-5ee8347fc6ef,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:43.646265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.652282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5f02158b-3541-4546-a351-9090b215ca3c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/4d605aed-24aa-429d-954c-139e65b87aaf HTTP/1.1" status: 204 len: 168 time: 2.0148087 Nov 05 14:49:43.653039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43668) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:43.720546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.747730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.779372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 23c75c34-c49e-48dd-99c4-e2f41cb6108a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23c75c34-c49e-48dd-99c4-e2f41cb6108a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:43.791577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.792369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7597b659-dde2-40d5-944e-6c7302e11125 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:43.792628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.829374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94221936-3e43-4b3a-a222-59fc53c2dbf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:43.831020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94221936-3e43-4b3a-a222-59fc53c2dbf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:43.832574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94221936-3e43-4b3a-a222-59fc53c2dbf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:43.837523 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-94221936-3e43-4b3a-a222-59fc53c2dbf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1769073 Nov 05 14:49:43.850988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43670) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:43.899206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f1b4c027-2121-4479-b889-4d0d2244f2eb None None] Could not find standard attr ID for object b2f21901-3fc5-4898-bec8-9458e31e6e1b. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:43.908032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.911962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.937641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=23c75c34-c49e-48dd-99c4-e2f41cb6108a,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:43.964799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:43.965051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.967739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f1b4c027-2121-4479-b889-4d0d2244f2eb None None] Could not find standard attr ID for object 4d605aed-24aa-429d-954c-139e65b87aaf. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:43.991914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:43.995796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f1b4c027-2121-4479-b889-4d0d2244f2eb None None] Could not find standard attr ID for object f0f2c8a2-0c64-4a49-a808-bab7787a4ab9. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:43.996694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:43.997262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:43.998317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.004881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.006062 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c524400c-2f57-457b-b68f-c9504eb8edf0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 204 len: 168 time: 3.2053339 Nov 05 14:49:44.010368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43672) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:44.018063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-404539574', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:44.032412 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-5033a951-9333-4a0b-9cae-b3ac5d54b90f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:49:44.033591 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5033a951-9333-4a0b-9cae-b3ac5d54b90f tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948 HTTP/1.1" status: 400 len: 364 time: 0.7332208 Nov 05 14:49:44.034454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f1b4c027-2121-4479-b889-4d0d2244f2eb None None] Provisioning complete for port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:44.035005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f1b4c027-2121-4479-b889-4d0d2244f2eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.043177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43676) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:44.053914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 33d79753-cab7-45b2-8878-491209ca8695 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:44.057736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.108917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.176175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.177495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.242764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.247789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.256188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.362182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd41816-af9b-4168-992f-5a43cc21d1e8 req-dc775e52-7beb-47fa-b064-9609a4f079ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:44.363913 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0cd41816-af9b-4168-992f-5a43cc21d1e8 req-dc775e52-7beb-47fa-b064-9609a4f079ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 945 time: 0.1990817 Nov 05 14:49:44.384504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.388672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73cc7478-7553-450c-bb11-19c70c623249 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.3736007 Nov 05 14:49:44.390199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43678) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:44.394742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:44.398663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.441380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.461159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27bd7ab7-dc42-45e7-97e2-f248664f89fb None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:44.583761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5b1a00db-36fd-4422-bca1-f1ed15cf9138 None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:44.584063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b1a00db-36fd-4422-bca1-f1ed15cf9138 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.667765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27bd7ab7-dc42-45e7-97e2-f248664f89fb None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:44.705820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.710804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.812844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=33d79753-cab7-45b2-8878-491209ca8695,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:44.834032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:44.837635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-307e1370-b5c2-4d03-b905-f7cfddb22fb6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/33d79753-cab7-45b2-8878-491209ca8695 HTTP/1.1" status: 204 len: 168 time: 0.9804103 Nov 05 14:49:44.842680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43680) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:44.852026 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0cd41816-af9b-4168-992f-5a43cc21d1e8 req-47955997-8534-4a89-90c2-c4d8d2090414 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4675913 Nov 05 14:49:45.000478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet b2527de8-ac81-4260-9913-f74a88c7062b {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:45.008955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.054479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-d420ae72-e4fa-429b-b3f8-f1864c828421', 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421', 'tenant_id': '3b26d4f4e40d40b98d8455e0b2c4ec13', 'fixed_ips': [{'subnet_id': '485c56d2-f225-45e1-86b5-bf585611fecc'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:49:45.056171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.147858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.203267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23c75c34-c49e-48dd-99c4-e2f41cb6108a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:45.253867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.298982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:45.345761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Allocated IP 2001:db8:1::2 (d420ae72-e4fa-429b-b3f8-f1864c828421/485c56d2-f225-45e1-86b5-bf585611fecc/64ae0ebc-f1d0-4ed8-9059-15774b95d2bc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:45.407227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:45.413127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=f0b92e1b-4795-4ee8-b00e-ea7af9f69e22,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:45.424518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:45.425133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.472739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.479990 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4dff2a7b-3ee5-460c-80ac-51800c159116 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.9148028 Nov 05 14:49:45.482874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43682) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:45.490712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'security_group': {'name': 'tempest-secgroup-878976363'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:45.503781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.584062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Allocated IP 2001:db8::1 (eeefa8c9-20cd-4d8f-bb76-d2922b8a4290/7f49ab69-3400-44cd-810e-98bdaf3cf7f7/39df88ee-4a23-48fe-8cb5-67e92dbf2723) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:45.590767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 23c75c34-c49e-48dd-99c4-e2f41cb6108a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:45.591289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.617496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Pushing event updated for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:45.640219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.724241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.724873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.737874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.738119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.783544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.834956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Pushing event updated for resources: {'Port': ['ID=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:45.843674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Network d420ae72-e4fa-429b-b3f8-f1864c828421 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:45.849021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:45.853372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:45.887707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.906357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 4f1ce27a-19c7-41ae-8be6-8a86912c76bc up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:45.921848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.940624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.949334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.970954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:45.977364 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/b2527de8-ac81-4260-9913-f74a88c7062b HTTP/1.1" status: 204 len: 168 time: 1.1236446 Nov 05 14:49:45.999605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43686) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:46.021763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacb39f2-42cf-4408-bcc0-58245c2ea639 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=b2527de8-ac81-4260-9913-f74a88c7062b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:46.056257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Attempting to bind port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:46.056781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Attempting to bind port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '5b5f0566-9a1e-48e9-bdad-974d03d242cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:46.057288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Attempting to bind port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc on network d420ae72-e4fa-429b-b3f8-f1864c828421 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:46.065582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:46.066064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Checking segment: {'id': '5b5f0566-9a1e-48e9-bdad-974d03d242cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:46.066561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.067049 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Bound using segment: {'id': '5b5f0566-9a1e-48e9-bdad-974d03d242cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:46.067647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Bound port: 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5b5f0566-9a1e-48e9-bdad-974d03d242cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': 'd420ae72-e4fa-429b-b3f8-f1864c828421'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:46.068113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.087758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.094967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:46.098542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.137504 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-db0fd126-53f9-45f5-b44e-83cb12b564e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1355135 Nov 05 14:49:46.143184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:49:46.153764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:46.154214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.160977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Network bde16d5a-a42f-4260-868f-719b54772c0d is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:46.161607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43688) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:46.162206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:46.162458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=103b7b23-87e2-4998-9e10-22256d9c4279,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:46.165451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:46.166019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.183239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:46.194560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:46.243332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] For port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:46.243914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Port': ['ID=39df88ee-4a23-48fe-8cb5-67e92dbf2723,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:46.251079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] For port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,segment=NetworkSegment(5b5f0566-9a1e-48e9-bdad-974d03d242cb),segment_id=5b5f0566-9a1e-48e9-bdad-974d03d242cb)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:46.255965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.258182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-50fa7d64-ae4a-4f6e-be5f-035f7043aa6e None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:46.258838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50fa7d64-ae4a-4f6e-be5f-035f7043aa6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.260726 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c37f0955-7e4f-4b4b-8eee-ee3e69556d5e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.7766678 Nov 05 14:49:46.261796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43690) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:46.262091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.273986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'security_group': {'name': 'tempest-secgroup-1114872507'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:46.292699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277d04c3-ca2e-496c-994c-4f39562fa7d3 req-6eecc6ab-2b0f-4379-b2f9-15dfb15464bf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:46.294388 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-277d04c3-ca2e-496c-994c-4f39562fa7d3 req-6eecc6ab-2b0f-4379-b2f9-15dfb15464bf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 945 time: 0.2471328 Nov 05 14:49:46.379220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.api [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 05 14:49:46.379220 dv-neutron-816850-1-hyperv neutron-server[113580]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 05 14:49:46.379220 dv-neutron-816850-1-hyperv neutron-server[113580]: [parameters: {'project_id_1': '6c1eac42b2854d16bc0940ee811229be', 'expiration_1': datetime.datetime(2021, 11, 5, 14, 49, 26, 335625)}] Nov 05 14:49:46.379220 dv-neutron-816850-1-hyperv neutron-server[113580]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=113580) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:49:46.379825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG oslo_db.api [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:49:46.407682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Router affa76f7-e71b-4e66-bc82-992ceed4fa91 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:46.418489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.479762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Allocated IP 172.26.5.31 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d8f2c382-f196-4d31-b853-cc682164e60d) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:46.501232 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-277d04c3-ca2e-496c-994c-4f39562fa7d3 req-840a8369-e32e-415e-b7b4-1a673cf7d81b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1529200 Nov 05 14:49:46.507130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.523383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f649be-a180-4e2e-8c85-eb84cc11f4d2 None None] Pushing event updated for resources: {'Port': ['ID=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:46.559684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:46.565994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61e4036a-08d4-4ad9-b9e2-abec43139062 admin admin] 10.222.0.30 "PUT /v2.0/routers/affa76f7-e71b-4e66-bc82-992ceed4fa91/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9529703 Nov 05 14:49:46.576284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-50fa7d64-ae4a-4f6e-be5f-035f7043aa6e None None] Port 1e2801d3-ca3e-4985-a965-861f5c8326b0 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:46.594861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Sync routers for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:46.624136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:46.624816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:46.627500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-50fa7d64-ae4a-4f6e-be5f-035f7043aa6e None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:46.627879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50fa7d64-ae4a-4f6e-be5f-035f7043aa6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.629575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.742328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:49:46.744994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e330292d-f2b2-4394-a1e9-bd7edee8e21b" -d '{"events": [{"server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "name": "network-vif-plugged", "status": "completed", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:49:46.782804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.827442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:46.840754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.873152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.878743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.896267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:46.902225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:49:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0b25cd4-4f1e-480c-b239-4844ec0f2f9b x-openstack-request-id: req-d0b25cd4-4f1e-480c-b239-4844ec0f2f9b {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:49:46.904570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "name": "network-vif-plugged", "status": "completed", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:49:46.904940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d0b25cd4-4f1e-480c-b239-4844ec0f2f9b {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:49:46.905619 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'code': 200} Nov 05 14:49:46.919934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:46.925020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.008088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.009579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7420957 Nov 05 14:49:47.021179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43700) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:47.023259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:47.025036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:47.029953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'security_group': {'name': 'tempest-secgroup-2048989989'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:47.075605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:47.136188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.157714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:47.216321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:47.216481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event updated for resources: {'Port': ['ID=d8f2c382-f196-4d31-b853-cc682164e60d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.221666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4467e864-54c4-4777-baa0-efff4b96a2a5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=010c3d56-8265-478d-8269-a7d541a68fff,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.262359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.293705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.329490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b263e29c-863c-456a-a593-368c5fb6498e req-0aad7182-a36d-4267-a384-193718d3ad56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:47.337039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b263e29c-863c-456a-a593-368c5fb6498e req-0aad7182-a36d-4267-a384-193718d3ad56 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1099 time: 0.2798853 Nov 05 14:49:47.356795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:47.365478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:47.376450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:47.377571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.382925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=f0bcc517-0f46-4740-80b0-e4593bc6bd5e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.401825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:47.402288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.407889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3f18dc19-3822-4fc0-8061-11403f09e664 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2310658 Nov 05 14:49:47.410443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43702) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:47.427399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:47.459923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:47.460293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.567511 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b263e29c-863c-456a-a593-368c5fb6498e req-e026060f-657d-4d4f-9d4d-87488ff5ce78 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1855769 Nov 05 14:49:47.615547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.633663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.634502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.639638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.642241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:47.647897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.690126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.738657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ccff528b-978f-48e4-90c9-2865c3ce1505,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.738876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:47.758432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-343465885', 'description': 'tempest-secgroup-smoke-343465885 description', 'project_id': '747df015bfd341929de773100c6c68ae'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:47.759770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:44Z', 'revision_number': 4, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1e2801d3-ca3e-4985-a965-861f5c8326b0', 'name': '', 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'mac_address': 'fa:16:3e:3b:b9:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_interface', 'standard_attr_id': 1008, 'fixed_ips': [{'subnet_id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:42Z', 'updated_at': '2021-11-05T14:49:44Z', 'revision_number': 2, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'subnets': [{'id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:47.809108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Checking router: affa76f7-e71b-4e66-bc82-992ceed4fa91 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:47.809702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Updating router affa76f7-e71b-4e66-bc82-992ceed4fa91 port 1e2801d3-ca3e-4985-a965-861f5c8326b0 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:49:47.844024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.862357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.863119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event updated for resources: {'Port': ['ID=39df88ee-4a23-48fe-8cb5-67e92dbf2723,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:47.887207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:47.887731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.894331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822b254d-2318-4e00-aed8-f1b3a7781827 req-6cc63efa-fd06-4b50-ad43-ebcff6a5d327 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:47.895833 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-822b254d-2318-4e00-aed8-f1b3a7781827 req-6cc63efa-fd06-4b50-ad43-ebcff6a5d327 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.1999998 Nov 05 14:49:47.938810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.963494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:47.967788 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-39ae9d31-4c92-4784-9cd7-e48b82722cc1 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.9382679 Nov 05 14:49:47.980021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,segment=NetworkSegment(5b5f0566-9a1e-48e9-bdad-974d03d242cb),segment_id=5b5f0566-9a1e-48e9-bdad-974d03d242cb)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:47.980392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43708) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:47.986162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-506452575', 'security_groups': ['ccff528b-978f-48e4-90c9-2865c3ce1505'], 'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'f0b92e1b-4795-4ee8-b00e-ea7af9f69e22'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:47.987591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:47.993490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.059946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cd8debc-acfe-48d9-abf4-d6920c6bacb9 None None] Network d420ae72-e4fa-429b-b3f8-f1864c828421 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:48.062195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7894d925-7bfe-4a09-bc32-d90d2c3820e3 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:48.065268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-661db7c0-145f-4e70-9cdf-6374fd07b0c8 None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:48.126579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:48.131430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.139591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.149390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:48.217211 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-822b254d-2318-4e00-aed8-f1b3a7781827 req-f300e335-f061-4d48-a6d7-995ac070d5c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2835457 Nov 05 14:49:48.263065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.307211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:49:48.313371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:48.313914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8e11a05-40ab-4971-aae2-57ee139e88ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.352532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.380041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroup': ['ID=04822744-30be-4b89-a4f8-6ca1fd516d0f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:48.397677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.401729 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-22a229ce-b613-4d88-ba0f-fbdacc4ada40 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.6586127 Nov 05 14:49:48.458762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43710) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:48.471053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-661db7c0-145f-4e70-9cdf-6374fd07b0c8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:48.608677 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:48.621388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:48.681605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4cd8debc-acfe-48d9-abf4-d6920c6bacb9 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:48.683636 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7894d925-7bfe-4a09-bc32-d90d2c3820e3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:48.757010 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:48.799451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:48.815528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4930c673-1e95-4dd6-96a2-c4ea00455c12 None None] Network d420ae72-e4fa-429b-b3f8-f1864c828421 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:48.835609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.908165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.921493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.969234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e69480ab-e53e-4330-b448-841e707610ea,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:48.979809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Router 7538d7ea-0474-4aa1-9cce-b31ff268f948 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:48.985602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:48.986938 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2c8b88f4-20b8-4c41-8c2d-f88388848c96 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5274448 Nov 05 14:49:49.015066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.020010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:49.044571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.063899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a137bff-71dd-40a9-8fa3-273949a10054 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:49.113687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.121484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:49.142545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:49.169270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] device_id is not set on port 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:49.176080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.200608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.208974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.209980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.224278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.229796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.245150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.257647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.265460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:49.278699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.279370 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] Sync routers for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:49.282561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-38ea0a1b-3d79-4c17-a1c6-737ce373d95d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2359831 Nov 05 14:49:49.286524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4930c673-1e95-4dd6-96a2-c4ea00455c12 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:49.294286 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:49.298545 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:49.299168 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:49.311511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:49.326869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:49.331277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.332587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3165035 Nov 05 14:49:49.346479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:49.346981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7a137bff-71dd-40a9-8fa3-273949a10054 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:49.356157 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:49.361027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43718) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.364055 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:49.374954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:49.386974 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:49.393023 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:49.398061 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.9832058 Nov 05 14:49:49.400667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e1a0dcd-03c1-4620-a7d6-e5b30848846e None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:49.401205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddb40056-5850-4770-bbba-1979dad5f0fc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1025b835-7405-4c67-8166-ac38dc0973c5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:49.403525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=941f7d6a-d3dd-4bba-b208-d876558a0668,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:49.406155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43720) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.414432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:02:25:58', 'name': 'tempest-NetworksTestDHCPv6-197608762'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:49.431922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d438800f-3ed9-4291-8ef3-c208b4769537 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=16']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:49.455940 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:49.456879 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c41c6d7-d911-429c-9c9c-8f5eef4ba8a7 None None] The sync data for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:49.472694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dc0789-37bb-4199-9ec5-9ec61a386bcd None None] Pushing event updated for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0e1a0dcd-03c1-4620-a7d6-e5b30848846e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:49.539240 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:49.571318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:49.572102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.579599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d2b91f-88cf-4659-b1b5-dd2fc9c47f5f req-544b9c07-a935-4230-868a-c62df042b852 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:49.581395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27d2b91f-88cf-4659-b1b5-dd2fc9c47f5f req-544b9c07-a935-4230-868a-c62df042b852 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.1611288 Nov 05 14:49:49.598966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.612710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ab96578a-dff6-41aa-ab12-f1e3f8827610 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.630674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b541aa34-038d-4406-a55a-e68c66186793 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:49.670748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:49.671124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.679614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Attempting to bind port 1e2801d3-ca3e-4985-a965-861f5c8326b0 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:49:49.679939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Attempting to bind port 1e2801d3-ca3e-4985-a965-861f5c8326b0 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:49:49.680323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Attempting to bind port 1e2801d3-ca3e-4985-a965-861f5c8326b0 on network bde16d5a-a42f-4260-868f-719b54772c0d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:49:49.704445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:49:49.704843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Checking segment: {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:49:49.705894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.706302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Bound using segment: {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:49:49.706798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Bound port: 1e2801d3-ca3e-4985-a965-861f5c8326b0, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba199014-4316-4a72-be9f-2e9a347a8e16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:49:49.707182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.708632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27d2b91f-88cf-4659-b1b5-dd2fc9c47f5f req-01b559a9-69a4-41df-aa6f-827629844b94 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1173928 Nov 05 14:49:49.716373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.732521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.748430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f2efdb2-d235-4593-9eab-b5f9dc330f2a,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:49.750271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:49.773652 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-ab96578a-dff6-41aa-ab12-f1e3f8827610 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 05 14:49:49.778025 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ab96578a-dff6-41aa-ab12-f1e3f8827610 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948 HTTP/1.1" status: 409 len: 329 time: 0.4863589 Nov 05 14:49:49.779249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43724) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.821950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.825654 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bab3fa2d-20bb-407e-ae88-7cafb24f7094 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4526761 Nov 05 14:49:49.827945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:49.833011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:49.866058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Port 1e2801d3-ca3e-4985-a965-861f5c8326b0 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:49.891608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.894616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.900557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8::192 (a79abec6-87fd-477e-a6d8-3655432a4a0a/f0b92e1b-4795-4ee8-b00e-ea7af9f69e22/52c4a31f-eb34-4bdb-a82f-de4c4df182e6) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:49.902550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Router 859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:49:49.926676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port ecf5d3b7-3aa8-4686-a10e-bc542ba803cd yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:49.955207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 7597b659-dde2-40d5-944e-6c7302e11125 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:49.955875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:49.983509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] For port 1e2801d3-ca3e-4985-a965-861f5c8326b0, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:49:49.998927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b541aa34-038d-4406-a55a-e68c66186793 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:50.006636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] For port 1e2801d3-ca3e-4985-a965-861f5c8326b0, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1e2801d3-ca3e-4985-a965-861f5c8326b0,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:49:50.016921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.103640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70964af5-cffc-4fbc-a375-d5e46bcba84c req-a1392185-17d5-493b-ac8a-44c46fbbdf9e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:50.105079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-70964af5-cffc-4fbc-a375-d5e46bcba84c req-a1392185-17d5-493b-ac8a-44c46fbbdf9e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.2483842 Nov 05 14:49:50.120840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.127344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c353326-d41d-4ae5-9c16-5bbbf60cb0ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.142538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 172.20.0.13 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/f0bcc517-0f46-4740-80b0-e4593bc6bd5e/ecf5d3b7-3aa8-4686-a10e-bc542ba803cd) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:50.147397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.154221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fe02:2558 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/941f7d6a-d3dd-4bba-b208-d876558a0668/ecf5d3b7-3aa8-4686-a10e-bc542ba803cd) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:50.174231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:50.175121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:50.179304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=27fe01e9-f62a-4087-aa44-362423740e03,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:50.192886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.194104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f2be1150-4f3d-4b89-80f2-ec6cc5790b39 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3645318 Nov 05 14:49:50.201544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.204922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dc0789-37bb-4199-9ec5-9ec61a386bcd None None] Pushing event updated for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:50.209881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:50.265773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Project 747df015bfd341929de773100c6c68ae added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:49:50.315177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.350998 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-70964af5-cffc-4fbc-a375-d5e46bcba84c req-f46a1a22-a19b-471a-85d4-aba8b252a1e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1890111 Nov 05 14:49:50.351974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:50.359823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.361137 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2b3f7a14-21ef-40dd-84a4-0bca52113946 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "PUT /v2.0/routers/859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 200 len: 882 time: 5.9699750 Nov 05 14:49:50.374221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] Sync routers for ids ['859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:50.386147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43730) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.386485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43732) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.396733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:50.397371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.428069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.441159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.451121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] Routers {'859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:50.451983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:50.464194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:50.474271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.478120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15aa70cf-1b84-4c4b-9d9e-c49a993802cd,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:50.493274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.495512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-328fc369-acb4-4822-96db-2b1779710a8a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2929964 Nov 05 14:49:50.506111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.514730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'security_group_rule': {'security_group_id': '04822744-30be-4b89-a4f8-6ca1fd516d0f', 'project_id': '747df015bfd341929de773100c6c68ae', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:50.548872 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Project 747df015bfd341929de773100c6c68ae added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:49:50.557176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.615658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.679607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.692774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:50.696953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.705675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:50.720443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:50.764981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:50.839581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:50.855092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] Routers {'859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:50.855734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:50.920166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f761bd7-1f13-437e-bda7-80af0e64726d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:50.925058 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2f761bd7-1f13-437e-bda7-80af0e64726d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1094 time: 0.5289047 Nov 05 14:49:50.931774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43736) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.941239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.11'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:50.975919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a4e9bed3-1355-4647-98cd-b450808cfaf5 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 200 len: 923 time: 0.5883095 Nov 05 14:49:50.980719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43738) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:50.995043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:50.996012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b7056f-53f5-4c8b-833e-e2b428c53c25 None None] The sync data for ids ['859ffa6f-2089-46b3-b6d5-ae6f0e3efce0'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:51.108380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.115379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=ecf5d3b7-3aa8-4686-a10e-bc542ba803cd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:51.123329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.124344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.133193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.134523 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6253564 Nov 05 14:49:51.138606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d94197-d707-4eea-b3de-f4dbfbd82269 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=111695b9-adcd-45fc-b070-399de702148f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:51.146061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:51.146484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.165207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:51.179146 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f4eb9db7-29ff-42ff-b58c-a8c7315c0bb0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 1.7688377 Nov 05 14:49:51.181653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43744) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:51.229958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.310145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1da638-2fcd-436a-90ab-84c5e7fbbd42 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.334025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1da638-2fcd-436a-90ab-84c5e7fbbd42 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.334486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=52c4a31f-eb34-4bdb-a82f-de4c4df182e6,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:51.337080 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fd1da638-2fcd-436a-90ab-84c5e7fbbd42 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1785 time: 0.1543908 Nov 05 14:49:51.341123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43766) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:51.422688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:51.437921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b16f47-b5b4-4550-a998-1cb9f26c052a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.442612 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4b16f47-b5b4-4550-a998-1cb9f26c052a tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=859ffa6f-2089-46b3-b6d5-ae6f0e3efce0&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.4595125 Nov 05 14:49:51.443612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43776) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:51.446243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:51.517908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:51.529232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.530430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.568144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port ecf5d3b7-3aa8-4686-a10e-bc542ba803cd {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:51.568516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.576310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:44Z', 'revision_number': 4, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1e2801d3-ca3e-4985-a965-861f5c8326b0', 'name': '', 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'mac_address': 'fa:16:3e:3b:b9:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_interface', 'standard_attr_id': 1008, 'fixed_ips': [{'subnet_id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:42Z', 'updated_at': '2021-11-05T14:49:49Z', 'revision_number': 4, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'subnets': [{'id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:51.602593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.610547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-039f15ac-b762-421b-b054-6e82c60ce9b1 None None] The sync data for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv is: [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:49:44Z', 'revision_number': 4, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1e2801d3-ca3e-4985-a965-861f5c8326b0', 'name': '', 'network_id': 'bde16d5a-a42f-4260-868f-719b54772c0d', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'mac_address': 'fa:16:3e:3b:b9:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_interface', 'standard_attr_id': 1008, 'fixed_ips': [{'subnet_id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:42Z', 'updated_at': '2021-11-05T14:49:49Z', 'revision_number': 4, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'subnets': [{'id': '2e71e7a1-f932-4523-a8ac-7f5facc8c11b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:51.645063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Update dhcp port {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'fixed_ips': [{'subnet_id': '2bd90bc7-9513-48fa-8b2f-64e5612245e5', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'f0b92e1b-4795-4ee8-b00e-ea7af9f69e22'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '2be4439b-204a-411e-8526-cf2a0f1f66b0'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:49:51.736578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.742434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:51.742813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.806481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:51.827549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for ecf5d3b7-3aa8-4686-a10e-bc542ba803cd owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:51.836289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4b43b5c-a29c-46da-ba58-6f3f7b929c10 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.8515151 Nov 05 14:49:51.836824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43792) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:51.843716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:51.958929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6954f506-0557-4151-81ca-a57d7168fce7 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:51.960598 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6954f506-0557-4151-81ca-a57d7168fce7 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.5118244 Nov 05 14:49:51.973537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43794) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:51.999408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 39df88ee-4a23-48fe-8cb5-67e92dbf2723 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:51.999838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.035145 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-03d3337f-c13d-4e2d-a60c-ff3e2acdf15c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 200 len: 205 time: 0.0592620 Nov 05 14:49:52.039026 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-e8302968-fd2a-4cac-a74c-fa65bdda545f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.4769356 Nov 05 14:49:52.040935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43796) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:52.091304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Allocated IP 2001:db8::2 (a79abec6-87fd-477e-a6d8-3655432a4a0a/f0b92e1b-4795-4ee8-b00e-ea7af9f69e22/2be4439b-204a-411e-8526-cf2a0f1f66b0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:52.117065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Port 39df88ee-4a23-48fe-8cb5-67e92dbf2723 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:52.302551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:52.370184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.374663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:52.375048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.394235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.401647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:52.407743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.434234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.451936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.532643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.547087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=ecf5d3b7-3aa8-4686-a10e-bc542ba803cd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:52.548331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-46191ce7-6990-480f-904d-52dd265a43ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.646952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:52.651279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac826e5-9759-4d9f-a92e-b8b025ced2a7 None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:52.669395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.675232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b0bf716-a111-45c2-aa8c-4269042ef647 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ecf5d3b7-3aa8-4686-a10e-bc542ba803cd HTTP/1.1" status: 204 len: 168 time: 1.3300109 Nov 05 14:49:52.676382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43808) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:52.690724 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet f0b92e1b-4795-4ee8-b00e-ea7af9f69e22 (CIDR: 2001:db8::/64) Nov 05 14:49:52.700168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:52.700563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-382915a1-314a-4eaa-a667-880886b459ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.703946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-eea8526c-16a9-4c03-bd84-1fc4a1f5dbd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:52.705529 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-eea8526c-16a9-4c03-bd84-1fc4a1f5dbd4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1099 time: 0.5220068 Nov 05 14:49:52.780629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-516c5aaa-6606-4a09-aaa8-6850dd66f296 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:52.784712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-516c5aaa-6606-4a09-aaa8-6850dd66f296 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:52.786644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-516c5aaa-6606-4a09-aaa8-6850dd66f296 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:52.795234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-516c5aaa-6606-4a09-aaa8-6850dd66f296 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1154733 Nov 05 14:49:52.795234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:49:52.795234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:52.801430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:52.888550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 941f7d6a-d3dd-4bba-b208-d876558a0668 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:52.895565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.207 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/924d6d1c-9bec-4e3a-9921-566a5e7cfc8a) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:52.900155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-93004974-5854-4bdb-9bd7-1b9f0ced8c8a tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0620053 Nov 05 14:49:52.900897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43814) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:52.901720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:52.910028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:52.956539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:52.956927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.021139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.054328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.178103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.266438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] For port 1e2801d3-ca3e-4985-a965-861f5c8326b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1e2801d3-ca3e-4985-a965-861f5c8326b0,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:53.273025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.282203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:53.297273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.309522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:53.315869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.378977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.387831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-f9d9989a-ac49-4010-914f-ec34d2991d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:53.389487 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-f9d9989a-ac49-4010-914f-ec34d2991d20 service neutron] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 898 time: 0.6584177 Nov 05 14:49:53.411306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.412874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d293c7dd-69b8-4e51-997c-ea347ea8ff51 None None] Pushing event updated for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:53.453955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:53.454339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.601474 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-3cb923d4-d231-49af-836a-a4dcfa357a6a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 217 time: 0.1591430 Nov 05 14:49:53.638325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.663539 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet 2bd90bc7-9513-48fa-8b2f-64e5612245e5 (CIDR: 2001:db8:0:1::/64) Nov 05 14:49:53.664906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1e2801d3-ca3e-4985-a965-861f5c8326b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:53.700792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.714024 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:49:53.714831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:49:53.718623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=941f7d6a-d3dd-4bba-b208-d876558a0668,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:53.728007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.737015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8dd1b334-543c-447e-897c-7f025270c531 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/941f7d6a-d3dd-4bba-b208-d876558a0668 HTTP/1.1" status: 204 len: 168 time: 0.9342482 Nov 05 14:49:53.739056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43848) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:53.739468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port d8f2c382-f196-4d31-b853-cc682164e60d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:53.739815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.752213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-116840c3-dcc0-4f93-a333-45f2437833ef None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:53.774548 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-504c6dbc-43c2-49a0-bf2c-77e29fe2cf99 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.8690245 Nov 05 14:49:53.778707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43850) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:53.782033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'subnet': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:53.789578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-0ef5eda2-2580-4518-b0c3-4c04f6acbf50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:53.791158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-0ef5eda2-2580-4518-b0c3-4c04f6acbf50 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.1818225 Nov 05 14:49:53.853267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting port 39df88ee-4a23-48fe-8cb5-67e92dbf2723 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:53.853590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.860490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet f0bcc517-0f46-4740-80b0-e4593bc6bd5e {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:53.864441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.897001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:53.932498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:53.955883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:53.970777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:53.989965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=924d6d1c-9bec-4e3a-9921-566a5e7cfc8a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:54.003699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Made reservation on behalf of 4ff2ceda9c9e4667b7921b128d51fb22 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:54.007422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-116840c3-dcc0-4f93-a333-45f2437833ef None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:54.007841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.011615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.082263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.120061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-d18fd424-5bc1-4c6c-b4dc-a60a41a0c8ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:54.121779 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-d18fd424-5bc1-4c6c-b4dc-a60a41a0c8ca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2902102 Nov 05 14:49:54.133478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for d8f2c382-f196-4d31-b853-cc682164e60d owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:54.148797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.178140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.192300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=f0bcc517-0f46-4740-80b0-e4593bc6bd5e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:54.194893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.202007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4babf7f-c98f-46e9-b5a6-641bb7d0a6df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/f0bcc517-0f46-4740-80b0-e4593bc6bd5e HTTP/1.1" status: 204 len: 168 time: 0.4590766 Nov 05 14:49:54.205558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43852) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:54.274028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-256fd733-9090-4406-84eb-cbbfcf30c106 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0643284 Nov 05 14:49:54.275238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43854) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:54.282120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:54.286675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-038a04a3-b9c8-4b2e-96b1-06f14271367e None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:54.287193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-038a04a3-b9c8-4b2e-96b1-06f14271367e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.323122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:54.323757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.451144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:54.456685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.584875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Calling delete_port for 39df88ee-4a23-48fe-8cb5-67e92dbf2723 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:54.666201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-038a04a3-b9c8-4b2e-96b1-06f14271367e None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:54.666870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-038a04a3-b9c8-4b2e-96b1-06f14271367e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.743623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.776354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-038a04a3-b9c8-4b2e-96b1-06f14271367e None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:54.831818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Network a79abec6-87fd-477e-a6d8-3655432a4a0a is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:54.843364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:54.845584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.911830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:54.912432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.917125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Subnet': ['ID=2baa3ad4-1b5c-443e-8528-5218e9715bd5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:54.922777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:54.960032 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-6619b07b-54e6-4bc0-8a89-468882c3d7c9 service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8241363 Nov 05 14:49:54.981433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-70e7177a-ad00-4c95-b739-309d0622b81d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.2032375 Nov 05 14:49:54.986836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43858) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:54.991494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:54.996405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:55.001738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:55.002339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.012874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=af42dfc8-6354-41fc-914a-f56f008b1cfa,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:55.031745 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-980b3177-280d-4f3d-95d3-de3e0e2d01f3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7553661 Nov 05 14:49:55.032380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43860) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:55.035738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-44449099', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '2baa3ad4-1b5c-443e-8528-5218e9715bd5'}], 'security_groups': ['103b7b23-87e2-4998-9e10-22256d9c4279', '010c3d56-8265-478d-8269-a7d541a68fff']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:55.037602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:55.132445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1e2801d3-ca3e-4985-a965-861f5c8326b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:55.224842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:55.225129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.280467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:55.286987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.549715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f39ba346-666c-4c48-bc53-955d00cb6d47 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:55.551223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f39ba346-666c-4c48-bc53-955d00cb6d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.623094 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bab0a204-aa5c-4add-b883-3a1979cb62d7 req-c6cc6d48-b7cc-4e27-8484-3871de4464a0 service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6543512 Nov 05 14:49:55.623687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.772883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=d8f2c382-f196-4d31-b853-cc682164e60d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:55.816765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f39ba346-666c-4c48-bc53-955d00cb6d47 None None] Provisioning complete for port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:55.817406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f39ba346-666c-4c48-bc53-955d00cb6d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.945786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:49:55.947159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:55.989427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.008122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c842006c-e2d0-4ef3-af1f-1ac26d47c454 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:56.029860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.031876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.068804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d902e7e-4abf-45bb-aac5-799d393fc313 None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:49:56.144480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Port': ['ID=39df88ee-4a23-48fe-8cb5-67e92dbf2723,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c842006c-e2d0-4ef3-af1f-1ac26d47c454 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:56.166285 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9d902e7e-4abf-45bb-aac5-799d393fc313 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:49:56.203645 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:49:56.250797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.267404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.277342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Provisioning complete for port 1e2801d3-ca3e-4985-a965-861f5c8326b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:56.277342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.431131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Could not find standard attr ID for object ecf5d3b7-3aa8-4686-a10e-bc542ba803cd. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:49:56.446868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Provisioning complete for port 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:56.447510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.523471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7986286f-1693-4b7a-8d7c-ce38032542ee None None] Port 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:49:56.567331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e008b9e-ea17-434a-bb0b-2d047739f546 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:56.595394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:56.636334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.650209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.650209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.739911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e008b9e-ea17-434a-bb0b-2d047739f546 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:49:56.741986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:56.750245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:56.757970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:56.759501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:56.771844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=4c86fd28-8a5c-44a7-9a11-d2133f9aaf67,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:56.795336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=19']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:56.807583 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b6b71450-cd00-48fb-aad4-b9c1592513dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7740741 Nov 05 14:49:56.808348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43864) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:56.814026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:31:d3:b3', 'name': 'tempest-NetworksTestDHCPv6-2055860275'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:56.993053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:49:56.998571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.027527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.053053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.059671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.136792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.168202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 99b59178-afee-446e-bc07-89108b770bdf yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:49:57.186850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:57.200484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.201127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router 859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:49:57.238205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.243359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eb174773-362f-432c-ad10-fe06ff58d187 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 204 len: 168 time: 5.1847007 Nov 05 14:49:57.248263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43868) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:57.256100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-969340594', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:57.327551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:57.327925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.391489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 172.20.0.2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/af42dfc8-6354-41fc-914a-f56f008b1cfa/99b59178-afee-446e-bc07-89108b770bdf) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:57.399147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fe31:d3b3 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/4c86fd28-8a5c-44a7-9a11-d2133f9aaf67/99b59178-afee-446e-bc07-89108b770bdf) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:57.431860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '4c86fd28-8a5c-44a7-9a11-d2133f9aaf67', 'ip_address': '2001:db8::f816:3eff:fe72:4018'}, {'subnet_id': 'af42dfc8-6354-41fc-914a-f56f008b1cfa'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '812cb9a1-7299-4389-992c-e158c9ab11b8'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:49:57.460842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.461986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.497450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.531113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Router 7538d7ea-0474-4aa1-9cce-b31ff268f948 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:57.621166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.621810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.648218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.655249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Delete allocated IP 2001:db8::192 (a79abec6-87fd-477e-a6d8-3655432a4a0a/f0b92e1b-4795-4ee8-b00e-ea7af9f69e22) {{(pid=113581) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:49:57.668852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.696449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.722419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:49:57.727839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:49:57.731625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:49:57.734856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-ee0eda60-cbf1-4f2d-a087-b70262546560 {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:49:57.735683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:49:57.738052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.742135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Allocated IP 2001:db8:0:2::1e9 (a79abec6-87fd-477e-a6d8-3655432a4a0a/2baa3ad4-1b5c-443e-8528-5218e9715bd5/52c4a31f-eb34-4bdb-a82f-de4c4df182e6) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:57.760221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:57.764044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:57.765352 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d71ba611-50c4-4677-97b6-a57ad9de0035 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.5129509 Nov 05 14:49:57.770973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43870) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:57.771946 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] Sync routers for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:57.777224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-412e2c1e-a789-4080-9e8c-824105ebf4d5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9950063 Nov 05 14:49:57.783645 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:57.784975 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:57.787520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': True}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:57.791454 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43872) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:57.823591 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:57.833729 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] Routers {'7538d7ea-0474-4aa1-9cce-b31ff268f948'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:57.834583 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['7538d7ea-0474-4aa1-9cce-b31ff268f948'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:57.875718 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:57.876658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-809a099a-f9f2-4a99-bbb7-1c84c465fd50 None None] The sync data for ids ['7538d7ea-0474-4aa1-9cce-b31ff268f948'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:49:57.876798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=99b59178-afee-446e-bc07-89108b770bdf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:57.990166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=924d6d1c-9bec-4e3a-9921-566a5e7cfc8a,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:58.066145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.166853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.176599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.217593 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-a8fe0ba2-5e36-4d7e-b852-b3ad1bb6caa2 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] show failed (client error): The resource could not be found. Nov 05 14:49:58.220948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8fe0ba2-5e36-4d7e-b852-b3ad1bb6caa2 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "GET /v2.0/routers/tempest-non_exist_router-560345449 HTTP/1.1" status: 404 len: 334 time: 0.4260886 Nov 05 14:49:58.225751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43876) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:58.234844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-62de08e4-99fb-4272-bed9-6a5da58460d3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Request body: {'router': {'name': 'new_name'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:49:58.238123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:58.239289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.291246 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP fbb19145-d30f-4e98-b332-420947e691a0 associated. External IP: 172.26.5.207, port: 4f1ce27a-19c7-41ae-8be6-8a86912c76bc. Nov 05 14:49:58.296768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.299531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] In _notify_port_updated(), no bound segment for port 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 on network a79abec6-87fd-477e-a6d8-3655432a4a0a {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:49:58.305224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:58.305885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.307208 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "PUT /v2.0/ports/52c4a31f-eb34-4bdb-a82f-de4c4df182e6 HTTP/1.1" status: 200 len: 968 time: 3.2782431 Nov 05 14:49:58.335425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43878) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:58.347019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-62de08e4-99fb-4272-bed9-6a5da58460d3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] update failed (client error): The resource could not be found. Nov 05 14:49:58.352646 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-62de08e4-99fb-4272-bed9-6a5da58460d3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "PUT /v2.0/routers/tempest-non_exist_router-501774580 HTTP/1.1" status: 404 len: 334 time: 0.1200709 Nov 05 14:49:58.352845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0fb61082-baf5-44e3-9f37-fdcd9c4d9023 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 1.5390487 Nov 05 14:49:58.352845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43880) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:58.353036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43882) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:58.357577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2b21c9e-9a45-433a-94f0-100b169f9549 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event updated for resources: {'Port': ['ID=52c4a31f-eb34-4bdb-a82f-de4c4df182e6,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:58.544732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Allocated IP 172.20.0.3 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/af42dfc8-6354-41fc-914a-f56f008b1cfa/812cb9a1-7299-4389-992c-e158c9ab11b8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:49:58.580437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.593107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting subnet 485c56d2-f225-45e1-86b5-bf585611fecc {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:49:58.603785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.637015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:49:58.683399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73953f59-ea78-42d9-9e8c-ed6065b9b463 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:58.689466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73953f59-ea78-42d9-9e8c-ed6065b9b463 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:58.694029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-73953f59-ea78-42d9-9e8c-ed6065b9b463 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1785 time: 0.3398981 Nov 05 14:49:58.695827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43884) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:58.720684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:49:58.744267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.758010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.764585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.812882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:58.812882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.824860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:49:58.862089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:49:58.865722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:58.874488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ca91032-8263-4847-ac50-91a8f0ac13f4 None None] Pushing event updated for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=20']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:58.882242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:58.882871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:58.920076 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3edc1593-44e3-4b9f-b55a-151c926e5880 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 7.9849737 Nov 05 14:49:58.920710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:49:58.927206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a58bc13-24b5-4723-9626-f58a1289fc21" -d '{"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:49:58.930451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43886) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:59.069080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:59.082172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.133422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:49:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f4d477d-59a5-4f84-ab1f-6638eb947c02 x-openstack-request-id: req-0f4d477d-59a5-4f84-ab1f-6638eb947c02 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:49:59.133422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:49:59.133422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0f4d477d-59a5-4f84-ab1f-6638eb947c02 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:49:59.133422 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'status': 'completed', 'code': 200} Nov 05 14:49:59.146297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.182140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 52c4a31f-eb34-4bdb-a82f-de4c4df182e6 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:59.194498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 99b59178-afee-446e-bc07-89108b770bdf {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:49:59.194814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.213848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:49:59.266873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8bc84108-8dd2-4a9b-b361-937a5b0814d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/fbb19145-d30f-4e98-b332-420947e691a0 HTTP/1.1" status: 200 len: 992 time: 0.3346088 Nov 05 14:49:59.286847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-bd09ca18-66a4-4326-8c91-d5ef99f231c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:59.288690 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-bd09ca18-66a4-4326-8c91-d5ef99f231c5 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1099 time: 0.1780696 Nov 05 14:49:59.405735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:49:59.405735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.445798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-88b06682-8dd9-4c5f-ad28-9f2a0e0f1887 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:59.446629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.449335 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-88b06682-8dd9-4c5f-ad28-9f2a0e0f1887 service neutron] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 898 time: 0.1515300 Nov 05 14:49:59.525323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Subnet': ['ID=485c56d2-f225-45e1-86b5-bf585611fecc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:49:59.539434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.542748 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c979d314-e89f-487b-8b1f-c7dc8682b9a3 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/subnets/485c56d2-f225-45e1-86b5-bf585611fecc HTTP/1.1" status: 204 len: 168 time: 1.1876798 Nov 05 14:49:59.545318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43892) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:49:59.559613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.594293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:49:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:59.617334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.619384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 99b59178-afee-446e-bc07-89108b770bdf owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:49:59.627479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:49:59.643045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:49:59.643685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:49:59.659215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.695675 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-6f6d1b54-9666-40ee-a035-a24d5bc54088 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 1000 time: 0.2381198 Nov 05 14:49:59.756668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.772578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:49:59.782708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-df649a3c-1327-495e-9bfa-a50b3a98cef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:59.785114 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-df649a3c-1327-495e-9bfa-a50b3a98cef3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.0778482 Nov 05 14:49:59.856011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:49:59.860932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-ca9fa707-db0b-4fe6-8eed-662bc8ba3473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:49:59.862486 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-ca9fa707-db0b-4fe6-8eed-662bc8ba3473 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0685110 Nov 05 14:49:59.938894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce2d7e04-6f57-4b3b-8617-701b9922f8cc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:49:59.941294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=52c4a31f-eb34-4bdb-a82f-de4c4df182e6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:00.001946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.005216 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-68fcac6e-1ef5-4ce0-8cbe-bd52f919ab4e tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/52c4a31f-eb34-4bdb-a82f-de4c4df182e6 HTTP/1.1" status: 204 len: 168 time: 1.6687794 Nov 05 14:50:00.008012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43894) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:00.037020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 172.26.5.254 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/75bc6788-4262-4744-a107-f5c171ddb57c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:00.055244 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-9a7e2a10-7f34-4739-b523-aa1cda999e30 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] GET failed (client error): The resource could not be found. Nov 05 14:50:00.057389 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9a7e2a10-7f34-4739-b523-aa1cda999e30 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports/52c4a31f-eb34-4bdb-a82f-de4c4df182e6 HTTP/1.1" status: 404 len: 333 time: 0.0469141 Nov 05 14:50:00.059622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de55c8ae-8e59-4cea-be8e-f583f7a86ea8 None None] Provisioning complete for port 812cb9a1-7299-4389-992c-e158c9ab11b8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:00.060006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de55c8ae-8e59-4cea-be8e-f583f7a86ea8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.061381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43896) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:00.097441 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-fc4b3530-0b0c-452a-912f-87436102065b service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2268741 Nov 05 14:50:00.168882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:00.169226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.273648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:00.291894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce2d7e04-6f57-4b3b-8617-701b9922f8cc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:00.293176 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0a58bc13-24b5-4723-9626-f58a1289fc21 req-5fd5518f-268b-4d42-a041-795c6632a6fa service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822655 Nov 05 14:50:00.316737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:49:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:00.321162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.356161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-decf455f-898f-4412-bec5-973f0e7b047d None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:49:16Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:49:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:00.378667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] For port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,segment=NetworkSegment(5b5f0566-9a1e-48e9-bdad-974d03d242cb),segment_id=5b5f0566-9a1e-48e9-bdad-974d03d242cb)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:00.379284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.407024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.459953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=99b59178-afee-446e-bc07-89108b770bdf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:00.478786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Calling delete_port for 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:00.485549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.547536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:00.566950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa44e332-d678-4dde-b356-8d255604d43e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/fbb19145-d30f-4e98-b332-420947e691a0 HTTP/1.1" status: 200 len: 992 time: 0.2876775 Nov 05 14:50:00.685326 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-031d855c-667b-449b-82c5-255b579cdd33 None None] New status for floating IP fbb19145-d30f-4e98-b332-420947e691a0: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:50:00.828774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Update dhcp port {'port': {'network_id': 'a79abec6-87fd-477e-a6d8-3655432a4a0a', 'fixed_ips': [{'subnet_id': '2bd90bc7-9513-48fa-8b2f-64e5612245e5', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'f0b92e1b-4795-4ee8-b00e-ea7af9f69e22', 'ip_address': '2001:db8::2'}, {'subnet_id': '2baa3ad4-1b5c-443e-8528-5218e9715bd5'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '2be4439b-204a-411e-8526-cf2a0f1f66b0'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:50:00.865929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.018588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.029434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.035385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.035575 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5dc04dd3-3b9c-45cf-8ba8-af1800fd1f57 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/99b59178-afee-446e-bc07-89108b770bdf HTTP/1.1" status: 204 len: 168 time: 2.3361218 Nov 05 14:50:01.042823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.045628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.047360 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/security-groups/ccff528b-978f-48e4-90c9-2865c3ce1505 HTTP/1.1" status: 204 len: 168 time: 0.9811783 Nov 05 14:50:01.050332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.092412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-374b7158-2a6c-4bf1-a9b0-98227cdf99ec tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccff528b-978f-48e4-90c9-2865c3ce1505,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.108764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:01.114782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:01.120007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.123280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:01.131905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=75bc6788-4262-4744-a107-f5c171ddb57c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.183134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] No DVR routers for this DVR port 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:01.187675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d839fcfc-8ce8-42d5-b58d-42db04d9f2cc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:01.189636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d839fcfc-8ce8-42d5-b58d-42db04d9f2cc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:01.191423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d839fcfc-8ce8-42d5-b58d-42db04d9f2cc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:01.192097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Port': ['ID=64ae0ebc-f1d0-4ed8-9059-15774b95d2bc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.207087 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d839fcfc-8ce8-42d5-b58d-42db04d9f2cc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1684730 Nov 05 14:50:01.207087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43906) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.345664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.356774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.388128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 4c86fd28-8a5c-44a7-9a11-d2133f9aaf67 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:01.390250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d420ae72-e4fa-429b-b3f8-f1864c828421']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:01.398169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.405072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Allocated IP 2001:db8:0:2::2 (a79abec6-87fd-477e-a6d8-3655432a4a0a/2baa3ad4-1b5c-443e-8528-5218e9715bd5/2be4439b-204a-411e-8526-cf2a0f1f66b0) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:01.414298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5b5f0566-9a1e-48e9-bdad-974d03d242cb') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:01.414631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5b5f0566-9a1e-48e9-bdad-974d03d242cb') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:01.426540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.430747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.474043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.485888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.487084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Releasing vlan 605 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:01.487594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:01.491207 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:01.535656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.539140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.540313 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/security-groups/010c3d56-8265-478d-8269-a7d541a68fff HTTP/1.1" status: 204 len: 168 time: 0.4883251 Nov 05 14:50:01.544214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43910) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.554577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:01.557893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5684d7bb-602f-4616-9604-ddc6044eeb51 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=010c3d56-8265-478d-8269-a7d541a68fff,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.578606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43912) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.627225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.633492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.636022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.645693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.651182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/networks/d420ae72-e4fa-429b-b3f8-f1864c828421 HTTP/1.1" status: 204 len: 168 time: 2.1002672 Nov 05 14:50:01.652182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.655414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43914) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.701585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.725623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872d9299-f7d1-4b4e-b1a7-021d8e3c793b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Network': ['ID=d420ae72-e4fa-429b-b3f8-f1864c828421,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.738733 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c3b813ad-6c12-4d73-bbbf-d2c09b010ecd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/fbb19145-d30f-4e98-b332-420947e691a0 HTTP/1.1" status: 200 len: 994 time: 0.1590128 Nov 05 14:50:01.771100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.771323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting subnet e4fc3864-f092-4d1a-a53b-effd12f3389b {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:01.776585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.799069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-996dd8d5-381c-4182-8953-e56b304f81be None None] Pushing event updated for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.843824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.845659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.868500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.917724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=4c86fd28-8a5c-44a7-9a11-d2133f9aaf67,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:01.924384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.930000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-391316ce-3674-438c-b604-41adbb4bdd4b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/4c86fd28-8a5c-44a7-9a11-d2133f9aaf67 HTTP/1.1" status: 204 len: 168 time: 0.7193825 Nov 05 14:50:01.930000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43916) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.965066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.968791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:01.970852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/security-groups/103b7b23-87e2-4998-9e10-22256d9c4279 HTTP/1.1" status: 204 len: 168 time: 0.4236147 Nov 05 14:50:01.977394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43918) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:01.996617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d7abbe-0ccc-4d44-8b2e-67f98042a8af tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=103b7b23-87e2-4998-9e10-22256d9c4279,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:02.061316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.065899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.230956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router bb5e7250-dcea-4104-9f86-274925a27786 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:50:02.382917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:02.387227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.388498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-caf5f8a0-c40f-410e-807e-0d38533ed670 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "PUT /v2.0/routers/bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 200 len: 918 time: 4.6126916 Nov 05 14:50:02.391276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:02.394629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] Sync routers for ids ['bb5e7250-dcea-4104-9f86-274925a27786'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:02.411707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] Routers {'bb5e7250-dcea-4104-9f86-274925a27786'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:02.413034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['bb5e7250-dcea-4104-9f86-274925a27786'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:02.440674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet af42dfc8-6354-41fc-914a-f56f008b1cfa {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:02.444309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.472974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:02.494782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] Routers {'bb5e7250-dcea-4104-9f86-274925a27786'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:02.495723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['bb5e7250-dcea-4104-9f86-274925a27786'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:02.498404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.530741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.540967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:02.541634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daba18ad-46e0-4a9d-96d1-32466ea67503 None None] The sync data for ids ['bb5e7250-dcea-4104-9f86-274925a27786'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:02.562246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cf7b2aa-e58f-4a4e-acaa-6e20502b48d0 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:02.579319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet f0b92e1b-4795-4ee8-b00e-ea7af9f69e22 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:02.596102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.606762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8be29508-6ba1-4dc4-8e36-0c8391e17aca tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 200 len: 924 time: 0.2045147 Nov 05 14:50:02.608092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43924) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:02.616808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a43d78-afab-4668-9a3f-5f778b63da60 None None] Network d420ae72-e4fa-429b-b3f8-f1864c828421 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-58a43d78-afab-4668-9a3f-5f778b63da60 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:50:02.650343 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:02.683251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.710136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6c896973-c5ad-47ff-bfad-45afdf78e1ad None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:02.711427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6c896973-c5ad-47ff-bfad-45afdf78e1ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.714892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21f204a9-c5c8-4697-8f80-292b3675bc07 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:02.720123 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-21f204a9-c5c8-4697-8f80-292b3675bc07 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=bb5e7250-dcea-4104-9f86-274925a27786&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.1107430 Nov 05 14:50:02.726642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43926) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9cf7b2aa-e58f-4a4e-acaa-6e20502b48d0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:02.764115 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:02.773092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.796419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5465388c-5202-4e5d-835b-e0b320fd15a6 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:02.830459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.862722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.868428 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/subnets/e4fc3864-f092-4d1a-a53b-effd12f3389b HTTP/1.1" status: 204 len: 168 time: 1.2107613 Nov 05 14:50:02.868428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e86ade9-1a26-4839-9ab6-19cd12cf7ab1 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Subnet': ['ID=e4fc3864-f092-4d1a-a53b-effd12f3389b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:02.873283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43928) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5465388c-5202-4e5d-835b-e0b320fd15a6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:02.892996 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:02.894645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a8068f5-496f-4eee-bca6-ead885f6ba32 None None] DHCP port deletion for d420ae72-e4fa-429b-b3f8-f1864c828421 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:02.898585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1504cfd4-3a62-48dd-933b-9816eea22746 None None] Network 55b25de1-89c8-4f5a-9068-ca3a407223db requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:02.912882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4c30ba2-d450-4d3d-ac21-41729e95b812 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:02.917562 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c4c30ba2-d450-4d3d-ac21-41729e95b812 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.1862519 Nov 05 14:50:02.918144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43930) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:02.982312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:02.989029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-47792518-61af-45d3-b089-13a202e7d0f6 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 200 len: 205 time: 0.0655978 Nov 05 14:50:02.993280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43932) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.035366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting subnet b92dc52e-57cd-4c0a-a15b-0685140cd283 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:03.043553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.114124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.157608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.164422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=af42dfc8-6354-41fc-914a-f56f008b1cfa,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:03.191825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6c896973-c5ad-47ff-bfad-45afdf78e1ad None None] Provisioning complete for port 7eb70a75-dc91-43e4-a84d-332680a5220e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:03.192229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6c896973-c5ad-47ff-bfad-45afdf78e1ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.198702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.203155 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a36423f4-b17f-4dc7-bd8a-bf2a451fd5f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/af42dfc8-6354-41fc-914a-f56f008b1cfa HTTP/1.1" status: 204 len: 168 time: 1.2718720 Nov 05 14:50:03.208339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43934) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.244154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.304837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:03.306914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] DHCP port deletion for 55b25de1-89c8-4f5a-9068-ca3a407223db request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:03.325684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.336833 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a77a207b-6e63-4ecd-8cba-430932684608 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1260493 Nov 05 14:50:03.366823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43938) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.384248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=f0b92e1b-4795-4ee8-b00e-ea7af9f69e22,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:03.407280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.417490 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-43f7ddc2-ab32-4303-a919-4c0c698f3599 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/f0b92e1b-4795-4ee8-b00e-ea7af9f69e22 HTTP/1.1" status: 204 len: 168 time: 1.4396584 Nov 05 14:50:03.418680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43940) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.461622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e91198b-f575-4f7e-939d-1de1d07e208b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:03.463542 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6e91198b-f575-4f7e-939d-1de1d07e208b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 867 time: 0.0956192 Nov 05 14:50:03.466707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43942) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.472423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6c896973-c5ad-47ff-bfad-45afdf78e1ad None None] Port 7eb70a75-dc91-43e4-a84d-332680a5220e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:03.532145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Deleting port bae07728-6a5f-414a-baa7-a1896eab25c9 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:03.532863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.555903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d650910b-69a2-462c-90a6-1a101fec55ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:03.557543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d650910b-69a2-462c-90a6-1a101fec55ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0896323 Nov 05 14:50:03.561462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43944) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.588399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffcf2c38-01fa-45b0-ac54-41af2cfbfe00 None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:03.594664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 2baa3ad4-1b5c-443e-8528-5218e9715bd5 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:03.599376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.610887 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e5ec373c-bc9e-41b6-9214-bcd12581ec4e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0479600 Nov 05 14:50:03.617033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.621756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43946) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.627897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:03.657909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3d09a9b-9a14-4198-b80f-35d4fadc5dfb None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:03.658135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.683491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:03.683859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.712078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f2d2c030-a3f0-47b5-9566-6f78d71457d5 None None] Could not find standard attr ID for object 99b59178-afee-446e-bc07-89108b770bdf. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:03.730750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f2d2c030-a3f0-47b5-9566-6f78d71457d5 None None] Could not find standard attr ID for object 52c4a31f-eb34-4bdb-a82f-de4c4df182e6. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:03.755514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port 75bc6788-4262-4744-a107-f5c171ddb57c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:03.755990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.783680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.786747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] For port bae07728-6a5f-414a-baa7-a1896eab25c9, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bae07728-6a5f-414a-baa7-a1896eab25c9,segment=NetworkSegment(6760743a-817c-4af3-bc4d-6c64c33bf41c),segment_id=6760743a-817c-4af3-bc4d-6c64c33bf41c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:03.787152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.818465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Calling delete_port for bae07728-6a5f-414a-baa7-a1896eab25c9 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:03.818793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:03.820203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.823486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.825359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:03.825532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ffcf2c38-01fa-45b0-ac54-41af2cfbfe00 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:03.835174 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:03.858833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8f568e4f-57a2-4f1e-b0a0-f294bcad3aa1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2358365 Nov 05 14:50:03.862728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43948) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:03.868097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:03.921863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:03.962660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for 75bc6788-4262-4744-a107-f5c171ddb57c owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:03.987399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.008611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.048211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Subnet': ['ID=b92dc52e-57cd-4c0a-a15b-0685140cd283,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.053913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:04.057352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:04.058509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.059211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.060955 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:04.061613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:04.064917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] Pushing event deleted for resources: {'Port': ['ID=bae07728-6a5f-414a-baa7-a1896eab25c9,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.068715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2350f58-2e76-440a-ae3b-9bf1c0036b2b None None] No DVR routers for this DVR port bae07728-6a5f-414a-baa7-a1896eab25c9 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:04.098997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ca45af47-cac5-4f99-9aea-1bcad65e97ef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2351949 Nov 05 14:50:04.105262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43950) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.108691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:04.112057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.116024 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bd058390-78b2-4c3c-8b9f-41bb3d297022 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/subnets/b92dc52e-57cd-4c0a-a15b-0685140cd283 HTTP/1.1" status: 204 len: 168 time: 1.2400899 Nov 05 14:50:04.122070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:04.126458 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43952) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.137666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fca7397-103a-4568-9d2a-5446a4f05c28 None None] Network 817c1122-6b1d-4ea9-8ba7-c09f43796853 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:04.142595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:04.142931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 64ae0ebc-f1d0-4ed8-9059-15774b95d2bc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:04.172608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.179013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43954) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.180865 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/2baa3ad4-1b5c-443e-8528-5218e9715bd5 HTTP/1.1" status: 204 len: 168 time: 0.7542849 Nov 05 14:50:04.183857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b11e43-021a-415f-919d-10178b79bb3c tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=2baa3ad4-1b5c-443e-8528-5218e9715bd5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.193153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2af522e8-9534-41e1-8657-89e25a3574ea None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:04.258890 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-e38118b1-4b4e-4ce2-889a-aac5ba3d7999 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:04.259519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e38118b1-4b4e-4ce2-889a-aac5ba3d7999 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:04.266902 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e38118b1-4b4e-4ce2-889a-aac5ba3d7999 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/f0b92e1b-4795-4ee8-b00e-ea7af9f69e22 HTTP/1.1" status: 404 len: 337 time: 0.0869122 Nov 05 14:50:04.267820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43956) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.312500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.318928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.362394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=75bc6788-4262-4744-a107-f5c171ddb57c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.389858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting subnet 2bd90bc7-9513-48fa-8b2f-64e5612245e5 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:04.393988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.464173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Deleting port 812cb9a1-7299-4389-992c-e158c9ab11b8 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:04.464766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2af522e8-9534-41e1-8657-89e25a3574ea None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:04.487653 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:04.521116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.549435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:04.554031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.555645 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:04.556354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:04.560858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] For port 812cb9a1-7299-4389-992c-e158c9ab11b8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=812cb9a1-7299-4389-992c-e158c9ab11b8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:04.561478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.568795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.577334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Calling delete_port for 812cb9a1-7299-4389-992c-e158c9ab11b8 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:04.586799 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b5b1cdde-74f9-4f7d-a6b2-3591f9c7167e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.4669483 Nov 05 14:50:04.587973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43960) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.602478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:04.606794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55b25de1-89c8-4f5a-9068-ca3a407223db']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:04.617673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6760743a-817c-4af3-bc4d-6c64c33bf41c') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:04.618002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6760743a-817c-4af3-bc4d-6c64c33bf41c') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:04.637133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.647721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] DHCP port deletion for 817c1122-6b1d-4ea9-8ba7-c09f43796853 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:04.656845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.671697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Releasing vlan 628 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:04.672997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:04.677423 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:04.719164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.725372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.738648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Deleting port 724cfc50-8a61-40a1-bcc8-66dd4b261382 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:04.738648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.766441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] Pushing event deleted for resources: {'Port': ['ID=812cb9a1-7299-4389-992c-e158c9ab11b8,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.768494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79efd658-4a7d-4609-9954-b416bd8d7f83 None None] No DVR routers for this DVR port 812cb9a1-7299-4389-992c-e158c9ab11b8 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:04.807842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.826863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.830880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.834163 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/networks/55b25de1-89c8-4f5a-9068-ca3a407223db HTTP/1.1" status: 204 len: 168 time: 0.6813436 Nov 05 14:50:04.836169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43962) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:04.852093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] For port 724cfc50-8a61-40a1-bcc8-66dd4b261382, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=724cfc50-8a61-40a1-bcc8-66dd4b261382,segment=NetworkSegment(a4318642-c0d1-436d-8b41-d942637f20d0),segment_id=a4318642-c0d1-436d-8b41-d942637f20d0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:04.853892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.861775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.867121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.875234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Calling delete_port for 724cfc50-8a61-40a1-bcc8-66dd4b261382 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:04.887697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:04.891781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.893218 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:04.893646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:04.958811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c158e9f4-8434-4e2c-8aa4-016f8cddc89d tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Network': ['ID=55b25de1-89c8-4f5a-9068-ca3a407223db,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:04.970869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:04.990588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.010744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] Pushing event deleted for resources: {'Port': ['ID=724cfc50-8a61-40a1-bcc8-66dd4b261382,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:05.013207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d63c38ac-1f66-43ee-80b4-3efd248d6d90 None None] No DVR routers for this DVR port 724cfc50-8a61-40a1-bcc8-66dd4b261382 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:05.034565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f050b52-7fc1-48fc-b4cd-14487e790b2f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:05.114802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.151015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['817c1122-6b1d-4ea9-8ba7-c09f43796853']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:05.157135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a4318642-c0d1-436d-8b41-d942637f20d0') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:05.157135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a4318642-c0d1-436d-8b41-d942637f20d0') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:05.167701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.181643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.188913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bae07728-6a5f-414a-baa7-a1896eab25c9 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:05.197797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Releasing vlan 618 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:05.198847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:05.203343 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:05.223441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: bae07728-6a5f-414a-baa7-a1896eab25c9 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:05.223691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bae07728-6a5f-414a-baa7-a1896eab25c9 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:05.224115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:05.253974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 812cb9a1-7299-4389-992c-e158c9ab11b8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:05.254324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 812cb9a1-7299-4389-992c-e158c9ab11b8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:05.255227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 724cfc50-8a61-40a1-bcc8-66dd4b261382 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:05.259005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.259555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router bb5e7250-dcea-4104-9f86-274925a27786 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:50:05.267824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.269157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0a2e3fee-67f9-47d7-968a-5f131fc13991 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 204 len: 168 time: 2.2747524 Nov 05 14:50:05.274672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43964) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.279972 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d51286af-70bc-4639-ab0a-82ee4634170d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.6881759 Nov 05 14:50:05.281311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-723246319', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:05.282437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43966) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.285343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.291750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:05.293632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 724cfc50-8a61-40a1-bcc8-66dd4b261382 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:05.293989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 724cfc50-8a61-40a1-bcc8-66dd4b261382 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:05.298445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f050b52-7fc1-48fc-b4cd-14487e790b2f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:05.312537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.314174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.362172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Subnet': ['ID=2bd90bc7-9513-48fa-8b2f-64e5612245e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:05.383920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.388357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-86d2ada3-9feb-433e-af13-8bb5a1649264 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/2bd90bc7-9513-48fa-8b2f-64e5612245e5 HTTP/1.1" status: 204 len: 168 time: 1.1173577 Nov 05 14:50:05.391258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43968) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.392568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.399459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.416281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.429165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.434569 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-433fe6d6-9ae1-41cc-a297-ba767e9d2303 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.435015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-433fe6d6-9ae1-41cc-a297-ba767e9d2303 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.436939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/networks/817c1122-6b1d-4ea9-8ba7-c09f43796853 HTTP/1.1" status: 204 len: 168 time: 0.5997677 Nov 05 14:50:05.438673 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-433fe6d6-9ae1-41cc-a297-ba767e9d2303 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/3943c90d-7859-4ab9-bc0d-30891fe19e0a HTTP/1.1" status: 404 len: 337 time: 0.0465009 Nov 05 14:50:05.439230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43970) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.441917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43972) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.466020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.470150 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5600e0cb-95c1-44d2-869f-170965946c13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.1916153 Nov 05 14:50:05.475684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 43974) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.492152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018d1b52-539c-4dec-be51-7c5c24b3aca5 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Network': ['ID=817c1122-6b1d-4ea9-8ba7-c09f43796853,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:05.496296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'enable_snat': False}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:05.502376 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9f2d9977-2101-48b5-bb15-e78df861c6c5 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "GET /v2.0/ports?device_id=85ee3714-cf48-4297-9200-eff9ba8ff95e HTTP/1.1" status: 200 len: 205 time: 0.0570691 Nov 05 14:50:05.504301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43976) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.547710 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-2ee2d0b9-8003-41ac-b33c-0b446f400390 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] delete failed (client error): The resource could not be found. Nov 05 14:50:05.548729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ee2d0b9-8003-41ac-b33c-0b446f400390 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/routers/85ee3714-cf48-4297-9200-eff9ba8ff95e HTTP/1.1" status: 404 len: 336 time: 0.0433607 Nov 05 14:50:05.551305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43980) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.587637 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e6fc820-fa66-492e-9059-e29ca3d071a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.588105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e6fc820-fa66-492e-9059-e29ca3d071a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.594246 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e6fc820-fa66-492e-9059-e29ca3d071a9 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/5c05a157-422b-4380-a664-7bdaeb7d66a7 HTTP/1.1" status: 404 len: 337 time: 0.0407860 Nov 05 14:50:05.596731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43982) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.600537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting subnet 7f49ab69-3400-44cd-810e-98bdaf3cf7f7 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:05.609760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.635274 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b2a8bb8c-13be-46a9-9e19-129825b7699d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.635926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b2a8bb8c-13be-46a9-9e19-129825b7699d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.639429 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b2a8bb8c-13be-46a9-9e19-129825b7699d tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/a56d5c9c-6ad1-46b6-81ff-d9a509668036 HTTP/1.1" status: 404 len: 337 time: 0.0417001 Nov 05 14:50:05.642009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43984) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.661939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a6c323f-5c75-4c09-89f9-b7bee3ceec3a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:05.671327 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d57bcec-6d9b-4202-b79b-49f2574dadd8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.672433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d57bcec-6d9b-4202-b79b-49f2574dadd8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.677925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9d57bcec-6d9b-4202-b79b-49f2574dadd8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/85779a9a-b126-4421-9e17-0b73e75facb1 HTTP/1.1" status: 404 len: 337 time: 0.0325463 Nov 05 14:50:05.678141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43986) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.706356 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-8972a0f9-5522-43ff-91a7-c1d921d417c8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.707341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8972a0f9-5522-43ff-91a7-c1d921d417c8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.713558 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8972a0f9-5522-43ff-91a7-c1d921d417c8 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/0778d4d2-0468-43f2-bd27-245b395a2a33 HTTP/1.1" status: 404 len: 333 time: 0.0319953 Nov 05 14:50:05.713827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43988) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.745897 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b02ecea5-d504-4fd7-b5ec-0b162e700dcf tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.746350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b02ecea5-d504-4fd7-b5ec-0b162e700dcf tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.752143 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b02ecea5-d504-4fd7-b5ec-0b162e700dcf tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/8a090c65-d7fb-4220-8814-b0198eb7fa87 HTTP/1.1" status: 404 len: 337 time: 0.0348952 Nov 05 14:50:05.752417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43990) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.766444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:05.770008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.771417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:05.771850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.773594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a6c323f-5c75-4c09-89f9-b7bee3ceec3a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:05.787268 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-a79083d2-a255-401c-87fe-66e9645fe661 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.787809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a79083d2-a255-401c-87fe-66e9645fe661 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.791072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a79083d2-a255-401c-87fe-66e9645fe661 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/76087b71-9aa7-48ca-80b3-62e5718f6fcf HTTP/1.1" status: 404 len: 337 time: 0.0376353 Nov 05 14:50:05.791748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.794183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43992) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.829281 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-84f76080-3dbb-4b01-ae05-517813ab9f52 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.830236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-84f76080-3dbb-4b01-ae05-517813ab9f52 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.834110 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-84f76080-3dbb-4b01-ae05-517813ab9f52 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/b36704e7-e731-48bb-a2fd-04a9235df3de HTTP/1.1" status: 404 len: 333 time: 0.0388858 Nov 05 14:50:05.836281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43994) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.869320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-843fca1f-877d-4850-87fd-19accdfe39fc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.870179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-843fca1f-877d-4850-87fd-19accdfe39fc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.873762 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-843fca1f-877d-4850-87fd-19accdfe39fc tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/9d5ce551-58db-4073-ae49-e7c43059bdf9 HTTP/1.1" status: 404 len: 337 time: 0.0362546 Nov 05 14:50:05.876957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43996) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.913289 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-acc370e7-2678-4446-913c-0cda0adc6eff tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:05.914697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-acc370e7-2678-4446-913c-0cda0adc6eff tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:05.918165 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-acc370e7-2678-4446-913c-0cda0adc6eff tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/subnets/926965ef-d5f1-4d02-846a-ee6c43bb40a9 HTTP/1.1" status: 404 len: 337 time: 0.0397949 Nov 05 14:50:05.920755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 43998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.922081 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ecd8667c-a37c-4f29-8907-70fea914c2b9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.6382978 Nov 05 14:50:05.924349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44000) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:05.932674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:05.941414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:06.032202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 7eb70a75-dc91-43e4-a84d-332680a5220e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:06.032521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.109487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.135876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.137886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38a83541-2c9b-49c6-9006-e82c93c28f5d None None] Network a79abec6-87fd-477e-a6d8-3655432a4a0a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:06.153094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 7eb70a75-dc91-43e4-a84d-332680a5220e owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:06.162618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:06.166751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.168145 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:06.168603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:06.208683 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f76d9897-4b13-47d2-9931-05026d7b4576 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2813387 Nov 05 14:50:06.210178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.224157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.248840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-485829c3-dfa5-48ad-9ac2-5dfcb7bb6211 None None] Provisioning complete for port 2be4439b-204a-411e-8526-cf2a0f1f66b0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:06.249205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-485829c3-dfa5-48ad-9ac2-5dfcb7bb6211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.256200 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-830eabc0-bd9b-4f60-971a-67d856a815e8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0445130 Nov 05 14:50:06.259689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44004) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.268364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Subnet': ['ID=7f49ab69-3400-44cd-810e-98bdaf3cf7f7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:06.273580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.276608 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-78059326-a286-4f84-80a0-07da9d706232 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/subnets/7f49ab69-3400-44cd-810e-98bdaf3cf7f7 HTTP/1.1" status: 204 len: 168 time: 0.8348224 Nov 05 14:50:06.279247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44006) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.286766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab26f6c8-c21b-41dd-bc0c-c53060e73872 None None] Network eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:06.413196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.427683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.440079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.441032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] DHCP port deletion for a79abec6-87fd-477e-a6d8-3655432a4a0a request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:06.496338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-350c26f6-bcfd-44b4-bfba-70a8d08a688a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:06.497170 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-350c26f6-bcfd-44b4-bfba-70a8d08a688a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2361970 Nov 05 14:50:06.501064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=7eb70a75-dc91-43e4-a84d-332680a5220e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:06.502959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-485829c3-dfa5-48ad-9ac2-5dfcb7bb6211 None None] Could not find standard attr ID for object 7eb70a75-dc91-43e4-a84d-332680a5220e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:06.503112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44008) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.549689 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d40a02bf-6e4b-4fbb-8308-f12b2b5349a8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0450301 Nov 05 14:50:06.553401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.553559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.559741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.559960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Deleting port 2be4439b-204a-411e-8526-cf2a0f1f66b0 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:06.561126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.564262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-587f58c6-8a6f-4639-a804-78f73ee14136 tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/ports/7eb70a75-dc91-43e4-a84d-332680a5220e HTTP/1.1" status: 204 len: 168 time: 0.6422222 Nov 05 14:50:06.567518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44012) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:06.581187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] DHCP port deletion for eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:06.600090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:06.666285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:06.666903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.686221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Calling delete_port for 2be4439b-204a-411e-8526-cf2a0f1f66b0 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:06.700481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Deleting port 520724fb-889b-44ff-8b19-6b3ab8762057 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:06.700853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.702193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Allocated IP 172.26.5.57 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/693c2947-20a7-4cd9-89a2-b1a62818045b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:06.748146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.801695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:06.806447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.809994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Deleting port 520724fb-889b-44ff-8b19-6b3ab8762057 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:06.810442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.819322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] For port 520724fb-889b-44ff-8b19-6b3ab8762057, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=520724fb-889b-44ff-8b19-6b3ab8762057,segment=NetworkSegment(98084bfc-d850-4b12-b946-4f9d3cfd95b1),segment_id=98084bfc-d850-4b12-b946-4f9d3cfd95b1)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:06.820002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.840509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Calling delete_port for 520724fb-889b-44ff-8b19-6b3ab8762057 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:06.891608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] For port 520724fb-889b-44ff-8b19-6b3ab8762057, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=520724fb-889b-44ff-8b19-6b3ab8762057,segment=NetworkSegment(98084bfc-d850-4b12-b946-4f9d3cfd95b1),segment_id=98084bfc-d850-4b12-b946-4f9d3cfd95b1)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:06.892063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.908798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Calling delete_port for 520724fb-889b-44ff-8b19-6b3ab8762057 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:06.911282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Deleting port 2be4439b-204a-411e-8526-cf2a0f1f66b0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:06.911724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.924360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.975222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:06.982528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.015646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] Pushing event deleted for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.022937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] For port 2be4439b-204a-411e-8526-cf2a0f1f66b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2be4439b-204a-411e-8526-cf2a0f1f66b0,segment=NetworkSegment(f8efc8e7-db86-4936-ba27-aa89e0b79b73),segment_id=f8efc8e7-db86-4936-ba27-aa89e0b79b73)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:07.023402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.033213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54b27772-6381-4082-a4de-ce3f6c0d5e17 None None] No DVR routers for this DVR port 2be4439b-204a-411e-8526-cf2a0f1f66b0 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:07.033571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.053154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Calling delete_port for 2be4439b-204a-411e-8526-cf2a0f1f66b0 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:07.067248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] No DVR routers for this DVR port 520724fb-889b-44ff-8b19-6b3ab8762057 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:07.071573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30374648-ee57-42e7-a728-c5875642a0bd None None] Pushing event deleted for resources: {'Port': ['ID=520724fb-889b-44ff-8b19-6b3ab8762057,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.119293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:07.125054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:07.133880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:07.135296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.154701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:07.172184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Port': ['ID=520724fb-889b-44ff-8b19-6b3ab8762057,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.186902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] No DVR routers for this DVR port 520724fb-889b-44ff-8b19-6b3ab8762057 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:07.188683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 2be4439b-204a-411e-8526-cf2a0f1f66b0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:07.189321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2be4439b-204a-411e-8526-cf2a0f1f66b0 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:07.189621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 520724fb-889b-44ff-8b19-6b3ab8762057 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:07.223337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 520724fb-889b-44ff-8b19-6b3ab8762057 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:07.223729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 520724fb-889b-44ff-8b19-6b3ab8762057 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:07.295278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Pushing event updated for resources: {'Port': ['ID=693c2947-20a7-4cd9-89a2-b1a62818045b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.302388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.305696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.381821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Port': ['ID=2be4439b-204a-411e-8526-cf2a0f1f66b0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.386374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] No DVR routers for this DVR port 2be4439b-204a-411e-8526-cf2a0f1f66b0 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:07.389327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eeefa8c9-20cd-4d8f-bb76-d2922b8a4290']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.405936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '98084bfc-d850-4b12-b946-4f9d3cfd95b1') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.406207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '98084bfc-d850-4b12-b946-4f9d3cfd95b1') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.437488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:07.441074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.447899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.494614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.502545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.513299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Releasing vlan 626 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:07.513697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:07.516843 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:07.536545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:07.541932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:07.545418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:07.546125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.551485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9301bc8-d3b2-4e91-b484-fe8d6b7fce3c None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:07.551970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.576684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a79abec6-87fd-477e-a6d8-3655432a4a0a']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.590562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=c8523a76-c2c2-46ee-b8c8-7b8f9c973770,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.591324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f8efc8e7-db86-4936-ba27-aa89e0b79b73') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.591607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f8efc8e7-db86-4936-ba27-aa89e0b79b73') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:07.602098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.610596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.616736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d3aadf3b-3f4c-4f7e-adba-03deb7ee8be5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.0591202 Nov 05 14:50:07.619428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.620920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44016) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:07.626057 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/networks/eeefa8c9-20cd-4d8f-bb76-d2922b8a4290 HTTP/1.1" status: 204 len: 168 time: 1.3458593 Nov 05 14:50:07.626912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:cc:ef:94', 'name': 'tempest-NetworksTestDHCPv6-754659167'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:07.628933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44018) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:07.641977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.656983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9225fb09-be30-4356-9644-c2ff16ee121b tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Pushing event deleted for resources: {'Network': ['ID=eeefa8c9-20cd-4d8f-bb76-d2922b8a4290,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.671775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Releasing vlan 623 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:07.672181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:07.675482 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:07.682861 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c6653488-0c8a-4789-922c-5ea23c5733f9 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "GET /v2.0/ports?device_id=7538d7ea-0474-4aa1-9cce-b31ff268f948 HTTP/1.1" status: 200 len: 205 time: 0.0499160 Nov 05 14:50:07.683099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44022) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c9301bc8-d3b2-4e91-b484-fe8d6b7fce3c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:07.701978 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:07.721915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5d62137-5de1-4b0a-88f2-e1a612930060 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:07.743059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.750481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.758967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] 10.222.0.30 "DELETE /v2.0/networks/a79abec6-87fd-477e-a6d8-3655432a4a0a HTTP/1.1" status: 204 len: 168 time: 1.1884484 Nov 05 14:50:07.791085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8873b315-2f2a-4ca7-956a-040283b6eeba tempest-PortsIpV6TestJSON-2022655656 tempest-PortsIpV6TestJSON-2022655656-project] Pushing event deleted for resources: {'Network': ['ID=a79abec6-87fd-477e-a6d8-3655432a4a0a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:07.847291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:07.848492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5d62137-5de1-4b0a-88f2-e1a612930060 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:08.118496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44028) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:08.165125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': 'c8523a76-c2c2-46ee-b8c8-7b8f9c973770'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:08.166166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.325702 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f39fa068-bdbf-4bbb-b3e0-e764b4838fa4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4ff2ceda9c9e4667b7921b128d51fb22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2078643 Nov 05 14:50:08.328133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44032) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:08.355688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Allocated IP 2001:db8::f816:3eff:fe2b:21b6 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/c8523a76-c2c2-46ee-b8c8-7b8f9c973770/40ac8793-66be-4545-bffd-185b0bb1dab4) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:08.396412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.426025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.449095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.456922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.506206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.511878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:08.515585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.519429 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cf08b40c-22cb-4a5b-80dc-d9afbb6bda07 HTTP/1.1" status: 204 len: 168 time: 0.1879711 Nov 05 14:50:08.533127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:50:08.537960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a69774-6b71-48b3-bc76-e8932189ca76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf08b40c-22cb-4a5b-80dc-d9afbb6bda07,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:08.552506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.570604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.581940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.582214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.582535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Fanout notify agent at l3_agent the message router_deleted on router 7538d7ea-0474-4aa1-9cce-b31ff268f948 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:50:08.592239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.603233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-59719844-dbdc-4b00-ba56-7dce2408c8d7 tempest-RoutersNegativeIpV6Test-1652824046 tempest-RoutersNegativeIpV6Test-1652824046-project] 10.222.0.30 "DELETE /v2.0/routers/7538d7ea-0474-4aa1-9cce-b31ff268f948 HTTP/1.1" status: 204 len: 168 time: 0.9169436 Nov 05 14:50:08.617154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.631030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:08.637085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:08.641634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:08.661015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Pushing event updated for resources: {'Port': ['ID=40ac8793-66be-4545-bffd-185b0bb1dab4,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:08.718814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Attempting to bind port 40ac8793-66be-4545-bffd-185b0bb1dab4 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:08.719524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Attempting to bind port 40ac8793-66be-4545-bffd-185b0bb1dab4 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:08.719676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Attempting to bind port 40ac8793-66be-4545-bffd-185b0bb1dab4 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:08.725801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:08.726364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:08.726874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.727566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:08.728240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Bound port: 40ac8793-66be-4545-bffd-185b0bb1dab4, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:08.728784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.777991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.809016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] For port 40ac8793-66be-4545-bffd-185b0bb1dab4, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:08.814931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] For port 40ac8793-66be-4545-bffd-185b0bb1dab4, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=40ac8793-66be-4545-bffd-185b0bb1dab4,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:08.829275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:08.829420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port ac1c1ee4-b886-417b-91fd-f97d0e9e3f41 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:08.897598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c536df2b-e179-4e8e-bb7d-9e3ccc78ea33 None None] Pushing event updated for resources: {'Port': ['ID=40ac8793-66be-4545-bffd-185b0bb1dab4,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:08.975997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44046) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:08.983180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Router 28eb0ac8-298f-480b-a2ee-2f5c3caec270 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:50:09.029713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fecc:ef94 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/c8523a76-c2c2-46ee-b8c8-7b8f9c973770/ac1c1ee4-b886-417b-91fd-f97d0e9e3f41) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:09.253481 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7d40998b-2dda-4f41-a799-6f0c6e33653c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3b26d4f4e40d40b98d8455e0b2c4ec13&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2748194 Nov 05 14:50:09.255841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44064) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.328119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.362170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.368447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:09.374356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.377964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f3a411bc-0509-45aa-97bf-f4365604bddf tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "PUT /v2.0/routers/28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 200 len: 918 time: 3.8888137 Nov 05 14:50:09.379728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44070) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.381170 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] Sync routers for ids ['28eb0ac8-298f-480b-a2ee-2f5c3caec270'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:09.397790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.400484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] Routers {'28eb0ac8-298f-480b-a2ee-2f5c3caec270'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:09.401751 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['28eb0ac8-298f-480b-a2ee-2f5c3caec270'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:09.420836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.490072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:09.493520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:09.496217 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:09.501659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:09.503999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:09.504922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.525448 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] Routers {'28eb0ac8-298f-480b-a2ee-2f5c3caec270'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:09.525676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=ac1c1ee4-b886-417b-91fd-f97d0e9e3f41,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:09.526634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['28eb0ac8-298f-480b-a2ee-2f5c3caec270'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:09.542493 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-59ffa77f-c60c-4584-962b-50bdedb2fea4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.9204817 Nov 05 14:50:09.545516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44074) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.566681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.568086 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:09.569261 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af042f4f-e034-4a5a-8543-eb2d43738c17 None None] The sync data for ids ['28eb0ac8-298f-480b-a2ee-2f5c3caec270'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:09.578538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:09.584444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/51ba82bb-f567-431c-b673-80dbbd240fa7 HTTP/1.1" status: 204 len: 168 time: 0.3273890 Nov 05 14:50:09.597779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050a3262-4a79-466a-b898-6ad776d9769b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51ba82bb-f567-431c-b673-80dbbd240fa7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:09.609381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1a824e02-176c-48c9-8f8c-adc526a9d6a6 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 200 len: 924 time: 0.2285120 Nov 05 14:50:09.609987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44080) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.659516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51ee3787-4179-474d-a0de-a798018aa419 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:09.663930 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-51ee3787-4179-474d-a0de-a798018aa419 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=28eb0ac8-298f-480b-a2ee-2f5c3caec270&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0524626 Nov 05 14:50:09.664550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44082) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.671036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3141651-dfb7-4acc-8eaa-d17a116586c9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:09.680258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3141651-dfb7-4acc-8eaa-d17a116586c9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:09.686108 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3141651-dfb7-4acc-8eaa-d17a116586c9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.1395266 Nov 05 14:50:09.689466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44084) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.777443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44086) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.791263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72885732-5572-4526-a0f5-757f74400481 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:09.796106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-72885732-5572-4526-a0f5-757f74400481 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/networks/6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 881 time: 0.1305909 Nov 05 14:50:09.799085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44090) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.851650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44094) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:09.853482 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8eb8245a-4d82-497b-8da0-101db2f3ebaf tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 200 len: 205 time: 0.0484607 Nov 05 14:50:09.856906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port ac1c1ee4-b886-417b-91fd-f97d0e9e3f41 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:09.859328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.001155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.016325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for ac1c1ee4-b886-417b-91fd-f97d0e9e3f41 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:10.093464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.201251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-42614b98-06e0-4509-a073-4219adc37449 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'default'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:10.202119 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-42614b98-06e0-4509-a073-4219adc37449 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 05 14:50:10.203242 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-42614b98-06e0-4509-a073-4219adc37449 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:50:10.209118 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-42614b98-06e0-4509-a073-4219adc37449 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.4296641 Nov 05 14:50:10.212534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44104) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:10.217973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--744107379'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:10.245699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.266481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.276555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.307261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.326067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=ac1c1ee4-b886-417b-91fd-f97d0e9e3f41,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:10.357245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.361082 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-de234259-9012-4990-9600-1f52abc53e59 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ac1c1ee4-b886-417b-91fd-f97d0e9e3f41 HTTP/1.1" status: 204 len: 168 time: 0.6704056 Nov 05 14:50:10.363894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44116) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:10.430091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.434002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cd4ce02-4ae5-445f-a5ab-6d175ee67af4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:10.435986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cd4ce02-4ae5-445f-a5ab-6d175ee67af4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:10.437742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.438454 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1cd4ce02-4ae5-445f-a5ab-6d175ee67af4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.0723495 Nov 05 14:50:10.441917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44118) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:10.507395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] Provisioning complete for port 40ac8793-66be-4545-bffd-185b0bb1dab4 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:10.508763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.588108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.605345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.609120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=39663616-24de-4732-99e1-8283e046865b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:10.655246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.659685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4460759 Nov 05 14:50:10.660318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44124) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:10.666490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '43eca6d0-36c1-49d2-acd8-c854ccc3c254', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:10.672972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7cbdd4a-4189-42b6-a516-65ecf42c4c29 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=43eca6d0-36c1-49d2-acd8-c854ccc3c254,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:10.716230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.720204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.812421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] For port 40ac8793-66be-4545-bffd-185b0bb1dab4, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=40ac8793-66be-4545-bffd-185b0bb1dab4,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:10.820938 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.848263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.857638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.900531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f110f31-b5f6-4157-b371-589062cce49b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:10.910831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.912038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6f2948-43af-429f-9fc1-31f059254f98 None None] Pushing event updated for resources: {'Port': ['ID=40ac8793-66be-4545-bffd-185b0bb1dab4,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:10.917966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a4adfa6c-4b6f-4a54-b674-8760665add10 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2553718 Nov 05 14:50:10.918611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44130) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:10.923607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4c7bf15d-b77a-4cb0-8281-55c126451de3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '43eca6d0-36c1-49d2-acd8-c854ccc3c254', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:10.954394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b5a70b87-b9be-4332-aead-d392c5186043 None None] Could not find standard attr ID for object ac1c1ee4-b886-417b-91fd-f97d0e9e3f41. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:10.957918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet c8523a76-c2c2-46ee-b8c8-7b8f9c973770 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:10.965081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:10.993466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4c7bf15d-b77a-4cb0-8281-55c126451de3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.014179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44134) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.026251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.091898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port 693c2947-20a7-4cd9-89a2-b1a62818045b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:11.092245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.137531 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-4c7bf15d-b77a-4cb0-8281-55c126451de3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): There was a conflict when trying to complete your request. Nov 05 14:50:11.139136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4c7bf15d-b77a-4cb0-8281-55c126451de3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.2193027 Nov 05 14:50:11.141714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44138) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.197345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7326eaaa-be5a-4d3f-9410-4f968187f366 tempest-ServiceProvidersTest-919410755 tempest-ServiceProvidersTest-919410755-project] 10.222.0.30 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.1819048 Nov 05 14:50:11.206469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 40ac8793-66be-4545-bffd-185b0bb1dab4 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:11.259021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.273249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.288013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.346836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.347189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.353196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.357833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/43eca6d0-36c1-49d2-acd8-c854ccc3c254 HTTP/1.1" status: 204 len: 168 time: 0.2143836 Nov 05 14:50:11.359315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44142) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.372004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for 693c2947-20a7-4cd9-89a2-b1a62818045b owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:11.406030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81dbd30e-5a6d-49ad-99ca-3d633fc2537c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=43eca6d0-36c1-49d2-acd8-c854ccc3c254,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:11.473923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.489566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 40ac8793-66be-4545-bffd-185b0bb1dab4 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:11.491825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0091dd6a-50a2-426d-9ab2-5ea7da67e7f9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1230359 Nov 05 14:50:11.492101 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.496173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.513225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--554155461'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:11.523966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.528814 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/c8523a76-c2c2-46ee-b8c8-7b8f9c973770 HTTP/1.1" status: 204 len: 168 time: 1.0858667 Nov 05 14:50:11.533886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cfc5e1b-cdd1-4ada-ae5d-0ea91293a8a8 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:11.535771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fb10f9-d445-455d-8c8d-75fa55d33186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=c8523a76-c2c2-46ee-b8c8-7b8f9c973770,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:11.550390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44148) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.624625 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a71d68d5-65c6-44dc-9fc4-d404afdb757d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0705783 Nov 05 14:50:11.624625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.632327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44150) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.656879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:11.658237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:11.693111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.781960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:11.805569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=693c2947-20a7-4cd9-89a2-b1a62818045b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:11.837731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.853490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.864494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:11.869584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.877849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.892511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Deleting port 40ac8793-66be-4545-bffd-185b0bb1dab4 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:11.892511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.960511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] For port 40ac8793-66be-4545-bffd-185b0bb1dab4, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=40ac8793-66be-4545-bffd-185b0bb1dab4,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:11.960851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:11.978707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Calling delete_port for 40ac8793-66be-4545-bffd-185b0bb1dab4 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:12.004753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.009252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5078104 Nov 05 14:50:12.012027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44158) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.019166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f60d501b-8d42-4ebf-af63-d1ad98798b62 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '58fe21b3-1506-414a-9e32-26b6aaf6c5e5', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:12.019882 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-f60d501b-8d42-4ebf-af63-d1ad98798b62 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Nov 05 14:50:12.020385 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-f60d501b-8d42-4ebf-af63-d1ad98798b62 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:12.025379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573e10b5-2f8f-41cc-ab19-0172db94befc admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.025930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f60d501b-8d42-4ebf-af63-d1ad98798b62 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0111964 Nov 05 14:50:12.026725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44160) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.033657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.041230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fc686d-6f97-42df-a162-b3c132a5c350 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=58fe21b3-1506-414a-9e32-26b6aaf6c5e5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.042942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.133595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.134295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router 28eb0ac8-298f-480b-a2ee-2f5c3caec270 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:50:12.142614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.143282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.144606 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9ecb1e04-7b79-4578-b1c9-f13abed9e85c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 204 len: 168 time: 2.2918918 Nov 05 14:50:12.148901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44162) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.156013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1510346168', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:12.175958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] Pushing event deleted for resources: {'Port': ['ID=40ac8793-66be-4545-bffd-185b0bb1dab4,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.178460 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c42dc6bf-fcad-42fd-a09c-6bfaeb55d78a None None] No DVR routers for this DVR port 40ac8793-66be-4545-bffd-185b0bb1dab4 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:12.189363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.211754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.212770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.243389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573e10b5-2f8f-41cc-ab19-0172db94befc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.248605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.252906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-573e10b5-2f8f-41cc-ab19-0172db94befc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.324408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:12.326573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.341112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.346397 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-573e10b5-2f8f-41cc-ab19-0172db94befc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d68a9f063319420fb90c0091a3a357e5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6858451 Nov 05 14:50:12.346755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44164) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.353566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573e10b5-2f8f-41cc-ab19-0172db94befc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=996fba7c-c700-4bda-895b-9ba1090a50e5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.364220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.367226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.370928 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/58fe21b3-1506-414a-9e32-26b6aaf6c5e5 HTTP/1.1" status: 204 len: 168 time: 0.3378546 Nov 05 14:50:12.379829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:12.380565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44166) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.398151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:12.407922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99b82c49-df4c-411c-8994-9cbe041493b6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fe21b3-1506-414a-9e32-26b6aaf6c5e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.412619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92e78681-ba75-42ee-9215-a0aee6c72667 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:12.413904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:12.414757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.427858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=245dcaa9-521b-45b6-b3de-0e9176a266e8,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.460422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b9122598-f5ca-4948-9370-265634a0d355 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8242910 Nov 05 14:50:12.461192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44168) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.467545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:f5:8f:56', 'name': 'tempest-NetworksTestDHCPv6-1796587818'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:12.480717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b6e5931d-5e0a-4fe8-8367-45d003d0ebfc tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0944402 Nov 05 14:50:12.486345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44170) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.505625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--1663196610'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-92e78681-ba75-42ee-9215-a0aee6c72667 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:12.536675 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:12.551393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8074eb12-072b-49f3-af4d-e004852f112a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:12.606312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.625358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.645018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:12.651095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.651596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.664746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8074eb12-072b-49f3-af4d-e004852f112a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:12.676953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port a8f0be00-4737-47fd-814c-2584c09bec2f yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:12.677268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.821118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fef5:8f56 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/245dcaa9-521b-45b6-b3de-0e9176a266e8/a8f0be00-4737-47fd-814c-2584c09bec2f) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:12.849279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.856536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.859547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.860861 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/996fba7c-c700-4bda-895b-9ba1090a50e5 HTTP/1.1" status: 204 len: 168 time: 0.5133264 Nov 05 14:50:12.868540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.879745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-080efaac-f85e-46d8-bf12-051a36ca3469 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=996fba7c-c700-4bda-895b-9ba1090a50e5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.923006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:12.924320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4311378 Nov 05 14:50:12.927993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290c6dbb-ec4b-4042-9fa9-cadf426fd408 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9f3740e8-b172-466a-bc05-6fb323f5c667,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:12.930941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44174) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:12.935498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c773a947-b9df-4afa-a509-dbbf239cc2ef tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '9f3740e8-b172-466a-bc05-6fb323f5c667', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:12.936033 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-c773a947-b9df-4afa-a509-dbbf239cc2ef tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Nov 05 14:50:12.936564 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-c773a947-b9df-4afa-a509-dbbf239cc2ef tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:12.940678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c773a947-b9df-4afa-a509-dbbf239cc2ef tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0062473 Nov 05 14:50:12.969473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44176) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.036248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '245dcaa9-521b-45b6-b3de-0e9176a266e8'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:13.037609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.128658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.176900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.181789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.244991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.248834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 40ac8793-66be-4545-bffd-185b0bb1dab4 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:13.254721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.287237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.325473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 40ac8793-66be-4545-bffd-185b0bb1dab4 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:13.326217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 40ac8793-66be-4545-bffd-185b0bb1dab4 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:13.358290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:13.366915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.369314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:13.370179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.372181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:13.372927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/9f3740e8-b172-466a-bc05-6fb323f5c667 HTTP/1.1" status: 204 len: 168 time: 0.4023964 Nov 05 14:50:13.379651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:13.380427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.383807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44188) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.397841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Allocated IP 2001:db8::f816:3eff:fe97:8128 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/245dcaa9-521b-45b6-b3de-0e9176a266e8/b8e0d499-cf11-4815-bfdc-ea78d51aaa7b) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:13.405066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Allocated IP 172.26.5.65 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/27b4e0ae-651d-444f-830c-7ab5a68360d8) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:13.407683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3263ecc-9d6c-4466-ba6b-4f892d92b1ee tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f3740e8-b172-466a-bc05-6fb323f5c667,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:13.408917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=a8f0be00-4737-47fd-814c-2584c09bec2f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:13.454208 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-603a4564-f447-45b2-9dfe-ac94938d7558 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.9909060 Nov 05 14:50:13.458581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.488207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8a6b685c-1784-4029-9f1a-f2eef6caf8a9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0977910 Nov 05 14:50:13.488446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44200) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.524801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--1896667634'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:13.577420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.579641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.607465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efd995af-b33e-435e-8d2c-452e5b6d6f39 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:13.610458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.615621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-efd995af-b33e-435e-8d2c-452e5b6d6f39 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 946 time: 0.1534798 Nov 05 14:50:13.616625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44204) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.621275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.664778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.673353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:13.677798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:13.685032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:13.740403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Pushing event updated for resources: {'Port': ['ID=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:13.761997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:13.777474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.782044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Attempting to bind port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:13.782543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Attempting to bind port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:13.782808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Attempting to bind port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:13.784205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:13.785325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.790389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:13.790773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:13.791223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.791789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:13.792255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Bound port: b8e0d499-cf11-4815-bfdc-ea78d51aaa7b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:13.792657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.795863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event updated for resources: {'Port': ['ID=27b4e0ae-651d-444f-830c-7ab5a68360d8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:13.810522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:13.877601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.880893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3906081 Nov 05 14:50:13.881987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d69811e-50ff-46a9-a5d5-f225a65b675d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=77fbdfc2-2390-4f3d-8fd4-cd29a73d472e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:13.882889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44212) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.893939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d4ffccdb-e4fa-477a-895e-e9dbf440a1c2 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '77fbdfc2-2390-4f3d-8fd4-cd29a73d472e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:13.895063 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-d4ffccdb-e4fa-477a-895e-e9dbf440a1c2 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Nov 05 14:50:13.895558 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-d4ffccdb-e4fa-477a-895e-e9dbf440a1c2 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:13.896573 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d4ffccdb-e4fa-477a-895e-e9dbf440a1c2 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0122881 Nov 05 14:50:13.899671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44214) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.944009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] For port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:13.947493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] For port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:13.947647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1f4e03bf-fc29-487e-b103-d690a9d0f2e8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '77fbdfc2-2390-4f3d-8fd4-cd29a73d472e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:13.948431 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-1f4e03bf-fc29-487e-b103-d690a9d0f2e8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Nov 05 14:50:13.948938 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-1f4e03bf-fc29-487e-b103-d690a9d0f2e8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:13.953975 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f4e03bf-fc29-487e-b103-d690a9d0f2e8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0490499 Nov 05 14:50:13.954753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44218) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.955452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port a8f0be00-4737-47fd-814c-2584c09bec2f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:13.955796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.957967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:13.967008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a4c99a44-43c1-4b56-9894-a8b00551e002 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '77fbdfc2-2390-4f3d-8fd4-cd29a73d472e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:13.967915 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-a4c99a44-43c1-4b56-9894-a8b00551e002 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Nov 05 14:50:13.981125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-a4c99a44-43c1-4b56-9894-a8b00551e002 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:13.985233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a4c99a44-43c1-4b56-9894-a8b00551e002 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0262716 Nov 05 14:50:13.985476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44220) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:13.990608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-701af0f3-6f1a-4bc3-86d6-dad4ac3b433d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '77fbdfc2-2390-4f3d-8fd4-cd29a73d472e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:13.991477 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-701af0f3-6f1a-4bc3-86d6-dad4ac3b433d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Nov 05 14:50:13.991949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-701af0f3-6f1a-4bc3-86d6-dad4ac3b433d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:13.995317 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-701af0f3-6f1a-4bc3-86d6-dad4ac3b433d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0058115 Nov 05 14:50:13.996674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44224) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.026177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f90abb-aa22-406d-9c4d-200dfe94eb63 None None] Pushing event updated for resources: {'Port': ['ID=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:14.091843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.121263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.185851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.190765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.194478 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/77fbdfc2-2390-4f3d-8fd4-cd29a73d472e HTTP/1.1" status: 204 len: 168 time: 0.1950569 Nov 05 14:50:14.196077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44228) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.202628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2490643-31cf-4b2a-ab41-8ae89c398615 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=77fbdfc2-2390-4f3d-8fd4-cd29a73d472e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:14.273938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44232) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.295266 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [-] 10.222.0.30 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0197120 Nov 05 14:50:14.299544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.305168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.379993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for a8f0be00-4737-47fd-814c-2584c09bec2f owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:14.391576 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e29bd31f-eb81-4f85-b5d4-075418987446 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1906054 Nov 05 14:50:14.392244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44238) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.400333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--309013171'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.403241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.447338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.488020 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee13ae11-b2cd-4f6d-9b0b-fc7ef30bb8b7 tempest-NetworksApiDiscovery-1924369285 tempest-NetworksApiDiscovery-1924369285-project] 10.222.0.30 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.1869926 Nov 05 14:50:14.566930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.572451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.604891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.606114 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2123966 Nov 05 14:50:14.608166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81a58d01-bec6-434c-b09a-290a36fcb671 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=594bc549-7721-4ace-9be4-798171c4cab0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:14.610009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44242) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.615025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a089a143-4103-4f51-89e5-e1a5d65b63cd tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.615569 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-a089a143-4103-4f51-89e5-e1a5d65b63cd tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 05 14:50:14.616019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-a089a143-4103-4f51-89e5-e1a5d65b63cd tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.620312 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a089a143-4103-4f51-89e5-e1a5d65b63cd tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0054739 Nov 05 14:50:14.621456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44244) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.628283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7b9e4174-5c3d-47c4-affc-72f793e91908 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.676442 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-7b9e4174-5c3d-47c4-affc-72f793e91908 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.681095 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7b9e4174-5c3d-47c4-affc-72f793e91908 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0580897 Nov 05 14:50:14.681551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44246) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.685986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-61a4c6f5-7f9e-4107-8964-598e8bb17496 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.688425 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-61a4c6f5-7f9e-4107-8964-598e8bb17496 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Nov 05 14:50:14.696543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-61a4c6f5-7f9e-4107-8964-598e8bb17496 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.700775 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61a4c6f5-7f9e-4107-8964-598e8bb17496 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0181532 Nov 05 14:50:14.701435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44248) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.706661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6eb3a9f5-7f24-412e-92bc-a0f6e9e0e3c3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.761264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-6eb3a9f5-7f24-412e-92bc-a0f6e9e0e3c3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.764122 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6eb3a9f5-7f24-412e-92bc-a0f6e9e0e3c3 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0614583 Nov 05 14:50:14.769117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.777524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8a8caf76-ba0c-48b0-aa0d-503703c05474 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.778027 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-8a8caf76-ba0c-48b0-aa0d-503703c05474 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Nov 05 14:50:14.778525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-8a8caf76-ba0c-48b0-aa0d-503703c05474 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.782109 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8a8caf76-ba0c-48b0-aa0d-503703c05474 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0088274 Nov 05 14:50:14.783211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44252) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.792305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.792547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c1ba1dcd-e8fb-4e49-8f81-75f0d253f7cc tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.794363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.829100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=a8f0be00-4737-47fd-814c-2584c09bec2f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:14.877208 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-c1ba1dcd-e8fb-4e49-8f81-75f0d253f7cc tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.882351 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c1ba1dcd-e8fb-4e49-8f81-75f0d253f7cc tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0968187 Nov 05 14:50:14.883349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44256) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.892862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-58107fef-215c-4354-9af9-a221af336595 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.893338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:14.893848 dv-neutron-816850-1-hyperv neutron-server[113580]: WARNING neutron.api.v2.base [None req-58107fef-215c-4354-9af9-a221af336595 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Nov 05 14:50:14.894513 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-58107fef-215c-4354-9af9-a221af336595 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:14.898464 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42081ceb-4afd-46d8-ad78-0ca6a350af20 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/a8f0be00-4737-47fd-814c-2584c09bec2f HTTP/1.1" status: 204 len: 168 time: 1.2788370 Nov 05 14:50:14.899077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44258) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.899210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44260) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:14.900337 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58107fef-215c-4354-9af9-a221af336595 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0147886 Nov 05 14:50:14.912661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-801bbd6a-5b03-410d-a10e-bb68452b6ed4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:14.925749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44262) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.123939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac15955e-c3ad-4df1-a074-fe9c77e1e63c admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.201892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b8e0d499-cf11-4815-bfdc-ea78d51aaa7b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:15.248942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac15955e-c3ad-4df1-a074-fe9c77e1e63c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.255875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac15955e-c3ad-4df1-a074-fe9c77e1e63c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.289219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:15.289854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.356652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ac15955e-c3ad-4df1-a074-fe9c77e1e63c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ac1242839660495a93a5d36e6a7dddb0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4271274 Nov 05 14:50:15.356652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac15955e-c3ad-4df1-a074-fe9c77e1e63c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af533480-692c-45e7-96c3-d5b42c076ebf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:15.369073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44268) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.399409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.437644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24d129f9-dd52-41e1-8aff-30a26f5034ac tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:15.440695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24d129f9-dd52-41e1-8aff-30a26f5034ac tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:15.442424 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24d129f9-dd52-41e1-8aff-30a26f5034ac tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.5410297 Nov 05 14:50:15.446219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44270) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.447272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:15.454171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.471694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.496886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.512764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 245dcaa9-521b-45b6-b3de-0e9176a266e8 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:15.517326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.550867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:15.563823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.582198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.586118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.590374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/af533480-692c-45e7-96c3-d5b42c076ebf HTTP/1.1" status: 204 len: 168 time: 0.2162786 Nov 05 14:50:15.596894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d328527-bc7f-417c-b933-603add6a2c6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af533480-692c-45e7-96c3-d5b42c076ebf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:15.651048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fbe07f92-f4f8-4d33-97ef-99ca1fd40d12 None None] Provisioning complete for port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:15.651359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbe07f92-f4f8-4d33-97ef-99ca1fd40d12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.672160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.721266 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-801bbd6a-5b03-410d-a10e-bb68452b6ed4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:15.725357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44274) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.725675 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-801bbd6a-5b03-410d-a10e-bb68452b6ed4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.8252993 Nov 05 14:50:15.730486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e6004ac8-9add-494b-86be-f50e2c526e44 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '594bc549-7721-4ace-9be4-798171c4cab0', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:15.792651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Router b87cb971-db85-4400-ad25-fc21873a4391 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:50:15.815561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-e6004ac8-9add-494b-86be-f50e2c526e44 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:15.816695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e6004ac8-9add-494b-86be-f50e2c526e44 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0902622 Nov 05 14:50:15.819713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44276) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.863970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.897548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=245dcaa9-521b-45b6-b3de-0e9176a266e8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:15.919517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.924796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-88ed29c4-463c-4911-8aa9-329cdb866a21 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/245dcaa9-521b-45b6-b3de-0e9176a266e8 HTTP/1.1" status: 204 len: 168 time: 0.4755330 Nov 05 14:50:15.927420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44278) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:15.932171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afaa2388-7674-4da6-bdda-b7a4ee9cd1ac None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:15.948600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:15.956739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-656f90a2-4cfd-4cf3-9575-1ce3ccef9651 None None] Could not find standard attr ID for object a8f0be00-4737-47fd-814c-2584c09bec2f. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:15.988229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.014364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1c6015da-904f-48b2-b576-cccb3103def6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0855789 Nov 05 14:50:16.019072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.063597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.067412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.069698 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/594bc549-7721-4ace-9be4-798171c4cab0 HTTP/1.1" status: 204 len: 168 time: 0.2482433 Nov 05 14:50:16.073221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44282) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.088441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94761133-93ed-46d0-b13e-40e4a55caeb4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=594bc549-7721-4ace-9be4-798171c4cab0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:16.103146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:16.126474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] Sync routers for ids ['b87cb971-db85-4400-ad25-fc21873a4391'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:16.130854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aaa46ab2-ad4b-4ef6-859f-033c61005358 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:16.135003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aaa46ab2-ad4b-4ef6-859f-033c61005358 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1121483 Nov 05 14:50:16.137454 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44284) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.138812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] Routers {'b87cb971-db85-4400-ad25-fc21873a4391'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:16.139566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b87cb971-db85-4400-ad25-fc21873a4391'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:16.172144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-511d0147-fde5-494b-802f-1a3f3a007864 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0955954 Nov 05 14:50:16.175022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.176209 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9871e1d0-6fd1-4d5e-a48f-2647ca61ac36 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 4.0263665 Nov 05 14:50:16.176784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44286) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.178781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:16.181272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--2125276076'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.184421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:16.194200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] Routers {'b87cb971-db85-4400-ad25-fc21873a4391'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:16.194668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44288) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.194799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b87cb971-db85-4400-ad25-fc21873a4391'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:16.200305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.208781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.261499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:16.262242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dea56e05-f1b7-4133-bc5d-c3f5019970b7 None None] The sync data for ids ['b87cb971-db85-4400-ad25-fc21873a4391'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:16.274279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2765a34e-9c86-4a5a-bf68-d47735ed5fab tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:16.279780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2765a34e-9c86-4a5a-bf68-d47735ed5fab tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1409509 Nov 05 14:50:16.283454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Deleting port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:16.283844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.284515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44290) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.298672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.303363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.342605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.344625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1668448 Nov 05 14:50:16.351654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44292) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.357467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-cc484466-2213-4c64-a193-ad4a4971bbb9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': 'dcee3b74-de15-4f5e-b085-175ba7e83c43', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.363301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc6e992-6305-4a9b-9d59-25c12c8792d9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dcee3b74-de15-4f5e-b085-175ba7e83c43,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:16.380327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] For port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:16.381069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.404191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e74689cf-3c79-4325-8dbe-8e255cd4f39b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1180990 Nov 05 14:50:16.407341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44296) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.408665 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Calling delete_port for b8e0d499-cf11-4815-bfdc-ea78d51aaa7b owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:16.421736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.502536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.511668 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-cc484466-2213-4c64-a193-ad4a4971bbb9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The resource could not be found. Nov 05 14:50:16.513419 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cc484466-2213-4c64-a193-ad4a4971bbb9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.1604350 Nov 05 14:50:16.517001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44300) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.524588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e1c3fe8f-37e8-421f-87d2-f282f8f7c64d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': 'dcee3b74-de15-4f5e-b085-175ba7e83c43', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': '28ce537e-3518-4ddb-a9f9-e19e3680100f'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.535284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] Pushing event deleted for resources: {'Port': ['ID=b8e0d499-cf11-4815-bfdc-ea78d51aaa7b,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:16.539417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25472113-2541-4ff4-ab85-735b8a432352 None None] No DVR routers for this DVR port b8e0d499-cf11-4815-bfdc-ea78d51aaa7b on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:16.556396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.api [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 05 14:50:16.556396 dv-neutron-816850-1-hyperv neutron-server[113581]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 05 14:50:16.556396 dv-neutron-816850-1-hyperv neutron-server[113581]: [parameters: {'project_id_1': '6c1eac42b2854d16bc0940ee811229be', 'expiration_1': datetime.datetime(2021, 11, 5, 14, 49, 56, 536143)}] Nov 05 14:50:16.556396 dv-neutron-816850-1-hyperv neutron-server[113581]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=113581) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:50:16.557390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG oslo_db.api [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:50:16.612290 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-e1c3fe8f-37e8-421f-87d2-f282f8f7c64d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The resource could not be found. Nov 05 14:50:16.616199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44302) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.616365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e1c3fe8f-37e8-421f-87d2-f282f8f7c64d tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0956719 Nov 05 14:50:16.685279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.716544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.746118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.763524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.784926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.787649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.791587 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/dcee3b74-de15-4f5e-b085-175ba7e83c43 HTTP/1.1" status: 204 len: 168 time: 0.1715367 Nov 05 14:50:16.792943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44304) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.815039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a99ed8-7ecf-4d4f-bbae-9dfae7536793 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcee3b74-de15-4f5e-b085-175ba7e83c43,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:16.825998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Deleting port 27b4e0ae-651d-444f-830c-7ab5a68360d8 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:16.826412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.848218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fdc1a915-1f53-45e7-b9bc-4f7a762a9210 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0540149 Nov 05 14:50:16.852066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44306) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.857594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-94913a58-6703-47d1-b081-9d73f6abe7a0 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': 'cc8a5517-2ebe-4cc7-82f3-e9e6fb15156d', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.912629 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-94913a58-6703-47d1-b081-9d73f6abe7a0 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The resource could not be found. Nov 05 14:50:16.916509 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-94913a58-6703-47d1-b081-9d73f6abe7a0 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0606344 Nov 05 14:50:16.917301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44308) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:16.917960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:16.922740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--2140798905'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:16.932571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Calling delete_port for 27b4e0ae-651d-444f-830c-7ab5a68360d8 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:16.951128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.042471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.050897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.101010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b8e0d499-cf11-4815-bfdc-ea78d51aaa7b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:17.126404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b8e0d499-cf11-4815-bfdc-ea78d51aaa7b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:17.126757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b8e0d499-cf11-4815-bfdc-ea78d51aaa7b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:17.138789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.141060 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2227528 Nov 05 14:50:17.147659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44310) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:17.154108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--742018159'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:17.162608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba0e4637-371d-4d39-9065-9205415b6ed6 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=710e9868-5d3c-406a-af9c-9f63d895ebb1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:17.179939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:17.184617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.273303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.395597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.402220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.448349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.453037 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3004956 Nov 05 14:50:17.453037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557c8c57-0dc8-411e-98df-6593bb41afcb tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c72d7af-2367-4b85-8d07-e5cd171b351c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:17.455487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44312) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:17.460278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ce9788d1-76cc-41d5-bcfd-0fcfa9b856b4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group_rule': {'security_group_id': '710e9868-5d3c-406a-af9c-9f63d895ebb1', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': '3c72d7af-2367-4b85-8d07-e5cd171b351c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:17.507192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.542076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Pushing event deleted for resources: {'Port': ['ID=27b4e0ae-651d-444f-830c-7ab5a68360d8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:17.551231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-ce9788d1-76cc-41d5-bcfd-0fcfa9b856b4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:17.552292 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ce9788d1-76cc-41d5-bcfd-0fcfa9b856b4 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.0958166 Nov 05 14:50:17.555258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44316) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:17.642540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.710304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:17.712484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.713589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.761212 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:17.768355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:17.777784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a492a881-b44f-4c72-83dd-809e7385efee None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:17.779157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=10e168b8-9853-4b5f-8ec5-accc8720fb64,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:17.789258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:17.790295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.797415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.821672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-48f7cde4-cb14-4dff-b5aa-702d91e8031b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.4065440 Nov 05 14:50:17.822061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:17.829486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:3b:f7:06', 'name': 'tempest-NetworksTestDHCPv6-522965195'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a492a881-b44f-4c72-83dd-809e7385efee None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:17.867031 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:17.888521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4921b2d7-273b-4594-b035-fdcbb3508b88 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:17.906049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.909645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.956425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.959035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:17.962230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/3c72d7af-2367-4b85-8d07-e5cd171b351c HTTP/1.1" status: 204 len: 168 time: 0.4039788 Nov 05 14:50:17.966049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44320) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:17.998810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2d687c-49f5-4ab0-a231-2618d47c73d8 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c72d7af-2367-4b85-8d07-e5cd171b351c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:18.009811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Router b87cb971-db85-4400-ad25-fc21873a4391 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:50:18.073008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e432d0c-57eb-422f-9d85-bb07ab0eec76 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1055801 Nov 05 14:50:18.078667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44322) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.092388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4921b2d7-273b-4594-b035-fdcbb3508b88 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:18.103026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:18.110585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.114872 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a5f58cb7-724b-496c-a08b-9a6a3927f89f tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "PUT /v2.0/routers/b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 200 len: 710 time: 1.9185481 Nov 05 14:50:18.115534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44324) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.117531 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] Sync routers for ids ['b87cb971-db85-4400-ad25-fc21873a4391'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:18.135262 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] Routers {'b87cb971-db85-4400-ad25-fc21873a4391'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:18.138134 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b87cb971-db85-4400-ad25-fc21873a4391'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:18.165009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:18.207308 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-42b2051c-ac68-4621-8934-0d77876b5af7 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/routers/b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 200 len: 745 time: 0.0905240 Nov 05 14:50:18.207943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44326) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.210564 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:18.241727 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] Routers {'b87cb971-db85-4400-ad25-fc21873a4391'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:18.242351 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:49:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['b87cb971-db85-4400-ad25-fc21873a4391'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:18.272958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.289547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44328) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.293652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4758a17e-1b03-4a3b-94c9-9028d2312e87 tempest-RoutersIpV6AdminTest-804464310 tempest-RoutersIpV6AdminTest-804464310-project-admin] 10.222.0.30 "GET /v2.0/ports?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&device_id=b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 200 len: 205 time: 0.0844681 Nov 05 14:50:18.301216 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:18.302127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c68066a4-059c-4bbf-9719-5d39401aef25 None None] The sync data for ids ['b87cb971-db85-4400-ad25-fc21873a4391'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:18.341361 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6e5efa25-bfaa-4c92-af77-2263884dffde tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 200 len: 205 time: 0.0458050 Nov 05 14:50:18.342423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44330) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.343485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.354588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.388061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.439234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.442517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port ccc392a8-a3aa-4a03-ac07-79d71de8ce60 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:18.576760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.579439 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.580581 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/710e9868-5d3c-406a-af9c-9f63d895ebb1 HTTP/1.1" status: 204 len: 168 time: 0.5008368 Nov 05 14:50:18.587023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44334) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.599427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01194b5b-3d5d-46d7-81e8-b4a384c7af3f tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=710e9868-5d3c-406a-af9c-9f63d895ebb1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:18.619972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fe3b:f706 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/10e168b8-9853-4b5f-8ec5-accc8720fb64/ccc392a8-a3aa-4a03-ac07-79d71de8ce60) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:18.624863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '10e168b8-9853-4b5f-8ec5-accc8720fb64'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:18.625809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.693589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.696868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.768983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3996fe60-57fe-4387-846a-d5704c45d896 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1818552 Nov 05 14:50:18.772791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44340) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.777460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'tempest-secgroup--663432317'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:18.783633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.784365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Fanout notify agent at l3_agent the message router_deleted on router b87cb971-db85-4400-ad25-fc21873a4391 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:50:18.797571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.801892 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c23f4a83-1efa-41ac-b89c-02f256995e4c tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 204 len: 168 time: 0.4550180 Nov 05 14:50:18.802583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44344) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.837971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1a0e3a46-6aa6-42a2-a3a8-15573c09cd13 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 200 len: 205 time: 0.0343661 Nov 05 14:50:18.840386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44346) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.856661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.881129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.883245 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-e6f042de-0737-45cc-86b6-a35cd91c8325 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:18.886743 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e6f042de-0737-45cc-86b6-a35cd91c8325 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/b87cb971-db85-4400-ad25-fc21873a4391 HTTP/1.1" status: 404 len: 336 time: 0.0429695 Nov 05 14:50:18.887820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44350) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.918677 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aca6d892-0dee-42cf-be11-595555c57154 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 200 len: 205 time: 0.0274758 Nov 05 14:50:18.918677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:18.919481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44352) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:18.953106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Allocated IP 2001:db8::f816:3eff:fe41:77c6 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/10e168b8-9853-4b5f-8ec5-accc8720fb64/0753828b-a81e-4e0b-a89b-9d193f0a9ea3) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:18.968382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-68b65d32-66c3-45c9-be95-805bf57e00c1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-343465885&fields=id&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 267 time: 0.0699341 Nov 05 14:50:18.992359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-0e6b928b-dede-45e0-a7a3-e55aaa13cfa0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:18.993413 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e6b928b-dede-45e0-a7a3-e55aaa13cfa0 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/28eb0ac8-298f-480b-a2ee-2f5c3caec270 HTTP/1.1" status: 404 len: 336 time: 0.0730360 Nov 05 14:50:18.997280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44354) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.025107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.037055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:19.039320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f8d6f0e8-3136-40f8-80a8-f68da4c777a5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 200 len: 205 time: 0.0384874 Nov 05 14:50:19.040430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=ccc392a8-a3aa-4a03-ac07-79d71de8ce60,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:19.042738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44356) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.043604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:19.051539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:19.057214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:19.057960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.078630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.098994 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-3a3025b7-53ce-4bf7-aec4-523e9818b600 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:19.099453 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a3025b7-53ce-4bf7-aec4-523e9818b600 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/bb5e7250-dcea-4104-9f86-274925a27786 HTTP/1.1" status: 404 len: 336 time: 0.0538948 Nov 05 14:50:19.102139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44358) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.127360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.134037 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2bf1827a-dd64-4a9c-977f-ab61ac3b0d6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.3108518 Nov 05 14:50:19.136362 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0742c135-5a6f-44e7-90f1-891eb1429957 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 200 len: 205 time: 0.0333266 Nov 05 14:50:19.136990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44360) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.139124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44362) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.139336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.141379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event updated for resources: {'SecurityGroup': ['ID=784a96d0-9d44-45ba-87c4-0ac2ca7249d7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:19.156681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.158026 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c33d1a6-b06a-457a-9bc0-cdb6e03ff32c tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3840582 Nov 05 14:50:19.166664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-90d4478e-1da0-46f0-be9f-005a2e40081b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:19.168576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-90d4478e-1da0-46f0-be9f-005a2e40081b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.1862261 Nov 05 14:50:19.178761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:19.181582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:19.183916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44364) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.187272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:19.188891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c78a57de-963a-4eb1-9ea8-f5222bdf9fe9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Request body: {'security_group': {'name': 'default'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:19.189310 dv-neutron-816850-1-hyperv neutron-server[113581]: WARNING neutron.api.v2.base [None req-c78a57de-963a-4eb1-9ea8-f5222bdf9fe9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Nov 05 14:50:19.189808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-c78a57de-963a-4eb1-9ea8-f5222bdf9fe9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] update failed (client error): There was a conflict when trying to complete your request. Nov 05 14:50:19.192924 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c78a57de-963a-4eb1-9ea8-f5222bdf9fe9 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "PUT /v2.0/security-groups/784a96d0-9d44-45ba-87c4-0ac2ca7249d7 HTTP/1.1" status: 409 len: 330 time: 0.0076134 Nov 05 14:50:19.194616 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-e4e395ff-250a-4524-8f62-cf6de4ab163d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:19.200412 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4e395ff-250a-4524-8f62-cf6de4ab163d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/859ffa6f-2089-46b3-b6d5-ae6f0e3efce0 HTTP/1.1" status: 404 len: 336 time: 0.0574996 Nov 05 14:50:19.200412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44366) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.200736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Pushing event updated for resources: {'Port': ['ID=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:19.208189 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-a51c451f-0a33-4bf3-9eeb-c98c89f5c8eb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/quotas/747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 375 time: 0.0209377 Nov 05 14:50:19.210970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44368) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.252790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Attempting to bind port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:19.253436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Attempting to bind port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:19.253801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Attempting to bind port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:19.259147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:19.259521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:19.259927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.260322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:19.260812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Bound port: 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:19.261200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.264336 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.268012 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b899eb25-b882-4bcb-a587-6925c18366d5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 200 len: 205 time: 0.0546625 Nov 05 14:50:19.270372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44370) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.291339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb0e8fab-719d-4bd8-9f01-4b438880b692 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:19.297946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb0e8fab-719d-4bd8-9f01-4b438880b692 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:19.302505 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eb0e8fab-719d-4bd8-9f01-4b438880b692 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.1600437 Nov 05 14:50:19.303206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44372) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.323951 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-351f6576-d75d-4486-b281-9f70bea0444d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:19.325004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-351f6576-d75d-4486-b281-9f70bea0444d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/d8fe5343-b5a8-47ba-a92f-c81dd0d9a861 HTTP/1.1" status: 404 len: 336 time: 0.0440164 Nov 05 14:50:19.328242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44374) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.329713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.341388 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-0d88d128-eaa7-4785-ad81-c76c4e496dbe tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1322241 Nov 05 14:50:19.346357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] For port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:19.353696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] For port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:19.358905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.372352 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f4533d2-e896-43f8-802f-8036ab24b063 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "GET /v2.0/ports?device_id=20bf511d-a5f6-41cd-941e-30fbb72f1d25 HTTP/1.1" status: 200 len: 205 time: 0.0392852 Nov 05 14:50:19.375196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44378) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.424625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port ccc392a8-a3aa-4a03-ac07-79d71de8ce60 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:19.425613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.432907 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-dd3bed10-75df-4ca6-a565-ed1fda6a5f9d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] delete failed (client error): The resource could not be found. Nov 05 14:50:19.433982 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd3bed10-75df-4ca6-a565-ed1fda6a5f9d tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/routers/20bf511d-a5f6-41cd-941e-30fbb72f1d25 HTTP/1.1" status: 404 len: 336 time: 0.0578766 Nov 05 14:50:19.438300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44380) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.467547 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-88be2523-c9f0-46e8-941c-b20df493fde5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:19.467547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-88be2523-c9f0-46e8-941c-b20df493fde5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:19.470516 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-88be2523-c9f0-46e8-941c-b20df493fde5 tempest-RoutersIpV6AdminTest-1226741709 tempest-RoutersIpV6AdminTest-1226741709-project] 10.222.0.30 "DELETE /v2.0/subnets/8eec5ce6-d5eb-4929-adc5-4286018c3a1a HTTP/1.1" status: 404 len: 337 time: 0.0324631 Nov 05 14:50:19.482176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9922eb72-7b20-4290-839b-485dc09ec7c7 None None] Pushing event updated for resources: {'Port': ['ID=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:19.489380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.492409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.494069 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/784a96d0-9d44-45ba-87c4-0ac2ca7249d7 HTTP/1.1" status: 204 len: 168 time: 0.2937150 Nov 05 14:50:19.506347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44384) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.531321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0bc450-26da-46d6-a1f7-e31e0d682611 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=784a96d0-9d44-45ba-87c4-0ac2ca7249d7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:19.572347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.591939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-debecc8a-36bc-4756-a893-5df1f2a40707 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0791271 Nov 05 14:50:19.592339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44386) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.609058 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-1f34d218-be7b-4d72-9048-3b77bc303c71 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] delete failed (client error): The resource could not be found. Nov 05 14:50:19.612496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f34d218-be7b-4d72-9048-3b77bc303c71 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "DELETE /v2.0/security-groups/49b0e122-fa9d-4b74-8914-7cbf38bc9978 HTTP/1.1" status: 404 len: 347 time: 0.0163472 Nov 05 14:50:19.615215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44388) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.634208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for ccc392a8-a3aa-4a03-ac07-79d71de8ce60 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:19.638989 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-037c371c-efd2-4de7-a172-74f4cbdc261a tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] show failed (client error): The resource could not be found. Nov 05 14:50:19.640330 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-037c371c-efd2-4de7-a172-74f4cbdc261a tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-groups/79f0b344-367d-4227-b2ca-c3b39c762c0b HTTP/1.1" status: 404 len: 347 time: 0.0236554 Nov 05 14:50:19.643836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44390) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.665690 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-0336300e-845f-40f9-bd5e-663aa46a0f80 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] show failed (client error): The resource could not be found. Nov 05 14:50:19.667144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0336300e-845f-40f9-bd5e-663aa46a0f80 tempest-NegativeSecGroupTest-1336068269 tempest-NegativeSecGroupTest-1336068269-project] 10.222.0.30 "GET /v2.0/security-group-rules/7eec24ad-52f6-4457-962d-ef4d31d3d9b1 HTTP/1.1" status: 404 len: 356 time: 0.0223856 Nov 05 14:50:19.772322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-c01cc141-d9f4-40fd-9b66-a253a50ed8ff service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4163435 Nov 05 14:50:19.874192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44398) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.902116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-6e1a2ea9-c763-42b0-a5d7-1b54109eb482 service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287959 Nov 05 14:50:19.931466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:19.972431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44404) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:19.973552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=ccc392a8-a3aa-4a03-ac07-79d71de8ce60,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:20.008656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.014822 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-695e6e07-1d99-43a9-adad-b890de1096b8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ccc392a8-a3aa-4a03-ac07-79d71de8ce60 HTTP/1.1" status: 204 len: 168 time: 0.7105870 Nov 05 14:50:20.016296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44412) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.053426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f41125d2-4f89-49e6-af5c-d810c363c022 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.110909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed7b43f1-cb18-4b38-aef7-221eb469e77f admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.128878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b21abcc-489e-4f22-a47b-0a9d7505359f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:20.130513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b21abcc-489e-4f22-a47b-0a9d7505359f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:20.132035 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2b21abcc-489e-4f22-a47b-0a9d7505359f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.1143286 Nov 05 14:50:20.135047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44416) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.183072 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d9d9f706-f0f8-47e7-9034-dc1424d41cac admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bfd52e3699604ed3812eb1d2ecc5aacb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2072725 Nov 05 14:50:20.185518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44418) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.215357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 10e168b8-9853-4b5f-8ec5-accc8720fb64 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:20.222071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.239093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.289371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.309706 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-662b478c-0349-49f5-b00a-f7d874a21df6 req-264b020c-0020-4c3c-9db1-60e008464c18 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0474238 Nov 05 14:50:20.312479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.356667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed7b43f1-cb18-4b38-aef7-221eb469e77f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.366948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.370665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44426) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.371309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed7b43f1-cb18-4b38-aef7-221eb469e77f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.372715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.373823 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/39663616-24de-4732-99e1-8283e046865b HTTP/1.1" status: 204 len: 168 time: 0.1872129 Nov 05 14:50:20.383328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62ffc329-db0b-429c-a3ce-6cde56556535 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39663616-24de-4732-99e1-8283e046865b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:20.543010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.549409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7b43f1-cb18-4b38-aef7-221eb469e77f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d883a8dd-e8d4-4002-9654-76c679c26dd8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:20.589146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44430) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.589540 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ed7b43f1-cb18-4b38-aef7-221eb469e77f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=744347060f8f40afa4d947d16b55db00&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7138708 Nov 05 14:50:20.629999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c2aaa82-81e5-4e86-8d64-03b335463203 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:20.630601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c2aaa82-81e5-4e86-8d64-03b335463203 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:20.631132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c2aaa82-81e5-4e86-8d64-03b335463203 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:20.632998 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6c2aaa82-81e5-4e86-8d64-03b335463203 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?project_id=2691099d79834234a0e6e846d81eed9c&network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 3000 time: 0.2556639 Nov 05 14:50:20.675340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.689290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.706504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=10e168b8-9853-4b5f-8ec5-accc8720fb64,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:20.722685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.724443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.727191 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f4cd7c3e-70e3-4991-9bdc-c5cb7068f845 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/10e168b8-9853-4b5f-8ec5-accc8720fb64 HTTP/1.1" status: 204 len: 168 time: 0.5911705 Nov 05 14:50:20.732164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44438) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.787869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-004ffc2b-bfb9-4667-9238-76d85f4a612d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0544744 Nov 05 14:50:20.792609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44440) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:20.801944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:20.802955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.805725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.808907 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d883a8dd-e8d4-4002-9654-76c679c26dd8 HTTP/1.1" status: 204 len: 168 time: 0.2183132 Nov 05 14:50:20.829564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd38d00-ec92-4122-b89b-e8ea3d6e5df5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d883a8dd-e8d4-4002-9654-76c679c26dd8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:20.843711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] Provisioning complete for port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:20.844226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.953833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:20.956802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:20.962625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.001217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] For port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:21.006604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.133776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-407a40b0-967e-42f8-8d1e-1fd8118b91a8 None None] Pushing event updated for resources: {'Port': ['ID=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:21.193442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14554bd9-4242-45ae-9733-9d19c25a56b2 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:21.209189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:21.281420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a2d5f253-55de-435b-bfd6-aa4150c4b4ef None None] Could not find standard attr ID for object ccc392a8-a3aa-4a03-ac07-79d71de8ce60. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:21.342869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:21.343365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.366818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44452) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:21.367009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:21.461366 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e8a6d945-7ef8-4729-963a-7bbf946a6011 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b797ddb0bdfc4d42860490426465674e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0933840 Nov 05 14:50:21.463361 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-85253047-9b28-4567-b711-7d2f076f116b req-f7a1f650-4106-45da-a93f-32b95cf97511 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0412574 Nov 05 14:50:21.463806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44454) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:21.479880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:21.527250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.542361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Deleting port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:21.543373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.553911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.561726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.605162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.608278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.609472 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/14b7f7df-458f-4ca5-b9d4-f595bcc253e5 HTTP/1.1" status: 204 len: 168 time: 0.1447804 Nov 05 14:50:21.617831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de818171-23c0-4013-ac5c-5fd71d6e9cb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14b7f7df-458f-4ca5-b9d4-f595bcc253e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:21.643946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] For port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:21.644332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.663363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Calling delete_port for 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:21.742761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:21.843838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.854749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.855577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.901742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.926494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] Pushing event deleted for resources: {'Port': ['ID=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:21.953531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:21.973120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:21.975084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04eebb76-7245-454a-b632-2f1570952c05 None None] No DVR routers for this DVR port 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:21.981576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:21.982106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:21.998484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4bd95be-e274-4e5f-8362-5d65dbec0fdd None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:22.001216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-b5fa3f95-9406-49f8-b49b-2099e2365141 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:22.002715 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-b5fa3f95-9406-49f8-b49b-2099e2365141 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.2440202 Nov 05 14:50:22.003359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=4416bcee-74a8-453e-84de-be049ae093d8,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:22.015360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=0753828b-a81e-4e0b-a89b-9d193f0a9ea3,revision_number=6']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:22.028501 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc914f70-0fae-4853-9768-47852ab50540 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.2339849 Nov 05 14:50:22.029096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44464) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:22.035883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:c5:ab:a1', 'name': 'tempest-NetworksTestDHCPv6-555779819'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f4bd95be-e274-4e5f-8362-5d65dbec0fdd None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:22.078733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:22.097362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-331cad56-ca47-43db-a953-4b998d4c4a5f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:22.179874 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-8a227d90-fbf3-41fe-b0e6-b6c435f64a29 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 379 time: 0.1478295 Nov 05 14:50:22.192059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'port': {'device_id': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'admin_state_up': True, 'tenant_id': '747df015bfd341929de773100c6c68ae', 'security_groups': ['04822744-30be-4b89-a4f8-6ca1fd516d0f']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:22.229663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-331cad56-ca47-43db-a953-4b998d4c4a5f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:22.257108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:22.261401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.306904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 10584cdf-2416-494d-82c9-d2782ca63001 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:22.402208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f3f669ab-3872-48ab-aaec-806f3c78d6ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.424587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Made reservation on behalf of 747df015bfd341929de773100c6c68ae for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:22.428215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.528035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fec5:aba1 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/4416bcee-74a8-453e-84de-be049ae093d8/10584cdf-2416-494d-82c9-d2782ca63001) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:22.555538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '4416bcee-74a8-453e-84de-be049ae093d8'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:22.556674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.594836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44484) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:22.629292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b8386495-18ba-4d15-8252-83e5a0ddbb7a req-57b537b4-67b3-498c-935d-4f6aabcfc690 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0540764 Nov 05 14:50:22.722383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-918315364'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:22.744512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:22.747875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.750733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.20.0.12 (45055355-0dd4-4c48-858a-f131e1d1f8bc/a738c6ea-0bb8-45cf-87bb-1b3689e6e451/958cd8d3-99e2-4811-9479-162a57c857cb) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:22.756799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.838317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.843417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.871425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 643} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:22.881875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3f4ec1ce-904e-46d9-8f5f-18da7e990057,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:22.887770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.888113 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Added segment c00de80a-a60c-48dc-a668-a7d79d77e170 of type vlan for network 1bfaca83-0340-4ff3-aa66-407477b33539 Nov 05 14:50:22.901230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.931507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.957797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.963618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:22.964286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.976267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:22.984991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.033577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 797 time: 0.4365921 Nov 05 14:50:23.037287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44490) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:23.045844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'subnet': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:23.065478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=10584cdf-2416-494d-82c9-d2782ca63001,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.066970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Allocated IP 2001:db8::f816:3eff:fe6f:1da0 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/4416bcee-74a8-453e-84de-be049ae093d8/f15dc9c1-dcee-4773-8fea-10e91478cd0d) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:23.084999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:23.087780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:23.091951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:23.098073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:23.098695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.118768 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1084124c-8259-4920-9de2-8fd3dff59ca8 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.0885887 Nov 05 14:50:23.122070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.126949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44492) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:23.167797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:23.178189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f555383-62b5-4265-9103-13fe282a1a16 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Network': ['ID=1bfaca83-0340-4ff3-aa66-407477b33539,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.202594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1bfaca83-0340-4ff3-aa66-407477b33539 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:23.203199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:23.208129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:23.208339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0753828b-a81e-4e0b-a89b-9d193f0a9ea3 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:23.208572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:23.211647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:23.236781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:23.241883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.265795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:23.266930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.294399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1075866 Nov 05 14:50:23.312425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3ba685e-9b37-43ac-91ec-2b4c433962c3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:23.313933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3ba685e-9b37-43ac-91ec-2b4c433962c3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.1827793 Nov 05 14:50:23.315338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.321346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Request body: {'port': {'device_id': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:23.348892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.354666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44494) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:23.369326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.409380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.410028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.410537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.411053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.411555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.412153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.412687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.413196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.413700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.414206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.414717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.415206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-468266fc-1a8f-4aa5-b219-72d1488dae15 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:23.430604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.437200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.452747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:23.456971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:23.463295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:23.466806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Pushing event updated for resources: {'Port': ['ID=f15dc9c1-dcee-4773-8fea-10e91478cd0d,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.509118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.552816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Attempting to bind port f15dc9c1-dcee-4773-8fea-10e91478cd0d on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:23.553280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Attempting to bind port f15dc9c1-dcee-4773-8fea-10e91478cd0d by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:23.554103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Attempting to bind port f15dc9c1-dcee-4773-8fea-10e91478cd0d on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:23.560788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:23.561594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:23.562233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.562797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:23.563377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Bound port: f15dc9c1-dcee-4773-8fea-10e91478cd0d, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:23.564207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.582036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Subnet': ['ID=2d1bad87-80f2-4687-95e5-3145d289743d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.615477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Checking segment: {'id': 'c00de80a-a60c-48dc-a668-a7d79d77e170', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:23.616156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network hostable DHCP agents. Network: 1bfaca83-0340-4ff3-aa66-407477b33539, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:23.618071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 10584cdf-2416-494d-82c9-d2782ca63001 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:23.618703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.637555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:23.649846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1bfaca83-0340-4ff3-aa66-407477b33539) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:23.657709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:23.658689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.678354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] For port f15dc9c1-dcee-4773-8fea-10e91478cd0d, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:23.682351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] For port f15dc9c1-dcee-4773-8fea-10e91478cd0d, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f15dc9c1-dcee-4773-8fea-10e91478cd0d,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:23.684001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e0d49030-52c4-42a7-8d85-8188dedc8341 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6454523 Nov 05 14:50:23.686969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44500) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:23.689310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:23.698969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-610345033'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:23.759413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2532067c-8f88-4c0a-8535-c9d2a02427c4 None None] Pushing event updated for resources: {'Port': ['ID=f15dc9c1-dcee-4773-8fea-10e91478cd0d,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:23.883749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d226ba9b-2ecb-48d5-8324-c0c2c3c064d5 req-2d6a9281-fb89-4ec7-b6a1-ee4703e48d66 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:23.885981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d226ba9b-2ecb-48d5-8324-c0c2c3c064d5 req-2d6a9281-fb89-4ec7-b6a1-ee4703e48d66 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 932 time: 0.1527209 Nov 05 14:50:23.962142 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d226ba9b-2ecb-48d5-8324-c0c2c3c064d5 req-df93e18a-87b7-4bae-9a4f-eef46bf018c2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0646157 Nov 05 14:50:23.964104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:23.968821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.018388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port 62ee1366-4cb1-48c5-ba61-ca96fb766084 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:24.191050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::197 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/62ee1366-4cb1-48c5-ba61-ca96fb766084) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:24.238839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.262787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 10584cdf-2416-494d-82c9-d2782ca63001 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:24.361373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.375669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 958cd8d3-99e2-4811-9479-162a57c857cb {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:50:24.385003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.397933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.405450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Transition to ACTIVE for port object 958cd8d3-99e2-4811-9479-162a57c857cb will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:50:24.415098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.447653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:24.453751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:24.456165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:24.462621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:24.462817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.481010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=62ee1366-4cb1-48c5-ba61-ca96fb766084,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:24.488977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.489338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.489683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.490158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.490732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.490732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.491102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.491446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.491756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.492182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.492590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.492914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:24.504215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Pushing event updated for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:24.515773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f837f5be-a4c1-4938-b4c0-be6f2083fcb0 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.8239548 Nov 05 14:50:24.519407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:24.519668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:24.529480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.533967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-448069214', 'allowed_address_pairs': [{'ip_address': '2001:db8::197', 'mac_address': 'fa:16:3e:84:48:b1'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:24.593482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=10584cdf-2416-494d-82c9-d2782ca63001,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:24.625711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.629351 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ae02118f-e3fb-4a4d-93af-7b8a1fa8ba13 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/10584cdf-2416-494d-82c9-d2782ca63001 HTTP/1.1" status: 204 len: 168 time: 1.2660367 Nov 05 14:50:24.635096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:24.677571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Attempting to bind port 958cd8d3-99e2-4811-9479-162a57c857cb on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:24.678341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Attempting to bind port 958cd8d3-99e2-4811-9479-162a57c857cb by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:24.678932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Attempting to bind port 958cd8d3-99e2-4811-9479-162a57c857cb on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:24.691796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Port 958cd8d3-99e2-4811-9479-162a57c857cb on network 45055355-0dd4-4c48-858a-f131e1d1f8bc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:50:24.692152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Attempting to bind port 958cd8d3-99e2-4811-9479-162a57c857cb on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:24.701543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:24.702012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:24.702371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Bound using segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:24.703065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Bound port: 958cd8d3-99e2-4811-9479-162a57c857cb, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:24.703561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.735071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42a46517-9d1b-425d-a436-6f296ca8d00f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:24.736776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42a46517-9d1b-425d-a436-6f296ca8d00f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:24.739294 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42a46517-9d1b-425d-a436-6f296ca8d00f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.1025906 Nov 05 14:50:24.742292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:24.848509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 4416bcee-74a8-453e-84de-be049ae093d8 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:24.853500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.859683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.900052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:24.921203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=958cd8d3-99e2-4811-9479-162a57c857cb,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:24.929759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.933009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:24.971992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16434882-0474-4ba7-8d15-d10fd17d18b6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:24.973570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-16434882-0474-4ba7-8d15-d10fd17d18b6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 814 time: 0.4530144 Nov 05 14:50:25.060054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:25.100250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.154617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80a285d2-6d59-495a-a351-76693ccd54a6 None None] Network 1bfaca83-0340-4ff3-aa66-407477b33539 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:25.185188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:25.186621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.188496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] 10.222.0.32 "PUT /v2.0/ports/958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 200 len: 1094 time: 1.8842950 Nov 05 14:50:25.201369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f15dc9c1-dcee-4773-8fea-10e91478cd0d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:25.202801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:50:25.205887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17057f90-432d-4863-9c62-00ee7773fab3" -d '{"events": [{"name": "network-changed", "server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:50:25.254898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.308430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port d1cde6dd-2d67-47bf-9008-8bd096e3f921 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:25.413893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Provisioning complete for port f15dc9c1-dcee-4773-8fea-10e91478cd0d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:25.416079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20399dd5-1755-4d54-aeb5-e23c97f4db6a service neutron] Pushing event updated for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:25.423782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.459901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-c18700cd-61f5-4881-aec8-f392eab74eba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:25.461517 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-c18700cd-61f5-4881-aec8-f392eab74eba service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1097 time: 0.2146726 Nov 05 14:50:25.462664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.490636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce1275a-4ede-45cd-8828-5751590664ec req-8160b12b-e078-4392-b543-8b7867f0f517 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:25.504632 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dce1275a-4ede-45cd-8828-5751590664ec req-8160b12b-e078-4392-b543-8b7867f0f517 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.3277328 Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-80a285d2-6d59-495a-a351-76693ccd54a6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:25.558313 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:25.571718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d816594-2fa9-41fd-b1dc-3e8a4ffd37c1 None None] Network 1bfaca83-0340-4ff3-aa66-407477b33539 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:25.601756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::287 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/d1cde6dd-2d67-47bf-9008-8bd096e3f921) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:25.644114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:50:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bfefc26b-f556-4ae4-98c3-f2b756be78cd x-openstack-request-id: req-bfefc26b-f556-4ae4-98c3-f2b756be78cd {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:50:25.644509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:50:25.644691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bfefc26b-f556-4ae4-98c3-f2b756be78cd {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:50:25.645079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb', 'status': 'completed', 'code': 200} Nov 05 14:50:25.648570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.651776 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/4416bcee-74a8-453e-84de-be049ae093d8 HTTP/1.1" status: 204 len: 168 time: 0.9086304 Nov 05 14:50:25.666518 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-878e759d-f1d0-4040-95f4-2b0af2660dba service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 200 len: 217 time: 0.1596246 Nov 05 14:50:25.667082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44520) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:25.669618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d7bc52-5d56-4f86-8fe9-f4c177ac7ac9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=4416bcee-74a8-453e-84de-be049ae093d8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8d816594-2fa9-41fd-b1dc-3e8a4ffd37c1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:25.709331 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:25.733340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port f15dc9c1-dcee-4773-8fea-10e91478cd0d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:25.734106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.766311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-79743c22-087f-432a-ac79-db3a0983b328 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:25.767893 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-79743c22-087f-432a-ac79-db3a0983b328 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0856435 Nov 05 14:50:25.828188 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6e6585af-33c3-41cc-9a17-4a9201744b5e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1402915 Nov 05 14:50:25.841925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44522) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:25.909282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.916238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:25.928526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44524) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:25.945075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dce1275a-4ede-45cd-8828-5751590664ec req-8df33848-0e23-4c37-9096-626089f8fd1f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4277706 Nov 05 14:50:25.958860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-d809b6ab-35f5-426b-a2dd-8256a989d7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:25.960355 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-d809b6ab-35f5-426b-a2dd-8256a989d7a7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1486578 Nov 05 14:50:25.966165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--824887310', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:26.012793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd0a1cbb-26e6-4bc5-828d-436659e739f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.017641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44526) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.018147 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fd0a1cbb-26e6-4bc5-828d-436659e739f0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.1750195 Nov 05 14:50:26.034102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4528e63-0061-4975-bb53-e997d2aa6346 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:26.034865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:26.039540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.084075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.158861 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-483d212f-85cf-4453-837d-9f3a1be03d93 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805038 Nov 05 14:50:26.210443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e36da46-0a1f-4d41-84fb-108042025f3d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.214420 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e36da46-0a1f-4d41-84fb-108042025f3d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1933284 Nov 05 14:50:26.214591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:26.215365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:26.223833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44528) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.236345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.238604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.241801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:26.252110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:26.259332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.260187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.278964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port f15dc9c1-dcee-4773-8fea-10e91478cd0d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f15dc9c1-dcee-4773-8fea-10e91478cd0d,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:26.291783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.336785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b0f230e-fdfc-4b39-b53f-c3bcb20b134f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1094499 Nov 05 14:50:26.338549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.339620 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment afefeb50-4b2f-4f90-9f53-397926bd6c86 of type vlan for network 6f42e72d-8f95-4783-82a7-99edeac923fe Nov 05 14:50:26.344707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=d1cde6dd-2d67-47bf-9008-8bd096e3f921,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:26.348363 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-502324e9-8587-4538-bce3-dff2f6f4b80f req-47d6c3a6-16da-4c3c-a641-f990405087c4 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1793487 Nov 05 14:50:26.351928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44530) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.397053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:26.432743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=f15dc9c1-dcee-4773-8fea-10e91478cd0d,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:26.435416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:50:26.435834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:50:26.444076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.444432 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.445053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.445393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.445724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.446056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.446380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.446707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.447040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.447351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.447671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.447988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:50:26.455981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd59ecb6-b102-43bb-a63b-1179e5653074 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 1.9380972 Nov 05 14:50:26.458456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44532) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.472787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.516723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17057f90-432d-4863-9c62-00ee7773fab3 req-8d9aa6a6-811e-4146-b4f2-9b2cbea84337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.518588 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-8d9aa6a6-811e-4146-b4f2-9b2cbea84337 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1097 time: 0.1170487 Nov 05 14:50:26.527588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.532817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.533460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.551746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:26.595625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eaf3d65-e54f-4c23-8eb1-4f420c4a94dd tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.602024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eaf3d65-e54f-4c23-8eb1-4f420c4a94dd tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.606972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3eaf3d65-e54f-4c23-8eb1-4f420c4a94dd tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1742 time: 0.1443510 Nov 05 14:50:26.609228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.617307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:26.622385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.625382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Deleting port f15dc9c1-dcee-4773-8fea-10e91478cd0d {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:26.625994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.704710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] For port f15dc9c1-dcee-4773-8fea-10e91478cd0d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=f15dc9c1-dcee-4773-8fea-10e91478cd0d,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:26.705196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.718896 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.7882204 Nov 05 14:50:26.723686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.727293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Calling delete_port for f15dc9c1-dcee-4773-8fea-10e91478cd0d owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:26.750468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b252c2-e5a3-4b87-a449-4b54f17493be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=6f42e72d-8f95-4783-82a7-99edeac923fe,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:26.755895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port d1cde6dd-2d67-47bf-9008-8bd096e3f921 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:26.756359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.760071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17057f90-432d-4863-9c62-00ee7773fab3 req-8def7562-27c1-4550-84f6-75551683d95d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.761707 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-8def7562-27c1-4550-84f6-75551683d95d service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.2341533 Nov 05 14:50:26.790550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 6f42e72d-8f95-4783-82a7-99edeac923fe details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:26.828758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcafea34-c3c8-45a5-a884-90eed4b1a8b6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:26.830325 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fcafea34-c3c8-45a5-a884-90eed4b1a8b6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.1043632 Nov 05 14:50:26.851011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44538) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:26.864490 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-2df8f1bc-7d5c-4fec-b6f8-0ec8073ddf17 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 200 len: 217 time: 0.0894344 Nov 05 14:50:26.933942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.937131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:26.993028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:26.996906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:27.003947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.004680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.006284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] No DVR routers for this DVR port f15dc9c1-dcee-4773-8fea-10e91478cd0d on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:27.013670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fc036c64-7491-4bb4-98f9-1bec61dc661b None None] Port f15dc9c1-dcee-4773-8fea-10e91478cd0d update to ACTIVE by agent not found {{(pid=113582) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 05 14:50:27.021603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=470327d9-d700-40da-96a2-04eb701e7ef2,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:27.022064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461e1d41-dec9-48a6-9483-412dc5f53bce None None] Pushing event deleted for resources: {'Port': ['ID=f15dc9c1-dcee-4773-8fea-10e91478cd0d,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:27.037851 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa5aa751-8f68-4c5b-baea-472f90a059b4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6625082 Nov 05 14:50:27.038616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44542) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.044184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:c5:c4:a1', 'name': 'tempest-NetworksTestDHCPv6-126824806'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:27.046071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23d08f8e-572c-4cc9-8ac1-9e0e0673dda0 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:27.101472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17057f90-432d-4863-9c62-00ee7773fab3 req-711575e9-c0bb-46ce-a7f1-805295f06f96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.102966 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-711575e9-c0bb-46ce-a7f1-805295f06f96 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.2243984 Nov 05 14:50:27.171585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f15dc9c1-dcee-4773-8fea-10e91478cd0d no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:27.184706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8eb61f4b-1897-4d00-aa97-c7db5ed9a392 None None] Could not find standard attr ID for object 10584cdf-2416-494d-82c9-d2782ca63001. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:27.187155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18f7dac-bdf9-4e77-b55c-38a37ff627fd req-d8138f32-ad73-48be-a72c-56bbeacbe071 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.194600 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d18f7dac-bdf9-4e77-b55c-38a37ff627fd req-d8138f32-ad73-48be-a72c-56bbeacbe071 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.0857322 Nov 05 14:50:27.208497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: f15dc9c1-dcee-4773-8fea-10e91478cd0d {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:27.208724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device f15dc9c1-dcee-4773-8fea-10e91478cd0d not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-23d08f8e-572c-4cc9-8ac1-9e0e0673dda0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:27.235333 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:27.248983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46a7cf53-93ef-4e15-8445-b5c92863fd76 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:27.276819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.280741 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23c31429-48d5-4312-b73b-c4d4e1faddb4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.282465 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23c31429-48d5-4312-b73b-c4d4e1faddb4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.4280584 Nov 05 14:50:27.290170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d18f7dac-bdf9-4e77-b55c-38a37ff627fd req-0e60ebdf-b592-4ebd-9852-6ba7da28865c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0942230 Nov 05 14:50:27.291039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44544) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.291841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:27.332188 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8826f1aa-3101-49ac-87bb-3ab8d5034117 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0401456 Nov 05 14:50:27.333375 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for d1cde6dd-2d67-47bf-9008-8bd096e3f921 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:27.341140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44546) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.359416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17057f90-432d-4863-9c62-00ee7773fab3 req-729877f9-0af7-4a1d-a6de-78264f52e604 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.360932 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-729877f9-0af7-4a1d-a6de-78264f52e604 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2221489 Nov 05 14:50:27.381319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46a7cf53-93ef-4e15-8445-b5c92863fd76 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:27.382317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.391672 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42768629-8543-42c3-81f9-41fdf901fe31 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0453107 Nov 05 14:50:27.394379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44548) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.408573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port afb02604-bc87-4a39-b84b-d63d621ce79b yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:27.547408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::288 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/470327d9-d700-40da-96a2-04eb701e7ef2/afb02604-bc87-4a39-b84b-d63d621ce79b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:27.640042 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-7ab02826-0f90-4532-87b1-2efef37b0cd2 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2596545 Nov 05 14:50:27.646302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96907265-1b41-4f3c-bf1c-35088836ac8d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:27.650984 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-96907265-1b41-4f3c-bf1c-35088836ac8d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2448254 Nov 05 14:50:27.651600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.711428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1bfaca83-0340-4ff3-aa66-407477b33539', 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'tenant_id': '86e1c5d009684c6eaa1634fb273b03cb', 'fixed_ips': [{'subnet_id': '2d1bad87-80f2-4687-95e5-3145d289743d'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:27.712411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.727819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '470327d9-d700-40da-96a2-04eb701e7ef2'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:27.731270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.737874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44552) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:27.738641 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-578cbbb9-0e95-427c-810b-ef520db39c24 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0841026 Nov 05 14:50:27.749393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-326061108', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:27.821808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.825053 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-17057f90-432d-4863-9c62-00ee7773fab3 req-80b9518d-44e8-4cde-b2b9-c2461f8dcdc6 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1718948 Nov 05 14:50:27.827141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.877331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=d1cde6dd-2d67-47bf-9008-8bd096e3f921,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:27.893387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:27.898211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.959175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Allocated IP 2001:db8::2 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/5d742be8-276f-4a4e-98b9-5ee67efa9305) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:27.990084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:27.996374 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-813d7897-7814-4638-b18d-1079ad126896 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/d1cde6dd-2d67-47bf-9008-8bd096e3f921 HTTP/1.1" status: 204 len: 168 time: 1.3879738 Nov 05 14:50:27.997020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44554) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:28.023337 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-dff79568-5ea2-4f0b-a62c-8fe753136d55 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] GET failed (client error): The resource could not be found. Nov 05 14:50:28.029877 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dff79568-5ea2-4f0b-a62c-8fe753136d55 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports/d1cde6dd-2d67-47bf-9008-8bd096e3f921 HTTP/1.1" status: 404 len: 333 time: 0.0318153 Nov 05 14:50:28.030525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44556) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:28.035454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1382514498'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:28.096295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.138982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.147473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.151504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=d4230734-010b-449e-9c56-77f77a8c925f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:28.163996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:28.168551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.170272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.196872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port 12b118ae-91cf-4890-8600-a49ab58eb3a3 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:28.200065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:28.203595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:28.227280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:28.228239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:28.230834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Pushing event updated for resources: {'Port': ['ID=5d742be8-276f-4a4e-98b9-5ee67efa9305,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:28.235303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:28.236055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.246806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:28.266414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:28.266929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 6f42e72d-8f95-4783-82a7-99edeac923fe, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:28.274812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.2350864 Nov 05 14:50:28.278670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44558) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:28.292044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:28.319266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e362339-d220-49e5-b4f9-a15a9b4bb805 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=afb02604-bc87-4a39-b84b-d63d621ce79b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:28.344922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6f42e72d-8f95-4783-82a7-99edeac923fe is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:28.362411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9f55329-353a-42c3-aa89-911cd5ebc7e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:28.364161 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f9f55329-353a-42c3-aa89-911cd5ebc7e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.0840518 Nov 05 14:50:28.365804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 6f42e72d-8f95-4783-82a7-99edeac923fe) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:28.367293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44562) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:28.378855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:28.379964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.402439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/470327d9-d700-40da-96a2-04eb701e7ef2/31b60062-9117-4649-9c0d-018e776a3bcc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:28.419876 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-10df9c33-a448-49ab-bfd8-86209e7693c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.6806679 Nov 05 14:50:28.433781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::e8 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/12b118ae-91cf-4890-8600-a49ab58eb3a3) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:28.549542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port afb02604-bc87-4a39-b84b-d63d621ce79b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:28.553353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.553493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d2c25da-0632-48e2-9a1f-d72049ea8ad0 req-d2ae05e4-7f05-4fc9-981f-095c80ce0fcc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:28.564759 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8d2c25da-0632-48e2-9a1f-d72049ea8ad0 req-d2ae05e4-7f05-4fc9-981f-095c80ce0fcc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1559825 Nov 05 14:50:28.601960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.617497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Attempting to bind port 5d742be8-276f-4a4e-98b9-5ee67efa9305 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:28.617875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Attempting to bind port 5d742be8-276f-4a4e-98b9-5ee67efa9305 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c00de80a-a60c-48dc-a668-a7d79d77e170', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:28.618328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Attempting to bind port 5d742be8-276f-4a4e-98b9-5ee67efa9305 on network 1bfaca83-0340-4ff3-aa66-407477b33539 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:28.624442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:28.626316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Checking segment: {'id': 'c00de80a-a60c-48dc-a668-a7d79d77e170', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:28.626794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.627280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Bound using segment: {'id': 'c00de80a-a60c-48dc-a668-a7d79d77e170', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:28.628933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Bound port: 5d742be8-276f-4a4e-98b9-5ee67efa9305, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c00de80a-a60c-48dc-a668-a7d79d77e170', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:28.629393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.631658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.703920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:28.706593 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8d2c25da-0632-48e2-9a1f-d72049ea8ad0 req-a3cf8e49-cb74-4b57-bd20-315401744b0a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1345799 Nov 05 14:50:28.733415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:28.741270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:28.758683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:28.771991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.813637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for afb02604-bc87-4a39-b84b-d63d621ce79b owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:28.818053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.831161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Attempting to bind port 31b60062-9117-4649-9c0d-018e776a3bcc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:28.831633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Attempting to bind port 31b60062-9117-4649-9c0d-018e776a3bcc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:28.832217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Attempting to bind port 31b60062-9117-4649-9c0d-018e776a3bcc on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:28.836564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] For port 5d742be8-276f-4a4e-98b9-5ee67efa9305, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:28.848411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:28.848924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:28.849396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.849880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:28.850420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Bound port: 31b60062-9117-4649-9c0d-018e776a3bcc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:28.850868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.856264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] For port 5d742be8-276f-4a4e-98b9-5ee67efa9305, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d742be8-276f-4a4e-98b9-5ee67efa9305,segment=NetworkSegment(c00de80a-a60c-48dc-a668-a7d79d77e170),segment_id=c00de80a-a60c-48dc-a668-a7d79d77e170)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:28.866193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.875083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:28.967523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44566) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:28.969098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1047114515', 'description': 'tempest-secgroup-smoke-1047114515 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:28.986860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=12b118ae-91cf-4890-8600-a49ab58eb3a3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.004789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:29.006167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978a25cd-d0bc-443c-8be0-e8b2b6c51c5d None None] Pushing event updated for resources: {'Port': ['ID=5d742be8-276f-4a4e-98b9-5ee67efa9305,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.010278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:29.015088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:29.024124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:29.026334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:29.026955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.033517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:29.040942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.050597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.079387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.079761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-363a11fb-0de8-4e96-bb5c-0756fbd0dcea tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 1.0480747 Nov 05 14:50:29.087755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44568) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.094364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::197', 'mac_address': 'fa:16:3e:84:48:b1'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:29.140776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67aaf94-8526-4fbf-9565-f5183725ea4f None None] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.214076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.219580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/afb02604-bc87-4a39-b84b-d63d621ce79b HTTP/1.1" status: 204 len: 168 time: 0.8511670 Nov 05 14:50:29.231505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7253dac-d076-44ed-ab43-0dd8aae90d1d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=afb02604-bc87-4a39-b84b-d63d621ce79b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.235794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44570) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.312089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7efb7b98-95f5-450e-8689-dcec6eec9b8c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:29.313789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7efb7b98-95f5-450e-8689-dcec6eec9b8c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:29.318496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7efb7b98-95f5-450e-8689-dcec6eec9b8c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.0774939 Nov 05 14:50:29.319091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44572) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.328329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.340907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.390230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 470327d9-d700-40da-96a2-04eb701e7ef2 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:29.401418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.422646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.426595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4588175 Nov 05 14:50:29.426595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35844325-e232-46e3-a2c7-a93c2798c0e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=42954ef8-ab29-4452-bffd-71e70483489f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.427174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44574) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.441071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:29.454338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.478752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.584684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.614001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.684914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.719411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=470327d9-d700-40da-96a2-04eb701e7ef2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:29.721417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:29.726844 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-31d52f34-cd14-4293-a8b8-7971f30304a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/470327d9-d700-40da-96a2-04eb701e7ef2 HTTP/1.1" status: 204 len: 168 time: 0.4042802 Nov 05 14:50:29.727151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44578) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.769403 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-13fa3ee4-0af6-40ed-8aa1-a900235b222c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0389435 Nov 05 14:50:29.770646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44580) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.821533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce372b55-af8c-4139-bff1-9a427c85a8a2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:29.825736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ce372b55-af8c-4139-bff1-9a427c85a8a2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0516701 Nov 05 14:50:29.826043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44582) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.887355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac2abdea-8c82-4970-8fa7-488cf01c9f75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:29.892496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ac2abdea-8c82-4970-8fa7-488cf01c9f75 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0614636 Nov 05 14:50:29.893109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44584) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.938986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-13c5faf0-fd5c-47ee-8987-200d747a5ee9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0445745 Nov 05 14:50:29.944219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44586) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:29.950194 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:30.052553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:30.056442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.092069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24823d51-0c94-4b56-a078-5dd7f6561023 req-69f7b8ed-b9d4-4325-aea9-64f342c67227 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:30.094198 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-24823d51-0c94-4b56-a078-5dd7f6561023 req-69f7b8ed-b9d4-4325-aea9-64f342c67227 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1103241 Nov 05 14:50:30.103646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.123082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.170002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=84534bff-21ae-46fc-8633-51765a628d89,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.193862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.194402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Provisioning complete for port 5d742be8-276f-4a4e-98b9-5ee67efa9305 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:30.195119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.195359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b36d6491-2df8-43b6-9a55-e36b860729ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7673535 Nov 05 14:50:30.206170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44588) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.211896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:30.223193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.235391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.263396 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-24823d51-0c94-4b56-a078-5dd7f6561023 req-fd21483d-6941-4185-ab15-246d05bbaef1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1528392 Nov 05 14:50:30.304371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] In _notify_port_updated(), no bound segment for port 12b118ae-91cf-4890-8600-a49ab58eb3a3 on network 1bfaca83-0340-4ff3-aa66-407477b33539 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:50:30.307959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.310372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:30.311196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.315561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "PUT /v2.0/ports/12b118ae-91cf-4890-8600-a49ab58eb3a3 HTTP/1.1" status: 200 len: 1002 time: 1.2263043 Nov 05 14:50:30.318713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.348845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] For port 5d742be8-276f-4a4e-98b9-5ee67efa9305, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d742be8-276f-4a4e-98b9-5ee67efa9305,segment=NetworkSegment(c00de80a-a60c-48dc-a668-a7d79d77e170),segment_id=c00de80a-a60c-48dc-a668-a7d79d77e170)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:30.358481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.364263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Could not find standard attr ID for object d1cde6dd-2d67-47bf-9008-8bd096e3f921. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:30.378410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.412816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211fdb13-8bbd-4175-8257-8158de7fb752 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=12b118ae-91cf-4890-8600-a49ab58eb3a3,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.418678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Provisioning complete for port 62ee1366-4cb1-48c5-ba61-ca96fb766084 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:30.419624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.425890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:30.450123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Pushing event updated for resources: {'Port': ['ID=5d742be8-276f-4a4e-98b9-5ee67efa9305,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.463687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-02819eb8-fac0-4a13-b1c7-faf7e7c0157a None None] Port 62ee1366-4cb1-48c5-ba61-ca96fb766084 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:30.482133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.487370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.517939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f41dfc2a-dc1e-4654-a562-353ac1ffb4f6,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.527074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.528657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9b9d56b0-1f3f-467d-8160-cc11b66f0fc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3214364 Nov 05 14:50:30.531745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44592) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.533754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 12b118ae-91cf-4890-8600-a49ab58eb3a3 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:30.534099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.558821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:30.627806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.634930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.646499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.649726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 12b118ae-91cf-4890-8600-a49ab58eb3a3 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:30.690396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04a572c7-15f0-483e-a783-4d119a0f604d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:30.724363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.734190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.795929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd1f553a-bd6b-4693-baef-fb683bea9f34,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.797390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.808689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.813554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0d1e4915-4075-4de2-97cb-e47ce32b4d79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2807295 Nov 05 14:50:30.814854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44594) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.817856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Provisioning complete for port 5d742be8-276f-4a4e-98b9-5ee67efa9305 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:30.818256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.827440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:30.829645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=12b118ae-91cf-4890-8600-a49ab58eb3a3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:30.851936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04a572c7-15f0-483e-a783-4d119a0f604d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:30.890045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:30.891927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.927583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.931255 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d38d068a-2223-4645-af55-f841780f5c4e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/12b118ae-91cf-4890-8600-a49ab58eb3a3 HTTP/1.1" status: 204 len: 168 time: 0.6062777 Nov 05 14:50:30.933889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44596) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.950143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.958863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.959541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:30.959905 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-3ce26eb4-bacd-4beb-97c0-858ac21d710b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] GET failed (client error): The resource could not be found. Nov 05 14:50:30.965089 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3ce26eb4-bacd-4beb-97c0-858ac21d710b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports/12b118ae-91cf-4890-8600-a49ab58eb3a3 HTTP/1.1" status: 404 len: 333 time: 0.0265248 Nov 05 14:50:30.965656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44598) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:30.975321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-2025440284'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.002361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Could not find standard attr ID for object d1cde6dd-2d67-47bf-9008-8bd096e3f921. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:31.044854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.053699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:31.054223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.055276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:31.063734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.065721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:31.083021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:31.084109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.093634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=1781de4d-f1e3-490e-afc1-53421e38642b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.111650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=5']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.117807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c7ec8894-2131-4e2a-97a6-5f2808c48529,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.120818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:31.129553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.130162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.134527 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c3610b09-8e8c-4b03-ab6b-9b4c6704f227 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3162355 Nov 05 14:50:31.135158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44600) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:31.140528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-34294ea0-e242-4616-b293-969debfd78fb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.1927075 Nov 05 14:50:31.142468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44602) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:31.145713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.148022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.202313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port 552c16fc-748f-43e8-ba21-80ca0721c9c1 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:31.313968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:50:31.325381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.337003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:31.341498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.380900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d742be8-276f-4a4e-98b9-5ee67efa9305 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:31.396494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::18f (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/552c16fc-748f-43e8-ba21-80ca0721c9c1) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:31.418636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.418993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.430262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.481831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b6233f0-7517-4cf2-90c1-16da500b8531,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.495037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-6f42e72d-8f95-4783-82a7-99edeac923fe', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': 'd4230734-010b-449e-9c56-77f77a8c925f'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:31.496042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.500309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e166593-a96d-46d4-8c3e-8accb6f8ad4f req-77ba5243-643b-4cad-8258-e70892e8d962 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:31.509125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:31.513892 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e166593-a96d-46d4-8c3e-8accb6f8ad4f req-77ba5243-643b-4cad-8258-e70892e8d962 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1164894 Nov 05 14:50:31.526430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.551300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 1781de4d-f1e3-490e-afc1-53421e38642b (CIDR: 2001:db8::/64) Nov 05 14:50:31.559333 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:31.560089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:31.575033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5d742be8-276f-4a4e-98b9-5ee67efa9305 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:31.575574 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.600415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.604607 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4dafe142-6768-4dfd-b23b-b2afab4907a4 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4588442 Nov 05 14:50:31.605155 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-520e6097-9014-4ab0-bc17-b7817fe86ef1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4689915 Nov 05 14:50:31.607730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44606) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:31.608678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44608) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:31.614488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '42954ef8-ab29-4452-bffd-71e70483489f', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.634618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.673071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.675507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Provisioning complete for port 62ee1366-4cb1-48c5-ba61-ca96fb766084 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:31.675916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.709078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.743485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.750610 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e166593-a96d-46d4-8c3e-8accb6f8ad4f req-540a57fb-83ae-4fda-aab1-50ccfd0b60f3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2345858 Nov 05 14:50:31.781769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-3077e01a-8a84-4e53-86e1-95e473b38f00 None None] Port 62ee1366-4cb1-48c5-ba61-ca96fb766084 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:31.788762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:50:31.798154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.838099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Allocated IP 172.20.0.18 (6f42e72d-8f95-4783-82a7-99edeac923fe/d4230734-010b-449e-9c56-77f77a8c925f/a477d1f0-5a76-432d-af07-9809ef4dce8f) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:31.844936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:31.867158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:31.868653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=552c16fc-748f-43e8-ba21-80ca0721c9c1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.871488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:31.874455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:31.878112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.881135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:31.881906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.896819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.917978 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-13b79dac-b9f4-4d7e-828e-cc00a63d1942 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 0.9511364 Nov 05 14:50:31.920961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44610) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:31.929108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:84:48:b1'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:31.935002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4da3cec-4006-4908-b54e-0fbbc72a853e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:31.943075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:31.944967 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-364772ae-0dd4-4fd7-89c9-62e707f2c591 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3350520 Nov 05 14:50:32.021015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:32.021632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.032711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:32.037419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.084333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.130828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.143710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.263082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Network 6f42e72d-8f95-4783-82a7-99edeac923fe is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:32.270883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:32.273318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:32.280992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Pushing event updated for resources: {'Port': ['ID=a477d1f0-5a76-432d-af07-9809ef4dce8f,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:32.355389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Attempting to bind port a477d1f0-5a76-432d-af07-9809ef4dce8f on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:32.355916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Attempting to bind port a477d1f0-5a76-432d-af07-9809ef4dce8f by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:32.356383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Attempting to bind port a477d1f0-5a76-432d-af07-9809ef4dce8f on network 6f42e72d-8f95-4783-82a7-99edeac923fe {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:32.362986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:32.363528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Checking segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:32.364045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.364567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Bound using segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:32.365152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Bound port: a477d1f0-5a76-432d-af07-9809ef4dce8f, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:32.365751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.447212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] For port a477d1f0-5a76-432d-af07-9809ef4dce8f, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:32.448775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-df12e9a9-163f-43ac-bbd2-fabd1ec0113f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1047114515&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.1912644 Nov 05 14:50:32.453069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] For port a477d1f0-5a76-432d-af07-9809ef4dce8f, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a477d1f0-5a76-432d-af07-9809ef4dce8f,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:32.465522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.546776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e5cc64-b359-438c-88d0-ed3bc18c881b None None] Pushing event updated for resources: {'Port': ['ID=a477d1f0-5a76-432d-af07-9809ef4dce8f,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:32.565666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.575373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.628180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2a7747c6-53f3-4b7d-9845-58c80dbb8585 None None] Provisioning complete for port 5d742be8-276f-4a4e-98b9-5ee67efa9305 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:32.630666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2a7747c6-53f3-4b7d-9845-58c80dbb8585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.636529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] In _notify_port_updated(), no bound segment for port 552c16fc-748f-43e8-ba21-80ca0721c9c1 on network 1bfaca83-0340-4ff3-aa66-407477b33539 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:50:32.646912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:32.647596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.648967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "PUT /v2.0/ports/552c16fc-748f-43e8-ba21-80ca0721c9c1 HTTP/1.1" status: 200 len: 1003 time: 0.7268248 Nov 05 14:50:32.651804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44624) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:32.667297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300d93e8-bfcb-4e2a-8c65-5e17141bc284 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=552c16fc-748f-43e8-ba21-80ca0721c9c1,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:32.703852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-706a7827-d908-4989-9ab6-ad423f2fb1be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:32.705444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-706a7827-d908-4989-9ab6-ad423f2fb1be tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=6f42e72d-8f95-4783-82a7-99edeac923fe HTTP/1.1" status: 200 len: 796 time: 0.2459874 Nov 05 14:50:32.722501 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-f7c74903-2d13-48b3-81f5-501a787419fb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0104721 Nov 05 14:50:32.748975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2a7747c6-53f3-4b7d-9845-58c80dbb8585 None None] Provisioning complete for port 62ee1366-4cb1-48c5-ba61-ca96fb766084 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:32.749685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2a7747c6-53f3-4b7d-9845-58c80dbb8585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.803588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-2a7747c6-53f3-4b7d-9845-58c80dbb8585 None None] Port 62ee1366-4cb1-48c5-ba61-ca96fb766084 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:32.869360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-2d706d9c-a3ed-4f18-8ccd-17823626f510 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1394632 Nov 05 14:50:32.933018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 552c16fc-748f-43e8-ba21-80ca0721c9c1 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:32.935204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:32.941054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a020362d-f0ad-4536-b314-e661c06ee90e None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:32.941667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a020362d-f0ad-4536-b314-e661c06ee90e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.036214 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-f414d8fa-4822-449e-a973-2c01a3f6423b service neutron] 10.222.0.30 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1582806 Nov 05 14:50:33.053579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f845a4c1-36d5-4918-9a22-671559387baa req-29e1ce7b-89b8-4532-827e-2d7f1264c0b6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:33.055076 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f845a4c1-36d5-4918-9a22-671559387baa req-29e1ce7b-89b8-4532-827e-2d7f1264c0b6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1867592 Nov 05 14:50:33.156254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.157034 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-8db8f392-1f40-4cf1-b618-270a948f0755 service neutron] 10.222.0.30 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1140969 Nov 05 14:50:33.172304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f845a4c1-36d5-4918-9a22-671559387baa req-d1e45772-94ea-43d7-aa09-f0fcb1d23d27 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1088188 Nov 05 14:50:33.175192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.184716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 552c16fc-748f-43e8-ba21-80ca0721c9c1 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:33.214281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:33.239217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:33.268725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:33.269102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.280163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:33.284591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:33.285203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.287443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:33.339391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44634) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:33.339946 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-609c76ce-a18b-4841-bdb3-c0d04f0fc568 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7098594 Nov 05 14:50:33.344806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:58:f9:6f', 'name': 'tempest-NetworksTestDHCPv6-251339673'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:33.378383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a477d1f0-5a76-432d-af07-9809ef4dce8f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:33.385760 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-57dd6e6d-b188-496e-bc97-895c2ef40cee req-aac81b1a-22f8-4778-b038-c602d892eb30 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 210 time: 0.0545218 Nov 05 14:50:33.457789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a477d1f0-5a76-432d-af07-9809ef4dce8f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:33.458361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.459792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.502955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=552c16fc-748f-43e8-ba21-80ca0721c9c1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:33.546249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.549639 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8167cd76-1208-4b2d-a691-74af930483a8 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/552c16fc-748f-43e8-ba21-80ca0721c9c1 HTTP/1.1" status: 204 len: 168 time: 0.8966396 Nov 05 14:50:33.553572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44638) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:33.581495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.589068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:33.598085 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-e32166cf-84bd-464e-90af-559ec2fe1bb3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] GET failed (client error): The resource could not be found. Nov 05 14:50:33.603370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e32166cf-84bd-464e-90af-559ec2fe1bb3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports/552c16fc-748f-43e8-ba21-80ca0721c9c1 HTTP/1.1" status: 404 len: 333 time: 0.0455019 Nov 05 14:50:33.603882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44642) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:33.610670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-157803190'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:33.630149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port a477d1f0-5a76-432d-af07-9809ef4dce8f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a477d1f0-5a76-432d-af07-9809ef4dce8f,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:33.637699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.700924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.707299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=a477d1f0-5a76-432d-af07-9809ef4dce8f,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:33.733304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port ab4213b2-b456-40ba-94f9-2bbd8345a17e yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:33.795324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:33.799402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:33.828521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port 915f1660-cfd2-4a75-a934-fe2e0f3d4178 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:33.896395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7c87a63-fd8d-45e5-8234-eb981db28515 None None] Network 6f42e72d-8f95-4783-82a7-99edeac923fe requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:33.950114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8:0:1::2fb (b10e20e9-e25a-4832-bd50-e158aa6d5da9/232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095/ab4213b2-b456-40ba-94f9-2bbd8345a17e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:33.963807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fe58:f96f (b10e20e9-e25a-4832-bd50-e158aa6d5da9/1781de4d-f1e3-490e-afc1-53421e38642b/ab4213b2-b456-40ba-94f9-2bbd8345a17e) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:34.004891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::346 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/915f1660-cfd2-4a75-a934-fe2e0f3d4178) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:34.080111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Provisioning complete for port 5d742be8-276f-4a4e-98b9-5ee67efa9305 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:34.080385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f7c87a63-fd8d-45e5-8234-eb981db28515 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:34.199712 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:34.232096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-813bdced-36c0-4643-866a-82b513492d13 None None] Network 6f42e72d-8f95-4783-82a7-99edeac923fe requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:34.246437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.254901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.304837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff324242-b2d7-4ccd-a99f-4694147f6adf None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:34.306318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.350099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-813bdced-36c0-4643-866a-82b513492d13 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:34.392166 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:34.396539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:34.397310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:34.405104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:34.408802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:34.409177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.409510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:34.415937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:34.416671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.424442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:34.428642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=915f1660-cfd2-4a75-a934-fe2e0f3d4178,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:34.443162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:34.450834 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-26bc6da4-2eba-4ce3-b0da-5d4aad923157 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.8427317 Nov 05 14:50:34.451211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44650) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:34.456807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'network_id': '1bfaca83-0340-4ff3-aa66-407477b33539', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-2011109526'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:34.460801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:34.461844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ff324242-b2d7-4ccd-a99f-4694147f6adf None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:34.486503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:34.498094 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.1575391 Nov 05 14:50:34.500866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44652) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:34.503005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8f5496-e2bd-43b8-8470-48198ea396dc tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=ab4213b2-b456-40ba-94f9-2bbd8345a17e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:34.531543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d230533-de26-49c3-a9cf-fc622381e884 req-7f1ca692-d27c-46e8-a0c7-2f552d94094b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:34.533643 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3d230533-de26-49c3-a9cf-fc622381e884 req-7f1ca692-d27c-46e8-a0c7-2f552d94094b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1689420 Nov 05 14:50:34.537197 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-74275c3a-f75f-4a5d-8a80-f2cdd7178bec req-819b51ab-7b29-488c-bdf3-dfd0b9d20eed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 210 time: 0.0477693 Nov 05 14:50:34.547021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9d22256-dbf3-4af0-91c3-33f69d79421a None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:34.612322 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3d230533-de26-49c3-a9cf-fc622381e884 req-e84f252a-5e64-4391-a744-59a61e4f0a48 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0640767 Nov 05 14:50:34.663099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Provisioning complete for port 62ee1366-4cb1-48c5-ba61-ca96fb766084 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:34.663530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c9d22256-dbf3-4af0-91c3-33f69d79421a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:34.697277 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:34.711447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Port 62ee1366-4cb1-48c5-ba61-ca96fb766084 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:34.724224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port ab4213b2-b456-40ba-94f9-2bbd8345a17e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:34.724737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.729310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Made reservation on behalf of 86e1c5d009684c6eaa1634fb273b03cb for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:34.734206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.738208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Provisioning complete for port a477d1f0-5a76-432d-af07-9809ef4dce8f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:34.739648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-274f3230-00c9-4619-8e9a-239d5abe56a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.794121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] device_id is not set on port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:34.921838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:34.931301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-6d46525b-0f9b-4614-ac10-56316ce200ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:34.932998 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-6d46525b-0f9b-4614-ac10-56316ce200ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=6f42e72d-8f95-4783-82a7-99edeac923fe HTTP/1.1" status: 200 len: 796 time: 0.2111759 Nov 05 14:50:34.936675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for ab4213b2-b456-40ba-94f9-2bbd8345a17e owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:35.001253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0badfce2-45e0-4617-8be6-d66b9b12d561 None None] Could not find standard attr ID for object afb02604-bc87-4a39-b84b-d63d621ce79b. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:35.008507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0badfce2-45e0-4617-8be6-d66b9b12d561 None None] Could not find standard attr ID for object 552c16fc-748f-43e8-ba21-80ca0721c9c1. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:35.018840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0badfce2-45e0-4617-8be6-d66b9b12d561 None None] Could not find standard attr ID for object 12b118ae-91cf-4890-8600-a49ab58eb3a3. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:35.048316 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-1e5de53b-5237-49f2-9453-9cadb21d6c65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 472 time: 0.1022208 Nov 05 14:50:35.061355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': '8ccb1947-4372-43f9-9682-a1da870699eb', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['42954ef8-ab29-4452-bffd-71e70483489f']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:35.088092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Allocated IP 2001:db8::397 (1bfaca83-0340-4ff3-aa66-407477b33539/2d1bad87-80f2-4687-95e5-3145d289743d/0b65d60e-bc87-44a2-ac88-7d6de5de8d4b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:35.134652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a477d1f0-5a76-432d-af07-9809ef4dce8f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:35.186779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-76a206db-7fb6-46fd-81c5-7f250bbffe2d None None] Provisioning complete for port 915f1660-cfd2-4a75-a934-fe2e0f3d4178 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:35.187155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-76a206db-7fb6-46fd-81c5-7f250bbffe2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.225755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:35.230696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.241883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a477d1f0-5a76-432d-af07-9809ef4dce8f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:35.242254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.256068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-76a206db-7fb6-46fd-81c5-7f250bbffe2d None None] Port 915f1660-cfd2-4a75-a934-fe2e0f3d4178 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:35.397169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d6825f47-d2a0-48f2-bab7-f8fe0e8d06de None None] Provisioning complete for port ab4213b2-b456-40ba-94f9-2bbd8345a17e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:35.397983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d6825f47-d2a0-48f2-bab7-f8fe0e8d06de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.423833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.437098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.19 (6f42e72d-8f95-4783-82a7-99edeac923fe/d4230734-010b-449e-9c56-77f77a8c925f/366f1e82-fb2b-41b4-90d6-dd5896e338bf) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:35.440189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d6825f47-d2a0-48f2-bab7-f8fe0e8d06de None None] Port ab4213b2-b456-40ba-94f9-2bbd8345a17e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:35.455187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.497573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=ab4213b2-b456-40ba-94f9-2bbd8345a17e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:35.562752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d6fd758f-b263-424c-912f-06339c265d4b None None] Could not find standard attr ID for object 12b118ae-91cf-4890-8600-a49ab58eb3a3. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:35.575780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.580386 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-002542bf-6422-464b-a1dd-e2aafff58934 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ab4213b2-b456-40ba-94f9-2bbd8345a17e HTTP/1.1" status: 204 len: 168 time: 1.0513659 Nov 05 14:50:35.582291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.584486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44660) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:35.672711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Network 1bfaca83-0340-4ff3-aa66-407477b33539 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:35.690539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.718838 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ceb40e93-9cc0-40ff-8ca7-b6a58e040ee6 req-129b0272-7873-4ae1-8cc1-88add010c982 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 210 time: 0.0662212 Nov 05 14:50:35.722895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:35.730524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:35.738368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:35.739110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.746844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=0b65d60e-bc87-44a2-ac88-7d6de5de8d4b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:35.758362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c14860b4-dd5b-4693-8565-03add30cf1a5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:35.759964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c14860b4-dd5b-4693-8565-03add30cf1a5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.1744745 Nov 05 14:50:35.762806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44664) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:35.780478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44666) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:35.782133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d1d3046a-90fc-4d5a-a9ee-e9734f96171b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.3241107 Nov 05 14:50:35.799474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::197', 'mac_address': 'fa:16:3e:84:48:b1'}, {'ip_address': '2001:db8::346', 'mac_address': 'fa:16:3e:90:ae:42'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:35.832259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:35.912608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80cd2fe-83f6-4eab-af2c-671cf8647b34 req-c7336fb6-2054-45b6-9ba7-c254c27d0ed9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:35.914148 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d80cd2fe-83f6-4eab-af2c-671cf8647b34 req-c7336fb6-2054-45b6-9ba7-c254c27d0ed9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1965015 Nov 05 14:50:35.954354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9050775-7776-4555-b120-7acc6962c8df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:35.955858 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9050775-7776-4555-b120-7acc6962c8df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.1905727 Nov 05 14:50:35.957898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6f42e72d-8f95-4783-82a7-99edeac923fe is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:35.958718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44668) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:35.975748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:35.983180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:35.997709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:36.019111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1da3b424-0926-4b9f-b778-c54e28aa1c4c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.021169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1da3b424-0926-4b9f-b778-c54e28aa1c4c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.023118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1da3b424-0926-4b9f-b778-c54e28aa1c4c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.027797 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1da3b424-0926-4b9f-b778-c54e28aa1c4c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0680373 Nov 05 14:50:36.028612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44670) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:36.085780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 1781de4d-f1e3-490e-afc1-53421e38642b {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:36.089326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.094662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.095309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.109628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-434e5814-501a-42fd-a94a-d29778a1ed88 None None] Provisioning complete for port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:36.109975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-434e5814-501a-42fd-a94a-d29778a1ed88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.110890 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d80cd2fe-83f6-4eab-af2c-671cf8647b34 req-0c1ac58f-2803-42fc-ad73-b211289e47b7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1518672 Nov 05 14:50:36.148236 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-a52c5ae9-f1d5-4ab9-8c90-00c186486693 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0925124 Nov 05 14:50:36.148855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.163857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-434e5814-501a-42fd-a94a-d29778a1ed88 None None] Port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:36.164981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.187818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Request body: {'port': {'device_id': '8ccb1947-4372-43f9-9682-a1da870699eb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:36.260839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.289298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.331531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.362393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=1781de4d-f1e3-490e-afc1-53421e38642b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:36.368325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.371707 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b98f31be-6fe9-44bc-94e4-8430f9d77ab6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/1781de4d-f1e3-490e-afc1-53421e38642b HTTP/1.1" status: 204 len: 168 time: 0.3419368 Nov 05 14:50:36.374874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44672) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:36.397320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-825d66c4-35af-41da-ad97-eb46c294f12c None None] Could not find standard attr ID for object 552c16fc-748f-43e8-ba21-80ca0721c9c1. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:36.399543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-655a200b-a282-48a3-96b2-4c328dca58a6 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:36.434290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:36.439413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.463126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-825d66c4-35af-41da-ad97-eb46c294f12c None None] Provisioning complete for port 366f1e82-fb2b-41b4-90d6-dd5896e338bf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:36.463871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-825d66c4-35af-41da-ad97-eb46c294f12c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.497699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.554710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-825d66c4-35af-41da-ad97-eb46c294f12c None None] Port 366f1e82-fb2b-41b4-90d6-dd5896e338bf cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-655a200b-a282-48a3-96b2-4c328dca58a6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:36.568014 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:36.569875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.587148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.600342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.634118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.644314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] In _notify_port_updated(), no bound segment for port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b on network 1bfaca83-0340-4ff3-aa66-407477b33539 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:50:36.649300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.649927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.651213 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "PUT /v2.0/ports/0b65d60e-bc87-44a2-ac88-7d6de5de8d4b HTTP/1.1" status: 200 len: 1068 time: 0.8696661 Nov 05 14:50:36.660525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44674) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:36.663268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:36.672494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.678563 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a19d9e0e-39d6-410f-bd37-1b12d5ae42df tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095 HTTP/1.1" status: 204 len: 168 time: 0.3025420 Nov 05 14:50:36.679245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44676) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:36.721038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d2af2e-26ff-452d-9e1e-306b8dcda23c tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event updated for resources: {'Port': ['ID=0b65d60e-bc87-44a2-ac88-7d6de5de8d4b,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:36.731595 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f4e5cc83-5201-43e1-b2e6-2cd9905df8ad tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0510809 Nov 05 14:50:36.733674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44678) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:36.738874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:36.808502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 366f1e82-fb2b-41b4-90d6-dd5896e338bf {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:50:36.818006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.838764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Transition to ACTIVE for port object 366f1e82-fb2b-41b4-90d6-dd5896e338bf will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:50:36.845670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.875508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28dae75c-ed92-4f6c-a5e2-92d9eec21a76 req-81ac35ce-4872-4eb2-940b-c4efca44659f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:36.877270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28dae75c-ed92-4f6c-a5e2-92d9eec21a76 req-81ac35ce-4872-4eb2-940b-c4efca44659f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 932 time: 0.0830126 Nov 05 14:50:36.887672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:36.888010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.891328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:36.894856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:36.981858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-18a9fd57-48e7-439d-890e-1fad34fb0197 None None] Provisioning complete for port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:36.983399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18a9fd57-48e7-439d-890e-1fad34fb0197 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.001787 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28dae75c-ed92-4f6c-a5e2-92d9eec21a76 req-bed16bd7-092d-461d-b51a-dc3e343b98cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122794 Nov 05 14:50:37.026815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Pushing event updated for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:37.085985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.110777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:37.119280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Attempting to bind port 366f1e82-fb2b-41b4-90d6-dd5896e338bf on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:37.119513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Attempting to bind port 366f1e82-fb2b-41b4-90d6-dd5896e338bf by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:37.119849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Attempting to bind port 366f1e82-fb2b-41b4-90d6-dd5896e338bf on network 6f42e72d-8f95-4783-82a7-99edeac923fe {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:37.129786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Port 366f1e82-fb2b-41b4-90d6-dd5896e338bf on network 6f42e72d-8f95-4783-82a7-99edeac923fe not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:50:37.130141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Attempting to bind port 366f1e82-fb2b-41b4-90d6-dd5896e338bf on network 6f42e72d-8f95-4783-82a7-99edeac923fe {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:37.171561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:37.171905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Checking segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:37.172299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Bound using segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:37.172806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Bound port: 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:37.173168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.181334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-18a9fd57-48e7-439d-890e-1fad34fb0197 None None] Port 0b65d60e-bc87-44a2-ac88-7d6de5de8d4b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:37.185315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1078db11-d1bb-49fe-8410-815143edbd9f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:37.281810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1078db11-d1bb-49fe-8410-815143edbd9f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:37.308784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:37.310197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:37.318283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7dcc96-d505-47a9-8b0a-abbbc93e51d2 req-402f3813-cc1a-43fe-8cef-e809ac69251a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:37.320671 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ea7dcc96-d505-47a9-8b0a-abbbc93e51d2 req-402f3813-cc1a-43fe-8cef-e809ac69251a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 944 time: 0.1003366 Nov 05 14:50:37.322514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:37.331405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.415691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:37.416309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.417736 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] 10.222.0.32 "PUT /v2.0/ports/366f1e82-fb2b-41b4-90d6-dd5896e338bf HTTP/1.1" status: 200 len: 1094 time: 1.2382376 Nov 05 14:50:37.418992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:50:37.420851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0762c073-2dd3-4537-acfa-6bedaeb92c35" -d '{"events": [{"name": "network-changed", "server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:50:37.486086 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:50:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b4ee48e-4e35-41d3-82ba-2c6c3d1f5c22 x-openstack-request-id: req-6b4ee48e-4e35-41d3-82ba-2c6c3d1f5c22 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:50:37.486514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:50:37.486855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6b4ee48e-4e35-41d3-82ba-2c6c3d1f5c22 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:50:37.487342 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf', 'status': 'completed', 'code': 200} Nov 05 14:50:37.520209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.521231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb90e087-aba2-4d5b-ac0d-2a58ee2985b5 service neutron] Pushing event updated for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:37.543293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.551951 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ea7dcc96-d505-47a9-8b0a-abbbc93e51d2 req-2a9cecef-7c8b-46b2-9be1-ea41a2870768 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2220461 Nov 05 14:50:37.689925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:37.723456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.730522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.731330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.825516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=5ebac38e-0a1c-4f32-8dda-652caf8c9f83,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:37.829140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:37.833282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:37.838700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:37.839404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:37.856305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=9']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:37.866834 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-22847281-1586-453d-86fd-c4d13d089f95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.1318955 Nov 05 14:50:37.869705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44686) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:37.875900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:37.916651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=0b65d60e-bc87-44a2-ac88-7d6de5de8d4b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:37.948520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-6edcd934-7f12-4238-8b3d-ce9427655b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:37.950039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-6edcd934-7f12-4238-8b3d-ce9427655b6b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 1097 time: 0.4618704 Nov 05 14:50:37.999929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:38.001531 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-69a35b02-98ea-4929-80ae-e0b5cd550086 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf HTTP/1.1" status: 200 len: 217 time: 0.0419767 Nov 05 14:50:38.004103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.083637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 958cd8d3-99e2-4811-9479-162a57c857cb details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:50:38.121682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-9fed050b-f667-4951-8673-59b18cd3c981 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:38.123063 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-9fed050b-f667-4951-8673-59b18cd3c981 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d4230734-010b-449e-9c56-77f77a8c925f HTTP/1.1" status: 200 len: 837 time: 0.1121492 Nov 05 14:50:38.152164 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 5ebac38e-0a1c-4f32-8dda-652caf8c9f83 (CIDR: 2001:db8::/64) Nov 05 14:50:38.155342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baf60ce8-61da-4b2b-a09b-a4a1b5377b6f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:38.160361 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:38.164931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:38.190355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.191327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd883fa9-54b3-4d79-a3d1-02d7164db11d req-355f0033-9bf3-46ba-9544-d278c7ec182d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:38.193515 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f2714a24-40f9-41e5-93f6-7ad508360ad7 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/0b65d60e-bc87-44a2-ac88-7d6de5de8d4b HTTP/1.1" status: 204 len: 168 time: 1.5320313 Nov 05 14:50:38.196257 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cd883fa9-54b3-4d79-a3d1-02d7164db11d req-355f0033-9bf3-46ba-9544-d278c7ec182d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 944 time: 0.0884666 Nov 05 14:50:38.196410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44690) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:38.207702 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-89e9d6ea-ac57-487f-8c7f-957f9680ed23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3342133 Nov 05 14:50:38.209368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44692) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:38.227100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:38.233040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ff58cb6a-2e13-4c1d-ad0d-851ea88dae54 None None] Provisioning complete for port a477d1f0-5a76-432d-af07-9809ef4dce8f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:38.234077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ff58cb6a-2e13-4c1d-ad0d-851ea88dae54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.234972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-042e94b0-4111-445a-83e8-39a46b280ab9 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] GET failed (client error): The resource could not be found. Nov 05 14:50:38.236547 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-042e94b0-4111-445a-83e8-39a46b280ab9 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports/0b65d60e-bc87-44a2-ac88-7d6de5de8d4b HTTP/1.1" status: 404 len: 333 time: 0.0393298 Nov 05 14:50:38.240442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44694) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:38.279241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cd693c4d-48e9-4593-86db-1ccb93bb8df1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:38.281360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-cd693c4d-48e9-4593-86db-1ccb93bb8df1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=6f42e72d-8f95-4783-82a7-99edeac923fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1385486 Nov 05 14:50:38.292370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cd883fa9-54b3-4d79-a3d1-02d7164db11d req-3720e94e-0feb-4d8f-b172-e7de4f6f2589 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859158 Nov 05 14:50:38.309800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=958cd8d3-99e2-4811-9479-162a57c857cb,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:38.334916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '958cd8d3-99e2-4811-9479-162a57c857cb', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'port_id': '958cd8d3-99e2-4811-9479-162a57c857cb', 'mac_address': 'fa:16:3e:dc:82:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 644, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:50:38.358079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 915f1660-cfd2-4a75-a934-fe2e0f3d4178 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:38.358576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.415931 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-03dff394-b0c2-4e29-8b59-6654e19e5e63 service neutron] 10.222.0.32 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251421 Nov 05 14:50:38.417663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:38.421631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.438456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baf60ce8-61da-4b2b-a09b-a4a1b5377b6f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:38.441811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.468288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.473957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 958cd8d3-99e2-4811-9479-162a57c857cb {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:50:38.483653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 915f1660-cfd2-4a75-a934-fe2e0f3d4178 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:38.501840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=958cd8d3-99e2-4811-9479-162a57c857cb,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:38.541095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.586991 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0f0d8aa8-1579-4529-bd82-8318fd5aeec9 req-315938d5-044f-481d-9d11-98f0d83da80e service neutron] 10.222.0.32 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1615710 Nov 05 14:50:38.627628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:38.682295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.712226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=915f1660-cfd2-4a75-a934-fe2e0f3d4178,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:38.746372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.750889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3826fd64-b448-4035-b2d8-8e4627c3747f tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/915f1660-cfd2-4a75-a934-fe2e0f3d4178 HTTP/1.1" status: 204 len: 168 time: 0.5082009 Nov 05 14:50:38.752603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44698) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:38.779183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['958cd8d3-99e2-4811-9479-162a57c857cb'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:50:38.780504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c06b1a2-8175-4109-a68f-792f08a6cb07 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] GET failed (client error): The resource could not be found. Nov 05 14:50:38.785290 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3c06b1a2-8175-4109-a68f-792f08a6cb07 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "GET /v2.0/ports/915f1660-cfd2-4a75-a934-fe2e0f3d4178 HTTP/1.1" status: 404 len: 333 time: 0.0283401 Nov 05 14:50:38.785943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44700) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:38.795801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-900b3253-20bd-43ab-a9ca-a7abd9d64938 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:38.796259 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-900b3253-20bd-43ab-a9ca-a7abd9d64938 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 1097 time: 0.1442058 Nov 05 14:50:38.808141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-893d4e0c-db8b-4e96-a6c1-9c2671e40345 req-b5ab055f-efde-40e7-830f-c47a2f9ef24f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:38.809770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-893d4e0c-db8b-4e96-a6c1-9c2671e40345 req-b5ab055f-efde-40e7-830f-c47a2f9ef24f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 945 time: 0.1632955 Nov 05 14:50:38.892875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 62ee1366-4cb1-48c5-ba61-ca96fb766084 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:38.893215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.969241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:38.974726 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-893d4e0c-db8b-4e96-a6c1-9c2671e40345 req-c3bfd2c5-b148-49df-a0cf-6569ab26be4d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1541579 Nov 05 14:50:39.028784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.038319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-85d9b66e-7104-44a3-929a-35f2ea145ffc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:39.041432 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-85d9b66e-7104-44a3-929a-35f2ea145ffc service neutron] 10.222.0.32 "GET /v2.0/networks?id=6f42e72d-8f95-4783-82a7-99edeac923fe HTTP/1.1" status: 200 len: 897 time: 0.2311957 Nov 05 14:50:39.054919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 62ee1366-4cb1-48c5-ba61-ca96fb766084 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:39.066059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:39.079881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:39.155858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:39.156473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.167234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:39.171812 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-e42aaf69-58e8-4546-988f-5724a5b5a645 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf HTTP/1.1" status: 200 len: 217 time: 0.1171556 Nov 05 14:50:39.179269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=5dbf5b48-77d8-40dd-a460-c16291e3adac,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:39.237590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:39.240901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.241057 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-43f08de3-ab70-4ce5-a628-69de1138ef70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.0150559 Nov 05 14:50:39.245146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44702) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:39.253258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:e3:b7:ed', 'name': 'tempest-NetworksTestDHCPv6-909359031'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:39.303516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.330209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-35655d71-2971-4e0c-ac64-cff106241b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:39.334311 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-35655d71-2971-4e0c-ac64-cff106241b10 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d4230734-010b-449e-9c56-77f77a8c925f HTTP/1.1" status: 200 len: 837 time: 0.1461053 Nov 05 14:50:39.335048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=62ee1366-4cb1-48c5-ba61-ca96fb766084,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:39.373683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.379527 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e2ad7dff-79ca-49f0-9076-a8ee5b698da3 tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/ports/62ee1366-4cb1-48c5-ba61-ca96fb766084 HTTP/1.1" status: 204 len: 168 time: 0.5925915 Nov 05 14:50:39.380155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:39.453449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-fdbbd6ab-2a62-4d0a-8ae2-f1eeef764bfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:39.454967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-fdbbd6ab-2a62-4d0a-8ae2-f1eeef764bfa service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=6f42e72d-8f95-4783-82a7-99edeac923fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1072371 Nov 05 14:50:39.484152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting subnet 2d1bad87-80f2-4687-95e5-3145d289743d {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:39.484416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.535180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cc80a3-4d05-4ce8-b6e9-50bf3c544d6f req-d00bc858-ff79-4a70-9f00-d90f5ec7f657 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:39.536800 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84cc80a3-4d05-4ce8-b6e9-50bf3c544d6f req-d00bc858-ff79-4a70-9f00-d90f5ec7f657 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 944 time: 0.1165445 Nov 05 14:50:39.562589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:39.568625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.623864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-bdeb6543-8ecd-4885-b52b-4e84fd94535b service neutron] 10.222.0.32 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1580873 Nov 05 14:50:39.633755 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84cc80a3-4d05-4ce8-b6e9-50bf3c544d6f req-32059788-d788-432f-858b-b962489d618f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0901132 Nov 05 14:50:39.735029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.752418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a810376e-42ba-451e-9b23-d1fa38e16e0e None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:39.771756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port f50ad061-fb48-46f6-95bf-d93e3e2caa05 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:39.823064 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0762c073-2dd3-4537-acfa-6bedaeb92c35 req-44820192-807a-4777-9de7-6fc46e961e9d service neutron] 10.222.0.32 "GET /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1730053 Nov 05 14:50:39.902109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-33e7be12-faef-48cb-a32b-8080f61850eb None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:39.902493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33e7be12-faef-48cb-a32b-8080f61850eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a810376e-42ba-451e-9b23-d1fa38e16e0e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:39.945281 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:39.963298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c32c15b-d8be-4975-b4e8-d72d31e16224 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:39.995906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8:0:1::20d (b10e20e9-e25a-4832-bd50-e158aa6d5da9/5dbf5b48-77d8-40dd-a460-c16291e3adac/f50ad061-fb48-46f6-95bf-d93e3e2caa05) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:40.005760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::f816:3eff:fee3:b7ed (b10e20e9-e25a-4832-bd50-e158aa6d5da9/5ebac38e-0a1c-4f32-8dda-652caf8c9f83/f50ad061-fb48-46f6-95bf-d93e3e2caa05) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4c32c15b-d8be-4975-b4e8-d72d31e16224 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:40.089886 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:40.094517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 958cd8d3-99e2-4811-9479-162a57c857cb up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:40.109837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.187229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 958cd8d3-99e2-4811-9479-162a57c857cb completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:50:40.188376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.195163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 958cd8d3-99e2-4811-9479-162a57c857cb triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:40.195539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.218769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Subnet': ['ID=2d1bad87-80f2-4687-95e5-3145d289743d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:40.225315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.232242 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-67e5389a-379c-47c7-9058-c2c8889fb06b tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/subnets/2d1bad87-80f2-4687-95e5-3145d289743d HTTP/1.1" status: 204 len: 168 time: 0.8475127 Nov 05 14:50:40.233586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44710) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:40.256726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-33e7be12-faef-48cb-a32b-8080f61850eb None None] Provisioning complete for port a477d1f0-5a76-432d-af07-9809ef4dce8f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:40.256961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33e7be12-faef-48cb-a32b-8080f61850eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.263441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a7afa8-75fa-4470-bacf-81048c1b8b7e req-df38c960-58f1-4a50-bae4-8b9b83a03e80 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:40.265068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b0a7afa8-75fa-4470-bacf-81048c1b8b7e req-df38c960-58f1-4a50-bae4-8b9b83a03e80 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 945 time: 0.1655009 Nov 05 14:50:40.320798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.325371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.336154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.384551 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b0a7afa8-75fa-4470-bacf-81048c1b8b7e req-d3f2e310-4c36-490e-a3f7-e652c5b20b3e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1102626 Nov 05 14:50:40.388194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.388934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:50:40.390655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Deleting port 5d742be8-276f-4a4e-98b9-5ee67efa9305 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:40.391120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.392178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-580ba8bf-c97b-4db4-afbe-073e719457d3" -d '{"events": [{"server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "name": "network-vif-plugged", "status": "completed", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:50:40.427444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=958cd8d3-99e2-4811-9479-162a57c857cb,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:40.434873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.484779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:40.489645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:40.490446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] For port 5d742be8-276f-4a4e-98b9-5ee67efa9305, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5d742be8-276f-4a4e-98b9-5ee67efa9305,segment=NetworkSegment(c00de80a-a60c-48dc-a668-a7d79d77e170),segment_id=c00de80a-a60c-48dc-a668-a7d79d77e170)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:40.490834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.492166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=f50ad061-fb48-46f6-95bf-d93e3e2caa05,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:40.494674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:40.496146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-624d70d6-1e0c-4c44-a22c-1a705e9fd1fb None None] Network 1bfaca83-0340-4ff3-aa66-407477b33539 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:40.501599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:40.502547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.515046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Calling delete_port for 5d742be8-276f-4a4e-98b9-5ee67efa9305 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:40.530075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-46c3a15a-baf1-4bc6-9972-948e5aafed1f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.2805858 Nov 05 14:50:40.531176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:40.557589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:40.577304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:50:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4883f121-6e63-4116-ba9e-36661d7968bf x-openstack-request-id: req-4883f121-6e63-4116-ba9e-36661d7968bf {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:50:40.577304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "name": "network-vif-plugged", "status": "completed", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:50:40.577566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4883f121-6e63-4116-ba9e-36661d7968bf {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:50:40.577761 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb', 'code': 200} Nov 05 14:50:40.665673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port f50ad061-fb48-46f6-95bf-d93e3e2caa05 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:40.666020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.690805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.705288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9ae003c-e15b-4aed-ab5f-dacc5cbfc20f None None] DHCP port deletion for 1bfaca83-0340-4ff3-aa66-407477b33539 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:40.746739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Port': ['ID=5d742be8-276f-4a4e-98b9-5ee67efa9305,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:40.748741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] No DVR routers for this DVR port 5d742be8-276f-4a4e-98b9-5ee67efa9305 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:40.835190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.843675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.848680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3771017e-446b-43bd-9b7a-a7fdb90c772b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:40.862128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bfaca83-0340-4ff3-aa66-407477b33539']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:40.869609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4b6e99-960d-4ff9-8a76-4de18bb5053a req-434be690-b96a-45ab-a079-a0649eb6ab84 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:40.871084 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e4b6e99-960d-4ff9-8a76-4de18bb5053a req-434be690-b96a-45ab-a079-a0649eb6ab84 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 944 time: 0.1313412 Nov 05 14:50:40.872004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for f50ad061-fb48-46f6-95bf-d93e3e2caa05 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:40.872632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c00de80a-a60c-48dc-a668-a7d79d77e170') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:40.872928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c00de80a-a60c-48dc-a668-a7d79d77e170') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:40.884096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81f0a9b-fc09-4f61-b47f-b65fb602a0fc req-54f72e37-aa91-41ea-b759-83a5245a2a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:40.885587 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e81f0a9b-fc09-4f61-b47f-b65fb602a0fc req-54f72e37-aa91-41ea-b759-83a5245a2a71 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1099 time: 0.1100676 Nov 05 14:50:40.886222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.900729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.907425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Releasing vlan 643 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:40.908490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:40.912064 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:40.955743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-030fcc88-1172-4a89-8d09-f80e85840b04 None None] Provisioning complete for port f50ad061-fb48-46f6-95bf-d93e3e2caa05 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:40.956108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-030fcc88-1172-4a89-8d09-f80e85840b04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.976014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.986869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:40.990679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] 10.222.0.30 "DELETE /v2.0/networks/1bfaca83-0340-4ff3-aa66-407477b33539 HTTP/1.1" status: 204 len: 168 time: 0.7557836 Nov 05 14:50:40.994767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3771017e-446b-43bd-9b7a-a7fdb90c772b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:41.001838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c1ab48-a676-4268-bf62-9364a7f5676e tempest-AllowedAddressPairIpV6TestJSON-2021879850 tempest-AllowedAddressPairIpV6TestJSON-2021879850-project] Pushing event deleted for resources: {'Network': ['ID=1bfaca83-0340-4ff3-aa66-407477b33539,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:41.008416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-030fcc88-1172-4a89-8d09-f80e85840b04 None None] Port f50ad061-fb48-46f6-95bf-d93e3e2caa05 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:50:41.017602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e4b6e99-960d-4ff9-8a76-4de18bb5053a req-0a087199-3fd7-4ca1-aaa3-61f18a5f0364 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1310675 Nov 05 14:50:41.021755 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e81f0a9b-fc09-4f61-b47f-b65fb602a0fc req-f9e59b4a-04eb-44d6-9a54-285a0bd2e481 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1268487 Nov 05 14:50:41.133028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d742be8-276f-4a4e-98b9-5ee67efa9305 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:41.156247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5d742be8-276f-4a4e-98b9-5ee67efa9305 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:41.156663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5d742be8-276f-4a4e-98b9-5ee67efa9305 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:41.158796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.196105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=f50ad061-fb48-46f6-95bf-d93e3e2caa05,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:41.246205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.251847 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1db2138f-0964-45e0-a7dc-aa4ffb58a0e3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/f50ad061-fb48-46f6-95bf-d93e3e2caa05 HTTP/1.1" status: 204 len: 168 time: 0.7195330 Nov 05 14:50:41.253545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44724) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.303332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba261425-a51b-44a4-ab8f-47284270b186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.307605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ba261425-a51b-44a4-ab8f-47284270b186 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.0530107 Nov 05 14:50:41.307778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.318736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.365042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a6621ad-7fb4-4826-9602-cd2b6d729730 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.369075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '5ebac38e-0a1c-4f32-8dda-652caf8c9f83', 'ip_address': '2001:db8::f816:3eff:febf:485d'}, {'subnet_id': '5dbf5b48-77d8-40dd-a460-c16291e3adac'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '31b60062-9117-4649-9c0d-018e776a3bcc'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:50:41.369603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44732) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.370381 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3a6621ad-7fb4-4826-9602-cd2b6d729730 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 963 time: 0.0615587 Nov 05 14:50:41.394445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.426164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df25a662-7e4d-4f1d-85cb-4a9d30a36eef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.427814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df25a662-7e4d-4f1d-85cb-4a9d30a36eef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.429408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df25a662-7e4d-4f1d-85cb-4a9d30a36eef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.431313 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-df25a662-7e4d-4f1d-85cb-4a9d30a36eef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0609074 Nov 05 14:50:41.434109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44736) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.535750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 5dbf5b48-77d8-40dd-a460-c16291e3adac {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:41.551784 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bb069d89-5024-400f-af08-606ebd8f0d7b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=86e1c5d009684c6eaa1634fb273b03cb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2316463 Nov 05 14:50:41.554475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44738) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:41.563427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Allocated IP 2001:db8:0:1::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/5dbf5b48-77d8-40dd-a460-c16291e3adac/31b60062-9117-4649-9c0d-018e776a3bcc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:41.567668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9022f2-365c-4c7a-86c4-cf7f7a467fb5 req-d38f953e-fb96-4479-af02-fee9fa857a16 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:41.569640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc9022f2-365c-4c7a-86c4-cf7f7a467fb5 req-d38f953e-fb96-4479-af02-fee9fa857a16 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0913701 Nov 05 14:50:41.612019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.625505 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc9022f2-365c-4c7a-86c4-cf7f7a467fb5 req-e367355c-42bb-4aa7-a644-01ac0d4b1834 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493469 Nov 05 14:50:41.641183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.691007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.693675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.695132 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3f4ec1ce-904e-46d9-8f5f-18da7e990057 HTTP/1.1" status: 204 len: 168 time: 0.1396694 Nov 05 14:50:41.704218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6c18fe-8c2a-4956-9de2-9382965f3be1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f4ec1ce-904e-46d9-8f5f-18da7e990057,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:41.827357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:41.856604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.861932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.865407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.908893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:41.962656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae837fbf-fcd7-4bfe-8003-e3bbbb108a8b None None] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=10']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:42.012135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.083608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 366f1e82-fb2b-41b4-90d6-dd5896e338bf details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:50:42.137598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.176576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.180074 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/5dbf5b48-77d8-40dd-a460-c16291e3adac HTTP/1.1" status: 204 len: 168 time: 0.7444046 Nov 05 14:50:42.182258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d502f46-a18f-4db7-87c4-de943434fdb9 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=5dbf5b48-77d8-40dd-a460-c16291e3adac,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:42.184070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44754) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:42.214165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e32799-9f9b-4615-b3c9-685ab2270414 req-c9f1d70a-eb23-4bfd-8df6-9c2c2a185d93 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:42.221447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-87e32799-9f9b-4615-b3c9-685ab2270414 req-c9f1d70a-eb23-4bfd-8df6-9c2c2a185d93 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 944 time: 0.0977213 Nov 05 14:50:42.239653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:42.263167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '366f1e82-fb2b-41b4-90d6-dd5896e338bf', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'port_id': '366f1e82-fb2b-41b4-90d6-dd5896e338bf', 'mac_address': 'fa:16:3e:15:f8:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 621, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'ip_address': '172.20.0.19'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:50:42.279459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 5ebac38e-0a1c-4f32-8dda-652caf8c9f83 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:42.283006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.301927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-87e32799-9f9b-4615-b3c9-685ab2270414 req-1ca1c441-53d7-4d3a-9a10-69ff7fb5aead tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0750599 Nov 05 14:50:42.339658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.340188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.354320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 366f1e82-fb2b-41b4-90d6-dd5896e338bf {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:50:42.390620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:42.397514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.449441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:42.461012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.531452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.561077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=5ebac38e-0a1c-4f32-8dda-652caf8c9f83,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:42.565648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.569080 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ce69152-2e83-48ae-b07a-3518b0b07b81 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/5ebac38e-0a1c-4f32-8dda-652caf8c9f83 HTTP/1.1" status: 204 len: 168 time: 0.3838561 Nov 05 14:50:42.571846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:42.593720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44766) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:42.622103 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd5dc948-d453-4140-be22-9dcca06bc084 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0458159 Nov 05 14:50:42.622103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44770) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:42.630294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:42.636753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['366f1e82-fb2b-41b4-90d6-dd5896e338bf'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:50:42.670664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6060f899-6be8-420f-bdc6-e307d331d8f3 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:42.732712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-1641443036'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:42.757373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Made reservation on behalf of bd0f5f4e2a514468870c23c02341c55b for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:42.761436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.768262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419d70d4-bda9-48bc-a482-2f3a768524fb req-13987875-6f6d-4ec4-be67-ebe5b4f60889 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:42.769925 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-419d70d4-bda9-48bc-a482-2f3a768524fb req-13987875-6f6d-4ec4-be67-ebe5b4f60889 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0717077 Nov 05 14:50:42.771055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.788792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2621ab90-fb9d-43e3-84a3-5ba92d1de210 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:42.789179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2621ab90-fb9d-43e3-84a3-5ba92d1de210 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.790351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:42.794077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.877915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.883067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.884159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6060f899-6be8-420f-bdc6-e307d331d8f3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:42.902191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-419d70d4-bda9-48bc-a482-2f3a768524fb req-8acbf90f-d0f4-4c11-b51b-f814d42a90c0 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1195884 Nov 05 14:50:42.908160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 607} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:42.934469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:42.934638 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Added segment 661010be-10de-4dac-802e-a274041f764d of type vlan for network 44336b04-0cd1-4a11-a25b-10e6133141be Nov 05 14:50:42.953152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0b20ced2-0bf8-4edb-8fa6-f68a5cc9f5cd,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:43.008126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.051119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.082697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e8cc1f-bd8b-4d35-bdfa-f727e12de8b4 req-ca21937b-8eb7-4a87-a8dd-48b9516d6d6e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.084499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e9e8cc1f-bd8b-4d35-bdfa-f727e12de8b4 req-ca21937b-8eb7-4a87-a8dd-48b9516d6d6e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0738039 Nov 05 14:50:43.085813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.092215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.093063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.101058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:43.108075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:43.112523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.113175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.131768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=0fd7742e-6c21-4877-9acf-2c1022179d22,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:43.142729 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-252efd16-4ded-4ea6-90e4-066de1990f90 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5197396 Nov 05 14:50:43.145617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44776) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:43.150980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:43.167218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:43.183711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'Network': ['ID=44336b04-0cd1-4a11-a25b-10e6133141be,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:43.192696 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-45654388-669d-437f-9e76-66573b54d773 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 0.5966854 Nov 05 14:50:43.201753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44778) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:43.208421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Request body: {'subnet': {'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:43.211022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 44336b04-0cd1-4a11-a25b-10e6133141be details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:43.226861 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e9e8cc1f-bd8b-4d35-bdfa-f727e12de8b4 req-45137777-7706-43e1-954c-09791cdeadf2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1309772 Nov 05 14:50:43.251635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44780) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:43.363071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.db.api [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 05 14:50:43.363071 dv-neutron-816850-1-hyperv neutron-server[113580]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 05 14:50:43.363071 dv-neutron-816850-1-hyperv neutron-server[113580]: [parameters: {'project_id_1': '6c1eac42b2854d16bc0940ee811229be', 'expiration_1': datetime.datetime(2021, 11, 5, 14, 50, 23, 340671)}] Nov 05 14:50:43.363071 dv-neutron-816850-1-hyperv neutron-server[113580]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=113580) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:50:43.363906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG oslo_db.api [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:50:43.366901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Made reservation on behalf of bd0f5f4e2a514468870c23c02341c55b for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:43.371074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.389160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:43.389661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.436331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d195fc65-10c8-4432-ae91-336fb907198c tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.437972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d195fc65-10c8-4432-ae91-336fb907198c tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1094 time: 0.1851754 Nov 05 14:50:43.440764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44786) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:43.445429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '958cd8d3-99e2-4811-9479-162a57c857cb', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address': '172.20.0.12'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:43.471606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.522964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16113b1b-bc7b-4fc7-9435-efd7ef015af8 req-3883add9-b0ed-4d9f-ace8-5593e481a454 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.525248 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-16113b1b-bc7b-4fc7-9435-efd7ef015af8 req-3883add9-b0ed-4d9f-ace8-5593e481a454 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 945 time: 0.1370587 Nov 05 14:50:43.594353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.618467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': '0fd7742e-6c21-4877-9acf-2c1022179d22'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '31b60062-9117-4649-9c0d-018e776a3bcc'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:50:43.626054 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-16113b1b-bc7b-4fc7-9435-efd7ef015af8 req-dd8f053c-8bbe-48f5-9e82-1404183d5532 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0831101 Nov 05 14:50:43.657894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.702211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.750931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.26.5.162 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/fadd8b68-f2c6-4728-a6e4-008fc9f6412a) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:43.776752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'Subnet': ['ID=b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:43.781861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Checking segment: {'id': '661010be-10de-4dac-802e-a274041f764d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:43.782291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Network hostable DHCP agents. Network: 44336b04-0cd1-4a11-a25b-10e6133141be, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:43.800742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Network 44336b04-0cd1-4a11-a25b-10e6133141be is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:43.810850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 44336b04-0cd1-4a11-a25b-10e6133141be) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:43.815530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:43.816228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.836163 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2fba6f7-f22a-4ca8-82ec-323179f1cba7 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6318455 Nov 05 14:50:43.836398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:43.838088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/0fd7742e-6c21-4877-9acf-2c1022179d22/31b60062-9117-4649-9c0d-018e776a3bcc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:43.841993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Request body: {'port': {'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-2038022167'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:43.869079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.902776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.925581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:43.929479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.945452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:43.953499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:43.953885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:43.957836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:43.961073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=fadd8b68-f2c6-4728-a6e4-008fc9f6412a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:43.990272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:43.998475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.064247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Made reservation on behalf of bd0f5f4e2a514468870c23c02341c55b for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:44.067844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.072372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 0fd7742e-6c21-4877-9acf-2c1022179d22 (CIDR: 2001:db8::/64) Nov 05 14:50:44.081032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99eb0b14-cb64-4a97-8081-0f03be60ea4c None None] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=13']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:44.091437 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:44.092516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:44.106835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 366f1e82-fb2b-41b4-90d6-dd5896e338bf up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:44.114762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] device_id is not set on port 5b43da50-60ed-43c1-b5cc-f024eccb9f8c yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:44.126252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4320198-3ede-4e2c-99c8-dc972cf06ffb tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.9795573 Nov 05 14:50:44.129160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44790) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:44.138316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:44.169963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 366f1e82-fb2b-41b4-90d6-dd5896e338bf completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:50:44.175295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 366f1e82-fb2b-41b4-90d6-dd5896e338bf triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:44.175737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.294475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.328718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:50:44.331298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df3303ef-8aa5-488d-8d73-100b8fdfb7f5" -d '{"events": [{"server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "name": "network-vif-plugged", "status": "completed", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:50:44.349011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:44.353275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Allocated IP 2001:db8::2ff (44336b04-0cd1-4a11-a25b-10e6133141be/b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d/5b43da50-60ed-43c1-b5cc-f024eccb9f8c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:44.358406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.389106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.399513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:50:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed9633f7-de4c-4f62-82af-9fee0108c134 x-openstack-request-id: req-ed9633f7-de4c-4f62-82af-9fee0108c134 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:50:44.400050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "name": "network-vif-plugged", "status": "completed", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:50:44.400504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ed9633f7-de4c-4f62-82af-9fee0108c134 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:50:44.401181 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf', 'code': 200} Nov 05 14:50:44.416591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:44.417840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:44.422254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.488932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.858878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138ef007-d44a-4248-83d9-a2a17b1c8d66 req-775dfaa8-b95e-4980-900f-ce9196beb32d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:44.861147 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-138ef007-d44a-4248-83d9-a2a17b1c8d66 req-775dfaa8-b95e-4980-900f-ce9196beb32d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.1430449 Nov 05 14:50:44.867858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6181c51a-f2ba-45fd-9f20-1330b958740a None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:44.874781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-672019c9-8e8b-4a91-ab8f-db53b14a3bc4 None None] Network 44336b04-0cd1-4a11-a25b-10e6133141be requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:44.924702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:44.984916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.objects.ports [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=113580) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:44.992303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-138ef007-d44a-4248-83d9-a2a17b1c8d66 req-f682642f-c933-45d5-9412-8ec4319944e2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1180654 Nov 05 14:50:45.008100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ceec553a-2b19-44f7-aa5f-bfef0e1974b6 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:45.008484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ceec553a-2b19-44f7-aa5f-bfef0e1974b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.012317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfde4e0-3811-44b4-ac8c-11c339d80e6f req-1cdf2f17-e7c1-4a62-9592-06103fe6874e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:45.013497 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7cfde4e0-3811-44b4-ac8c-11c339d80e6f req-1cdf2f17-e7c1-4a62-9592-06103fe6874e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 1099 time: 0.4171674 Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6181c51a-f2ba-45fd-9f20-1330b958740a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:45.054395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:45.065687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-672019c9-8e8b-4a91-ab8f-db53b14a3bc4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:45.076533 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:45.077958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.087244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15a33841-5739-4179-bbff-1bd78c871bf0 None None] Network 44336b04-0cd1-4a11-a25b-10e6133141be requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:45.087687 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7cfde4e0-3811-44b4-ac8c-11c339d80e6f req-b18852f9-c116-4969-9f79-c9412eca974a service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661898 Nov 05 14:50:45.098004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.147854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=fadd8b68-f2c6-4728-a6e4-008fc9f6412a,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:45.162323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Network 44336b04-0cd1-4a11-a25b-10e6133141be is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:45.168744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.190106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:45.195932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:45.201754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:45.207419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:45.208042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.220688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'Port': ['ID=5b43da50-60ed-43c1-b5cc-f024eccb9f8c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:45.246703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e2d7be2b-e7ff-4819-b46c-a1bc2e39c80e tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 1.4091754 Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-15a33841-5739-4179-bbff-1bd78c871bf0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:45.247275 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:45.248436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44796) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:45.256124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Request body: {'port': {'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1681450227', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:45.256448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] bootfile-name is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:45.256815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] tftp-server is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:45.257318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] server-ip-address is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:45.258874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af3d654f-22d5-45a3-a02d-13d7c8803dc1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:45.290902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:45.290902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.307591 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP baa1f31b-d39c-407b-9a15-cc4161256e47 associated. External IP: 172.26.5.162, port: 958cd8d3-99e2-4811-9479-162a57c857cb. Nov 05 14:50:45.338370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.455240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af3d654f-22d5-45a3-a02d-13d7c8803dc1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:45.495025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Made reservation on behalf of bd0f5f4e2a514468870c23c02341c55b for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:45.499159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.531378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] device_id is not set on port 6df4ddc1-e640-4b7a-8c80-ffd93f8d198b yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:45.535318 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:50:45.538369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:50:45.596501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:45.652351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:45.669519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:45.670555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.671267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.681508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.682346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.704770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e91d47c4-ce65-4d3f-9bd4-5b70f159221d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2622960 Nov 05 14:50:45.705818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:50:45.708299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de4c22b9-5106-47f1-b1b1-393204470a8e" -d '{"events": [{"name": "network-changed", "server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:50:45.715947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:45.717224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:45.731046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Allocated IP 2001:db8::1a5 (44336b04-0cd1-4a11-a25b-10e6133141be/b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d/6df4ddc1-e640-4b7a-8c80-ffd93f8d198b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:45.754761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:50:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b4220cc-0c08-430f-a5b6-74c3a497dd8f x-openstack-request-id: req-8b4220cc-0c08-430f-a5b6-74c3a497dd8f {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:50:45.755048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:50:45.755300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8b4220cc-0c08-430f-a5b6-74c3a497dd8f {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:50:45.755731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb', 'status': 'completed', 'code': 200} Nov 05 14:50:45.787711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:45.808961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:45.821940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:45.822540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:45.829510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-e67a0d83-7b45-453a-9806-95ede888cd19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:45.831152 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-e67a0d83-7b45-453a-9806-95ede888cd19 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1099 time: 0.0505662 Nov 05 14:50:45.839799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=e494c577-e67a-482d-aefd-5e890ef4a070,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:45.863669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=15']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:45.875953 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-15cf1c14-7b78-412b-a268-1971bc854018 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.7450559 Nov 05 14:50:45.879162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44802) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:45.884169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:a7:ff:a6', 'name': 'tempest-NetworksTestDHCPv6-1991731836'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:45.941740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-cd73b999-16df-40f1-99e0-202bcf1d4236 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:45.943417 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-cd73b999-16df-40f1-99e0-202bcf1d4236 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.1046548 Nov 05 14:50:45.990710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-44336b04-0cd1-4a11-a25b-10e6133141be', 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be', 'tenant_id': 'bd0f5f4e2a514468870c23c02341c55b', 'fixed_ips': [{'subnet_id': 'b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:45.991571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.035225 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-40d9c2cd-a657-4338-9d5a-560d22c9f25e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 200 len: 1000 time: 0.0840983 Nov 05 14:50:46.106167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:50:46.139966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-e70f2665-ffeb-4b0c-9838-2d4874f2d090 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.141798 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-e70f2665-ffeb-4b0c-9838-2d4874f2d090 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0982087 Nov 05 14:50:46.172596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.178217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:46.239637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-2ea3fe6a-c2b0-4741-ac48-26774e74ae8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.242791 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-2ea3fe6a-c2b0-4741-ac48-26774e74ae8c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0889916 Nov 05 14:50:46.296610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec8440ab-f60e-4eb6-b4c2-19b072b664bc req-0d2bbb5e-e042-4c9a-bda0-0c863d7c2b5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.304203 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec8440ab-f60e-4eb6-b4c2-19b072b664bc req-0d2bbb5e-e042-4c9a-bda0-0c863d7c2b5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.2046444 Nov 05 14:50:46.360163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.366804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.383078 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-9f3b7889-cc19-47fe-a761-4880c663bb46 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1320806 Nov 05 14:50:46.431144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec8440ab-f60e-4eb6-b4c2-19b072b664bc req-52ffba69-5313-41d1-a036-a22b07795bb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1258142 Nov 05 14:50:46.434275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:46.434817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Allocated IP 2001:db8::2 (44336b04-0cd1-4a11-a25b-10e6133141be/b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d/9950b0b7-10f2-4365-9bf8-ea1561796f24) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:46.487774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Network 44336b04-0cd1-4a11-a25b-10e6133141be is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:46.495125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'Port': ['ID=6df4ddc1-e640-4b7a-8c80-ffd93f8d198b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:46.498386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:46.503237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:46.515441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.516213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.531858 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de4c22b9-5106-47f1-b1b1-393204470a8e req-60c7d47e-70fb-4c51-b490-fe5b3bf63133 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1417270 Nov 05 14:50:46.550501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d00ac5c7-e5e5-40b4-973b-81c7b9876ac8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1150 time: 1.2991555 Nov 05 14:50:46.554803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44806) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:46.625918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd54f8f0-fa33-41c1-af10-b7310b387b21 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.632084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd54f8f0-fa33-41c1-af10-b7310b387b21 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:46.636806 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cd54f8f0-fa33-41c1-af10-b7310b387b21 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1884 time: 0.0783043 Nov 05 14:50:46.641021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44808) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:46.676865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'baa1f31b-d39c-407b-9a15-cc4161256e47', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.162', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '958cd8d3-99e2-4811-9479-162a57c857cb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1159, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:dc:82:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:50:44Z', 'updated_at': '2021-11-05T14:50:44Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:46.687601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::91 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/0fd7742e-6c21-4877-9acf-2c1022179d22/5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:46.695544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8:0:1:f816:3eff:fea7:ffa6 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/e494c577-e67a-482d-aefd-5e890ef4a070/5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:46.713607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:50:46.734179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.735630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:46.736560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:46.763236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Deleting port 6df4ddc1-e640-4b7a-8c80-ffd93f8d198b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:46.763686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.782246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.838279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Network 44336b04-0cd1-4a11-a25b-10e6133141be is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:46.870231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.878741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:46.883819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:46.886417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Pushing event updated for resources: {'Port': ['ID=9950b0b7-10f2-4365-9bf8-ea1561796f24,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:46.887167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Calling delete_port for 6df4ddc1-e640-4b7a-8c80-ffd93f8d198b owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:46.940752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b31d2df2-4b2c-48b4-b083-ad31c86d8341 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:46.941159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b31d2df2-4b2c-48b4-b083-ad31c86d8341 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:46.980359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:50:47.036141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Attempting to bind port 9950b0b7-10f2-4365-9bf8-ea1561796f24 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:47.036845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Attempting to bind port 9950b0b7-10f2-4365-9bf8-ea1561796f24 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '661010be-10de-4dac-802e-a274041f764d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:47.036845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Attempting to bind port 9950b0b7-10f2-4365-9bf8-ea1561796f24 on network 44336b04-0cd1-4a11-a25b-10e6133141be {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:47.042567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.079873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event deleted for resources: {'Port': ['ID=6df4ddc1-e640-4b7a-8c80-ffd93f8d198b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:47.108830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.112980 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-49d3f8d2-fd96-4b57-9f22-5b133cbe0b4c tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "DELETE /v2.0/ports/6df4ddc1-e640-4b7a-8c80-ffd93f8d198b HTTP/1.1" status: 204 len: 168 time: 0.4704401 Nov 05 14:50:47.116545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44810) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:47.123811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:47.124183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Checking segment: {'id': '661010be-10de-4dac-802e-a274041f764d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:47.124622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.124759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Request body: {'port': {'name': 'tempest-new-port-name-7343590', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:47.125010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Bound using segment: {'id': '661010be-10de-4dac-802e-a274041f764d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:47.125130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] bootfile-name is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:47.125339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] tftp-server is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:47.125489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Bound port: 9950b0b7-10f2-4365-9bf8-ea1561796f24, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '661010be-10de-4dac-802e-a274041f764d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '44336b04-0cd1-4a11-a25b-10e6133141be'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:47.125662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.api.validators [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] server-ip-address is not in valid_values {{(pid=113580) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Nov 05 14:50:47.125863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.148150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:47.215843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.243037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.333947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-211c545d-1930-41a4-974a-85240a200bcc None None] For port 9950b0b7-10f2-4365-9bf8-ea1561796f24, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:47.357244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-211c545d-1930-41a4-974a-85240a200bcc None None] For port 9950b0b7-10f2-4365-9bf8-ea1561796f24, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9950b0b7-10f2-4365-9bf8-ea1561796f24,segment=NetworkSegment(661010be-10de-4dac-802e-a274041f764d),segment_id=661010be-10de-4dac-802e-a274041f764d)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:47.360741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.363550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.368396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:47.368766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.421214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:47.431068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:47.436808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:47.442435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:47.443077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.445663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:47.479526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-947b2ef5-a841-46ad-a4fc-41151242c9b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 1.5966213 Nov 05 14:50:47.479793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:47.490892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-211c545d-1930-41a4-974a-85240a200bcc None None] Pushing event updated for resources: {'Port': ['ID=9950b0b7-10f2-4365-9bf8-ea1561796f24,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:47.577656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'baa1f31b-d39c-407b-9a15-cc4161256e47', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.162', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '958cd8d3-99e2-4811-9479-162a57c857cb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1159, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:dc:82:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:50:44Z', 'updated_at': '2021-11-05T14:50:44Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:47.578495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.585075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.620920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de5423e-15f3-4868-a9ff-883bf7694c89 None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'baa1f31b-d39c-407b-9a15-cc4161256e47', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.162', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '958cd8d3-99e2-4811-9479-162a57c857cb', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1159, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:dc:82:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:50:44Z', 'updated_at': '2021-11-05T14:50:44Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:47.622961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] In _notify_port_updated(), no bound segment for port 5b43da50-60ed-43c1-b5cc-f024eccb9f8c on network 44336b04-0cd1-4a11-a25b-10e6133141be {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:50:47.628557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:47.629234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.634011 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "PUT /v2.0/ports/5b43da50-60ed-43c1-b5cc-f024eccb9f8c HTTP/1.1" status: 200 len: 1127 time: 0.5153139 Nov 05 14:50:47.640201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44816) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:47.646388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ee5bf4-f5c6-41a3-b618-a637f63ef9df req-d277bc20-5375-4bce-a2ca-579619c4c234 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:47.647964 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a6ee5bf4-f5c6-41a3-b618-a637f63ef9df req-d277bc20-5375-4bce-a2ca-579619c4c234 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.0774124 Nov 05 14:50:47.700108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29c163d-6569-4300-a7a3-53583041b8a8 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event updated for resources: {'Port': ['ID=5b43da50-60ed-43c1-b5cc-f024eccb9f8c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:47.733493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a82204da-01f8-43ad-93cb-bc4aaf478ea5 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:47.738995 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a82204da-01f8-43ad-93cb-bc4aaf478ea5 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "GET /v2.0/ports/5b43da50-60ed-43c1-b5cc-f024eccb9f8c HTTP/1.1" status: 200 len: 1127 time: 0.0934830 Nov 05 14:50:47.740810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44818) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:47.751840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:47.752189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.752388 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a6ee5bf4-f5c6-41a3-b618-a637f63ef9df req-d6c5be38-6928-4645-a5c0-ecd651c2f684 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0969768 Nov 05 14:50:47.919850 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7124944c-fc0b-4bee-b476-c2959d0ec033 None None] New status for floating IP baa1f31b-d39c-407b-9a15-cc4161256e47: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:50:47.945117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:47.965187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:47.980593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e102ff9-a9d5-4446-9f58-1e4da754bd10 req-be9a292e-f8ba-4e11-b7f1-4ddb267b0942 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:47.982123 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e102ff9-a9d5-4446-9f58-1e4da754bd10 req-be9a292e-f8ba-4e11-b7f1-4ddb267b0942 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.1395752 Nov 05 14:50:48.045332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Deleting port 5b43da50-60ed-43c1-b5cc-f024eccb9f8c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:48.045734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.136862 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e102ff9-a9d5-4446-9f58-1e4da754bd10 req-9151e036-f1ad-4b0f-8ddb-357e80370986 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1459291 Nov 05 14:50:48.148523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.223912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.248627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Calling delete_port for 5b43da50-60ed-43c1-b5cc-f024eccb9f8c owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:48.360661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.400565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:48.452385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.458137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-606abc48-c820-4be6-8d84-99e948f773a7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6 HTTP/1.1" status: 204 len: 168 time: 0.9749992 Nov 05 14:50:48.458452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44826) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.516145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.523527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a89dbb94-121b-4475-aa5e-a61e08d88244 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:48.527620 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a89dbb94-121b-4475-aa5e-a61e08d88244 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0656729 Nov 05 14:50:48.528502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44828) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.540976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b01a6a5-a642-48e4-89ab-4e81848f0cdc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:48.555302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event deleted for resources: {'Port': ['ID=5b43da50-60ed-43c1-b5cc-f024eccb9f8c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:48.569368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Could not find standard attr ID for object 5b43da50-60ed-43c1-b5cc-f024eccb9f8c. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:48.580231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.584332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f2ea5aed-acc3-42bb-9828-78d445d42861 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "DELETE /v2.0/ports/5b43da50-60ed-43c1-b5cc-f024eccb9f8c HTTP/1.1" status: 204 len: 168 time: 0.8425519 Nov 05 14:50:48.588904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44830) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.595649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acd43b6f-4c18-47ee-a3ec-a8df3cc4ac6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:48.597586 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-acd43b6f-4c18-47ee-a3ec-a8df3cc4ac6d tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0684314 Nov 05 14:50:48.600152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44832) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.609679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Provisioning complete for port 9950b0b7-10f2-4365-9bf8-ea1561796f24 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:48.610113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.645006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Deleting subnet b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:48.648491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.663654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d2990be-098b-400a-bf38-94449bf30973 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:48.665407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d2990be-098b-400a-bf38-94449bf30973 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:48.666962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d2990be-098b-400a-bf38-94449bf30973 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:48.668872 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3d2990be-098b-400a-bf38-94449bf30973 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0676556 Nov 05 14:50:48.671780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44834) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.692855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.718340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b01a6a5-a642-48e4-89ab-4e81848f0cdc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:48.725667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 0fd7742e-6c21-4877-9acf-2c1022179d22 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:48.729172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.742879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.785389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.791897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.865641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.880324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.896442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event deleted for resources: {'Subnet': ['ID=b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:48.898533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:48.901809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18f850d4-69b2-4680-800d-b5437aaafc66 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "DELETE /v2.0/subnets/b0e2b2e4-03dc-4b12-91fa-d0dd70d11f6d HTTP/1.1" status: 204 len: 168 time: 0.3119330 Nov 05 14:50:48.905704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44836) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:48.953622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:50:48.953974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:50:49.001052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.008627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.024356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30de58ac-fbb2-44f2-9a22-4ec41615364a None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:49.039783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=0fd7742e-6c21-4877-9acf-2c1022179d22,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:49.071859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.077801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44838) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:49.078065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-edafa2f6-f26a-4591-a58e-9b724a94e208 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/0fd7742e-6c21-4877-9acf-2c1022179d22 HTTP/1.1" status: 204 len: 168 time: 0.4046879 Nov 05 14:50:49.113516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Deleting port 9950b0b7-10f2-4365-9bf8-ea1561796f24 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:49.114009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-30de58ac-fbb2-44f2-9a22-4ec41615364a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:49.128059 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:49.140339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97a32574-fa92-4adc-a3f9-3e3bf93c12cc None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:49.174654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet e494c577-e67a-482d-aefd-5e890ef4a070 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:49.179514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.225290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] For port 9950b0b7-10f2-4365-9bf8-ea1561796f24, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9950b0b7-10f2-4365-9bf8-ea1561796f24,segment=NetworkSegment(661010be-10de-4dac-802e-a274041f764d),segment_id=661010be-10de-4dac-802e-a274041f764d)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:49.225656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-97a32574-fa92-4adc-a3f9-3e3bf93c12cc None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:49.233321 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:49.235027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9950b0b7-10f2-4365-9bf8-ea1561796f24 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:49.245755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Calling delete_port for 9950b0b7-10f2-4365-9bf8-ea1561796f24 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:49.256914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.313428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9950b0b7-10f2-4365-9bf8-ea1561796f24 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:49.313714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.347990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6544f36e-32d1-42a9-8f87-736598dffae5 None None] Network 44336b04-0cd1-4a11-a25b-10e6133141be requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:49.353150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.371802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.391001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] No DVR routers for this DVR port 9950b0b7-10f2-4365-9bf8-ea1561796f24 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:49.397600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event deleted for resources: {'Port': ['ID=9950b0b7-10f2-4365-9bf8-ea1561796f24,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:49.422355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Could not find standard attr ID for object 9950b0b7-10f2-4365-9bf8-ea1561796f24. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:49.426358 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No ports have port_id starting with 9950b0b7-10f2-4365-9bf8-ea1561796f24 Nov 05 14:50:49.469648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.497307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.500499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=e494c577-e67a-482d-aefd-5e890ef4a070,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:49.507223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.512929 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-567bdbbd-53ad-4838-b07d-284439aae873 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/e494c577-e67a-482d-aefd-5e890ef4a070 HTTP/1.1" status: 204 len: 168 time: 0.4318862 Nov 05 14:50:49.513891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44840) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:49.547493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['44336b04-0cd1-4a11-a25b-10e6133141be']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:49.566597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-114e7c0e-c4d5-4067-a6ff-167ed8c0f157 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0491612 Nov 05 14:50:49.566816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '661010be-10de-4dac-802e-a274041f764d') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:49.566816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '661010be-10de-4dac-802e-a274041f764d') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:49.567202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44842) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:49.582627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:49.608083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.619546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81681de3-512b-43e7-bded-fa2148f36813 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:49.648723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Port 9950b0b7-10f2-4365-9bf8-ea1561796f24 update to ACTIVE by agent not found {{(pid=113582) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Nov 05 14:50:49.655380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.672543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Releasing vlan 607 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:49.673115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:49.675878 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:49.698021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-043059fb-8a82-444e-8549-7c36796b1abf None None] DHCP port deletion for 44336b04-0cd1-4a11-a25b-10e6133141be request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:49.706061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Provisioning complete for port 31b60062-9117-4649-9c0d-018e776a3bcc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:49.706434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-df748897-01a6-44f8-bedb-f7aad931ab88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.712292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44844) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:49.751012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.758459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.761649 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] 10.222.0.30 "DELETE /v2.0/networks/44336b04-0cd1-4a11-a25b-10e6133141be HTTP/1.1" status: 204 len: 168 time: 0.8549237 Nov 05 14:50:49.764026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:49.767298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:49.781182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125f101c-e38b-45f6-87ca-09949472cc62 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472 tempest-ExtraDHCPOptionsIpV6TestJSON-1379621472-project] Pushing event deleted for resources: {'Network': ['ID=44336b04-0cd1-4a11-a25b-10e6133141be,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:49.914854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:49.963016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-234b6f40-5bd1-464e-811d-70aa6e9e2d8b None None] Could not find standard attr ID for object 5b43da50-60ed-43c1-b5cc-f024eccb9f8c. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:49.966737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-234b6f40-5bd1-464e-811d-70aa6e9e2d8b None None] Could not find standard attr ID for object 6df4ddc1-e640-4b7a-8c80-ffd93f8d198b. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:49.971234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-234b6f40-5bd1-464e-811d-70aa6e9e2d8b None None] Could not find standard attr ID for object 5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:49.979704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-234b6f40-5bd1-464e-811d-70aa6e9e2d8b None None] Could not find standard attr ID for object 9950b0b7-10f2-4365-9bf8-ea1561796f24. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:50:49.986663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Deleting port 31b60062-9117-4649-9c0d-018e776a3bcc {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:49.986663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.008340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.063542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:50.066964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:50.073349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:50.073941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.077836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-23a5f3f8-6dda-4479-8d12-109d99e1387a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.082542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] For port 31b60062-9117-4649-9c0d-018e776a3bcc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=31b60062-9117-4649-9c0d-018e776a3bcc,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:50.083123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.089275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=874131b9-80ef-4cd6-bd33-7d88e5c45d57,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:50.098782 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-622e770c-03c3-4c5b-81fb-0407e3fb10b6 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5298495 Nov 05 14:50:50.101756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44850) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:50.107310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Calling delete_port for 31b60062-9117-4649-9c0d-018e776a3bcc owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:50.110580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:50.165409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44852) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:50.219264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.251793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] Pushing event deleted for resources: {'Port': ['ID=31b60062-9117-4649-9c0d-018e776a3bcc,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:50.259727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1b9960-03b8-44ba-8278-d1260e605239 None None] No DVR routers for this DVR port 31b60062-9117-4649-9c0d-018e776a3bcc on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:50.275633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:50.280740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-005933bc-d871-420b-96ea-e83a0da15f7e None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:50.281919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.349628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-005933bc-d871-420b-96ea-e83a0da15f7e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:50.381815 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:50.398515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172126a1-a084-41a2-a55d-500a6f8938c2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:50.410000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.ipam_backend_mixin [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 874131b9-80ef-4cd6-bd33-7d88e5c45d57 (CIDR: 2001:db8::/64) Nov 05 14:50:50.416336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:50:50.416812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:50.447075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-80a7280a-5578-429c-b52a-86a7a24aeafa tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3419254 Nov 05 14:50:50.447877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44856) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:50.453752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'subnet': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:50.496104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9355f698-a44c-4598-828c-056bddfc5e8c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bd0f5f4e2a514468870c23c02341c55b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3297350 Nov 05 14:50:50.498699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44858) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:50.526736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172126a1-a084-41a2-a55d-500a6f8938c2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:50.597795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:50.602994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.620606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.693924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.795502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.17 (6f42e72d-8f95-4783-82a7-99edeac923fe/d4230734-010b-449e-9c56-77f77a8c925f/c55d2ea6-0622-4508-8711-245ed9cc9b39) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:50.799969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.802741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.804001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0b20ced2-0bf8-4edb-8fa6-f68a5cc9f5cd HTTP/1.1" status: 204 len: 168 time: 0.3042138 Nov 05 14:50:50.817961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4767350-b653-4111-8b55-8319cef345e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b20ced2-0bf8-4edb-8fa6-f68a5cc9f5cd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:50.859927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'tenant_id': '6c1eac42b2854d16bc0940ee811229be', 'fixed_ips': [{'subnet_id': '874131b9-80ef-4cd6-bd33-7d88e5c45d57'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:50.862735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:50.987603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.032851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Allocated IP 2001:db8::2 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/874131b9-80ef-4cd6-bd33-7d88e5c45d57/b2b30375-395c-41b1-97f0-04093a949ee8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:51.033048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.objects.ports [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=113581) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 05 14:50:51.034807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.065978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.084474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:51.087602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:51.109256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:51.110652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.142608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 0.6935439 Nov 05 14:50:51.148723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44866) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:51.155231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Request body: {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'mac_address': 'fa:16:3e:21:a6:f3', 'name': 'tempest-NetworksTestDHCPv6-2110162535'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:51.162282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7dc9c8e-ac8b-45f0-8b64-da9bf6a12218 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Subnet': ['ID=a21a9de0-7c92-4b55-8b37-2723044eb2e0,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:51.173027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:51.193968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:51.196144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6f42e72d-8f95-4783-82a7-99edeac923fe is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:51.197965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:51.201320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:51.261078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.264989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 31b60062-9117-4649-9c0d-018e776a3bcc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:51.267970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 31b60062-9117-4649-9c0d-018e776a3bcc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:51.269792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9950b0b7-10f2-4365-9bf8-ea1561796f24 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:51.296364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Made reservation on behalf of 6c1eac42b2854d16bc0940ee811229be for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:51.366285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.371990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 9950b0b7-10f2-4365-9bf8-ea1561796f24 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:50:51.373396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9950b0b7-10f2-4365-9bf8-ea1561796f24 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:50:51.376772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.422317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:51.427774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:51.437838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:51.448450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Pushing event updated for resources: {'Port': ['ID=b2b30375-395c-41b1-97f0-04093a949ee8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:51.467709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.511642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.553124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Attempting to bind port b2b30375-395c-41b1-97f0-04093a949ee8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:51.553524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Attempting to bind port b2b30375-395c-41b1-97f0-04093a949ee8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:51.553896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Attempting to bind port b2b30375-395c-41b1-97f0-04093a949ee8 on network b10e20e9-e25a-4832-bd50-e158aa6d5da9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:51.561580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:51.562278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Checking segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:51.562687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.563081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Bound using segment: {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:51.563547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Bound port: b2b30375-395c-41b1-97f0-04093a949ee8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c25bd26f-d0c3-42a1-9e61-f742954e18ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:51.563971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.570879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] device_id is not set on port 523599ef-2fcf-409b-9811-e8fa1078fc47 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:50:51.718381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] For port b2b30375-395c-41b1-97f0-04093a949ee8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:51.723754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] For port b2b30375-395c-41b1-97f0-04093a949ee8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b2b30375-395c-41b1-97f0-04093a949ee8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:51.730686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:51.829928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a363a680-1cfa-4b7d-91ed-106f92cd58e3 None None] Pushing event updated for resources: {'Port': ['ID=b2b30375-395c-41b1-97f0-04093a949ee8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:51.945962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8::175 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/874131b9-80ef-4cd6-bd33-7d88e5c45d57/523599ef-2fcf-409b-9811-e8fa1078fc47) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:51.952942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:51.965087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Allocated IP 2001:db8:0:1:f816:3eff:fe21:a6f3 (b10e20e9-e25a-4832-bd50-e158aa6d5da9/a21a9de0-7c92-4b55-8b37-2723044eb2e0/523599ef-2fcf-409b-9811-e8fa1078fc47) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:52.052204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.062915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.093781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2121731271'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:52.130179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.178345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:52.183041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.186840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.199077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.216007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:52.268374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6f42e72d-8f95-4783-82a7-99edeac923fe is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:52.268626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.270404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:52.327063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:52.331214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:52.341055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:52.347399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:52.348094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.371750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event updated for resources: {'Port': ['ID=523599ef-2fcf-409b-9811-e8fa1078fc47,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:52.380035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0554dec2-7204-4f22-b888-0ab8dee27920 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.382643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.389475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.401533 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-52ede9c7-f17b-4374-a5f1-257caa04cd3b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.2514648 Nov 05 14:50:52.415921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44886) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:52.452602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:52.470675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c5a7eb4f-37ba-47aa-89e7-491987823dfc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:52.473763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.474112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment b5af64d6-5b6d-4c31-975c-26be66a33176 of type vlan for network 7af763c1-3dec-4615-bdd1-5bb920e3101e Nov 05 14:50:52.546147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.581929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.587546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:52.588136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.645107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting port 523599ef-2fcf-409b-9811-e8fa1078fc47 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:52.645468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.696908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:50:52.712885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7446034 Nov 05 14:50:52.712885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39fcda4-e852-4b5c-82ab-b51627c4e458 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=7af763c1-3dec-4615-bdd1-5bb920e3101e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:52.737198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:52.769136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:52.782983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Calling delete_port for 523599ef-2fcf-409b-9811-e8fa1078fc47 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:52.848759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:50:52.861342 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-df8c0896-0823-4c1c-a4c0-464962bd1467 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/c9eda620-b56d-4879-9d5c-3b17badf0d55/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1398997 Nov 05 14:50:52.882342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:50:52.903480 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:52.904741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:53.070981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:50:53.072213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.113042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c730cc3-b58d-428c-b3eb-36eee0d4a06e None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:53.114852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Port': ['ID=523599ef-2fcf-409b-9811-e8fa1078fc47,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:53.173081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.178771 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d124b702-d25a-4fb9-9ee5-f085d471617a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/523599ef-2fcf-409b-9811-e8fa1078fc47 HTTP/1.1" status: 204 len: 168 time: 0.7596552 Nov 05 14:50:53.179083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44892) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:53.220533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] Provisioning complete for port b2b30375-395c-41b1-97f0-04093a949ee8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:53.221171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.244291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-409551b7-ab1e-4c4c-be3c-7db17cbb802a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:53.249065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-409551b7-ab1e-4c4c-be3c-7db17cbb802a tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.0688050 Nov 05 14:50:53.249308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44894) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:53.264925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b2b30375-395c-41b1-97f0-04093a949ee8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:53.319570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0df1922-aa2e-4924-9bc6-c14dc2a5b9dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:53.321433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a0df1922-aa2e-4924-9bc6-c14dc2a5b9dd tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.0710356 Nov 05 14:50:53.323978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44896) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:53.390158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c5501f2-29b4-447e-9986-9ba7dd3fb016 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:53.392104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c5501f2-29b4-447e-9986-9ba7dd3fb016 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:53.393766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c5501f2-29b4-447e-9986-9ba7dd3fb016 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:53.398223 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0c5501f2-29b4-447e-9986-9ba7dd3fb016 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0706160 Nov 05 14:50:53.398859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44898) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:53.468417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet 874131b9-80ef-4cd6-bd33-7d88e5c45d57 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:53.471987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.472731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.492662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c730cc3-b58d-428c-b3eb-36eee0d4a06e None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:53.512938 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.527133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.534860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b2b30375-395c-41b1-97f0-04093a949ee8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:53.535356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.825067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] For port b2b30375-395c-41b1-97f0-04093a949ee8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b2b30375-395c-41b1-97f0-04093a949ee8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:53.832705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.835039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.908509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.936621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=874131b9-80ef-4cd6-bd33-7d88e5c45d57,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:53.941465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:53.947850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44902) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:53.956188 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c022903b-311c-4f4e-8a9c-9ca3c27747f2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/874131b9-80ef-4cd6-bd33-7d88e5c45d57 HTTP/1.1" status: 204 len: 168 time: 0.5558796 Nov 05 14:50:53.977845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58d5a58-fef0-4478-be24-0c8e6338672c None None] Pushing event updated for resources: {'Port': ['ID=b2b30375-395c-41b1-97f0-04093a949ee8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:54.006518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Deleting subnet a21a9de0-7c92-4b55-8b37-2723044eb2e0 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:50:54.009933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.014706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:50:51Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c55d2ea6-0622-4508-8711-245ed9cc9b39', 'name': '', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:6a:f2:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1165, 'fixed_ips': [{'subnet_id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:50:50Z', 'updated_at': '2021-11-05T14:50:51Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:54.048987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:50:54.049394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Updating router c9eda620-b56d-4879-9d5c-3b17badf0d55 port c55d2ea6-0622-4508-8711-245ed9cc9b39 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:50:54.059567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.099200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.116299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.186181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.219706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Subnet': ['ID=a21a9de0-7c92-4b55-8b37-2723044eb2e0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:54.222158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.228759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44904) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.228922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8b76b813-8080-4154-bb82-224a28b5e02e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/a21a9de0-7c92-4b55-8b37-2723044eb2e0 HTTP/1.1" status: 204 len: 168 time: 0.2797632 Nov 05 14:50:54.289162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-50ad9751-fc15-478a-a95a-8dad20fc1dc0 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0583143 Nov 05 14:50:54.291497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44906) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.315445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe90dd87-9472-48c5-9ed9-82c146ec0772 None None] Update dhcp port {'port': {'network_id': 'b10e20e9-e25a-4832-bd50-e158aa6d5da9', 'fixed_ips': [{'subnet_id': 'a21a9de0-7c92-4b55-8b37-2723044eb2e0'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': 'b2b30375-395c-41b1-97f0-04093a949ee8'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:50:54.348599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e34e4d5-ff27-4542-9d66-f5481e916109 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:54.353137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e34e4d5-ff27-4542-9d66-f5481e916109 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0601361 Nov 05 14:50:54.353473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44908) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.383900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fe90dd87-9472-48c5-9ed9-82c146ec0772 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.415475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95fa4dd5-0fd6-4584-9ef5-9f3faaad4e6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:54.419928 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-95fa4dd5-0fd6-4584-9ef5-9f3faaad4e6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0653052 Nov 05 14:50:54.420746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44910) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.467088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44912) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.467401 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-87942c27-5760-4097-a836-4f968067628e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0429907 Nov 05 14:50:54.493343 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-a93a1bd0-5552-4875-8ac2-2824f567656f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.493961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a93a1bd0-5552-4875-8ac2-2824f567656f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.497979 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a93a1bd0-5552-4875-8ac2-2824f567656f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/523599ef-2fcf-409b-9811-e8fa1078fc47 HTTP/1.1" status: 404 len: 333 time: 0.0313284 Nov 05 14:50:54.501040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44914) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.528314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-06293fd5-43c4-4e8b-8a99-facfeaf445ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.528922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-06293fd5-43c4-4e8b-8a99-facfeaf445ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.535327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-06293fd5-43c4-4e8b-8a99-facfeaf445ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/a21a9de0-7c92-4b55-8b37-2723044eb2e0 HTTP/1.1" status: 404 len: 337 time: 0.0314908 Nov 05 14:50:54.535502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44916) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.564027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-bca8ed0a-0e36-4b1b-a1be-bdcb8196a9d3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.570052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bca8ed0a-0e36-4b1b-a1be-bdcb8196a9d3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.577156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bca8ed0a-0e36-4b1b-a1be-bdcb8196a9d3 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/874131b9-80ef-4cd6-bd33-7d88e5c45d57 HTTP/1.1" status: 404 len: 337 time: 0.0369985 Nov 05 14:50:54.577448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44918) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.604404 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b32aa5ab-b8cf-46b3-94cc-132c0708bd51 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.605320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b32aa5ab-b8cf-46b3-94cc-132c0708bd51 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.611316 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b32aa5ab-b8cf-46b3-94cc-132c0708bd51 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/5c94dfb0-c33f-42c9-b137-0c89e0ebe5c6 HTTP/1.1" status: 404 len: 333 time: 0.0301349 Nov 05 14:50:54.611584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44920) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.638768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.640714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-92624603-47cd-4bc1-95df-72934d9d2c6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.641732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-92624603-47cd-4bc1-95df-72934d9d2c6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.645298 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-92624603-47cd-4bc1-95df-72934d9d2c6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/e494c577-e67a-482d-aefd-5e890ef4a070 HTTP/1.1" status: 404 len: 337 time: 0.0326571 Nov 05 14:50:54.647864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.649313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c09ca9c2-f698-4767-aa57-1b54c25ba452 None None] Network b10e20e9-e25a-4832-bd50-e158aa6d5da9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:54.666078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.680345 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9fef6826-5a14-4f95-b473-75a991315022 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.680926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9fef6826-5a14-4f95-b473-75a991315022 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.684537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9fef6826-5a14-4f95-b473-75a991315022 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/0fd7742e-6c21-4877-9acf-2c1022179d22 HTTP/1.1" status: 404 len: 337 time: 0.0344715 Nov 05 14:50:54.687431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44924) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.711336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-e7938ec2-5bac-4673-ab01-bc628c6668ff tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.711708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e7938ec2-5bac-4673-ab01-bc628c6668ff tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.718786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44926) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.724555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e7938ec2-5bac-4673-ab01-bc628c6668ff tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/f50ad061-fb48-46f6-95bf-d93e3e2caa05 HTTP/1.1" status: 404 len: 333 time: 0.0263355 Nov 05 14:50:54.750571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-d6a4b482-d8c1-4537-954e-b4bcdcbaff52 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.751333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d6a4b482-d8c1-4537-954e-b4bcdcbaff52 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.754930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d6a4b482-d8c1-4537-954e-b4bcdcbaff52 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/5dbf5b48-77d8-40dd-a460-c16291e3adac HTTP/1.1" status: 404 len: 337 time: 0.0344188 Nov 05 14:50:54.757388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44928) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.797368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-cda637b2-3fab-4d81-8d50-193f9706b864 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.797871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cda637b2-3fab-4d81-8d50-193f9706b864 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.803453 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cda637b2-3fab-4d81-8d50-193f9706b864 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/5ebac38e-0a1c-4f32-8dda-652caf8c9f83 HTTP/1.1" status: 404 len: 337 time: 0.0428216 Nov 05 14:50:54.803711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44930) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.815882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-98122812-88b0-47a7-bf0a-4d8e7dad24a5 None None] Provisioning complete for port b2b30375-395c-41b1-97f0-04093a949ee8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:54.816250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-98122812-88b0-47a7-bf0a-4d8e7dad24a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.845356 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-007fa4e6-4ef8-41e1-ad99-767bbf80970f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.846123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-007fa4e6-4ef8-41e1-ad99-767bbf80970f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.851606 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-007fa4e6-4ef8-41e1-ad99-767bbf80970f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ab4213b2-b456-40ba-94f9-2bbd8345a17e HTTP/1.1" status: 404 len: 333 time: 0.0448036 Nov 05 14:50:54.851975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44932) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.871200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a9c9a7-d375-4d6a-b25b-1d5dd161b086 None None] Pushing event updated for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:54.881447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7a653d9-25ad-4c7c-9750-09d7af4ab3d2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.881900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a7a653d9-25ad-4c7c-9750-09d7af4ab3d2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.884947 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a7a653d9-25ad-4c7c-9750-09d7af4ab3d2 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/232dfb4d-66b6-4e3c-b2e6-1aa9cfb8b095 HTTP/1.1" status: 404 len: 337 time: 0.0316219 Nov 05 14:50:54.887611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44934) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.912695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Attempting to bind port c55d2ea6-0622-4508-8711-245ed9cc9b39 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:54.913152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Attempting to bind port c55d2ea6-0622-4508-8711-245ed9cc9b39 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:54.913591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Attempting to bind port c55d2ea6-0622-4508-8711-245ed9cc9b39 on network 6f42e72d-8f95-4783-82a7-99edeac923fe {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:54.934769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:54.935807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Checking segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:54.936305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.936778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Bound using segment: {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:54.937390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Bound port: c55d2ea6-0622-4508-8711-245ed9cc9b39, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'afefeb50-4b2f-4f90-9f53-397926bd6c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:54.937903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.944970 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-b84576f4-a3ad-45da-bbee-037a756e0aba tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.945519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b84576f4-a3ad-45da-bbee-037a756e0aba tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.954506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b84576f4-a3ad-45da-bbee-037a756e0aba tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/1781de4d-f1e3-490e-afc1-53421e38642b HTTP/1.1" status: 404 len: 337 time: 0.0657873 Nov 05 14:50:54.957058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44936) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:54.966820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:54.989971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] DHCP port deletion for b10e20e9-e25a-4832-bd50-e158aa6d5da9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:50:54.991512 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ec1a440-af84-492e-a720-1783f0e5a1c5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:54.992230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8ec1a440-af84-492e-a720-1783f0e5a1c5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:54.999774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44938) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.000740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8ec1a440-af84-492e-a720-1783f0e5a1c5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/afb02604-bc87-4a39-b84b-d63d621ce79b HTTP/1.1" status: 404 len: 333 time: 0.0425899 Nov 05 14:50:55.029365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-b0752a93-3805-479c-b80d-90ef9ae6c991 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.029823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b0752a93-3805-479c-b80d-90ef9ae6c991 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.032952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0752a93-3805-479c-b80d-90ef9ae6c991 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/470327d9-d700-40da-96a2-04eb701e7ef2 HTTP/1.1" status: 404 len: 337 time: 0.0324018 Nov 05 14:50:55.035503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44940) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.063890 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-cdd7d99f-71dd-46e3-a009-8fe79b386356 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.064607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cdd7d99f-71dd-46e3-a009-8fe79b386356 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.068065 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cdd7d99f-71dd-46e3-a009-8fe79b386356 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/10584cdf-2416-494d-82c9-d2782ca63001 HTTP/1.1" status: 404 len: 333 time: 0.0315571 Nov 05 14:50:55.070727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44942) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.103824 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-0b881260-92a3-477b-aee4-be60519f942f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.104874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0b881260-92a3-477b-aee4-be60519f942f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.107560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] For port c55d2ea6-0622-4508-8711-245ed9cc9b39, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:55.109595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0b881260-92a3-477b-aee4-be60519f942f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/4416bcee-74a8-453e-84de-be049ae093d8 HTTP/1.1" status: 404 len: 337 time: 0.0375903 Nov 05 14:50:55.118958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44944) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.142369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] For port c55d2ea6-0622-4508-8711-245ed9cc9b39, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c55d2ea6-0622-4508-8711-245ed9cc9b39,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:55.160333 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-de699623-2c76-4288-91fe-69477e84ddd1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.162040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de699623-2c76-4288-91fe-69477e84ddd1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.165480 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-de699623-2c76-4288-91fe-69477e84ddd1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ccc392a8-a3aa-4a03-ac07-79d71de8ce60 HTTP/1.1" status: 404 len: 333 time: 0.0454841 Nov 05 14:50:55.168028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44946) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.174374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.210799 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c991d910-1d77-46fc-a990-3809d88e0c2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.211456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c991d910-1d77-46fc-a990-3809d88e0c2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.215032 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c991d910-1d77-46fc-a990-3809d88e0c2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/10e168b8-9853-4b5f-8ec5-accc8720fb64 HTTP/1.1" status: 404 len: 337 time: 0.0450091 Nov 05 14:50:55.217274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44948) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.234854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b2b30375-395c-41b1-97f0-04093a949ee8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:50:55.243599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Deleting port b2b30375-395c-41b1-97f0-04093a949ee8 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:50:55.244097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.250164 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce0099fe-8bad-460e-835a-fb1677c8bcf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.251100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ce0099fe-8bad-460e-835a-fb1677c8bcf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.254334 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ce0099fe-8bad-460e-835a-fb1677c8bcf5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/a8f0be00-4737-47fd-814c-2584c09bec2f HTTP/1.1" status: 404 len: 333 time: 0.0355573 Nov 05 14:50:55.256956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44950) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.287044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a9c9a7-d375-4d6a-b25b-1d5dd161b086 None None] Pushing event updated for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:55.314135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-fbc53426-39fc-4d0f-beca-f7c025e8a7f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.315335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fbc53426-39fc-4d0f-beca-f7c025e8a7f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.323873 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fbc53426-39fc-4d0f-beca-f7c025e8a7f5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/245dcaa9-521b-45b6-b3de-0e9176a266e8 HTTP/1.1" status: 404 len: 337 time: 0.0646319 Nov 05 14:50:55.325549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44952) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.363934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-c0462788-84cd-498d-9c77-7d61816d1f37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.364751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c0462788-84cd-498d-9c77-7d61816d1f37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.372389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c0462788-84cd-498d-9c77-7d61816d1f37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ac1c1ee4-b886-417b-91fd-f97d0e9e3f41 HTTP/1.1" status: 404 len: 333 time: 0.0434954 Nov 05 14:50:55.372634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] Provisioning complete for port c55d2ea6-0622-4508-8711-245ed9cc9b39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:55.372634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.373096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44956) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.409099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:50:55.409740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:55.410356 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-124d7eaa-9403-4ab9-a405-dbaebfd0ad6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.410921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-124d7eaa-9403-4ab9-a405-dbaebfd0ad6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.417288 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-124d7eaa-9403-4ab9-a405-dbaebfd0ad6c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/c8523a76-c2c2-46ee-b8c8-7b8f9c973770 HTTP/1.1" status: 404 len: 337 time: 0.0409198 Nov 05 14:50:55.417456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] For port b2b30375-395c-41b1-97f0-04093a949ee8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b2b30375-395c-41b1-97f0-04093a949ee8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:55.417456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.419192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44958) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.451790 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-bd1ff445-135e-49dc-b79a-602a826bdf8b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.452823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bd1ff445-135e-49dc-b79a-602a826bdf8b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.458506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bd1ff445-135e-49dc-b79a-602a826bdf8b tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/99b59178-afee-446e-bc07-89108b770bdf HTTP/1.1" status: 404 len: 333 time: 0.0372491 Nov 05 14:50:55.459496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44960) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.503173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Calling delete_port for b2b30375-395c-41b1-97f0-04093a949ee8 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:50:55.509345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-54b61268-c2e6-4822-bcfb-f291cb9f40a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.510365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-54b61268-c2e6-4822-bcfb-f291cb9f40a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.517026 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54b61268-c2e6-4822-bcfb-f291cb9f40a1 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/4c86fd28-8a5c-44a7-9a11-d2133f9aaf67 HTTP/1.1" status: 404 len: 337 time: 0.0538781 Nov 05 14:50:55.517526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44962) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.559198 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4de39c79-eb79-44ae-87ab-91e77ca60dfe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.559817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4de39c79-eb79-44ae-87ab-91e77ca60dfe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.565890 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4de39c79-eb79-44ae-87ab-91e77ca60dfe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/af42dfc8-6354-41fc-914a-f56f008b1cfa HTTP/1.1" status: 404 len: 337 time: 0.0444987 Nov 05 14:50:55.567271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44964) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.593279 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-9de9585a-bcc1-4ec0-bfca-a7a7a9a92e8e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.596112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9de9585a-bcc1-4ec0-bfca-a7a7a9a92e8e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.599324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.604775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9de9585a-bcc1-4ec0-bfca-a7a7a9a92e8e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/ecf5d3b7-3aa8-4686-a10e-bc542ba803cd HTTP/1.1" status: 404 len: 333 time: 0.0338116 Nov 05 14:50:55.605611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44966) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.640914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f651bf4-5b63-4015-acab-5b473ddcd684 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.641397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f651bf4-5b63-4015-acab-5b473ddcd684 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.644586 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8f651bf4-5b63-4015-acab-5b473ddcd684 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/941f7d6a-d3dd-4bba-b208-d876558a0668 HTTP/1.1" status: 404 len: 337 time: 0.0370059 Nov 05 14:50:55.647026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44968) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.673193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b2b30375-395c-41b1-97f0-04093a949ee8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b2b30375-395c-41b1-97f0-04093a949ee8,segment=NetworkSegment(c25bd26f-d0c3-42a1-9e61-f742954e18ac),segment_id=c25bd26f-d0c3-42a1-9e61-f742954e18ac)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:55.677936 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-17158494-1fe4-4d46-8c45-e053ca663b3f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.677936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-17158494-1fe4-4d46-8c45-e053ca663b3f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.681678 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-17158494-1fe4-4d46-8c45-e053ca663b3f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/f0bcc517-0f46-4740-80b0-e4593bc6bd5e HTTP/1.1" status: 404 len: 337 time: 0.0337124 Nov 05 14:50:55.684652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44970) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.710813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.713620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:50:55.715957 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e115156-ba3f-4fcd-9c67-b4ce21113f77 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.715957 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e115156-ba3f-4fcd-9c67-b4ce21113f77 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.719318 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5e115156-ba3f-4fcd-9c67-b4ce21113f77 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/4d605aed-24aa-429d-954c-139e65b87aaf HTTP/1.1" status: 404 len: 333 time: 0.0319076 Nov 05 14:50:55.722270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44972) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.753329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-a551b260-a755-4777-a912-f8c3070f6b43 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.753924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a551b260-a755-4777-a912-f8c3070f6b43 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.759562 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a551b260-a755-4777-a912-f8c3070f6b43 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/33d79753-cab7-45b2-8878-491209ca8695 HTTP/1.1" status: 404 len: 337 time: 0.0328429 Nov 05 14:50:55.760183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44974) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.786322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb7e0ca9-6964-4280-bdf5-d5c0db95f9fe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.786940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb7e0ca9-6964-4280-bdf5-d5c0db95f9fe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.792810 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fb7e0ca9-6964-4280-bdf5-d5c0db95f9fe tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/b2527de8-ac81-4260-9913-f74a88c7062b HTTP/1.1" status: 404 len: 337 time: 0.0290759 Nov 05 14:50:55.794836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44976) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.802105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.823115 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-283cfc55-736f-49b0-ae19-94bf6af2ebef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.824096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-283cfc55-736f-49b0-ae19-94bf6af2ebef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.830340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-283cfc55-736f-49b0-ae19-94bf6af2ebef tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/2a04edba-bc8e-40e7-9635-82b241595a08 HTTP/1.1" status: 404 len: 333 time: 0.0320196 Nov 05 14:50:55.831553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44978) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.857401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-544eb17e-31c8-49e7-b675-5c376dc3139e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.858357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-544eb17e-31c8-49e7-b675-5c376dc3139e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.863642 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-544eb17e-31c8-49e7-b675-5c376dc3139e tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/87967cb5-16aa-49ed-9935-26fdde4030e3 HTTP/1.1" status: 404 len: 337 time: 0.0296996 Nov 05 14:50:55.864885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44980) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.865054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.885196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b2b30375-395c-41b1-97f0-04093a949ee8,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:55.894015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9cbb341c-b0d1-4d75-8092-7f963d553359 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:55.894603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9cbb341c-b0d1-4d75-8092-7f963d553359 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:55.900650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9cbb341c-b0d1-4d75-8092-7f963d553359 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/412fdc86-72fe-42be-a9d6-a604f13e9214 HTTP/1.1" status: 404 len: 337 time: 0.0317576 Nov 05 14:50:55.900959 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44982) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.935208 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-876c1c8d-941a-4fa3-93ec-7a7f2ad9f1d5 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports?device_id=d4048807-5f13-4206-9a9b-0d4c0cb0fbbd HTTP/1.1" status: 200 len: 205 time: 0.0306261 Nov 05 14:50:55.935462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44984) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.936522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] No DVR routers for this DVR port b2b30375-395c-41b1-97f0-04093a949ee8 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:50:55.944177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d26d7c6f-d190-4a1e-aee7-959616103d48 None None] Pushing event deleted for resources: {'Port': ['ID=b2b30375-395c-41b1-97f0-04093a949ee8,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:55.958674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] For port c55d2ea6-0622-4508-8711-245ed9cc9b39, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c55d2ea6-0622-4508-8711-245ed9cc9b39,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:55.959766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:55.978692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-0480b97e-820b-4696-8292-6dc91d618c95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] delete failed (client error): The resource could not be found. Nov 05 14:50:55.982831 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0480b97e-820b-4696-8292-6dc91d618c95 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/routers/d4048807-5f13-4206-9a9b-0d4c0cb0fbbd HTTP/1.1" status: 404 len: 336 time: 0.0431807 Nov 05 14:50:55.983653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44986) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:55.992936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 44988) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.006362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:56.011881 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-82c19a5c-e89e-4b7a-b427-b8877aed8c37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.012339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-82c19a5c-e89e-4b7a-b427-b8877aed8c37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.016048 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-82c19a5c-e89e-4b7a-b427-b8877aed8c37 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/64c672d2-220d-4e2a-8a91-e208f7489004 HTTP/1.1" status: 404 len: 337 time: 0.0313728 Nov 05 14:50:56.018646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44990) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.048762 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4324cdc3-f7f1-48d0-b002-5788c934638c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "GET /v2.0/ports?device_id=2c5f71a3-858d-4eeb-b981-4010027a4a3a HTTP/1.1" status: 200 len: 205 time: 0.0288911 Nov 05 14:50:56.051145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44992) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.102024 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-e953562c-5c8e-43dd-a8ef-626d27849e70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] delete failed (client error): The resource could not be found. Nov 05 14:50:56.103217 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e953562c-5c8e-43dd-a8ef-626d27849e70 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/routers/2c5f71a3-858d-4eeb-b981-4010027a4a3a HTTP/1.1" status: 404 len: 336 time: 0.0510776 Nov 05 14:50:56.105985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44994) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.108836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:56.112730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.136433 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-4479db86-de7a-4925-8174-d1b7c56a52cf tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.136834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4479db86-de7a-4925-8174-d1b7c56a52cf tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.140024 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4479db86-de7a-4925-8174-d1b7c56a52cf tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/33f8e1a1-1691-45cb-ac9d-aec04dbd05e1 HTTP/1.1" status: 404 len: 337 time: 0.0328348 Nov 05 14:50:56.142589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44996) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.158413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.181378 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-e667b90d-fcc6-4ac0-a60a-d437fb9c8d58 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.182074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e667b90d-fcc6-4ac0-a60a-d437fb9c8d58 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.185920 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e667b90d-fcc6-4ac0-a60a-d437fb9c8d58 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/3c98a3c2-b492-4ae7-9611-f92b792136c3 HTTP/1.1" status: 404 len: 337 time: 0.0422487 Nov 05 14:50:56.188354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 44998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.213664 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ef650c4b-51eb-493d-8afa-e631cdf4b3e7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.214365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ef650c4b-51eb-493d-8afa-e631cdf4b3e7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.217657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ef650c4b-51eb-493d-8afa-e631cdf4b3e7 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/e4b43ad4-9025-4e60-8b0d-925df9b5185f HTTP/1.1" status: 404 len: 333 time: 0.0281920 Nov 05 14:50:56.220096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45000) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.237378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433aa824-7e01-430b-9807-afa1dc4deee4 None None] Pushing event updated for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:56.251622 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c4bdbbc5-4834-4d1e-b019-3b72b0e92b2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.252167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c4bdbbc5-4834-4d1e-b019-3b72b0e92b2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.255430 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4bdbbc5-4834-4d1e-b019-3b72b0e92b2f tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/a768bb05-bb78-4925-8fda-9c0baf327757 HTTP/1.1" status: 404 len: 337 time: 0.0342948 Nov 05 14:50:56.257884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.282769 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2cd1c0fe-eea1-4d8c-bf48-44032becf771 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.283737 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2cd1c0fe-eea1-4d8c-bf48-44032becf771 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.287149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2cd1c0fe-eea1-4d8c-bf48-44032becf771 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/2dfc8537-16e5-4887-9cf9-489d02451b20 HTTP/1.1" status: 404 len: 333 time: 0.0280373 Nov 05 14:50:56.289644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45004) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.290753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9b19e8ba-9975-4547-a4e8-1fed47038cb7 None None] Provisioning complete for port c55d2ea6-0622-4508-8711-245ed9cc9b39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:56.291134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9b19e8ba-9975-4547-a4e8-1fed47038cb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.315091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.321236 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-5555714b-3fe9-431f-86b1-6b600bc44801 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.322069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5555714b-3fe9-431f-86b1-6b600bc44801 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.331043 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5555714b-3fe9-431f-86b1-6b600bc44801 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/e706d5bb-3762-4326-8986-774b1aaab6da HTTP/1.1" status: 404 len: 337 time: 0.0394335 Nov 05 14:50:56.332137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45006) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.359933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ed58199b-e40c-4e9c-b289-7e90b3313b2c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.361147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ed58199b-e40c-4e9c-b289-7e90b3313b2c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.363448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:50:51Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c55d2ea6-0622-4508-8711-245ed9cc9b39', 'name': '', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:6a:f2:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1165, 'fixed_ips': [{'subnet_id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:50:50Z', 'updated_at': '2021-11-05T14:50:55Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:56.367870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45008) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.368300 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ed58199b-e40c-4e9c-b289-7e90b3313b2c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/d477ac7c-42b7-4320-8cc5-815ca6f78796 HTTP/1.1" status: 404 len: 333 time: 0.0345013 Nov 05 14:50:56.397616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8085cc7-05da-4d1b-9dd6-c21f4d61fd88 None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:50:51Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c55d2ea6-0622-4508-8711-245ed9cc9b39', 'name': '', 'network_id': '6f42e72d-8f95-4783-82a7-99edeac923fe', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:6a:f2:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1165, 'fixed_ips': [{'subnet_id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:50:50Z', 'updated_at': '2021-11-05T14:50:55Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd4230734-010b-449e-9c56-77f77a8c925f', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:50:56.400314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=52f5eb84-f99d-4964-83b1-c68678a28029,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:56.414879 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-7f13b6de-bbb0-4743-940d-2215d6281024 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.415341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7f13b6de-bbb0-4743-940d-2215d6281024 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.418485 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7f13b6de-bbb0-4743-940d-2215d6281024 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/11204b5e-1e58-4357-91a5-02b709c7f8ec HTTP/1.1" status: 404 len: 337 time: 0.0475647 Nov 05 14:50:56.421124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.463985 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-5e61cba1-8759-4f50-87f5-9a891ceee61b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0752559 Nov 05 14:50:56.468286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'b5af64d6-5b6d-4c31-975c-26be66a33176', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:56.468712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 7af763c1-3dec-4615-bdd1-5bb920e3101e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:56.475256 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-24f8ec8f-486c-4427-b322-1efdfda95e23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.475951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24f8ec8f-486c-4427-b322-1efdfda95e23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.484571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-24f8ec8f-486c-4427-b322-1efdfda95e23 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/1c48c25e-2cfa-43eb-902b-6b4db807ee4e HTTP/1.1" status: 404 len: 333 time: 0.0623960 Nov 05 14:50:56.484764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45012) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.502933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:56.515177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 7af763c1-3dec-4615-bdd1-5bb920e3101e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:56.516524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-38676a45-afd3-4413-97c6-1e9132a51220 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.516979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-38676a45-afd3-4413-97c6-1e9132a51220 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.524308 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-38676a45-afd3-4413-97c6-1e9132a51220 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/dc61f290-cd06-42ed-8982-77970397aacc HTTP/1.1" status: 404 len: 337 time: 0.0370946 Nov 05 14:50:56.528276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74a1c80b-29ae-41c7-97a0-7829712baf3d None None] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:56.534820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45014) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.536711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:56.536711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.563787 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1deae280-7dcd-4e17-94ad-4381b8a18158 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5693293 Nov 05 14:50:56.567176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45016) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.570340 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-24778462-9460-491a-83d6-afe84ac8286c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.571089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24778462-9460-491a-83d6-afe84ac8286c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.574711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1648346156'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:56.577407 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24778462-9460-491a-83d6-afe84ac8286c tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/df8146e1-ec8d-4995-bb95-8971b515eb88 HTTP/1.1" status: 404 len: 333 time: 0.0414577 Nov 05 14:50:56.581201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45018) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.605014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:56.610850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.632215 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-120c1aca-c297-4d96-bf54-df96c0cd4491 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.632708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-120c1aca-c297-4d96-bf54-df96c0cd4491 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-74a1c80b-29ae-41c7-97a0-7829712baf3d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:56.635208 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:56.639585 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-120c1aca-c297-4d96-bf54-df96c0cd4491 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/66450838-5872-4508-8f2f-b18bf8d25df9 HTTP/1.1" status: 404 len: 337 time: 0.0562043 Nov 05 14:50:56.641077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45020) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.648048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a1295df-b8d0-4e3a-89f9-032642ca95d4 None None] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:50:56.650602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 637} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:56.660135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.660523 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment a35b305c-6dc4-44c6-8099-f5095da3d078 of type vlan for network 93897455-afbe-4960-a8fe-81ce8457870d Nov 05 14:50:56.670371 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-2592c021-e7d5-49b4-9c18-4a294fa672ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.671496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2592c021-e7d5-49b4-9c18-4a294fa672ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.675708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2592c021-e7d5-49b4-9c18-4a294fa672ae tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/f5e063c4-2754-475a-9c55-2149d6a3f3cd HTTP/1.1" status: 404 len: 333 time: 0.0347447 Nov 05 14:50:56.678253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45022) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.704263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.717209 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-32142ea4-9f63-442e-a15e-98f54bc91a08 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.717660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-32142ea4-9f63-442e-a15e-98f54bc91a08 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.721218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-32142ea4-9f63-442e-a15e-98f54bc91a08 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/f6f3175d-c163-448a-9ed7-190917a19926 HTTP/1.1" status: 404 len: 337 time: 0.0415251 Nov 05 14:50:56.724430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45024) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4a1295df-b8d0-4e3a-89f9-032642ca95d4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:50:56.729824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:50:56.736838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.740996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9733fd1e-447a-4ff6-a341-f31328dcf336 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:56.743604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:56.744315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.760263 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-62f06e54-6af1-403a-905c-cb6498bd5c63 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.761004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-62f06e54-6af1-403a-905c-cb6498bd5c63 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.767404 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-62f06e54-6af1-403a-905c-cb6498bd5c63 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/ports/d6cf7793-6c1b-4377-98a7-19c6cd75dbef HTTP/1.1" status: 404 len: 333 time: 0.0417316 Nov 05 14:50:56.771296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-ef7b8d2e-9ba4-4280-bae6-85d93b36819e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:56.772801 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-ef7b8d2e-9ba4-4280-bae6-85d93b36819e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1099 time: 0.2474167 Nov 05 14:50:56.773916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45026) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.813643 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2426908 Nov 05 14:50:56.814447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45028) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.819632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '93897455-afbe-4960-a8fe-81ce8457870d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:56.828815 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-c97379e4-0a7c-4cf8-89ba-eb2c73d294ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] DELETE failed (client error): The resource could not be found. Nov 05 14:50:56.829304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c97379e4-0a7c-4cf8-89ba-eb2c73d294ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:50:56.835380 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c97379e4-0a7c-4cf8-89ba-eb2c73d294ed tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/subnets/fe3e362f-5083-44d4-a2b6-0e9e05fc1d22 HTTP/1.1" status: 404 len: 337 time: 0.0583694 Nov 05 14:50:56.844108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45030) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:56.870901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad56381-f08c-4a62-88af-36037acbbab0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=93897455-afbe-4960-a8fe-81ce8457870d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:56.889468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9733fd1e-447a-4ff6-a341-f31328dcf336 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:56.894337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 93897455-afbe-4960-a8fe-81ce8457870d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:56.930178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:56.933827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:56.961415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.189075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.246363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c55d2ea6-0622-4508-8711-245ed9cc9b39 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:57.250261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=80c84fe6-26a8-46f1-8904-4de1338c8bc4,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:57.291481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'a35b305c-6dc4-44c6-8099-f5095da3d078', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '93897455-afbe-4960-a8fe-81ce8457870d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:57.292497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 93897455-afbe-4960-a8fe-81ce8457870d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:57.317485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 93897455-afbe-4960-a8fe-81ce8457870d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:57.331288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 93897455-afbe-4960-a8fe-81ce8457870d) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:57.344675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c55d2ea6-0622-4508-8711-245ed9cc9b39 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:57.345141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.348582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:57.350360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.372356 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3dbc35ec-d38b-469c-a74d-27fbe9b2d73d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.5568252 Nov 05 14:50:57.374270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-7af763c1-3dec-4615-bdd1-5bb920e3101e', 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e', 'tenant_id': 'e4e12076a8c94dbbbd5277433a80c9aa', 'fixed_ips': [{'subnet_id': '52f5eb84-f99d-4964-83b1-c68678a28029'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:57.375131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.375734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45032) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:57.492730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.501991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.512543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-d91733e0-d81b-4e0d-8cc4-256e8075d987 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:57.514552 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-d91733e0-d81b-4e0d-8cc4-256e8075d987 service neutron] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 898 time: 0.7185609 Nov 05 14:50:57.539100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b10e20e9-e25a-4832-bd50-e158aa6d5da9']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.550303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.558392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Allocated IP 2001:db8:0:ffff::2 (7af763c1-3dec-4615-bdd1-5bb920e3101e/52f5eb84-f99d-4964-83b1-c68678a28029/68b9a9fa-843f-45e0-aba7-b0c4610b00f8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:50:57.583397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c25bd26f-d0c3-42a1-9e61-f742954e18ac') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.583397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c25bd26f-d0c3-42a1-9e61-f742954e18ac') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.596092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.619929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.626400 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-d203a525-1570-4c23-b8d5-6ca45c51d00e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 1002 time: 0.0984585 Nov 05 14:50:57.627482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.643709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Releasing vlan 604 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:57.644109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:57.648008 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:57.655362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=80c84fe6-26a8-46f1-8904-4de1338c8bc4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:57.716798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.733041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.739005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-58fa774a-b3c6-4bed-9769-0f1690bf46e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:57.740624 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-58fa774a-b3c6-4bed-9769-0f1690bf46e0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.1067719 Nov 05 14:50:57.741314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.741543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.742035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93897455-afbe-4960-a8fe-81ce8457870d']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.750700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.751993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a35b305c-6dc4-44c6-8099-f5095da3d078') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.752284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a35b305c-6dc4-44c6-8099-f5095da3d078') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:57.757343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] 10.222.0.30 "DELETE /v2.0/networks/b10e20e9-e25a-4832-bd50-e158aa6d5da9 HTTP/1.1" status: 204 len: 168 time: 0.9100459 Nov 05 14:50:57.766029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.783967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.791133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 637 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:50:57.792444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.794798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:50:57.796069 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:50:57.799968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Pushing event updated for resources: {'Port': ['ID=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:57.804645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1a2be0-fa1a-4897-844e-0f08ecbaa263 tempest-NetworksTestDHCPv6-1229495084 tempest-NetworksTestDHCPv6-1229495084-project] Pushing event deleted for resources: {'Network': ['ID=b10e20e9-e25a-4832-bd50-e158aa6d5da9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:57.813526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:57.816984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:50:57.825801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-59cd0fcf-cb1b-4b12-a509-b33bbb7046d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:57.827678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-59cd0fcf-cb1b-4b12-a509-b33bbb7046d3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0702822 Nov 05 14:50:57.878873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.891502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.892346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Attempting to bind port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:50:57.893261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Attempting to bind port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b5af64d6-5b6d-4c31-975c-26be66a33176', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:50:57.893644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Attempting to bind port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 on network 7af763c1-3dec-4615-bdd1-5bb920e3101e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:50:57.896474 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/93897455-afbe-4960-a8fe-81ce8457870d HTTP/1.1" status: 204 len: 168 time: 0.5192244 Nov 05 14:50:57.899926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45040) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:57.906817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:50:57.907203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Checking segment: {'id': 'b5af64d6-5b6d-4c31-975c-26be66a33176', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:57.907613 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.908153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Bound using segment: {'id': 'b5af64d6-5b6d-4c31-975c-26be66a33176', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:50:57.908728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Bound port: 68b9a9fa-843f-45e0-aba7-b0c4610b00f8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5af64d6-5b6d-4c31-975c-26be66a33176', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '7af763c1-3dec-4615-bdd1-5bb920e3101e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:50:57.909513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.909906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-509891764'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:57.910696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1e2801-ca08-4666-91c2-d5d6e1a19d89 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=93897455-afbe-4960-a8fe-81ce8457870d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:57.959697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:57.966415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:57.982479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-21980291-1537-46f1-9685-af06e75582c9 None None] For port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:50:57.982933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-9a505908-0a3b-4b5b-b32a-2aa86f5cf7c7 service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1463418 Nov 05 14:50:57.985815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-21980291-1537-46f1-9685-af06e75582c9 None None] For port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,segment=NetworkSegment(b5af64d6-5b6d-4c31-975c-26be66a33176),segment_id=b5af64d6-5b6d-4c31-975c-26be66a33176)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:50:57.992255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.053064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21980291-1537-46f1-9685-af06e75582c9 None None] Pushing event updated for resources: {'Port': ['ID=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:58.055211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 641} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:58.074188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.074760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment d66b7cfc-30de-4b42-9a71-760fa1099c86 of type vlan for network a90ba218-4374-4630-b1ee-6495377ae3f1 Nov 05 14:50:58.104049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45044) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:58.137053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.148570 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0745e2a0-569b-4f49-91ef-97c53bb2a803 req-dfb28824-cd5d-40b5-9760-1c31053f3fed service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1574082 Nov 05 14:50:58.169884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.176260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:58.176891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.239298 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3380804 Nov 05 14:50:58.242208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45048) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:58.258349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:58.295505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6d1d93-8149-4e22-9436-213c0b1ca0ca tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=a90ba218-4374-4630-b1ee-6495377ae3f1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:58.315495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a90ba218-4374-4630-b1ee-6495377ae3f1 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:58.349841 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-40b744a6-cd1e-416b-9d4a-a02a35bee9bd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6c1eac42b2854d16bc0940ee811229be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2419188 Nov 05 14:50:58.350448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45050) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:58.403987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:58.407561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.469704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.504925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.594481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.597066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.598217 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/11ddda98-43c0-4ce7-b6e1-50d929ed73fb HTTP/1.1" status: 204 len: 168 time: 0.2472508 Nov 05 14:50:58.620379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529d561d-873f-4b86-b663-4a9d50102779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11ddda98-43c0-4ce7-b6e1-50d929ed73fb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:58.673561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.734183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:58.746149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'd66b7cfc-30de-4b42-9a71-760fa1099c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:58.746496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: a90ba218-4374-4630-b1ee-6495377ae3f1, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:58.766442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network a90ba218-4374-4630-b1ee-6495377ae3f1 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:58.778388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a90ba218-4374-4630-b1ee-6495377ae3f1) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:58.783326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:58.784118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.807248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45056) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:58.813156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1392773463'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:58.813323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e1608acb-4e80-453b-b001-8d33607cbc46 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 0.5696614 Nov 05 14:50:58.842708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:58.846432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.876469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 604} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:58.891735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.892182 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment 9f678d62-82dc-49bd-91ed-19a823ea3809 of type vlan for network 55438f8e-e3b1-4529-a257-0177cc94bb35 Nov 05 14:50:58.942996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.974246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:58.980997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:58.982154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.054480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45066) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:59.054610 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2462139 Nov 05 14:50:59.060062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '55438f8e-e3b1-4529-a257-0177cc94bb35', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:59.061343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0172027-920c-4d74-b743-883b251dff37 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=55438f8e-e3b1-4529-a257-0177cc94bb35,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.074546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 55438f8e-e3b1-4529-a257-0177cc94bb35 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:50:59.202530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:59.208520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.215457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:50:59.245761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0d78595-b4e6-4d45-9659-a6daff47b65e None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:50:59.273886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.ipam_backend_mixin [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Performing IP validity checks on allocation pools {{(pid=113580) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:50:59.274417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.ipam_backend_mixin [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113580) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:50:59.333359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:59.333902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.393964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5d480340-a406-4564-b18e-e771a439fa67 None None] Provisioning complete for port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:50:59.394494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d480340-a406-4564-b18e-e771a439fa67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.404157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45076) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:59.409633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.458312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0d78595-b4e6-4d45-9659-a6daff47b65e None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:50:59.471685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=cd928e0e-d6e9-4a3b-93a7-eebc2173689f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.481005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': '9f678d62-82dc-49bd-91ed-19a823ea3809', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '55438f8e-e3b1-4529-a257-0177cc94bb35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:50:59.482127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 55438f8e-e3b1-4529-a257-0177cc94bb35, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:50:59.511865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.514322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 55438f8e-e3b1-4529-a257-0177cc94bb35 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:50:59.528072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 55438f8e-e3b1-4529-a257-0177cc94bb35) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:50:59.536021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:59.536761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.543951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-650762714'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:59.565320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:50:59.569502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.571846 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-535ee0f3-ab88-4562-9422-16b7a27c8a45 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 0.5161843 Nov 05 14:50:59.575199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45080) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:59.585128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.640604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,segment=NetworkSegment(b5af64d6-5b6d-4c31-975c-26be66a33176),segment_id=b5af64d6-5b6d-4c31-975c-26be66a33176)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:50:59.645104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d480340-a406-4564-b18e-e771a439fa67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.656398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.690476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.694417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.695668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.727438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 645} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:50:59.737276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e0866fe1-458f-4345-8403-cbccaacd9294,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.743994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.743994 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment 45ed7a9f-3390-4f59-81f4-13bc1b71301c of type vlan for network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 Nov 05 14:50:59.751972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.778618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.795159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.807634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-5d480340-a406-4564-b18e-e771a439fa67 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:50:59.807992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-5d480340-a406-4564-b18e-e771a439fa67 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:50:59.819814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.822614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.830856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:50:59.831889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.847984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=cd928e0e-d6e9-4a3b-93a7-eebc2173689f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.860857 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.4551897 Nov 05 14:50:59.861502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45082) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:50:59.876985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'name': 'tempest-PortsTestJSON-1843313528'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:50:59.916866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a90ba218-4374-4630-b1ee-6495377ae3f1', 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1', 'tenant_id': 'e4e12076a8c94dbbbd5277433a80c9aa', 'fixed_ips': [{'subnet_id': '1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:50:59.918746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.921461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.949610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55438f8e-e3b1-4529-a257-0177cc94bb35']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:59.963018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9f678d62-82dc-49bd-91ed-19a823ea3809') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:59.963318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9f678d62-82dc-49bd-91ed-19a823ea3809') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:50:59.977304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:50:59.981094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183608dc-6113-4fe2-beb8-322a987e49dd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:50:59.993853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.001926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 604 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:00.002327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.021497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:00.025996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.027013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:00.047350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:00.064232 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:00.068414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.081632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.085919 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/55438f8e-e3b1-4529-a257-0177cc94bb35 HTTP/1.1" status: 204 len: 168 time: 0.5087512 Nov 05 14:51:00.099155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45084) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:00.106102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1763892463'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.110949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a3c247-a44c-4ff2-909c-71bc7bf4b06d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=55438f8e-e3b1-4529-a257-0177cc94bb35,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.134910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:00.139076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.169105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 633} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:00.182596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.182830 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment 82cdc934-4990-42e3-a2a8-d9f0e9d0d03c of type vlan for network 2ec6930a-aaef-48c1-a42b-556c22ac1062 Nov 05 14:51:00.186045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Allocated IP 2001:db8::1 (a90ba218-4374-4630-b1ee-6495377ae3f1/1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842/7271b469-820b-49bd-9c96-32c16ffb85c8) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:00.235506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.259805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.266933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.275246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:00.276103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.298115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.360862 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2603300 Nov 05 14:51:00.363994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45088) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:00.365261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1872859-216a-43ee-a1f7-184cddde0080 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=2ec6930a-aaef-48c1-a42b-556c22ac1062,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.372239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '2ec6930a-aaef-48c1-a42b-556c22ac1062', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.387648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=88fbe395-fa9d-43e6-bbfe-e1e7831bad59,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.424936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 2ec6930a-aaef-48c1-a42b-556c22ac1062 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:00.451229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': '45ed7a9f-3390-4f59-81f4-13bc1b71301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:00.451587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:00.491145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:00.514217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:00.519878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:00.535517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:00.536448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.548714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:00.554787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.602236 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ea773c80-94aa-405d-a087-a94662d2fdc4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.7298834 Nov 05 14:51:00.605605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45090) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:00.611414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-2127156017'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.620369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.628765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.634491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:00.641361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.670787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 604} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:00.681193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.681434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Network a90ba218-4374-4630-b1ee-6495377ae3f1 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:00.681667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment eb73353f-0122-42d0-888b-b821c92afaaa of type vlan for network 81e73083-a5f4-4f46-ad25-ea69cf0422ae Nov 05 14:51:00.688159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:00.692015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:00.703027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Pushing event updated for resources: {'Port': ['ID=7271b469-820b-49bd-9c96-32c16ffb85c8,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.726768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.727079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7e6a65a4-9632-41b8-9df5-2d7f304bed7b None None] Provisioning complete for port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:00.727449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e6a65a4-9632-41b8-9df5-2d7f304bed7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.754444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.760823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:00.761404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.777036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.790504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Attempting to bind port 7271b469-820b-49bd-9c96-32c16ffb85c8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:00.790841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Attempting to bind port 7271b469-820b-49bd-9c96-32c16ffb85c8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd66b7cfc-30de-4b42-9a71-760fa1099c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:00.791219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Attempting to bind port 7271b469-820b-49bd-9c96-32c16ffb85c8 on network a90ba218-4374-4630-b1ee-6495377ae3f1 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:00.800053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:00.800362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Checking segment: {'id': 'd66b7cfc-30de-4b42-9a71-760fa1099c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:00.801545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.801955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Bound using segment: {'id': 'd66b7cfc-30de-4b42-9a71-760fa1099c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:00.802437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Bound port: 7271b469-820b-49bd-9c96-32c16ffb85c8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd66b7cfc-30de-4b42-9a71-760fa1099c86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': 'a90ba218-4374-4630-b1ee-6495377ae3f1'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:00.802830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.833478 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2248194 Nov 05 14:51:00.835415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45092) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:00.842444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=17197c19-7640-4365-8fdf-d3b129d64cea,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.843368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'ports': [{'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'}, {'network_id': '81e73083-a5f4-4f46-ad25-ea69cf0422ae'}]} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.843674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.844991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '81e73083-a5f4-4f46-ad25-ea69cf0422ae'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:00.850464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e4b18ca-effa-4f7b-9774-7c8b697b067f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=81e73083-a5f4-4f46-ad25-ea69cf0422ae,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:00.852037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': '82cdc934-4990-42e3-a2a8-d9f0e9d0d03c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '2ec6930a-aaef-48c1-a42b-556c22ac1062'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:00.852491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 2ec6930a-aaef-48c1-a42b-556c22ac1062, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:00.870909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 2ec6930a-aaef-48c1-a42b-556c22ac1062 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:00.871134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 81e73083-a5f4-4f46-ad25-ea69cf0422ae details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:00.881998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 2ec6930a-aaef-48c1-a42b-556c22ac1062) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:00.890544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:00.891330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:00.913417 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-06d88e69-b08f-4d6e-a766-f68f0948c81a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 0.5453765 Nov 05 14:51:00.914033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45094) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:00.955586 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] For port 7271b469-820b-49bd-9c96-32c16ffb85c8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:00.982390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] For port 7271b469-820b-49bd-9c96-32c16ffb85c8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7271b469-820b-49bd-9c96-32c16ffb85c8,segment=NetworkSegment(d66b7cfc-30de-4b42-9a71-760fa1099c86),segment_id=d66b7cfc-30de-4b42-9a71-760fa1099c86)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:01.000085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.064141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69778d0e-2b9e-4ae2-8bce-45ebe35b3686 None None] Pushing event updated for resources: {'Port': ['ID=7271b469-820b-49bd-9c96-32c16ffb85c8,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:01.112719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.126346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 2} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:01.131164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.150379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.171756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:01.253037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:01.253680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.260967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.312376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 3126a319-057e-40a6-ac80-2516c8b23a40 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:01.376353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.444476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=17197c19-7640-4365-8fdf-d3b129d64cea,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:01.529748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.562795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2ec6930a-aaef-48c1-a42b-556c22ac1062']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:01.566084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.608799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '82cdc934-4990-42e3-a2a8-d9f0e9d0d03c') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:01.609481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '82cdc934-4990-42e3-a2a8-d9f0e9d0d03c') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:01.627132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.652389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port d79a4a7f-c1ef-49b6-a71d-8aa5748773af yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:01.655636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.664225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 633 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:01.664652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:01.667620 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:01.742076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.750506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.753716 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/2ec6930a-aaef-48c1-a42b-556c22ac1062 HTTP/1.1" status: 204 len: 168 time: 0.8385248 Nov 05 14:51:01.758665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45096) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:01.764285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1757169823'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:01.770859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dd8d487-18c4-4fd7-a9b5-369b630b1799 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=2ec6930a-aaef-48c1-a42b-556c22ac1062,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:01.789334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:01.793203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.820440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:01.832944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.833303 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment 6ba6998a-4db9-44df-9257-1148c617100b of type vlan for network 3ff908fb-c489-489d-a6b1-0f62ca491684 Nov 05 14:51:01.855059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.876745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.896238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.905346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.912224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:01.912877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.946198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:01.949361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:01.952224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:01.953255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:01.975370 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2155015 Nov 05 14:51:01.975894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=3126a319-057e-40a6-ac80-2516c8b23a40,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:01.978135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45098) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:01.983706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '3ff908fb-c489-489d-a6b1-0f62ca491684', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:02.043419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1f8721-0015-457d-9bf7-e0326aaefd81 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=3ff908fb-c489-489d-a6b1-0f62ca491684,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:02.045002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=d79a4a7f-c1ef-49b6-a71d-8aa5748773af,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:02.047548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': 'eb73353f-0122-42d0-888b-b821c92afaaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '81e73083-a5f4-4f46-ad25-ea69cf0422ae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:02.047984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 81e73083-a5f4-4f46-ad25-ea69cf0422ae, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:02.066188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 81e73083-a5f4-4f46-ad25-ea69cf0422ae is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:02.068965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 3ff908fb-c489-489d-a6b1-0f62ca491684 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:02.086049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 81e73083-a5f4-4f46-ad25-ea69cf0422ae) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:02.095043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:02.095260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:02.101925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.102919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:02.108494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:02.109337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.127233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-73e87cba-eed8-411c-a96b-9726f80ac8fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.2907529 Nov 05 14:51:02.130473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45100) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:02.190316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7777236a-5512-4258-a318-babe3f53a9f9 None None] Network 93897455-afbe-4960-a8fe-81ce8457870d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.199163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61953c05-51c5-4cda-a01a-7d8e6d7ce15d None None] Network a90ba218-4374-4630-b1ee-6495377ae3f1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.204132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea3816a3-a27d-4ea6-a97e-d4b0a676cfb0 None None] Network 55438f8e-e3b1-4529-a257-0177cc94bb35 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.208074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91caab4d-434d-43fc-8880-ad39ba07bcd2 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.238807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port d79a4a7f-c1ef-49b6-a71d-8aa5748773af {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:02.239148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ea3816a3-a27d-4ea6-a97e-d4b0a676cfb0 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.256385 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.316102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.316483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9cb8535-93da-459a-89c6-25a9b9c0d6ca None None] Network 2ec6930a-aaef-48c1-a42b-556c22ac1062 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7777236a-5512-4258-a318-babe3f53a9f9 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.320975 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.331442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for d79a4a7f-c1ef-49b6-a71d-8aa5748773af owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:02.332112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec690c9f-54a1-46d6-967e-4751c1b2ba7e None None] Network 81e73083-a5f4-4f46-ad25-ea69cf0422ae requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.334079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca313faf-8a19-4c5c-b01b-7418e5a43d6a None None] Network 55438f8e-e3b1-4529-a257-0177cc94bb35 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.351547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f561fd9-1cd1-406e-9588-42b4b6ef11cc None None] Network 93897455-afbe-4960-a8fe-81ce8457870d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.355553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d9cb8535-93da-459a-89c6-25a9b9c0d6ca None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.417152 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.427849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=e3a5f36b-5438-4120-8b3d-29413a02c7fe,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:02.431185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ca313faf-8a19-4c5c-b01b-7418e5a43d6a None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.446903 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.456821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39ce52db-d2da-4f7c-9d66-36a479bbf936 None None] Network 2ec6930a-aaef-48c1-a42b-556c22ac1062 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.457462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': '6ba6998a-4db9-44df-9257-1148c617100b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '3ff908fb-c489-489d-a6b1-0f62ca491684'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:02.458033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 3ff908fb-c489-489d-a6b1-0f62ca491684, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4f561fd9-1cd1-406e-9588-42b4b6ef11cc None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.458901 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.462063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=d79a4a7f-c1ef-49b6-a71d-8aa5748773af,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:02.470470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.476227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ad44c949-a62f-4ff0-9b88-45b3bf5b0bcc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/d79a4a7f-c1ef-49b6-a71d-8aa5748773af HTTP/1.1" status: 204 len: 168 time: 0.3417635 Nov 05 14:51:02.476776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45108) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:02.500743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 3ff908fb-c489-489d-a6b1-0f62ca491684 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-39ce52db-d2da-4f7c-9d66-36a479bbf936 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:02.511737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.513396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 3ff908fb-c489-489d-a6b1-0f62ca491684) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:02.518121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Provisioning complete for port 7271b469-820b-49bd-9c96-32c16ffb85c8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:02.522120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:02.522838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.522971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.542542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-420ec0cf-445c-45a9-8034-e990f0aa7291 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:02.545686 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0b43fcf6-8568-4f8a-9b74-8708f3e133f7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.5665147 Nov 05 14:51:02.548273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45110) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:02.549850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-420ec0cf-445c-45a9-8034-e990f0aa7291 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:02.551544 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-420ec0cf-445c-45a9-8034-e990f0aa7291 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1452 time: 0.0736959 Nov 05 14:51:02.555744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45112) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:02.558656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3dfd5b1-827f-4f52-b27d-500b8a32e881 None None] Network 3ff908fb-c489-489d-a6b1-0f62ca491684 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-61953c05-51c5-4cda-a01a-7d8e6d7ce15d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:02.622067 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.650388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-375d07fe-6be3-4310-88cd-e70b0da28055 None None] Network a90ba218-4374-4630-b1ee-6495377ae3f1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.661056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.718774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a3dfd5b1-827f-4f52-b27d-500b8a32e881 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:02.742038 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.773099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ea2cc8f-a656-45d8-b878-c1729b5356b8 None None] Network 3ff908fb-c489-489d-a6b1-0f62ca491684 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:02.792350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.824518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=e3a5f36b-5438-4120-8b3d-29413a02c7fe,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-375d07fe-6be3-4310-88cd-e70b0da28055 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:02.842413 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.846226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.892201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3ea2cc8f-a656-45d8-b878-c1729b5356b8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:02.897908 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:02.908273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] For port 7271b469-820b-49bd-9c96-32c16ffb85c8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7271b469-820b-49bd-9c96-32c16ffb85c8,segment=NetworkSegment(d66b7cfc-30de-4b42-9a71-760fa1099c86),segment_id=d66b7cfc-30de-4b42-9a71-760fa1099c86)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:02.914782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cb95527-bd81-46b2-b89d-e4aea21ff104 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:02.918683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.920474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ff908fb-c489-489d-a6b1-0f62ca491684']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:02.930710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6ba6998a-4db9-44df-9257-1148c617100b') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:02.931141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6ba6998a-4db9-44df-9257-1148c617100b') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:02.941944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.956944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.963988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 638 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:02.964549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:02.968299 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:03.014516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 3126a319-057e-40a6-ac80-2516c8b23a40 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:03.015110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.022136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Provisioning complete for port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:03.022748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.038720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.060365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.063767 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/3ff908fb-c489-489d-a6b1-0f62ca491684 HTTP/1.1" status: 204 len: 168 time: 0.5142901 Nov 05 14:51:03.065763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0642630-4836-41b8-b803-54475eaf229b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=3ff908fb-c489-489d-a6b1-0f62ca491684,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.069005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fd6bc0-3592-4042-8ae2-c18f2019319f None None] Pushing event updated for resources: {'Port': ['ID=7271b469-820b-49bd-9c96-32c16ffb85c8,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.069189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45114) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.074262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-766864180'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:03.097368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.100320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:03.105742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.111494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 3126a319-057e-40a6-ac80-2516c8b23a40 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:03.145364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 611} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:03.156160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.156641 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment ead83e19-f207-47f4-b784-16b9b3fcbe26 of type vlan for network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 Nov 05 14:51:03.165837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb95527-bd81-46b2-b89d-e4aea21ff104 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:03.202990 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.211352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.242488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=3126a319-057e-40a6-ac80-2516c8b23a40,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.245981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.249380 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c1ba12d0-5167-4be8-b71d-914276deb485 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/3126a319-057e-40a6-ac80-2516c8b23a40 HTTP/1.1" status: 204 len: 168 time: 0.6924872 Nov 05 14:51:03.252545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45116) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.255189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.262310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:03.262310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.262568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7271b469-820b-49bd-9c96-32c16ffb85c8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:03.307118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d992ca1-c30b-4931-8825-0ac6df54ad76 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:03.308655 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2d992ca1-c30b-4931-8825-0ac6df54ad76 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.0550010 Nov 05 14:51:03.311660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45118) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.330879 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2608385 Nov 05 14:51:03.333884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45120) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.338091 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-3448e5ad-2c16-4aab-a680-787a750914f7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:03.339127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:03.342946 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3448e5ad-2c16-4aab-a680-787a750914f7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/d79a4a7f-c1ef-49b6-a71d-8aa5748773af HTTP/1.1" status: 404 len: 333 time: 0.0266480 Nov 05 14:51:03.343182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45122) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.353206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 7271b469-820b-49bd-9c96-32c16ffb85c8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:03.353878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.382559 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-dddd8ae7-f8fc-452c-819c-913940537b50 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:03.384242 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dddd8ae7-f8fc-452c-819c-913940537b50 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/3126a319-057e-40a6-ac80-2516c8b23a40 HTTP/1.1" status: 404 len: 333 time: 0.0401263 Nov 05 14:51:03.388335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45124) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.399193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56e59c0b-b73a-4b4c-ba08-5bb578a19986 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.415556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:03.452024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:03.457678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.469963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.580780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.603588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81e73083-a5f4-4f46-ad25-ea69cf0422ae']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:03.614625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eb73353f-0122-42d0-888b-b821c92afaaa') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:03.614933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eb73353f-0122-42d0-888b-b821c92afaaa') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:03.627400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.643019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.651198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 604 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:03.651409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:03.655131 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:03.664823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.742534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=41f29ee7-5f83-41d7-92b9-a59361ee6b2b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.750843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'ead83e19-f207-47f4-b784-16b9b3fcbe26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:03.751290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:03.769649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.771800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:03.779254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.786996 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/81e73083-a5f4-4f46-ad25-ea69cf0422ae HTTP/1.1" status: 204 len: 168 time: 0.3929687 Nov 05 14:51:03.787781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45126) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.792890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7a8b2b-b9b9-4307-8180-59500229923a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=81e73083-a5f4-4f46-ad25-ea69cf0422ae,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:03.793241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1272726766'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:03.797588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:03.803805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:03.804398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.822152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b245c4cf-dd46-4950-b62a-ad54f649a9b1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:03.830537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:03.835278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.842258 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f276c43c-4027-484e-9b3a-858b2cc5cdbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5073562 Nov 05 14:51:03.845791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45128) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:03.854424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:03.865051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 631} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:03.874687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.875039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment b4426fb2-958d-4864-a3cb-1d1a13a6ebc5 of type vlan for network 676107a1-d6c3-4c31-a258-26b3a1c26764 Nov 05 14:51:03.923171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.940546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b245c4cf-dd46-4950-b62a-ad54f649a9b1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:03.951994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.959228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:03.959836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:03.980656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:03.985425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.035829 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2442331 Nov 05 14:51:04.036502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45130) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:04.043686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '676107a1-d6c3-4c31-a258-26b3a1c26764', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:04.048682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e654145b-1924-4d7d-a983-80cd2868a978 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=676107a1-d6c3-4c31-a258-26b3a1c26764,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:04.064992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 676107a1-d6c3-4c31-a258-26b3a1c26764 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:04.176015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:04.179436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.264082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.ipam_backend_mixin [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Performing IP validity checks on allocation pools {{(pid=113580) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:51:04.264772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.ipam_backend_mixin [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113580) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:51:04.279955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1', 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1', 'tenant_id': 'e4e12076a8c94dbbbd5277433a80c9aa', 'fixed_ips': [{'subnet_id': '41f29ee7-5f83-41d7-92b9-a59361ee6b2b'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:04.280907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.440065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Allocated IP 2001:db8::2 (0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1/41f29ee7-5f83-41d7-92b9-a59361ee6b2b/9fe1ec7d-4110-43ca-b326-ef22498f06f9) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:04.460898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.527992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:04.529175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.539338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:04.544835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.545449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.566382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:04.582863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3f9474c6-fd0b-4674-a0f9-c3c3f92a751b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.7332540 Nov 05 14:51:04.583432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45134) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:04.617250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.626980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.631522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': 'b4426fb2-958d-4864-a3cb-1d1a13a6ebc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 631, 'network_id': '676107a1-d6c3-4c31-a258-26b3a1c26764'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:04.631885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 676107a1-d6c3-4c31-a258-26b3a1c26764, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:04.639472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=e48d5a4b-9b90-4eb4-9c00-fed479f2bb14,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:04.656354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 676107a1-d6c3-4c31-a258-26b3a1c26764 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:04.667766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 676107a1-d6c3-4c31-a258-26b3a1c26764) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:04.672172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.672821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.695263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.696908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.699120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.701033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:04.701361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.705066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:04.705907 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2d6f2009-05ac-474d-84f7-47c1718a539b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6683905 Nov 05 14:51:04.710362 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d5840575-3361-4895-87e2-fc5645a90aa5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1224587 Nov 05 14:51:04.710535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:04.710911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Pushing event updated for resources: {'Port': ['ID=9fe1ec7d-4110-43ca-b326-ef22498f06f9,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:04.711143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45136) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:04.711667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45138) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:04.720092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:04.720241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1350580577'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:04.726313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '676107a1-d6c3-4c31-a258-26b3a1c26764', 'name': 'tempest-PortsTestJSON-40268148'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:04.778981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Attempting to bind port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:04.779354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Attempting to bind port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'ead83e19-f207-47f4-b784-16b9b3fcbe26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:04.779718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Attempting to bind port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 on network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:04.785436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:04.785810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Checking segment: {'id': 'ead83e19-f207-47f4-b784-16b9b3fcbe26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:04.786211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.786690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Bound using segment: {'id': 'ead83e19-f207-47f4-b784-16b9b3fcbe26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:04.787149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Bound port: 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ead83e19-f207-47f4-b784-16b9b3fcbe26', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 611, 'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:04.787833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.799796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:04.803313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.857197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 626} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:04.864442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] For port 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:04.868416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] For port 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9fe1ec7d-4110-43ca-b326-ef22498f06f9,segment=NetworkSegment(ead83e19-f207-47f4-b784-16b9b3fcbe26),segment_id=ead83e19-f207-47f4-b784-16b9b3fcbe26)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:04.874307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.874703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment babb3e46-112d-47ce-9925-2210b515c627 of type vlan for network 108856b5-4ce7-4455-af00-d6c5872d9153 Nov 05 14:51:04.875036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.909132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:04.912735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.936320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:04.948342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port ad5d9943-ace9-494e-a9b7-9b644ed6f0ba yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:04.950017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2f4a1e-2e19-492e-bd6d-fe937702440d None None] Pushing event updated for resources: {'Port': ['ID=9fe1ec7d-4110-43ca-b326-ef22498f06f9,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:05.014101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.020373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:05.021020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.032955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e58956d1-31ab-45f2-964e-65c468926088 None None] Provisioning complete for port 7271b469-820b-49bd-9c96-32c16ffb85c8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:05.033789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e58956d1-31ab-45f2-964e-65c468926088 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.127798 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.4113519 Nov 05 14:51:05.130552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45140) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:05.139650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193ca143-feca-47a8-b201-08fbc353e56c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=108856b5-4ce7-4455-af00-d6c5872d9153,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:05.152600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'New_network'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:05.158274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 108856b5-4ce7-4455-af00-d6c5872d9153 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:05.187237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.13 (676107a1-d6c3-4c31-a258-26b3a1c26764/e48d5a4b-9b90-4eb4-9c00-fed479f2bb14/ad5d9943-ace9-494e-a9b7-9b644ed6f0ba) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:05.344834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.359575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.378323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 108856b5-4ce7-4455-af00-d6c5872d9153 is not hosted by any dhcp agent {{(pid=113581) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 05 14:51:05.380733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.383965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:05.384603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.386180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "PUT /v2.0/networks/108856b5-4ce7-4455-af00-d6c5872d9153 HTTP/1.1" status: 200 len: 723 time: 0.2543719 Nov 05 14:51:05.389419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:05.398588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '108856b5-4ce7-4455-af00-d6c5872d9153', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:05.436535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a173bc1-af93-4bb8-9989-50e32046b886 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=108856b5-4ce7-4455-af00-d6c5872d9153,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:05.448017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 108856b5-4ce7-4455-af00-d6c5872d9153 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:05.493362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.565406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 676107a1-d6c3-4c31-a258-26b3a1c26764 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:05.566501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:05.570258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.573634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=ad5d9943-ace9-494e-a9b7-9b644ed6f0ba,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:05.577962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:05.589552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:05.684159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:05.685371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.712528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b63751b1-d4ba-4112-af6e-9a4a2e2292ca tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 0.9977822 Nov 05 14:51:05.713604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45146) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:05.824372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.826942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port ad5d9943-ace9-494e-a9b7-9b644ed6f0ba {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:05.827297 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.907897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=180c3b3c-19b6-4da7-9311-e6cc3fa455bf,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:05.915899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'babb3e46-112d-47ce-9925-2210b515c627', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 626, 'network_id': '108856b5-4ce7-4455-af00-d6c5872d9153'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:05.916302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 108856b5-4ce7-4455-af00-d6c5872d9153, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:05.939477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 108856b5-4ce7-4455-af00-d6c5872d9153 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:05.953983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 108856b5-4ce7-4455-af00-d6c5872d9153) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:05.955699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.961378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:05.962549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:05.974670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for ad5d9943-ace9-494e-a9b7-9b644ed6f0ba owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:05.989867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1aefc84f-b7f2-4f5f-a515-29f061f25cbe tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5990748 Nov 05 14:51:05.992772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45148) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.000641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:06.071704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15fb1c55-dde3-43f5-a324-95b5c6382805 None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.073171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-331b4ef0-4f8f-4e85-ba88-ff48952de6b4 None None] Network 676107a1-d6c3-4c31-a258-26b3a1c26764 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.078508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8ae96f7-7216-4671-afbf-11771793e780 None None] Network 108856b5-4ce7-4455-af00-d6c5872d9153 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.112066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-10020767'] for subnet, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.123960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.229294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=ad5d9943-ace9-494e-a9b7-9b644ed6f0ba,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:06.234194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.236439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Provisioning complete for port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:06.236836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.242137 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0eb52ead-ae5e-4ed6-9bb5-564bdc4f78e2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/ad5d9943-ace9-494e-a9b7-9b644ed6f0ba HTTP/1.1" status: 204 len: 168 time: 0.5256608 Nov 05 14:51:06.244050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45150) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.271807 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-e37a9095-9252-405e-8d29-059b569cc0af tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:06.272485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e37a9095-9252-405e-8d29-059b569cc0af tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:06.273074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-10356132'] for subnet, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.275692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e37a9095-9252-405e-8d29-059b569cc0af tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/ad5d9943-ace9-494e-a9b7-9b644ed6f0ba HTTP/1.1" status: 404 len: 333 time: 0.0301476 Nov 05 14:51:06.278878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-15fb1c55-dde3-43f5-a324-95b5c6382805 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.303304 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.307146 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-433e7180-3c7b-4152-9423-fb6c3c5e6ab5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-331b4ef0-4f8f-4e85-ba88-ff48952de6b4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.308016 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.311402 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-433e7180-3c7b-4152-9423-fb6c3c5e6ab5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/ad5d9943-ace9-494e-a9b7-9b644ed6f0ba HTTP/1.1" status: 404 len: 333 time: 0.0308216 Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c8ae96f7-7216-4671-afbf-11771793e780 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.314733 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.315817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45154) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.323292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cc0309f-8176-4339-84ef-6d705b34c0b0 None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.335532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:06.336165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.341384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "PUT /v2.0/subnets/180c3b3c-19b6-4da7-9311-e6cc3fa455bf HTTP/1.1" status: 200 len: 826 time: 0.3421433 Nov 05 14:51:06.341562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45156) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.342199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3446e60-3db4-4239-98d6-3bffb1200ea0 None None] Network 676107a1-d6c3-4c31-a258-26b3a1c26764 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.343988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdbe31f7-389b-4d80-a731-451d95ca5e44 None None] Network 108856b5-4ce7-4455-af00-d6c5872d9153 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.354378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3473cb-94c0-4d1f-9942-422f4379d90e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=180c3b3c-19b6-4da7-9311-e6cc3fa455bf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:06.410092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet e48d5a4b-9b90-4eb4-9c00-fed479f2bb14 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:06.413274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.446826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.466482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.514696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.535887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.583307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.613023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=180c3b3c-19b6-4da7-9311-e6cc3fa455bf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:06.614165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.648902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=e48d5a4b-9b90-4eb4-9c00-fed479f2bb14,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:06.656338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.659823 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7499c4d0-9a59-4d33-b7d4-5fbbff189c40 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/e48d5a4b-9b90-4eb4-9c00-fed479f2bb14 HTTP/1.1" status: 204 len: 168 time: 0.3369195 Nov 05 14:51:06.663028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45160) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.685688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.710002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['108856b5-4ce7-4455-af00-d6c5872d9153']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.721561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'babb3e46-112d-47ce-9925-2210b515c627') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.722160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'babb3e46-112d-47ce-9925-2210b515c627') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.733347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fdbe31f7-389b-4d80-a731-451d95ca5e44 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.734268 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3cc0309f-8176-4339-84ef-6d705b34c0b0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.737212 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.739202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.746033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e3446e60-3db4-4239-98d6-3bffb1200ea0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.755336 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.756415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.763978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3355bcb9-8b88-4f51-b229-1054d07a06dc None None] Network 108856b5-4ce7-4455-af00-d6c5872d9153 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.766741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f817fa5-9956-4bfe-bf30-e642309e73f1 None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:06.769874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 626 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:06.770465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:06.774002 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:06.841980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.855089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.858791 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/108856b5-4ce7-4455-af00-d6c5872d9153 HTTP/1.1" status: 204 len: 168 time: 0.5174921 Nov 05 14:51:06.861692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45162) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.874654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.876944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c246054d-068e-4ab4-81d5-f1ba14752765 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=108856b5-4ce7-4455-af00-d6c5872d9153,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:06.877082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] For port 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9fe1ec7d-4110-43ca-b326-ef22498f06f9,segment=NetworkSegment(ead83e19-f207-47f4-b784-16b9b3fcbe26),segment_id=ead83e19-f207-47f4-b784-16b9b3fcbe26)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:06.886698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.893704 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-592290b0-7e8d-4791-a3a8-34a2d4522738 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:06.894291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-592290b0-7e8d-4791-a3a8-34a2d4522738 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:06.897357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-592290b0-7e8d-4791-a3a8-34a2d4522738 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/108856b5-4ce7-4455-af00-d6c5872d9153 HTTP/1.1" status: 404 len: 339 time: 0.0322287 Nov 05 14:51:06.901560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45164) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:06.907917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1695350768', 'description': 'd1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:06.910149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['676107a1-d6c3-4c31-a258-26b3a1c26764']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.920978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b4426fb2-958d-4864-a3cb-1d1a13a6ebc5') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.921348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b4426fb2-958d-4864-a3cb-1d1a13a6ebc5') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:06.931494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.931858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:06.936783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.948925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3f817fa5-9956-4bfe-bf30-e642309e73f1 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:06.951182 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:06.957869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 631 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:06.958864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:06.962155 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:06.969182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f096cef-244e-4306-bfa9-2d0dd444e6ed None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:06.971621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 600} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:06.977007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Provisioning complete for port 7271b469-820b-49bd-9c96-32c16ffb85c8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:06.977381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.984406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:06.985043 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment a25583b2-abc3-4b0a-bce8-cf009607f4b3 of type vlan for network 384d8140-133a-4d22-85a3-817ccf26417c Nov 05 14:51:07.027340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.036199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.038136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b97b56-149e-4143-832d-f33258f13aae None None] Pushing event updated for resources: {'Port': ['ID=9fe1ec7d-4110-43ca-b326-ef22498f06f9,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:07.043854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.051144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/676107a1-d6c3-4c31-a258-26b3a1c26764 HTTP/1.1" status: 204 len: 168 time: 0.3838320 Nov 05 14:51:07.052489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45166) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.059076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1756041646'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:07.064724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.065529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d68f96d8-1dde-43b1-aa19-5c1b6f449480 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=676107a1-d6c3-4c31-a258-26b3a1c26764,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:07.070746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:07.071341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.154194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:07.158188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.173533 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.2705793 Nov 05 14:51:07.176351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45168) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.182529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4865242f-928b-46fa-bae7-c81170626998 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=384d8140-133a-4d22-85a3-817ccf26417c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:07.188195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f096cef-244e-4306-bfa9-2d0dd444e6ed None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:07.195574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 616} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:07.196513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 384d8140-133a-4d22-85a3-817ccf26417c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:07.207843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.208217 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment d5ad6535-8135-4dec-a57c-06f1b19f1c2e of type vlan for network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 Nov 05 14:51:07.256035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.266971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9fe1ec7d-4110-43ca-b326-ef22498f06f9 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:07.282275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.282990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8981569-65a5-4763-8cfb-9e8ef3f6f60f tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:07.287192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b8981569-65a5-4763-8cfb-9e8ef3f6f60f tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks?id=384d8140-133a-4d22-85a3-817ccf26417c HTTP/1.1" status: 200 len: 765 time: 0.1072679 Nov 05 14:51:07.287458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45170) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.288487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:07.289142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.292641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'description': 'd2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:07.353916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3000853 Nov 05 14:51:07.356770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45172) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.362082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '39c5c3a7-33e5-444d-8ab6-cdea9d2a8087', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:07.363401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adedd6bd-c2ee-4a2a-bcfd-e9c203c01db7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=39c5c3a7-33e5-444d-8ab6-cdea9d2a8087,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:07.381408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:07.486320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:07.486782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.544804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.552561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:07.555946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.605568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.667140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 384d8140-133a-4d22-85a3-817ccf26417c is not hosted by any dhcp agent {{(pid=113580) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 05 14:51:07.672850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:07.673455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.674747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "PUT /v2.0/networks/384d8140-133a-4d22-85a3-817ccf26417c HTTP/1.1" status: 200 len: 762 time: 0.3863559 Nov 05 14:51:07.677750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45174) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.712943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437c7446-8e8e-4e5e-b9cc-7fff6bf09c2b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=384d8140-133a-4d22-85a3-817ccf26417c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:07.733846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 384d8140-133a-4d22-85a3-817ccf26417c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:07.800836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc67e3a0-4717-4fd3-97dc-d79da669b3a5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:07.806340 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bc67e3a0-4717-4fd3-97dc-d79da669b3a5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks?id=384d8140-133a-4d22-85a3-817ccf26417c HTTP/1.1" status: 200 len: 765 time: 0.1270652 Nov 05 14:51:07.806514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45176) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:07.839694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Update dhcp port {'port': {'network_id': '0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1', 'fixed_ips': [{'subnet_id': '41f29ee7-5f83-41d7-92b9-a59361ee6b2b', 'ip_address': '2001:db8::2'}, {'subnet_id': '59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '9fe1ec7d-4110-43ca-b326-ef22498f06f9'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:51:07.870148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:07.902224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.036751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Allocated IP 172.20.0.1 (0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1/59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d/9fe1ec7d-4110-43ca-b326-ef22498f06f9) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:08.038310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=879d6116-1256-4917-a983-251dbc30f714,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:08.062129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c28ca22-5209-460e-b94f-b403e7323fe7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.063627 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1c28ca22-5209-460e-b94f-b403e7323fe7 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2515104 Nov 05 14:51:08.066811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45178) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.071448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': 'd5ad6535-8135-4dec-a57c-06f1b19f1c2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': '39c5c3a7-33e5-444d-8ab6-cdea9d2a8087'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:08.071876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:08.091983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:08.102526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:08.107205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.108069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.112138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-227d39ed-3373-4d31-b9db-6a9ac3991562 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 207 time: 0.0436602 Nov 05 14:51:08.115505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45180) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.131108 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d768fdff-279d-4f1f-b1a9-f96894b7cf3d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7730784 Nov 05 14:51:08.134096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45182) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.139183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '39c5c3a7-33e5-444d-8ab6-cdea9d2a8087', 'security_groups': [], 'name': 'tempest-PortsTestJSON-1026415392'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:08.156554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] For port 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9fe1ec7d-4110-43ca-b326-ef22498f06f9,segment=NetworkSegment(ead83e19-f207-47f4-b784-16b9b3fcbe26),segment_id=ead83e19-f207-47f4-b784-16b9b3fcbe26)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:08.190529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.197258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.262459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:08.265444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.266616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.275350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.283611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.286372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 54c513f4-4f43-4c6a-a6c5-5bd63becb620 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:08.292705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.292890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d11c678f-0f01-4590-8d14-2c52295b3a12 None None] Pushing event updated for resources: {'Port': ['ID=9fe1ec7d-4110-43ca-b326-ef22498f06f9,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:08.302021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.308486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.314959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5c2d8832-05d7-47e5-bf40-a6dae040ff33 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3730 time: 0.1983883 Nov 05 14:51:08.315651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45184) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.417929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.4 (39c5c3a7-33e5-444d-8ab6-cdea9d2a8087/879d6116-1256-4917-a983-251dbc30f714/54c513f4-4f43-4c6a-a6c5-5bd63becb620) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:08.461944 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-29b86203-cf38-44fc-ae9a-4a7d8a30bd9e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 812 time: 0.1449246 Nov 05 14:51:08.465395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45186) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.531514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.533171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.534963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.536507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.538084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.539780 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b5418d37-0215-4b5e-9c3e-274093babf51 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0733678 Nov 05 14:51:08.544738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45188) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.576695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.611316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.613798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.615906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.616296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.617777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.619413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.621368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-01171372-3c9b-4bfd-8ca5-a74b61269dff tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.0756333 Nov 05 14:51:08.626048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45190) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.676126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:08.680135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:08.682600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:08.710346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=54c513f4-4f43-4c6a-a6c5-5bd63becb620,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:08.742790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.744496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.749798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7929455-3604-4fb7-9364-b8267d26ab13 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.756006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45192) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.756224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b7929455-3604-4fb7-9364-b8267d26ab13 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks/7af763c1-3dec-4615-bdd1-5bb920e3101e HTTP/1.1" status: 200 len: 804 time: 0.1289268 Nov 05 14:51:08.771526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b5ea4b63-55c4-4693-b649-3773cd83eb28 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 886 time: 0.6362805 Nov 05 14:51:08.774387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45194) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.869993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b6b7b110-2a1d-41a0-aeed-f2c34e3da418 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/networks/7af763c1-3dec-4615-bdd1-5bb920e3101e?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 320 time: 0.1126750 Nov 05 14:51:08.874499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.880002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 54c513f4-4f43-4c6a-a6c5-5bd63becb620 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:08.880338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:08.911418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d801df77-e254-4592-ada9-9a893bc02001 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:08.933569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95cf6cd4-d297-4ec8-a2da-75d62079c5bc tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:08.938488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-95cf6cd4-d297-4ec8-a2da-75d62079c5bc tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets/52f5eb84-f99d-4964-83b1-c68678a28029 HTTP/1.1" status: 200 len: 843 time: 0.0593319 Nov 05 14:51:08.939260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45198) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:08.986333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.002437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 54c513f4-4f43-4c6a-a6c5-5bd63becb620 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:09.026300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-25134121-7897-4324-8d8d-599e54baee04 None None] Provisioning complete for port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:09.026675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-25134121-7897-4324-8d8d-599e54baee04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.074742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d801df77-e254-4592-ada9-9a893bc02001 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:09.182242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.197764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9fe1ec7d-4110-43ca-b326-ef22498f06f9 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:09.225466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=54c513f4-4f43-4c6a-a6c5-5bd63becb620,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:09.305273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-914352d0-94c0-444d-a99a-fb142870d82d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['shared'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:09.306697 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-914352d0-94c0-444d-a99a-fb142870d82d tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "GET /v2.0/subnets/52f5eb84-f99d-4964-83b1-c68678a28029?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.3670855 Nov 05 14:51:09.312917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45202) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:09.317564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:09.317953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.318073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1153778274'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:09.322790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.326593 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-386ed534-bcde-4b59-8463-6302e95147c7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/54c513f4-4f43-4c6a-a6c5-5bd63becb620 HTTP/1.1" status: 204 len: 168 time: 0.5510757 Nov 05 14:51:09.329617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45204) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:09.346886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:09.351889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.356985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-664163be-69d6-417f-9f27-2dafdb5e7989 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:09.361282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-664163be-69d6-417f-9f27-2dafdb5e7989 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/54c513f4-4f43-4c6a-a6c5-5bd63becb620 HTTP/1.1" status: 404 len: 333 time: 0.0273721 Nov 05 14:51:09.361746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45206) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:09.383871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 643} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:09.395413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.395757 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Added segment db17e443-55c8-493e-a4e1-910b812e0523 of type vlan for network 18818ba7-eb29-4990-9981-32f9b0d9b775 Nov 05 14:51:09.414718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 879d6116-1256-4917-a983-251dbc30f714 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:09.417486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.439791 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.462174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.471857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.479448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:09.480065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.505843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9954b9fd-69c2-4180-9f21-16ed4c7af2c0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-39c5c3a7-33e5-444d-8ab6-cdea9d2a8087', 'network_id': '39c5c3a7-33e5-444d-8ab6-cdea9d2a8087', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': '879d6116-1256-4917-a983-251dbc30f714'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:09.506772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9954b9fd-69c2-4180-9f21-16ed4c7af2c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.527175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.552592 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2385840 Nov 05 14:51:09.558914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45208) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:09.564762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:09.597532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9954b9fd-69c2-4180-9f21-16ed4c7af2c0 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 879d6116-1256-4917-a983-251dbc30f714: This subnet is being modified by another concurrent operation. Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 300, in create_dhcp_port Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise self.value Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server raise exception Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 879d6116-1256-4917-a983-251dbc30f714: This subnet is being modified by another concurrent operation. Nov 05 14:51:09.612527 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:09.634860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=879d6116-1256-4917-a983-251dbc30f714,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:09.634860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.635079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-686454de-95e1-4cd7-b60d-3e74c16e403a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Network': ['ID=18818ba7-eb29-4990-9981-32f9b0d9b775,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:09.646788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-330693d8-609d-4e12-8bee-a849970c1310 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/879d6116-1256-4917-a983-251dbc30f714 HTTP/1.1" status: 204 len: 168 time: 0.2812748 Nov 05 14:51:09.647196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45210) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:09.655264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:09.690292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Made reservation on behalf of e4e12076a8c94dbbbd5277433a80c9aa for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:09.695276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.757521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.764116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 14:51:09.764844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 14:51:09.850237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.874187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['39c5c3a7-33e5-444d-8ab6-cdea9d2a8087']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:09.884379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd5ad6535-8135-4dec-a57c-06f1b19f1c2e') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:09.884780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd5ad6535-8135-4dec-a57c-06f1b19f1c2e') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:09.899662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.907675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.914389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.921918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 616 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:09.922523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:09.926391 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:09.993171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:09.997878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.004766 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 HTTP/1.1" status: 204 len: 168 time: 0.3529615 Nov 05 14:51:10.005747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45212) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:10.012167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'name': 'tempest-PortsTestJSON-1712930232'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:10.027467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2814f2c-190d-4b19-b6da-194c5b865850 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=39c5c3a7-33e5-444d-8ab6-cdea9d2a8087,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:10.104390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-776eb708-e650-4afa-8e9a-47b6789e9eab None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:10.121446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:10.126132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.154639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 37c41c34-9677-4bc2-bbfd-b84b268a3526 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:10.197819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b3ef2b87-aeef-45b7-a7b6-e10abf50436d None None] Provisioning complete for port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:10.198201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3ef2b87-aeef-45b7-a7b6-e10abf50436d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.319764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=75d71fb7-4e32-40cf-b7fa-cea57337f8bc,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:10.330241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Checking segment: {'id': 'db17e443-55c8-493e-a4e1-910b812e0523', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:10.330591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network hostable DHCP agents. Network: 18818ba7-eb29-4990-9981-32f9b0d9b775, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:10.335805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.354256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:10.364574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 18818ba7-eb29-4990-9981-32f9b0d9b775) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:10.372657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:10.373388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.376819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.393969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-776eb708-e650-4afa-8e9a-47b6789e9eab None None] Unable to find a vacant binding_index for network 18818ba7-eb29-4990-9981-32f9b0d9b775 and agent e00c03f2-9866-481b-b4b5-10f75e3fb25b {{(pid=113582) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 05 14:51:10.400800 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-61454dcb-30a9-4307-b143-d428876aa317 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 0.8406172 Nov 05 14:51:10.401177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-776eb708-e650-4afa-8e9a-47b6789e9eab None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 18818ba7-eb29-4990-9981-32f9b0d9b775) {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:10.401618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45214) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:10.409461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:10.428943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:10.431691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:10.438297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:10.444263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:10.444900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.457654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=37c41c34-9677-4bc2-bbfd-b84b268a3526,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:10.469397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-39fc610a-3c53-4e99-8d0a-0ef7d0f0d89d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.4626005 Nov 05 14:51:10.471802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45216) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:10.528278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9931214'] for subnet, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.585622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 37c41c34-9677-4bc2-bbfd-b84b268a3526 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:10.585992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.659364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.677633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 37c41c34-9677-4bc2-bbfd-b84b268a3526 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:10.698379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-9638471'] for subnet, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.749197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:10.750080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.751650 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "PUT /v2.0/subnets/75d71fb7-4e32-40cf-b7fa-cea57337f8bc HTTP/1.1" status: 200 len: 900 time: 0.3488662 Nov 05 14:51:10.755287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45218) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:10.777591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.806908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=37c41c34-9677-4bc2-bbfd-b84b268a3526,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:10.816297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.822491 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e4713098-fee7-4b82-9de0-ff5faa426ca6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/37c41c34-9677-4bc2-bbfd-b84b268a3526 HTTP/1.1" status: 204 len: 168 time: 0.3482809 Nov 05 14:51:10.823311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45220) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:10.827477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f65d792-0e27-42ad-9a07-b5ff239b1478 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event updated for resources: {'Subnet': ['ID=75d71fb7-4e32-40cf-b7fa-cea57337f8bc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:10.829002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'mac_address': 'fa:16:3e:11:77:04', 'name': 'tempest-PortsTestJSON-240758008'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:10.858838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-18818ba7-eb29-4990-9981-32f9b0d9b775', 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775', 'tenant_id': 'e4e12076a8c94dbbbd5277433a80c9aa', 'fixed_ips': [{'subnet_id': '75d71fb7-4e32-40cf-b7fa-cea57337f8bc'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:10.860361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.883949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:10.929266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:10.946919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.007815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.029746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Allocated IP 2001:db8::3 (18818ba7-eb29-4990-9981-32f9b0d9b775/75d71fb7-4e32-40cf-b7fa-cea57337f8bc/8867e509-470e-4dc0-9c0d-1d1e2decfdaf) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:11.030495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 66b02ac3-097a-4ee8-bfe0-2539e909f456 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:11.186322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.193251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.203479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.210465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.239364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.242654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=75d71fb7-4e32-40cf-b7fa-cea57337f8bc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:11.261699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Pushing event updated for resources: {'Port': ['ID=8867e509-470e-4dc0-9c0d-1d1e2decfdaf,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:11.267953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:11.269621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:11.272386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:11.288098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:11.293736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:11.297796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:11.303731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:11.304506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.314911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.317802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=66b02ac3-097a-4ee8-bfe0-2539e909f456,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:11.327462 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-23700c65-7062-4473-84cc-494c37c5333b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 0.5032117 Nov 05 14:51:11.332600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45224) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:11.338456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Attempting to bind port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:11.338839 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Attempting to bind port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'db17e443-55c8-493e-a4e1-910b812e0523', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:11.339321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Attempting to bind port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf on network 18818ba7-eb29-4990-9981-32f9b0d9b775 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:11.345978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:11.345978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Checking segment: {'id': 'db17e443-55c8-493e-a4e1-910b812e0523', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:11.346695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.347080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Bound using segment: {'id': 'db17e443-55c8-493e-a4e1-910b812e0523', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:11.347557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Bound port: 8867e509-470e-4dc0-9c0d-1d1e2decfdaf, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db17e443-55c8-493e-a4e1-910b812e0523', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '18818ba7-eb29-4990-9981-32f9b0d9b775'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:11.347947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.380102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18818ba7-eb29-4990-9981-32f9b0d9b775']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:11.396553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45226) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:11.399454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-146a4ae0-e88d-423c-915c-f5fe8c9be3a5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:11.400878 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-146a4ae0-e88d-423c-915c-f5fe8c9be3a5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/66b02ac3-097a-4ee8-bfe0-2539e909f456 HTTP/1.1" status: 200 len: 840 time: 0.0673285 Nov 05 14:51:11.402784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db17e443-55c8-493e-a4e1-910b812e0523') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:11.403105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db17e443-55c8-493e-a4e1-910b812e0523') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:11.404758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45228) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:11.422311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] For port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:11.425999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] For port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8867e509-470e-4dc0-9c0d-1d1e2decfdaf,segment=NetworkSegment(db17e443-55c8-493e-a4e1-910b812e0523),segment_id=db17e443-55c8-493e-a4e1-910b812e0523)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:11.431008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.437193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.461610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.490155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 643 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:11.490537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:11.494570 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:11.534702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023a5655-4e78-49ab-98b0-0ec4b8dd53c6 None None] Pushing event updated for resources: {'Port': ['ID=8867e509-470e-4dc0-9c0d-1d1e2decfdaf,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:11.563112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65bdfc56-83c3-4ee7-b603-79b34dfc35c1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:11.563338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.db.api [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 05 14:51:11.563338 dv-neutron-816850-1-hyperv neutron-server[113581]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 05 14:51:11.563338 dv-neutron-816850-1-hyperv neutron-server[113581]: [parameters: {'id': '18818ba7-eb29-4990-9981-32f9b0d9b775'}] Nov 05 14:51:11.563338 dv-neutron-816850-1-hyperv neutron-server[113581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=113581) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:51:11.563762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG oslo_db.api [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:51:11.573570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 66b02ac3-097a-4ee8-bfe0-2539e909f456 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:11.573912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.646050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.660169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 66b02ac3-097a-4ee8-bfe0-2539e909f456 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:11.695530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65bdfc56-83c3-4ee7-b603-79b34dfc35c1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:11.749643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.785960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=66b02ac3-097a-4ee8-bfe0-2539e909f456,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:11.794985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.798792 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-267b824f-a9fe-4be6-bbf9-aed5e444c155 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/66b02ac3-097a-4ee8-bfe0-2539e909f456 HTTP/1.1" status: 204 len: 168 time: 0.3930943 Nov 05 14:51:11.801579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45230) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:11.829663 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-11b6c467-013f-45d5-abb9-7a312316d318 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:11.834947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.835161 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-11b6c467-013f-45d5-abb9-7a312316d318 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/66b02ac3-097a-4ee8-bfe0-2539e909f456 HTTP/1.1" status: 404 len: 333 time: 0.0284228 Nov 05 14:51:11.835552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45232) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:11.840985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'name': 'tempest-PortsTestJSON-1825462652'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:11.941634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:11.947788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:11.973992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 29e57842-efd9-462b-b3c5-5c4272a3abd1 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:11.998972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c35bad3d-6493-4c64-a496-8c54f63fa1ea None None] Network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:12.002102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6db6038e-dd16-4f46-ac7d-aa30bede5110 None None] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c35bad3d-6493-4c64-a496-8c54f63fa1ea None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:12.053764 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:12.067431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.095042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7ef9307-f5ff-4000-9918-5e084d5986d3 None None] Network 39c5c3a7-33e5-444d-8ab6-cdea9d2a8087 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c7ef9307-f5ff-4000-9918-5e084d5986d3 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:12.111255 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:12.137739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41938d0d-7da1-4317-9121-5e3c80abcebd None None] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:12.184812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port c55d2ea6-0622-4508-8711-245ed9cc9b39 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:12.185140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.253505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85c05403-55e1-4883-a1dc-6d1007f13a41 None None] Network 18818ba7-eb29-4990-9981-32f9b0d9b775 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:12.270047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.286186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port c55d2ea6-0622-4508-8711-245ed9cc9b39, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c55d2ea6-0622-4508-8711-245ed9cc9b39,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:12.286685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.291423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:12.292091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.301040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for c55d2ea6-0622-4508-8711-245ed9cc9b39 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:12.366513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b91d870a-0aef-45d1-854d-c9fe27fcaf20 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:12.401340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.408174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] For port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8867e509-470e-4dc0-9c0d-1d1e2decfdaf,segment=NetworkSegment(db17e443-55c8-493e-a4e1-910b812e0523),segment_id=db17e443-55c8-493e-a4e1-910b812e0523)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:12.408563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.468812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:12.469989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Calling delete_port for 8867e509-470e-4dc0-9c0d-1d1e2decfdaf owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:12.479064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:12.483054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:12.485630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b91d870a-0aef-45d1-854d-c9fe27fcaf20 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:12.489101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:12.489715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.529544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=29e57842-efd9-462b-b3c5-5c4272a3abd1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:12.544133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:12.544755 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d20a96e8-b7a0-47a4-b617-85fb154b4df1 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.7077003 Nov 05 14:51:12.553746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:12.580931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.626363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=c55d2ea6-0622-4508-8711-245ed9cc9b39,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:12.638672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.656078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No DVR routers for this DVR port 8867e509-470e-4dc0-9c0d-1d1e2decfdaf on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:12.702506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.717537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Port': ['ID=8867e509-470e-4dc0-9c0d-1d1e2decfdaf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:12.785718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-997d31e8-3a3d-4737-8d95-8b743e68c063 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:12.790683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.817911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18818ba7-eb29-4990-9981-32f9b0d9b775']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:12.828193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db17e443-55c8-493e-a4e1-910b812e0523') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:12.829517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db17e443-55c8-493e-a4e1-910b812e0523') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:12.838682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.857591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.865292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 643 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:12.866203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:12.869423 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:12.944107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.953508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.956270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.959459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-997d31e8-3a3d-4737-8d95-8b743e68c063 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:12.964894 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/18818ba7-eb29-4990-9981-32f9b0d9b775 HTTP/1.1" status: 204 len: 168 time: 2.2028382 Nov 05 14:51:12.966089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45236) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:12.990626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:12.996503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36628c9c-273c-4cd1-94d8-46e826b6e89c tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=18818ba7-eb29-4990-9981-32f9b0d9b775,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:13.033679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.036595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-0474621c-fd91-45cb-a6bb-128acd23defc tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:13.037212 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0474621c-fd91-45cb-a6bb-128acd23defc tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:13.041406 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0474621c-fd91-45cb-a6bb-128acd23defc tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/75d71fb7-4e32-40cf-b7fa-cea57337f8bc HTTP/1.1" status: 404 len: 337 time: 0.0610185 Nov 05 14:51:13.044679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45238) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.069363 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-7e34243f-6402-40f2-a479-a274ab1fa670 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:13.070742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7e34243f-6402-40f2-a479-a274ab1fa670 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:13.074476 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7e34243f-6402-40f2-a479-a274ab1fa670 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/18818ba7-eb29-4990-9981-32f9b0d9b775 HTTP/1.1" status: 404 len: 339 time: 0.0286238 Nov 05 14:51:13.077472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45240) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.084790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] In _notify_port_updated(), no bound segment for port 29e57842-efd9-462b-b3c5-5c4272a3abd1 on network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:51:13.090510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:13.091190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.093609 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/ports/29e57842-efd9-462b-b3c5-5c4272a3abd1 HTTP/1.1" status: 200 len: 818 time: 0.5476367 Nov 05 14:51:13.098753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45242) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.135786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdac65b6-5f9d-418d-af44-9fa2fb3726ce tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=29e57842-efd9-462b-b3c5-5c4272a3abd1,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:13.268808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.290575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:13.349489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 29e57842-efd9-462b-b3c5-5c4272a3abd1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:13.349834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.420516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:13.431340 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:13.440946 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-850e65a5-8582-42e6-a060-2efc7eba4862 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/c9eda620-b56d-4879-9d5c-3b17badf0d55/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0431788 Nov 05 14:51:13.444937 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:13.445939 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.474136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.510612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.513956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['384d8140-133a-4d22-85a3-817ccf26417c']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.532007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a25583b2-abc3-4b0a-bce8-cf009607f4b3') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.532308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a25583b2-abc3-4b0a-bce8-cf009607f4b3') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.541597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 29e57842-efd9-462b-b3c5-5c4272a3abd1 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:13.547885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.570108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.575617 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:13.612081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 600 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:13.612376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:13.615592 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:13.692921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.706217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.711993 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/384d8140-133a-4d22-85a3-817ccf26417c HTTP/1.1" status: 204 len: 168 time: 0.6249397 Nov 05 14:51:13.711993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45248) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.726015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0294ca6a-f15d-421f-99cd-2ce781c05452 req-e9ff56f5-f483-4584-801c-cd23590a129f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:13.727175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0294ca6a-f15d-421f-99cd-2ce781c05452 req-e9ff56f5-f483-4584-801c-cd23590a129f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.0614536 Nov 05 14:51:13.747514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-496f41ec-16e9-4f80-9986-6b30a9ebd97e tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=384d8140-133a-4d22-85a3-817ccf26417c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:13.753118 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-0393ef7f-7572-47a3-b35a-9aabe350a8c6 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:13.753572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0393ef7f-7572-47a3-b35a-9aabe350a8c6 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:13.759106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0393ef7f-7572-47a3-b35a-9aabe350a8c6 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/180c3b3c-19b6-4da7-9311-e6cc3fa455bf HTTP/1.1" status: 404 len: 337 time: 0.0439911 Nov 05 14:51:13.759404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45252) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.770839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.791134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-5b241418-1cac-494b-a85b-65426e827fc5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:13.791786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5b241418-1cac-494b-a85b-65426e827fc5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:13.795412 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b241418-1cac-494b-a85b-65426e827fc5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/108856b5-4ce7-4455-af00-d6c5872d9153 HTTP/1.1" status: 404 len: 339 time: 0.0349729 Nov 05 14:51:13.798191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45254) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.813793 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0294ca6a-f15d-421f-99cd-2ce781c05452 req-1f915544-9ec0-4dc2-a5a0-c65880621d48 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769820 Nov 05 14:51:13.818996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=29e57842-efd9-462b-b3c5-5c4272a3abd1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:13.824135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.828197 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-73978eeb-409b-44cb-ba23-0203a9b8ff10 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/29e57842-efd9-462b-b3c5-5c4272a3abd1 HTTP/1.1" status: 204 len: 168 time: 0.7275939 Nov 05 14:51:13.831370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45256) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.867265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting subnet 59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:13.870856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.881045 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.898431 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7203719f-fb87-4916-b380-bbb371aa9f6b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:13.902488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7203719f-fb87-4916-b380-bbb371aa9f6b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.0682533 Nov 05 14:51:13.902937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45258) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.908543 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:13.917071 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:13.917670 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:13.937442 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9cce008-ffe5-415c-8982-80537d528401 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:13.939684 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a9cce008-ffe5-415c-8982-80537d528401 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/29e57842-efd9-462b-b3c5-5c4272a3abd1 HTTP/1.1" status: 404 len: 333 time: 0.0351567 Nov 05 14:51:13.944372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45260) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:13.949598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-183759805'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:13.952344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:13.971927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:13.981465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.011823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 640} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:14.023557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.023916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment 2d341384-c0b0-4bde-b730-eeb331cb0808 of type vlan for network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 Nov 05 14:51:14.039585 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:14.052538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.066726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.092704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.098327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:14.098921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.123669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.155300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.162151 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d HTTP/1.1" status: 204 len: 168 time: 0.3598003 Nov 05 14:51:14.162151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ba8155-9a74-4bd2-a5b5-5e1f9ddfee49 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=59a95870-2fb0-4ab6-8d46-af7a8f1ecb2d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:14.162452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45262) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:14.169141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7203899-c252-4564-9822-836c590053d3 None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:14.182388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45264) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:14.182650 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.2374024 Nov 05 14:51:14.190276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:14.209764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1438b0e6-cb33-4eec-a195-136964f1f3ff tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=3b7a31b1-f7b7-436c-ae6e-0c0383567567,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:14.235478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting subnet 41f29ee7-5f83-41d7-92b9-a59361ee6b2b {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:14.239205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a7203899-c252-4564-9822-836c590053d3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:14.250371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:14.254708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:14.273425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2600d277-2ea5-4593-b678-23334e74b29a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:14.284909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.322331 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:14.336884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:14.344081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.364826 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aada2c8e-6308-4085-8d56-de6dc9eeef98 None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'fbb19145-d30f-4e98-b332-420947e691a0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.207', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'port_id': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 1040, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'mac_address': 'fa:16:3e:c8:3a:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:49:54Z', 'updated_at': '2021-11-05T14:50:00Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:14.395464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.461493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.489790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=41f29ee7-5f83-41d7-92b9-a59361ee6b2b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:14.493487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.498992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2600d277-2ea5-4593-b678-23334e74b29a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:14.499169 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-10a2f62e-3c96-410d-a304-852317375a47 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/41f29ee7-5f83-41d7-92b9-a59361ee6b2b HTTP/1.1" status: 204 len: 168 time: 0.3339794 Nov 05 14:51:14.499288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45266) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:14.587644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.590214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.645170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:14.645505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.656494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=d1404318-14e3-4edd-880e-92ec2576089c,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:14.667096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': '2d341384-c0b0-4bde-b730-eeb331cb0808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:14.667399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 3b7a31b1-f7b7-436c-ae6e-0c0383567567, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:14.686057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:14.696348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 3b7a31b1-f7b7-436c-ae6e-0c0383567567) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:14.701289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:14.701929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.717319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] For port 9fe1ec7d-4110-43ca-b326-ef22498f06f9, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9fe1ec7d-4110-43ca-b326-ef22498f06f9,segment=NetworkSegment(ead83e19-f207-47f4-b784-16b9b3fcbe26),segment_id=ead83e19-f207-47f4-b784-16b9b3fcbe26)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:14.717689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.720264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ed16ea53-5c6a-432d-adfb-19ca6fb23be6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5366881 Nov 05 14:51:14.723357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45268) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:14.729984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:14.738633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Calling delete_port for 9fe1ec7d-4110-43ca-b326-ef22498f06f9 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:14.794278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a1db492-f457-42ee-b221-84fa7cb529f2 None None] Network 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:14.813453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-605a6980-5bd1-4b6c-ad1c-c1307a6939a4 None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:14.861954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.892836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:14.898716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Port': ['ID=9fe1ec7d-4110-43ca-b326-ef22498f06f9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:14.898955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:14.905421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No DVR routers for this DVR port 9fe1ec7d-4110-43ca-b326-ef22498f06f9 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:14.961240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e6296d82-9d21-4812-a762-8cec5dc218a1 None None] Could not find standard attr ID for object 9fe1ec7d-4110-43ca-b326-ef22498f06f9. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:15.020340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.033810 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet d1404318-14e3-4edd-880e-92ec2576089c (CIDR: 172.20.0.0/28) Nov 05 14:51:15.037974 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:51:15.038616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-605a6980-5bd1-4b6c-ad1c-c1307a6939a4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:15.045456 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:15.065679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-860b1430-b49e-43c9-bf9c-3a724ec7e3ac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3403180 Nov 05 14:51:15.067938 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b23e98c-df50-4173-b7ca-c58bf5887830 None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:15.071599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45272) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.075449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655fb8f1-4797-4411-9987-cb1a6eede882 req-a005b0dc-b01b-4749-ba32-50696346bc2b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:15.077101 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-655fb8f1-4797-4411-9987-cb1a6eede882 req-a005b0dc-b01b-4749-ba32-50696346bc2b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.1299870 Nov 05 14:51:15.082051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:15.108588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:15.135809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ead83e19-f207-47f4-b784-16b9b3fcbe26') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:15.136028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ead83e19-f207-47f4-b784-16b9b3fcbe26') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:15.148662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.150932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8ba457f-8935-4d0a-a923-447628c93b87 None None] DHCP port deletion for 0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:15.180679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4b23e98c-df50-4173-b7ca-c58bf5887830 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:15.192837 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:15.201119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-5e368910-1b15-4000-8793-ad7f06e3ab09 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:15.202663 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-5e368910-1b15-4000-8793-ad7f06e3ab09 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 946 time: 0.1670377 Nov 05 14:51:15.205911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 611 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:15.206146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b95390f-c017-47c5-8412-e09953e263be None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:15.206308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:15.210829 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:15.232008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-655fb8f1-4797-4411-9987-cb1a6eede882 req-e62a83e6-7788-4753-8760-2f759fb35235 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=42954ef8-ab29-4452-bffd-71e70483489f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1371565 Nov 05 14:51:15.261943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c55d2ea6-0622-4508-8711-245ed9cc9b39 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:15.263943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:15.267720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.290959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: c55d2ea6-0622-4508-8711-245ed9cc9b39 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:15.291617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c55d2ea6-0622-4508-8711-245ed9cc9b39 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:15.333043 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.347227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.350396 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1 HTTP/1.1" status: 204 len: 168 time: 0.8496604 Nov 05 14:51:15.353390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45274) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.365775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e79fcc6-234f-45f9-a835-7117952cbae5 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=0c14c1b0-b00d-4f39-a8a6-62a5c53e80e1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:15.382260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b95390f-c017-47c5-8412-e09953e263be None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:15.388174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-33764ec4-5b2d-4037-8814-46df3e5f3cb0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.388667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-33764ec4-5b2d-4037-8814-46df3e5f3cb0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.389235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 366f1e82-fb2b-41b4-90d6-dd5896e338bf {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:15.389572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.394458 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-33764ec4-5b2d-4037-8814-46df3e5f3cb0 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/e3a5f36b-5438-4120-8b3d-29413a02c7fe HTTP/1.1" status: 404 len: 337 time: 0.0378654 Nov 05 14:51:15.396148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45276) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.424674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-28e4adbe-7993-4510-a966-7e91d7c3b1be tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.425374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28e4adbe-7993-4510-a966-7e91d7c3b1be tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.428617 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-28e4adbe-7993-4510-a966-7e91d7c3b1be tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/3ff908fb-c489-489d-a6b1-0f62ca491684 HTTP/1.1" status: 404 len: 339 time: 0.0314219 Nov 05 14:51:15.431422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45278) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.464111 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-3da6f26b-4d42-4b79-99c3-56d9877f429a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.464872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3da6f26b-4d42-4b79-99c3-56d9877f429a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.468610 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3da6f26b-4d42-4b79-99c3-56d9877f429a tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/17197c19-7640-4365-8fdf-d3b129d64cea HTTP/1.1" status: 404 len: 337 time: 0.0360363 Nov 05 14:51:15.473072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.500537 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-167b1d42-f94a-4527-9709-86a8c75ee574 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.501246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-167b1d42-f94a-4527-9709-86a8c75ee574 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.504060 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-167b1d42-f94a-4527-9709-86a8c75ee574 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/2ec6930a-aaef-48c1-a42b-556c22ac1062 HTTP/1.1" status: 404 len: 339 time: 0.0298896 Nov 05 14:51:15.509407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45282) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.537479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 366f1e82-fb2b-41b4-90d6-dd5896e338bf, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=366f1e82-fb2b-41b4-90d6-dd5896e338bf,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:15.537834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.544375 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-451f95e9-2f57-48df-83e8-fefdadfe0c78 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.544942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-451f95e9-2f57-48df-83e8-fefdadfe0c78 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.548198 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-451f95e9-2f57-48df-83e8-fefdadfe0c78 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/cd928e0e-d6e9-4a3b-93a7-eebc2173689f HTTP/1.1" status: 404 len: 337 time: 0.0377553 Nov 05 14:51:15.550787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45284) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.552837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 366f1e82-fb2b-41b4-90d6-dd5896e338bf owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:15.589582 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-da1cb982-a278-4e09-a1fe-290987903b7b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:15.590756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-da1cb982-a278-4e09-a1fe-290987903b7b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:15.596751 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-da1cb982-a278-4e09-a1fe-290987903b7b tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/55438f8e-e3b1-4529-a257-0177cc94bb35 HTTP/1.1" status: 404 len: 339 time: 0.0421784 Nov 05 14:51:15.596947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45286) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.637867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.660904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting subnet 1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:15.666031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.666790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': 'd1404318-14e3-4edd-880e-92ec2576089c'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:15.669118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.680670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:15.688350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:15.691472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:15.692072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.707296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=7f6d99db-0d5a-4fce-9488-068e3003910d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:15.719616 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-88e4c0d3-239e-43d6-80b9-2a047a4465fc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.6458452 Nov 05 14:51:15.722095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45288) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:15.728556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'fixed_ips': [{'subnet_id': 'd1404318-14e3-4edd-880e-92ec2576089c'}, {'subnet_id': '7f6d99db-0d5a-4fce-9488-068e3003910d'}], 'name': 'tempest-PortsTestJSON-687462246'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:15.730964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.811428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.854977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:15.865232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=366f1e82-fb2b-41b4-90d6-dd5896e338bf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:15.899652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.932171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 366f1e82-fb2b-41b4-90d6-dd5896e338bf on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:15.936190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.939470 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dce011d2-52cf-4d0d-9ae9-6c83e3dcfb2f req-ca15e239-e14c-44e5-8a82-ebd201c994ea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/366f1e82-fb2b-41b4-90d6-dd5896e338bf HTTP/1.1" status: 204 len: 173 time: 0.7278562 Nov 05 14:51:15.939914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'name': 'network-vif-deleted', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:15.942210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5bc2867-3259-4536-8470-3b8ed8e1ae98" -d '{"events": [{"server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "name": "network-vif-deleted", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:15.976524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:15.991446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Allocated IP 172.20.0.2 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/d1404318-14e3-4edd-880e-92ec2576089c/652c550e-ea1a-41fe-a346-1f67da341920) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:15.994042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b8094af-8c0c-45c4-8978-45f8120f3efa x-openstack-request-id: req-7b8094af-8c0c-45c4-8978-45f8120f3efa {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:15.996749 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ccb1947-4372-43f9-9682-a1da870699eb", "name": "network-vif-deleted", "tag": "366f1e82-fb2b-41b4-90d6-dd5896e338bf", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:15.997144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7b8094af-8c0c-45c4-8978-45f8120f3efa {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:15.997514 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ccb1947-4372-43f9-9682-a1da870699eb', 'name': 'network-vif-deleted', 'tag': '366f1e82-fb2b-41b4-90d6-dd5896e338bf', 'status': 'completed', 'code': 200} Nov 05 14:51:15.999255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.024695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 173cd8d3-ed48-49cd-a059-02b64f7ce161 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:16.031238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.033291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.039459 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-61525d66-e0d9-483e-b565-ccd0ce4e0217 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/1a9fcfaf-9dfb-4b53-a38e-ae6db16dc842 HTTP/1.1" status: 204 len: 168 time: 0.4388504 Nov 05 14:51:16.039459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45292) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:16.133440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.178873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.185957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.186838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting port 7271b469-820b-49bd-9c96-32c16ffb85c8 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:16.187382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.232935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:16.235985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:16.241010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:16.245626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Pushing event updated for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.255146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] For port 7271b469-820b-49bd-9c96-32c16ffb85c8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7271b469-820b-49bd-9c96-32c16ffb85c8,segment=NetworkSegment(d66b7cfc-30de-4b42-9a71-760fa1099c86),segment_id=d66b7cfc-30de-4b42-9a71-760fa1099c86)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:16.255870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.269830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Calling delete_port for 7271b469-820b-49bd-9c96-32c16ffb85c8 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:16.316863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Attempting to bind port 652c550e-ea1a-41fe-a346-1f67da341920 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:16.317666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Attempting to bind port 652c550e-ea1a-41fe-a346-1f67da341920 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2d341384-c0b0-4bde-b730-eeb331cb0808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:16.318042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Attempting to bind port 652c550e-ea1a-41fe-a346-1f67da341920 on network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:16.322545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.14 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/d1404318-14e3-4edd-880e-92ec2576089c/173cd8d3-ed48-49cd-a059-02b64f7ce161) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:16.325096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:16.325473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Checking segment: {'id': '2d341384-c0b0-4bde-b730-eeb331cb0808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:16.326074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.326315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Bound using segment: {'id': '2d341384-c0b0-4bde-b730-eeb331cb0808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:16.326836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Bound port: 652c550e-ea1a-41fe-a346-1f67da341920, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d341384-c0b0-4bde-b730-eeb331cb0808', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:16.327296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.330977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.22 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/7f6d99db-0d5a-4fce-9488-068e3003910d/173cd8d3-ed48-49cd-a059-02b64f7ce161) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:16.364353 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d6735b7b-e7e0-4b69-93ee-45bbfdeb5600 req-3e516097-1fb1-4d68-bf90-c22560244a31 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ccb1947-4372-43f9-9682-a1da870699eb HTTP/1.1" status: 200 len: 210 time: 0.0371902 Nov 05 14:51:16.406846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.435302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Port': ['ID=7271b469-820b-49bd-9c96-32c16ffb85c8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.438256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:16.438830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No DVR routers for this DVR port 7271b469-820b-49bd-9c96-32c16ffb85c8 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:16.453027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=652c550e-ea1a-41fe-a346-1f67da341920,segment=NetworkSegment(2d341384-c0b0-4bde-b730-eeb331cb0808),segment_id=2d341384-c0b0-4bde-b730-eeb331cb0808)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:16.468342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.535655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7512b5-583f-4917-a8ad-34513a802319 None None] Pushing event updated for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.569490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.572238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.592608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a90ba218-4374-4630-b1ee-6495377ae3f1']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:16.602994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd66b7cfc-30de-4b42-9a71-760fa1099c86') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:16.603494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd66b7cfc-30de-4b42-9a71-760fa1099c86') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:16.613560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.615536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.631072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.637657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 641 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:16.638045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:16.641458 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:16.656493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:16.660238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:16.666319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:16.692859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=173cd8d3-ed48-49cd-a059-02b64f7ce161,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.719366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.735678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:16.736066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.742283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.746336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/a90ba218-4374-4630-b1ee-6495377ae3f1 HTTP/1.1" status: 204 len: 168 time: 0.7060704 Nov 05 14:51:16.749769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45296) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:16.761653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88cb1ef-1cbc-4f05-974a-e4ab4464d1d3 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=a90ba218-4374-4630-b1ee-6495377ae3f1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:16.765644 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fe65b84e-cdb8-42eb-be6b-dd8c2897982d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1004 time: 1.0419815 Nov 05 14:51:16.768034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45298) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:16.773269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'd1404318-14e3-4edd-880e-92ec2576089c'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:16.787071 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e0dbd3f-4a73-48a0-8261-928db2a280bd tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:16.787525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9e0dbd3f-4a73-48a0-8261-928db2a280bd tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:16.793101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9e0dbd3f-4a73-48a0-8261-928db2a280bd tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/80c84fe6-26a8-46f1-8904-4de1338c8bc4 HTTP/1.1" status: 404 len: 337 time: 0.0389555 Nov 05 14:51:16.793914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45300) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:16.820614 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ed17a5d-6248-476d-96eb-dc408029d170 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:16.822295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4ed17a5d-6248-476d-96eb-dc408029d170 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:16.828767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4ed17a5d-6248-476d-96eb-dc408029d170 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/93897455-afbe-4960-a8fe-81ce8457870d HTTP/1.1" status: 404 len: 339 time: 0.0337286 Nov 05 14:51:16.832585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45302) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:16.891470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting subnet 52f5eb84-f99d-4964-83b1-c68678a28029 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:16.894835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.940435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:16.940701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.031039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.105081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.145138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Subnet': ['ID=52f5eb84-f99d-4964-83b1-c68678a28029,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.149405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.155975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6852a574-a3af-43ca-b4af-d15a2626aff2 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/subnets/52f5eb84-f99d-4964-83b1-c68678a28029 HTTP/1.1" status: 204 len: 168 time: 0.3201115 Nov 05 14:51:17.156714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45304) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:17.206190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Delete allocated IP 172.20.0.22 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/7f6d99db-0d5a-4fce-9488-068e3003910d) {{(pid=113581) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:51:17.235331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.279203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 652c550e-ea1a-41fe-a346-1f67da341920 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:17.303176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Deleting port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:17.304691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.343111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 652c550e-ea1a-41fe-a346-1f67da341920 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:17.343630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.354863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.359664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.426488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] For port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,segment=NetworkSegment(b5af64d6-5b6d-4c31-975c-26be66a33176),segment_id=b5af64d6-5b6d-4c31-975c-26be66a33176)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:17.426488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.445673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Calling delete_port for 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:17.446662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.451442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45308) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:17.494585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=652c550e-ea1a-41fe-a346-1f67da341920,segment=NetworkSegment(2d341384-c0b0-4bde-b730-eeb331cb0808),segment_id=2d341384-c0b0-4bde-b730-eeb331cb0808)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:17.504711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.539084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9fe1ec7d-4110-43ca-b326-ef22498f06f9 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:17.564785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 9fe1ec7d-4110-43ca-b326-ef22498f06f9 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:17.565272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9fe1ec7d-4110-43ca-b326-ef22498f06f9 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:17.597994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.600866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.635804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Port': ['ID=68b9a9fa-843f-45e0-aba7-b0c4610b00f8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.657448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] No DVR routers for this DVR port 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:17.659714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.708401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63240a4f-88fe-4077-94b6-dcdf44a96796 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:17.750347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.769143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.815627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7af763c1-3dec-4615-bdd1-5bb920e3101e']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:17.822737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63240a4f-88fe-4077-94b6-dcdf44a96796 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:17.826433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5af64d6-5b6d-4c31-975c-26be66a33176') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:17.826733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5af64d6-5b6d-4c31-975c-26be66a33176') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:17.838167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.840730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=173cd8d3-ed48-49cd-a059-02b64f7ce161,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.843759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1475d611-c59f-456b-b1ed-1937094470f6 None None] Provisioning complete for port 652c550e-ea1a-41fe-a346-1f67da341920 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:17.844132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1475d611-c59f-456b-b1ed-1937094470f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.855118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.863015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:17.863709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:17.866932 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:17.918914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.922386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.923790 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/42954ef8-ab29-4452-bffd-71e70483489f HTTP/1.1" status: 204 len: 168 time: 0.4710064 Nov 05 14:51:17.928978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] In _notify_port_updated(), no bound segment for port 173cd8d3-ed48-49cd-a059-02b64f7ce161 on network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:51:17.936368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:17.936757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.942033 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f882656b-8620-4fdf-9126-aa8f5e14132a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/ports/173cd8d3-ed48-49cd-a059-02b64f7ce161 HTTP/1.1" status: 200 len: 919 time: 1.1694970 Nov 05 14:51:17.942280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45312) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:17.944481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661ae555-657d-4ec1-a10d-ce54900658aa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=42954ef8-ab29-4452-bffd-71e70483489f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.952442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.956201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'd1404318-14e3-4edd-880e-92ec2576089c'}, {'subnet_id': '7f6d99db-0d5a-4fce-9488-068e3003910d'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:17.965912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:17.972051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] 10.222.0.30 "DELETE /v2.0/networks/7af763c1-3dec-4615-bdd1-5bb920e3101e HTTP/1.1" status: 204 len: 168 time: 0.8118064 Nov 05 14:51:17.989198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6673ce-d01c-42a4-92c3-eb9ae0424318 tempest-NetworksIpV6Test-819406606 tempest-NetworksIpV6Test-819406606-project] Pushing event deleted for resources: {'Network': ['ID=7af763c1-3dec-4615-bdd1-5bb920e3101e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:17.991349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45316) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:18.062311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.067492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet d4230734-010b-449e-9c56-77f77a8c925f {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:18.073547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.125709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.159224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 366f1e82-fb2b-41b4-90d6-dd5896e338bf no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:18.197857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 366f1e82-fb2b-41b4-90d6-dd5896e338bf {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:18.198589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 366f1e82-fb2b-41b4-90d6-dd5896e338bf not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:18.218554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.232176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.313142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38a8df60-bc73-4b02-87c1-6eb3f47843d7 None None] DHCP port deletion for a90ba218-4374-4630-b1ee-6495377ae3f1 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:18.320525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.352371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45320) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:18.364874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=d4230734-010b-449e-9c56-77f77a8c925f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:18.368715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.372210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7f23bed9-6efa-4af5-99b3-941b33e6b04b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/d4230734-010b-449e-9c56-77f77a8c925f HTTP/1.1" status: 204 len: 168 time: 0.3796554 Nov 05 14:51:18.375336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45324) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:18.408488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Update dhcp port {'port': {'network_id': '3b7a31b1-f7b7-436c-ae6e-0c0383567567', 'fixed_ips': [{'subnet_id': 'd1404318-14e3-4edd-880e-92ec2576089c', 'ip_address': '172.20.0.2'}, {'subnet_id': '7f6d99db-0d5a-4fce-9488-068e3003910d'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '652c550e-ea1a-41fe-a346-1f67da341920'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:51:18.424674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.22 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/7f6d99db-0d5a-4fce-9488-068e3003910d/173cd8d3-ed48-49cd-a059-02b64f7ce161) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:18.444959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.501697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.561869 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6eb2b33-7bb7-4ea9-84bf-b2bb9b4e60be admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e4e12076a8c94dbbbd5277433a80c9aa&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2022471 Nov 05 14:51:18.562301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45326) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:18.590919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.597825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.649691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Allocated IP 172.20.0.18 (3b7a31b1-f7b7-436c-ae6e-0c0383567567/7f6d99db-0d5a-4fce-9488-068e3003910d/652c550e-ea1a-41fe-a346-1f67da341920) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:18.708566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=173cd8d3-ed48-49cd-a059-02b64f7ce161,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:18.739652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] In _notify_port_updated(), no bound segment for port 173cd8d3-ed48-49cd-a059-02b64f7ce161 on network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:51:18.745757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:18.747232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.748864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0652bdf7-0796-4ea0-8ae2-4979a0bcd29c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/ports/173cd8d3-ed48-49cd-a059-02b64f7ce161 HTTP/1.1" status: 200 len: 999 time: 0.8056233 Nov 05 14:51:18.752317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45328) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:18.763269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=652c550e-ea1a-41fe-a346-1f67da341920,segment=NetworkSegment(2d341384-c0b0-4bde-b730-eeb331cb0808),segment_id=2d341384-c0b0-4bde-b730-eeb331cb0808)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:18.798783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.808840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.861029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 173cd8d3-ed48-49cd-a059-02b64f7ce161 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:18.862265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.915620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b345ad2-f5de-4c38-8650-a4d63982890b None None] Pushing event updated for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:18.960027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.963490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port a477d1f0-5a76-432d-af07-9809ef4dce8f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:18.963999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:18.972924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 173cd8d3-ed48-49cd-a059-02b64f7ce161 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:19.013473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.051047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port a477d1f0-5a76-432d-af07-9809ef4dce8f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a477d1f0-5a76-432d-af07-9809ef4dce8f,segment=NetworkSegment(afefeb50-4b2f-4f90-9f53-397926bd6c86),segment_id=afefeb50-4b2f-4f90-9f53-397926bd6c86)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:19.051405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.054921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.075642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for a477d1f0-5a76-432d-af07-9809ef4dce8f owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:19.173398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.176439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.177736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c5a7eb4f-37ba-47aa-89e7-491987823dfc HTTP/1.1" status: 204 len: 168 time: 0.6143470 Nov 05 14:51:19.189937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.199551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa4a8a7-387f-497a-bed4-8135bb7fcf69 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5a7eb4f-37ba-47aa-89e7-491987823dfc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:19.220498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.260837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=a477d1f0-5a76-432d-af07-9809ef4dce8f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:19.263218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port a477d1f0-5a76-432d-af07-9809ef4dce8f on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:19.287364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=173cd8d3-ed48-49cd-a059-02b64f7ce161,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:19.306992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 652c550e-ea1a-41fe-a346-1f67da341920 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:19.378291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 652c550e-ea1a-41fe-a346-1f67da341920 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:19.379504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.383385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.395654 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f292249-a13f-430e-a21c-026d7147eb3b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/173cd8d3-ed48-49cd-a059-02b64f7ce161 HTTP/1.1" status: 204 len: 168 time: 0.6409428 Nov 05 14:51:19.396105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45334) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:19.399197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.436236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-76abc33c-6707-4708-b2e8-ae3aeb73fb4a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:19.440488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-76abc33c-6707-4708-b2e8-ae3aeb73fb4a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/173cd8d3-ed48-49cd-a059-02b64f7ce161 HTTP/1.1" status: 404 len: 333 time: 0.0410292 Nov 05 14:51:19.441360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45336) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:19.494865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f42e72d-8f95-4783-82a7-99edeac923fe']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:19.516135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7271b469-820b-49bd-9c96-32c16ffb85c8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:19.524428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'afefeb50-4b2f-4f90-9f53-397926bd6c86') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:19.525131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'afefeb50-4b2f-4f90-9f53-397926bd6c86') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:19.539987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.550261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 7f6d99db-0d5a-4fce-9488-068e3003910d {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:19.559658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.561370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.568481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 7271b469-820b-49bd-9c96-32c16ffb85c8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:19.568845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7271b469-820b-49bd-9c96-32c16ffb85c8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:19.568982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:19.569388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:19.573315 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:19.616775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.638014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce3aa57b-da78-4c73-ac18-471ce5b0cb17 None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:19.655836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.675668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.678373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/6f42e72d-8f95-4783-82a7-99edeac923fe HTTP/1.1" status: 204 len: 168 time: 1.3016164 Nov 05 14:51:19.685039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45346) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:19.697405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10285e2-3072-4fa7-8988-3a10af0b50a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=6f42e72d-8f95-4783-82a7-99edeac923fe,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:19.699149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13be71ed-f321-4a91-9152-c7eca73007f8 None None] Network 7af763c1-3dec-4615-bdd1-5bb920e3101e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:19.708128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-006ff1c3-92d5-4785-bc54-217740184cc1 None None] Could not find standard attr ID for object 173cd8d3-ed48-49cd-a059-02b64f7ce161. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-13be71ed-f321-4a91-9152-c7eca73007f8 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:19.724397 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:19.745824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-006ff1c3-92d5-4785-bc54-217740184cc1 None None] Provisioning complete for port 652c550e-ea1a-41fe-a346-1f67da341920 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:19.746202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-006ff1c3-92d5-4785-bc54-217740184cc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ce3aa57b-da78-4c73-ac18-471ce5b0cb17 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:19.780624 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:19.839608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.871341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-945c28bb-e97f-46f3-8a96-2b161870590d None None] DHCP port deletion for 7af763c1-3dec-4615-bdd1-5bb920e3101e request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:19.951627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:19.984446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=7f6d99db-0d5a-4fce-9488-068e3003910d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:19.992485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.004502 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2d8d5ab8-e114-48d6-b661-a82763f75577 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/7f6d99db-0d5a-4fce-9488-068e3003910d HTTP/1.1" status: 204 len: 168 time: 0.5623515 Nov 05 14:51:20.006973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45354) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:20.042388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 924d6d1c-9bec-4e3a-9921-566a5e7cfc8a {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:20.042847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.053767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb38b9ea-4800-45d0-bb5b-46d5d336953e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.127710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45358) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:20.134000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5935e3ec-e9ac-4cd0-aac9-1bea37a15a4e None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:20.143299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet d1404318-14e3-4edd-880e-92ec2576089c {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:20.158531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.197382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f2e6058a-16f3-467c-a9df-0d44f013c862 None None] Could not find standard attr ID for object 173cd8d3-ed48-49cd-a059-02b64f7ce161. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:20.206748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.207076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.221179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5935e3ec-e9ac-4cd0-aac9-1bea37a15a4e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:20.234461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:20.246780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 924d6d1c-9bec-4e3a-9921-566a5e7cfc8a owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:20.285593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-122648242-network', 'tenant_id': 'de6b84a04f00477c855a9f7319208b60'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:20.331304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afa6e8f5-431f-4269-815d-d4697b119637 None None] DHCP port deletion for 6f42e72d-8f95-4783-82a7-99edeac923fe request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:20.421780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Made reservation on behalf of de6b84a04f00477c855a9f7319208b60 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:20.424139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.444045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.463443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.513562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-98e45e7b-7bd4-424e-9388-066b8238e758 None None] Could not find standard attr ID for object 173cd8d3-ed48-49cd-a059-02b64f7ce161. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:20.580671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.636594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.641107 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/d1404318-14e3-4edd-880e-92ec2576089c HTTP/1.1" status: 204 len: 168 time: 0.6321762 Nov 05 14:51:20.641435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4740605-1f4c-461b-a3c5-19deed799d49 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=d1404318-14e3-4edd-880e-92ec2576089c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:20.643644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45366) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:20.660872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.685679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbe19d3f-6621-4e08-b7b8-54bd6d5ca75f None None] Network 3b7a31b1-f7b7-436c-ae6e-0c0383567567 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:20.702204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=924d6d1c-9bec-4e3a-9921-566a5e7cfc8a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:20.711060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.737758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.741553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.743171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7e00d3f7-9b26-47b5-b3ee-a2791b523f84 None None] Could not find standard attr ID for object 173cd8d3-ed48-49cd-a059-02b64f7ce161. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:20.789494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:20.802721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 652c550e-ea1a-41fe-a346-1f67da341920 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:20.803065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.808424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.808859 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Added segment a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1 of type vlan for network 118716b0-934b-459d-b87c-bcebda6b65cb Nov 05 14:51:20.813602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a45e52b-7884-4895-87b4-88437d02e4e5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:20.863596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.863929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP fbb19145-d30f-4e98-b332-420947e691a0 disassociated (deleted). External IP: 172.26.5.207, port: 4f1ce27a-19c7-41ae-8be6-8a86912c76bc. Nov 05 14:51:20.880563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=652c550e-ea1a-41fe-a346-1f67da341920,segment=NetworkSegment(2d341384-c0b0-4bde-b730-eeb331cb0808),segment_id=2d341384-c0b0-4bde-b730-eeb331cb0808)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:20.880831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.886171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] DHCP port deletion for 3b7a31b1-f7b7-436c-ae6e-0c0383567567 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:20.897503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 652c550e-ea1a-41fe-a346-1f67da341920 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:20.904767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.940487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Deleting port 652c550e-ea1a-41fe-a346-1f67da341920 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:20.940870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.977780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.978762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:20.979366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:20.982424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.007822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.014170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No DVR routers for this DVR port 652c550e-ea1a-41fe-a346-1f67da341920 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:21.021126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] For port 652c550e-ea1a-41fe-a346-1f67da341920, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=652c550e-ea1a-41fe-a346-1f67da341920,segment=NetworkSegment(2d341384-c0b0-4bde-b730-eeb331cb0808),segment_id=2d341384-c0b0-4bde-b730-eeb331cb0808)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:21.021534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.036841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Calling delete_port for 652c550e-ea1a-41fe-a346-1f67da341920 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:21.048518 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.9180763 Nov 05 14:51:21.052321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45368) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:21.059490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Request body: {'subnet': {'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-122648242-subnet', 'tenant_id': 'de6b84a04f00477c855a9f7319208b60', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:21.096378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16934dc9-769c-4dc0-a100-f07d4da2075b admin admin] Pushing event updated for resources: {'Network': ['ID=118716b0-934b-459d-b87c-bcebda6b65cb,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.101646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.131287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 118716b0-934b-459d-b87c-bcebda6b65cb details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:21.131458 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Made reservation on behalf of de6b84a04f00477c855a9f7319208b60 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:21.134199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.139182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b7a31b1-f7b7-436c-ae6e-0c0383567567']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:21.151017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2d341384-c0b0-4bde-b730-eeb331cb0808') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:21.151697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2d341384-c0b0-4bde-b730-eeb331cb0808') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:21.169424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.189456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.198340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 640 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:21.199543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:21.205825 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:21.229081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:21.237574 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.253620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:21.280866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.288472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.289441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:21.289796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 68b9a9fa-843f-45e0-aba7-b0c4610b00f8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:21.290222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a477d1f0-5a76-432d-af07-9809ef4dce8f no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:21.295525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/3b7a31b1-f7b7-436c-ae6e-0c0383567567 HTTP/1.1" status: 204 len: 168 time: 0.6473899 Nov 05 14:51:21.295708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] Pushing event deleted for resources: {'Port': ['ID=652c550e-ea1a-41fe-a346-1f67da341920,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.297502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45370) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:21.298200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2d509cb-8f70-4cb9-a112-4e0f08831ab3 None None] No DVR routers for this DVR port 652c550e-ea1a-41fe-a346-1f67da341920 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:21.319034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615eb428-b29a-4ea9-8974-caf1c19947f5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=3b7a31b1-f7b7-436c-ae6e-0c0383567567,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.333373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: a477d1f0-5a76-432d-af07-9809ef4dce8f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:21.333723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a477d1f0-5a76-432d-af07-9809ef4dce8f not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:21.334134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 652c550e-ea1a-41fe-a346-1f67da341920 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:21.363185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee98c01c-3fe2-421d-91ab-ed77e17e5b7e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:21.368202 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee98c01c-3fe2-421d-91ab-ed77e17e5b7e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports HTTP/1.1" status: 200 len: 844 time: 0.0674350 Nov 05 14:51:21.368373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62ae2f93-fe93-4ae7-bb9f-c8d21d46b2df None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:21.368373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 652c550e-ea1a-41fe-a346-1f67da341920 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:21.368373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 652c550e-ea1a-41fe-a346-1f67da341920 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:21.369381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45372) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:21.424546 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8eba4ab5-856b-49c7-8d07-c54b0bb80053 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.0526078 Nov 05 14:51:21.428233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45374) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:21.433455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-931998695'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:21.441101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:21.450378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.456356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:21.459820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:21.463569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.478258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62ae2f93-fe93-4ae7-bb9f-c8d21d46b2df None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:21.481619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:21.486069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:50:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:21.489142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:21.499969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.500311 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment a3d25451-d747-44a5-bf40-3da972cb323f of type vlan for network f2fa7fd5-600e-454b-a029-df621bd7d2e4 Nov 05 14:51:21.530327 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ebbac9ce-21d1-4d9d-9a6f-dbd43b724061 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/fbb19145-d30f-4e98-b332-420947e691a0 HTTP/1.1" status: 204 len: 168 time: 1.8424973 Nov 05 14:51:21.533565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:21.535579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74" -d '{"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:21.549483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.561268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.585842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.593211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:21.593919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.606163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af4338dd-8be3-48f1-a495-574e16cad660 x-openstack-request-id: req-af4338dd-8be3-48f1-a495-574e16cad660 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:21.606738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:21.607182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-af4338dd-8be3-48f1-a495-574e16cad660 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:21.608000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'status': 'completed', 'code': 200} Nov 05 14:51:21.665759 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.2351265 Nov 05 14:51:21.668127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45380) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:21.673882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:21.723172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-b597b2af-e578-4136-9b85-5b49623e90f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:21.727573 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-b597b2af-e578-4136-9b85-5b49623e90f8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 1099 time: 0.0918944 Nov 05 14:51:21.729554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2adc5528-6869-48c4-a553-e6664c363034,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.733952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6f35a2-e300-43dc-80bd-838563670d24 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=f2fa7fd5-600e-454b-a029-df621bd7d2e4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:21.734683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Checking segment: {'id': 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:21.735198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Network hostable DHCP agents. Network: 118716b0-934b-459d-b87c-bcebda6b65cb, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:21.795759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:21.801711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:21.817906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:21.825709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Network 118716b0-934b-459d-b87c-bcebda6b65cb is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:21.850279 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 118716b0-934b-459d-b87c-bcebda6b65cb) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:21.968371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:22.015645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.086429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=11ceccaf-3d48-4fd5-a907-518913b99bc1,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:22.100280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': 'a3d25451-d747-44a5-bf40-3da972cb323f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:22.100850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: f2fa7fd5-600e-454b-a029-df621bd7d2e4, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:22.119786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:22.130843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, f2fa7fd5-600e-454b-a029-df621bd7d2e4) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:22.135533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.136256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.157079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5ad52a94-4b3a-4929-af80-c986a6426ded tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4847844 Nov 05 14:51:22.157431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:22.162699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4', 'name': 'tempest-PortsTestJSON-776936698'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:22.216224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.216899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.247075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a35290b1-abff-4f72-88dd-175e4e581799 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.1936934 Nov 05 14:51:22.251933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-93c3f12a-6468-44b9-b57c-d6efd4727fc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.253431 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-93c3f12a-6468-44b9-b57c-d6efd4727fc3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 200 len: 898 time: 0.5098088 Nov 05 14:51:22.267129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69055f39-f47b-4652-aae0-76a2a8442c4f req-f7759f92-6308-41e1-a132-8badb58753e5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.268700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-69055f39-f47b-4652-aae0-76a2a8442c4f req-f7759f92-6308-41e1-a132-8badb58753e5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.4332292 Nov 05 14:51:22.302352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:22.306512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.319756 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-6463460b-a2fc-4d11-b604-674b9da4f8df service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 200 len: 217 time: 0.0499141 Nov 05 14:51:22.332785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port a127ea7d-b870-4a9e-86dd-55674d085cb5 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:22.377387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55708240-8c43-415e-b310-16b7efe1e0d2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:22.407380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e24f57e1-ce82-40e9-adce-198d4ff05b5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.416953 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-69055f39-f47b-4652-aae0-76a2a8442c4f req-7b82c429-0d80-4a6a-bf02-060019d575c0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1404245 Nov 05 14:51:22.422434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-800e1a29-d1c5-45f5-ba6e-234f480c584a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.423885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-800e1a29-d1c5-45f5-ba6e-234f480c584a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 200 len: 835 time: 0.0957973 Nov 05 14:51:22.488645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-cd566d0b-58ba-4de6-9b88-78477eccf1ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.490021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.9 (f2fa7fd5-600e-454b-a029-df621bd7d2e4/11ceccaf-3d48-4fd5-a907-518913b99bc1/a127ea7d-b870-4a9e-86dd-55674d085cb5) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:22.491018 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-cd566d0b-58ba-4de6-9b88-78477eccf1ef service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=965643a3-ab1e-4f60-b0a0-5bd33b3145bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0582352 Nov 05 14:51:22.498430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:22.548929 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:51:22.552360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:22.567686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55708240-8c43-415e-b310-16b7efe1e0d2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:22.578273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:22.579017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:22.625393 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-f0b656ba-bf56-49d7-a2f8-acd7d8fa4ef1 service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247077 Nov 05 14:51:22.716175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.738144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6991c4ee-68bf-4dd5-9fda-9f15e32adc74 req-57021b0c-321f-4c25-987e-b7025c48cf1e service neutron] 10.222.0.32 "GET /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1042368 Nov 05 14:51:22.761152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.788976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:22.810017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:22.817765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:22.822053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:22.850433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=a127ea7d-b870-4a9e-86dd-55674d085cb5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:22.887939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:22.888670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.911171 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5546ada0-ee79-4d89-a72f-c7f9f564e43e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 0.7500820 Nov 05 14:51:22.911394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45400) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:22.916543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4', 'name': 'tempest-PortsTestJSON-1826672339'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:22.926609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45402) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:22.931604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1652705376-network', 'tenant_id': 'bd04573eae1b48a9b0189847c94eba44'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:22.953671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Made reservation on behalf of bd04573eae1b48a9b0189847c94eba44 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:22.956130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:22.965879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.047370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:23.051143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.068770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.074007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port be70e4b7-53fb-4068-8a85-f8bb742ee5c0 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:23.075756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.085185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-f2fa7fd5-600e-454b-a029-df621bd7d2e4', 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': '11ceccaf-3d48-4fd5-a907-518913b99bc1'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:23.086139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.109733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 639} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:23.132340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4a15ac5-179d-414b-8d83-1ed78946fe04,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:23.136403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.137099 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Added segment 17e0be91-2702-4c17-a898-e417f2e8190c of type vlan for network d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 Nov 05 14:51:23.194864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:23.206869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.5 (f2fa7fd5-600e-454b-a029-df621bd7d2e4/11ceccaf-3d48-4fd5-a907-518913b99bc1/be70e4b7-53fb-4068-8a85-f8bb742ee5c0) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:23.222337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff841830-95e2-4100-91bd-52f50fc8f021 None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '96d615f3-eea3-46d2-b255-96f704d51534', 'name': '', 'network_id': '965643a3-ab1e-4f60-b0a0-5bd33b3145bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:56:73:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_interface', 'standard_attr_id': 942, 'fixed_ips': [{'subnet_id': '3381e8ef-646f-402d-992f-758c603f54be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:15Z', 'updated_at': '2021-11-05T14:49:24Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '3381e8ef-646f-402d-992f-758c603f54be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:23.230140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.262004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-f9c05101-558b-4c16-8023-aba85cd6d7f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:23.264539 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-f9c05101-558b-4c16-8023-aba85cd6d7f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.0902841 Nov 05 14:51:23.305909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.306963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:23.307615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.367315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4370806 Nov 05 14:51:23.368080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45404) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:23.376871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Request body: {'subnet': {'network_id': 'd69ff73c-63e4-4635-bfb5-efdd4d3e17e1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1652705376-subnet', 'tenant_id': 'bd04573eae1b48a9b0189847c94eba44', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:23.391523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.393106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.417536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Pushing event updated for resources: {'Network': ['ID=d69ff73c-63e4-4635-bfb5-efdd4d3e17e1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:23.427629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Made reservation on behalf of bd04573eae1b48a9b0189847c94eba44 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:23.429977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.430333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.430484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.430676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.431015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.431354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.431682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.432207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.433025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.433025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.433267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.433522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.434448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf6e6488-a776-4732-93ba-1df26ce418b2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:23.450206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:23.457540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:23.457880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.591703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:23.592573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.593812 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd3d8d92-d154-4fe1-ba7a-b970be589377 None None] New status for floating IP fbb19145-d30f-4e98-b332-420947e691a0: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:51:23.612800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 4f1ce27a-19c7-41ae-8be6-8a86912c76bc owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:23.655125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.682016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Allocated IP 172.20.0.2 (f2fa7fd5-600e-454b-a029-df621bd7d2e4/11ceccaf-3d48-4fd5-a907-518913b99bc1/43bc55d2-aecd-403b-a3e3-3168901f3af1) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:23.719859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.737401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93c41f4-dd91-47e1-b615-409930d3d47f req-86c4e82b-6f55-44b7-8269-bf0f87e90869 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:23.744705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e93c41f4-dd91-47e1-b615-409930d3d47f req-86c4e82b-6f55-44b7-8269-bf0f87e90869 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e8275bc-3945-4cd6-b7cd-8c418a670d7b HTTP/1.1" status: 200 len: 946 time: 0.1514351 Nov 05 14:51:23.777861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:23.784688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.802102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:23.807412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=be70e4b7-53fb-4068-8a85-f8bb742ee5c0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:23.810415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:23.821369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=4f1ce27a-19c7-41ae-8be6-8a86912c76bc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:23.865249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 4f1ce27a-19c7-41ae-8be6-8a86912c76bc on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:23.868449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.872218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e89e370f-d2c4-4cd4-a902-aa1c8d4f37e2 req-47c3e32a-8f3d-4a41-a57c-ef3ba5e3fdf7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/4f1ce27a-19c7-41ae-8be6-8a86912c76bc HTTP/1.1" status: 204 len: 173 time: 0.5979612 Nov 05 14:51:23.872764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'name': 'network-vif-deleted', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:23.874985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7838aa32-9a19-4d4d-9538-7cb2dbb125c9,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:23.875282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0546616a-062e-40f2-b420-68a5a4474aaf" -d '{"events": [{"server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "name": "network-vif-deleted", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:23.920275 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e93c41f4-dd91-47e1-b615-409930d3d47f req-61516234-2fc3-476e-a6c0-239359195e0b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=47fcff7a-3ae1-433f-8294-891325add414&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1746259 Nov 05 14:51:23.940181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:23.940315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:23.946885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Checking segment: {'id': '17e0be91-2702-4c17-a898-e417f2e8190c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'd69ff73c-63e4-4635-bfb5-efdd4d3e17e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:23.947270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Network hostable DHCP agents. Network: d69ff73c-63e4-4635-bfb5-efdd4d3e17e1, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:23.952812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0428a72-70c3-4c3f-944f-61fc43981af4 x-openstack-request-id: req-a0428a72-70c3-4c3f-944f-61fc43981af4 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:23.953112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e8275bc-3945-4cd6-b7cd-8c418a670d7b", "name": "network-vif-deleted", "tag": "4f1ce27a-19c7-41ae-8be6-8a86912c76bc", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:23.953370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a0428a72-70c3-4c3f-944f-61fc43981af4 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:23.953770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e8275bc-3945-4cd6-b7cd-8c418a670d7b', 'name': 'network-vif-deleted', 'tag': '4f1ce27a-19c7-41ae-8be6-8a86912c76bc', 'status': 'completed', 'code': 200} Nov 05 14:51:23.982006 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f07491ad-ad3c-4c16-a94c-04456db7b5c0 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.0694504 Nov 05 14:51:23.983209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Network d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:23.985020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45410) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:23.995889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d69ff73c-63e4-4635-bfb5-efdd4d3e17e1) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:24.001713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:24.002953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.024005 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8316ab4d-20b9-4108-9113-5855b81aac09 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6540720 Nov 05 14:51:24.059242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.066377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.105031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baff99a5-e046-4537-bf87-95917361fa96 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:24.109588 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-baff99a5-e046-4537-bf87-95917361fa96 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.9 HTTP/1.1" status: 200 len: 921 time: 0.1204033 Nov 05 14:51:24.109780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:24.110908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45414) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:24.122175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:24.126048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:24.133478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Pushing event updated for resources: {'Port': ['ID=43bc55d2-aecd-403b-a3e3-3168901f3af1,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:24.188395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Attempting to bind port 43bc55d2-aecd-403b-a3e3-3168901f3af1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:24.188796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Attempting to bind port 43bc55d2-aecd-403b-a3e3-3168901f3af1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'a3d25451-d747-44a5-bf40-3da972cb323f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:24.189161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Attempting to bind port 43bc55d2-aecd-403b-a3e3-3168901f3af1 on network f2fa7fd5-600e-454b-a029-df621bd7d2e4 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:24.194530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 50, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:24.194928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Checking segment: {'id': 'a3d25451-d747-44a5-bf40-3da972cb323f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:24.195333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.195752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Bound using segment: {'id': 'a3d25451-d747-44a5-bf40-3da972cb323f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:24.196171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Bound port: 43bc55d2-aecd-403b-a3e3-3168901f3af1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a3d25451-d747-44a5-bf40-3da972cb323f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': 'f2fa7fd5-600e-454b-a029-df621bd7d2e4'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:24.196600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.230125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port be70e4b7-53fb-4068-8a85-f8bb742ee5c0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:24.231674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.272782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] For port 43bc55d2-aecd-403b-a3e3-3168901f3af1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:24.282612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] For port 43bc55d2-aecd-403b-a3e3-3168901f3af1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=43bc55d2-aecd-403b-a3e3-3168901f3af1,segment=NetworkSegment(a3d25451-d747-44a5-bf40-3da972cb323f),segment_id=a3d25451-d747-44a5-bf40-3da972cb323f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:24.291181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.369105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.391114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91716512-7ac3-463a-a905-ab25b06e7db3 None None] Pushing event updated for resources: {'Port': ['ID=43bc55d2-aecd-403b-a3e3-3168901f3af1,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:24.402360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for be70e4b7-53fb-4068-8a85-f8bb742ee5c0 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:24.603293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.643475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=be70e4b7-53fb-4068-8a85-f8bb742ee5c0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:24.678340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-c18c182f-d306-48c7-9c6f-e1821cd51631 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:24.680578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-c18c182f-d306-48c7-9c6f-e1821cd51631 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/networks?id=118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 200 len: 811 time: 0.1623991 Nov 05 14:51:24.698622 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-102b9e51-3c34-487a-9044-5533a7fb551f tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/quotas/de6b84a04f00477c855a9f7319208b60 HTTP/1.1" status: 200 len: 375 time: 0.0113401 Nov 05 14:51:24.718024 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.721809 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f4025c57-b9d2-47db-a37c-5c3fe19f35eb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/be70e4b7-53fb-4068-8a85-f8bb742ee5c0 HTTP/1.1" status: 204 len: 168 time: 0.6098592 Nov 05 14:51:24.724609 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45430) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:24.745140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-19b0f08c-b767-4381-860d-ec20ef90a1b3 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=de6b84a04f00477c855a9f7319208b60&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0397389 Nov 05 14:51:24.752189 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-b32c9bd9-76d3-48f9-8352-a395e580ec31 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:24.753899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b32c9bd9-76d3-48f9-8352-a395e580ec31 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/be70e4b7-53fb-4068-8a85-f8bb742ee5c0 HTTP/1.1" status: 404 len: 333 time: 0.0281205 Nov 05 14:51:24.756943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45432) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:24.836804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-b7b275a8-9508-4384-a319-0694109a96a5 service neutron] 10.222.0.30 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884254 Nov 05 14:51:24.848541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.851800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port a127ea7d-b870-4a9e-86dd-55674d085cb5 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:24.852137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.938083 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-c7f06d7c-938b-475c-ae5e-9ced30cd508b service neutron] 10.222.0.30 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0943246 Nov 05 14:51:24.941012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:24.954673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for a127ea7d-b870-4a9e-86dd-55674d085cb5 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:24.982804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45436) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:25.059335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.118567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.145599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.179873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a1decfee-9e20-4605-9c1d-dab1885a1732 req-f833a0bf-2c76-4445-a322-432075e24adf tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 210 time: 0.0583067 Nov 05 14:51:25.242099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=a127ea7d-b870-4a9e-86dd-55674d085cb5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:25.248623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.258775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.259034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 43bc55d2-aecd-403b-a3e3-3168901f3af1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:25.260033 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/47fcff7a-3ae1-433f-8294-891325add414 HTTP/1.1" status: 204 len: 168 time: 0.2761555 Nov 05 14:51:25.290071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=47fcff7a-3ae1-433f-8294-891325add414,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:25.308835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.309197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.309538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.309874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.310205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.310585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.310915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.311259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.311570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.311893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.312213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.313170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cba114e3-4d73-4635-a075-4146ca920399 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:25.317106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45448) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:25.352710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 43bc55d2-aecd-403b-a3e3-3168901f3af1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:25.353098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.393581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.404480 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4fba3d1b-c7fc-4f23-9480-1ce5156f8464 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/a127ea7d-b870-4a9e-86dd-55674d085cb5 HTTP/1.1" status: 204 len: 168 time: 0.6464465 Nov 05 14:51:25.408338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45450) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:25.458757 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d106de4-1299-4e65-bd00-b4dfc0c124f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:25.462887 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4d106de4-1299-4e65-bd00-b4dfc0c124f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/a127ea7d-b870-4a9e-86dd-55674d085cb5 HTTP/1.1" status: 404 len: 333 time: 0.0534010 Nov 05 14:51:25.466875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45452) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:25.480053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.520315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 43bc55d2-aecd-403b-a3e3-3168901f3af1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=43bc55d2-aecd-403b-a3e3-3168901f3af1,segment=NetworkSegment(a3d25451-d747-44a5-bf40-3da972cb323f),segment_id=a3d25451-d747-44a5-bf40-3da972cb323f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:25.525488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.529956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 11ceccaf-3d48-4fd5-a907-518913b99bc1 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:25.538481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.610808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e401a76c-da2d-48ee-9cc0-78aa4f311cf2 None None] Network 118716b0-934b-459d-b87c-bcebda6b65cb requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.614227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebd60000-caed-444c-98f1-66801ff8e82f None None] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.629286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=43bc55d2-aecd-403b-a3e3-3168901f3af1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:25.669519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fe08565-097f-4d3c-b60f-a00885b93b74 None None] Network d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.695847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.785936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7b9e3cc8-64ab-428c-b378-4219820e52d7 None None] Provisioning complete for port 43bc55d2-aecd-403b-a3e3-3168901f3af1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:25.786241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7b9e3cc8-64ab-428c-b378-4219820e52d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.860255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ebd60000-caed-444c-98f1-66801ff8e82f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:25.863518 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e401a76c-da2d-48ee-9cc0-78aa4f311cf2 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:25.883964 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4fe08565-097f-4d3c-b60f-a00885b93b74 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:25.885930 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:25.892563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-272299a0-7885-490b-8904-dd8de7f776dc None None] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.940253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d89a2b1-cf44-4d21-b17f-aadb69be0e7e None None] Network 118716b0-934b-459d-b87c-bcebda6b65cb requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.942189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240f300d-10a3-4ba9-956f-a107c3f70498 None None] Network d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:25.961026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:25.972494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.021987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.026031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/11ceccaf-3d48-4fd5-a907-518913b99bc1 HTTP/1.1" status: 204 len: 168 time: 0.5575118 Nov 05 14:51:26.028871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45456) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:26.029778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28098fea-3c7c-4650-94ce-27fd7a7b17d7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=11ceccaf-3d48-4fd5-a907-518913b99bc1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:26.060718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.135486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-272299a0-7885-490b-8904-dd8de7f776dc None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:26.150126 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-240f300d-10a3-4ba9-956f-a107c3f70498 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:26.162947 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1d89a2b1-cf44-4d21-b17f-aadb69be0e7e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:26.168816 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:26.171843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-019bdf59-b56f-49dd-8694-9b66a50833e3 None None] Network f2fa7fd5-600e-454b-a029-df621bd7d2e4 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:26.184098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 4f1ce27a-19c7-41ae-8be6-8a86912c76bc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:26.185965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7b9e3cc8-64ab-428c-b378-4219820e52d7 None None] Could not find standard attr ID for object a127ea7d-b870-4a9e-86dd-55674d085cb5. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:26.219503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 43bc55d2-aecd-403b-a3e3-3168901f3af1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:26.220200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.260497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 4f1ce27a-19c7-41ae-8be6-8a86912c76bc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:26.260497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 4f1ce27a-19c7-41ae-8be6-8a86912c76bc not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:26.389171 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e0bd262-ab88-46d9-b4f6-0274d7ce02b4 req-2894f567-dc67-430c-8018-1181e7b0ed93 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 210 time: 0.1005323 Nov 05 14:51:26.408972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] For port 43bc55d2-aecd-403b-a3e3-3168901f3af1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=43bc55d2-aecd-403b-a3e3-3168901f3af1,segment=NetworkSegment(a3d25451-d747-44a5-bf40-3da972cb323f),segment_id=a3d25451-d747-44a5-bf40-3da972cb323f)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:26.409335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.423843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] DHCP port deletion for f2fa7fd5-600e-454b-a029-df621bd7d2e4 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:26.434879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 43bc55d2-aecd-403b-a3e3-3168901f3af1 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:26.455031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 96d615f3-eea3-46d2-b255-96f704d51534 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:26.455452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.492481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Deleting port 43bc55d2-aecd-403b-a3e3-3168901f3af1 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:26.493074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.519985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-373d1c68-cd43-4195-a8dc-ddf945ee248a tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:26.521478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-373d1c68-cd43-4195-a8dc-ddf945ee248a tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.32 "GET /v2.0/networks?id=118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 200 len: 811 time: 0.2340295 Nov 05 14:51:26.536639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Request body: {'port': {'device_id': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb', 'admin_state_up': True, 'tenant_id': 'de6b84a04f00477c855a9f7319208b60'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:26.559585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 96d615f3-eea3-46d2-b255-96f704d51534, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=96d615f3-eea3-46d2-b255-96f704d51534,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:26.560067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.564652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] For port 43bc55d2-aecd-403b-a3e3-3168901f3af1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=43bc55d2-aecd-403b-a3e3-3168901f3af1,segment=NetworkSegment(a3d25451-d747-44a5-bf40-3da972cb323f),segment_id=a3d25451-d747-44a5-bf40-3da972cb323f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:26.565083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.574575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 96d615f3-eea3-46d2-b255-96f704d51534 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:26.578556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Calling delete_port for 43bc55d2-aecd-403b-a3e3-3168901f3af1 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:26.630483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.661125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.670438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=43bc55d2-aecd-403b-a3e3-3168901f3af1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:26.674877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No DVR routers for this DVR port 43bc55d2-aecd-403b-a3e3-3168901f3af1 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:26.685278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Pushing event deleted for resources: {'Port': ['ID=43bc55d2-aecd-403b-a3e3-3168901f3af1,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:26.695162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.695817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.696322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.696842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.697181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.697517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.697848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.698181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.698510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.698834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.699718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.700067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:26.702915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7096912e-5a14-4d65-be11-9d88e3800472 None None] No DVR routers for this DVR port 43bc55d2-aecd-403b-a3e3-3168901f3af1 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:26.738566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a802a40b-28de-4f97-84ae-d515b2365782 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:26.777253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.780701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Made reservation on behalf of de6b84a04f00477c855a9f7319208b60 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:26.785078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.813792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.825420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f2fa7fd5-600e-454b-a029-df621bd7d2e4']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:26.837727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a3d25451-d747-44a5-bf40-3da972cb323f') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:26.838021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a3d25451-d747-44a5-bf40-3da972cb323f') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:26.854458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a802a40b-28de-4f97-84ae-d515b2365782 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:26.858114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=96d615f3-eea3-46d2-b255-96f704d51534,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:26.881013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.907148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.935117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 609 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:26.935513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:26.938576 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:27.024834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Allocated IP 172.20.0.8 (118716b0-934b-459d-b87c-bcebda6b65cb/2adc5528-6869-48c4-a553-e6664c363034/e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:27.026831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.032275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.040278 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/f2fa7fd5-600e-454b-a029-df621bd7d2e4 HTTP/1.1" status: 204 len: 168 time: 1.0062296 Nov 05 14:51:27.042938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45464) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:27.055103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1651823660'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:27.076098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457161f6-cbe3-4a15-a825-6ff195683526 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=f2fa7fd5-600e-454b-a029-df621bd7d2e4,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:27.123413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:27.126966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.169074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:27.222706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.223051 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment 2f29a027-5987-4bf8-91ab-6aacd0f3a084 of type vlan for network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 Nov 05 14:51:27.291378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 43bc55d2-aecd-403b-a3e3-3168901f3af1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:27.300172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.317156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 43bc55d2-aecd-403b-a3e3-3168901f3af1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:27.317450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 43bc55d2-aecd-403b-a3e3-3168901f3af1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:27.332493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e37f41d-ca7c-4f05-8e61-6ebd7fd2e195 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:27.350516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.358028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.359410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.363759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:27.364348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.436349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e37f41d-ca7c-4f05-8e61-6ebd7fd2e195 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:27.453695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.4077442 Nov 05 14:51:27.459442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:27.468188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:27.490787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f24ce769-1b1a-4afd-b669-0f35ee6f9e44 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=23cfead9-1069-4401-ba2e-c7a78daf1bd8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:27.502399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:27.542171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.560482 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fb992863-259a-40fc-95b0-ebfa079514f5 req-6dbe40d9-b15c-410b-9896-9330e952246d tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 210 time: 0.0697329 Nov 05 14:51:27.622367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Network 118716b0-934b-459d-b87c-bcebda6b65cb is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:27.623147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Pushing event updated for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:27.627874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:27.631692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:27.660558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router c9eda620-b56d-4879-9d5c-3b17badf0d55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:27.676472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:27.679860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.733476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:27.734322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.764681 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a96be3b7-dfa2-4334-aaf8-e5b926f7c584 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2320559 Nov 05 14:51:27.778177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Request body: {'port': {'device_id': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:27.778485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:27.784603 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-36e5abe8-a29b-479c-bf9e-5bb6c93bd5c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/c9eda620-b56d-4879-9d5c-3b17badf0d55/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4656467 Nov 05 14:51:27.786587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45470) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:27.791099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Sync routers for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:27.801637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:27.802250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:27.888045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet 3381e8ef-646f-402d-992f-758c603f54be {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:27.896270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:27.908104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:27.939140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.006252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.090870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:26Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:28.098487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.122147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Checking router: c9eda620-b56d-4879-9d5c-3b17badf0d55 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:28.131252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Routers {'c9eda620-b56d-4879-9d5c-3b17badf0d55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:28.131979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['c9eda620-b56d-4879-9d5c-3b17badf0d55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:28.245095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] Set router c9eda620-b56d-4879-9d5c-3b17badf0d55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:28.265628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.326748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:28.355276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': '2f29a027-5987-4bf8-91ab-6aacd0f3a084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:28.356161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 23cfead9-1069-4401-ba2e-c7a78daf1bd8, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:28.407738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:28.416341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.435704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:26Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:28.453982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 23cfead9-1069-4401-ba2e-c7a78daf1bd8) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:28.455376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=3381e8ef-646f-402d-992f-758c603f54be,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:28.458471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.461654 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8e43e17e-ba6d-4187-b8f4-2c288b66b371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/3381e8ef-646f-402d-992f-758c603f54be HTTP/1.1" status: 204 len: 168 time: 0.6741288 Nov 05 14:51:28.464498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45472) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:28.466543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:28.467122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.467975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6447b31c-effc-45d5-a41e-97468c8edd25 None None] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:28.493867 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ff2ba5af-7772-44c9-b9fe-e9e7e76b5d06 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0332880 Nov 05 14:51:28.512421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45474) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:28.517312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8', 'name': 'tempest-PortsTestJSON-400537387', 'fixed_ips': [{'subnet_id': '4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6', 'ip_address': '172.20.0.10'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:28.531020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84fc9372-e737-45d1-b6c1-044f76eadbcb None None] The sync data for ids ['c9eda620-b56d-4879-9d5c-3b17badf0d55'] in dv-neutron-816850-1-hyperv is: [{'id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'name': 'tempest-TestNetworkBasicOps-router-926573290', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157'}], 'enable_snat': True}, 'gw_port_id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:04Z', 'updated_at': '2021-11-05T14:51:26Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'dbed45f6-5a06-4297-8146-dbb3a29f0ec6', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:5c:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9eda620-b56d-4879-9d5c-3b17badf0d55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 927, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:06Z', 'updated_at': '2021-11-05T14:49:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:28.532787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88409cac-7815-44be-8799-d08889c43cda None None] Network 965643a3-ab1e-4f60-b0a0-5bd33b3145bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:28.581022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6447b31c-effc-45d5-a41e-97468c8edd25 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:28.588425 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:28.606939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.629564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.632719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Transition to ACTIVE for port object e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:51:28.643894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f9afbf5-f1de-452a-8268-6d3570ca7e85 None None] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:28.659871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0f9afbf5-f1de-452a-8268-6d3570ca7e85 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:28.739323 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:28.758777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.812637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Pushing event updated for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:28.816187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port dbed45f6-5a06-4297-8146-dbb3a29f0ec6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:28.816802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.840114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67aa71d5-37da-484b-a352-8ac6e621aa84 req-090c25ce-eddd-41ba-b761-9d7ddbd57f10 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:28.841646 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-67aa71d5-37da-484b-a352-8ac6e621aa84 req-090c25ce-eddd-41ba-b761-9d7ddbd57f10 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 943 time: 0.1861856 Nov 05 14:51:28.868836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:28.897716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port dbed45f6-5a06-4297-8146-dbb3a29f0ec6, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:28.898077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:28.920371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for dbed45f6-5a06-4297-8146-dbb3a29f0ec6 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:28.925309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] DHCP port deletion for 965643a3-ab1e-4f60-b0a0-5bd33b3145bc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:28.937754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Attempting to bind port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:28.938087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Attempting to bind port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:28.938415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Attempting to bind port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 on network 118716b0-934b-459d-b87c-bcebda6b65cb {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:28.985557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Deleting port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:28.985863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.063188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] For port ca6f2f02-df01-42fa-a18b-094bdc2e7a68, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,segment=NetworkSegment(c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31),segment_id=c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:29.063757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.085139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Calling delete_port for ca6f2f02-df01-42fa-a18b-094bdc2e7a68 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:29.159085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.187142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 96d615f3-eea3-46d2-b255-96f704d51534 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:29.203562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=dbed45f6-5a06-4297-8146-dbb3a29f0ec6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:29.217495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 96d615f3-eea3-46d2-b255-96f704d51534 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:29.217757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 96d615f3-eea3-46d2-b255-96f704d51534 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:29.218193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ca6f2f02-df01-42fa-a18b-094bdc2e7a68 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:29.260531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.265550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.294739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] Pushing event deleted for resources: {'Port': ['ID=ca6f2f02-df01-42fa-a18b-094bdc2e7a68,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:29.309978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No active binding found for port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 {{(pid=113582) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 05 14:51:29.309978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ca6f2f02-df01-42fa-a18b-094bdc2e7a68 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:29.310325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 on network 118716b0-934b-459d-b87c-bcebda6b65cb not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:51:29.310585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Attempting to bind port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 on network 118716b0-934b-459d-b87c-bcebda6b65cb {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:29.319931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5515c86-37b5-4506-bcf6-179e871c87fa None None] No DVR routers for this DVR port ca6f2f02-df01-42fa-a18b-094bdc2e7a68 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:29.333579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:29.333916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Checking segment: {'id': 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:29.334301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Bound using segment: {'id': 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:29.334735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Bound port: e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:29.335092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.338463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9ca2409-71df-4343-aa12-af73b67694e4 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:29.345611 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-67aa71d5-37da-484b-a352-8ac6e621aa84 req-9cec6b28-e8ab-40d4-b1c6-1c1bf7c08597 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4946511 Nov 05 14:51:29.375126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.384590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.386832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.412908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 34d79fb0-aa32-4b54-bc17-06a5db1bed18 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:29.435833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.436421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router c9eda620-b56d-4879-9d5c-3b17badf0d55 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:51:29.437224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9ca2409-71df-4343-aa12-af73b67694e4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:29.445511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.449068 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-28254a0f-cba4-4d45-afa1-a26cffa18503 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/c9eda620-b56d-4879-9d5c-3b17badf0d55 HTTP/1.1" status: 204 len: 168 time: 0.9816566 Nov 05 14:51:29.452066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45478) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:29.491135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:29.544594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,segment=NetworkSegment(a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1),segment_id=a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:29.545898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.554234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.617280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:29.617915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.619373 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] 10.222.0.32 "PUT /v2.0/ports/e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 200 len: 1093 time: 1.8459997 Nov 05 14:51:29.619838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:29.622758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-660535b7-ebd4-40c9-b03a-d35268496777" -d '{"events": [{"name": "network-changed", "server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:29.680196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e887f590-ab7a-46b5-a4b5-77c30b959f6e service neutron] Pushing event updated for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:29.708044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.10 (23cfead9-1069-4401-ba2e-c7a78daf1bd8/4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6/34d79fb0-aa32-4b54-bc17-06a5db1bed18) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:29.710979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3b074f8-2097-4940-ab33-041a24a9ff86 x-openstack-request-id: req-d3b074f8-2097-4940-ab33-041a24a9ff86 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:29.711276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:29.711706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d3b074f8-2097-4940-ab33-041a24a9ff86 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:29.712349 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645', 'status': 'completed', 'code': 200} Nov 05 14:51:29.716938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.744759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-57c0c336-ae45-4711-be53-c0adbc106aa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:29.745329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['965643a3-ab1e-4f60-b0a0-5bd33b3145bc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:29.746338 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-57c0c336-ae45-4711-be53-c0adbc106aa0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=de6b84a04f00477c855a9f7319208b60&device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 1096 time: 0.0789926 Nov 05 14:51:29.755187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:29.755448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c946ff97-ae0f-4ec0-8a62-e4f0aaf41a31') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:29.765835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.780362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.788335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 647 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:29.788996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:29.793720 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:29.805239 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-a9cbfeaf-a3c2-4cac-9435-0f19e2882700 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 200 len: 217 time: 0.0479083 Nov 05 14:51:29.860018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.878402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.884894 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/965643a3-ab1e-4f60-b0a0-5bd33b3145bc HTTP/1.1" status: 204 len: 168 time: 0.4283876 Nov 05 14:51:29.884894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634a6fbc-6b57-45a0-822c-36a3a8494928 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=965643a3-ab1e-4f60-b0a0-5bd33b3145bc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:29.897694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45482) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:29.904354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--2095489538', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:29.907723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-23cfead9-1069-4401-ba2e-c7a78daf1bd8', 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': '4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:29.908645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.928824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:29.931294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-b5f0911c-4ede-4eb8-95c3-86e18b2a8070 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:29.932961 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-b5f0911c-4ede-4eb8-95c3-86e18b2a8070 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=2adc5528-6869-48c4-a553-e6664c363034 HTTP/1.1" status: 200 len: 851 time: 0.1184452 Nov 05 14:51:29.934776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.959572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:29.969588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:29.970007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment 31d54faf-467f-4166-88f4-413d4f86ed30 of type vlan for network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 Nov 05 14:51:29.974860 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-44b46647-8059-4e7c-a749-2f903891ee7c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=118716b0-934b-459d-b87c-bcebda6b65cb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343580 Nov 05 14:51:30.020331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.052832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.054956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.058910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.063118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.110665 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-0e5128f2-4490-4d5b-be95-242dea950db8 service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245713 Nov 05 14:51:30.120802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2217407 Nov 05 14:51:30.123800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45484) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:30.130270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:30.148145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ae8b7a-1662-4895-9802-bceac4d7acef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:30.162211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.162464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.163559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.173971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:30.227262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.228542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:30.239007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:30.242745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=34d79fb0-aa32-4b54-bc17-06a5db1bed18,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:30.246836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:30.254154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Allocated IP 172.20.0.2 (23cfead9-1069-4401-ba2e-c7a78daf1bd8/4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6/1833b765-8f4a-4d30-ac51-faaa7d49f66d) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:30.292366 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc694445-56bf-4e67-a2f9-c0a4c0802909 req-9c98f61a-f496-47ed-baa0-7d720ec2cb87 service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1748250 Nov 05 14:51:30.314385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.315550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.339927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a1fd8fc2-417b-43ac-81bf-5450f802e96e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.8262749 Nov 05 14:51:30.342380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45486) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:30.348233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8', 'name': 'tempest-PortsTestJSON-1597996194', 'fixed_ips': [{'subnet_id': '4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6', 'ip_address': '172.20.0.9'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:30.416641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.437000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.445490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.493692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:30.498568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:30.500311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660535b7-ebd4-40c9-b03a-d35268496777 req-23dfe8ce-0160-461f-9f81-72a59750e41d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.501246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:30.501856 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-23dfe8ce-0160-461f-9f81-72a59750e41d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=de6b84a04f00477c855a9f7319208b60&device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 1096 time: 0.1501691 Nov 05 14:51:30.505143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Pushing event updated for resources: {'Port': ['ID=1833b765-8f4a-4d30-ac51-faaa7d49f66d,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:30.563001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Attempting to bind port 1833b765-8f4a-4d30-ac51-faaa7d49f66d on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:30.563368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Attempting to bind port 1833b765-8f4a-4d30-ac51-faaa7d49f66d by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2f29a027-5987-4bf8-91ab-6aacd0f3a084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:30.563796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Attempting to bind port 1833b765-8f4a-4d30-ac51-faaa7d49f66d on network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:30.570255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:30.570739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Checking segment: {'id': '2f29a027-5987-4bf8-91ab-6aacd0f3a084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:30.571147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.571540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Bound using segment: {'id': '2f29a027-5987-4bf8-91ab-6aacd0f3a084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:30.572008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Bound port: 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f29a027-5987-4bf8-91ab-6aacd0f3a084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': '23cfead9-1069-4401-ba2e-c7a78daf1bd8'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:30.572385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.584294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d614411-948e-4ef4-9ce7-6677c94872bf req-97bedf3e-8992-4809-8fd6-be3a0ef8f8a0 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.586074 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7d614411-948e-4ef4-9ce7-6677c94872bf req-97bedf3e-8992-4809-8fd6-be3a0ef8f8a0 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 943 time: 0.1653788 Nov 05 14:51:30.634848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:30.640860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.645835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] For port 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:30.649466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] For port 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1833b765-8f4a-4d30-ac51-faaa7d49f66d,segment=NetworkSegment(2f29a027-5987-4bf8-91ab-6aacd0f3a084),segment_id=2f29a027-5987-4bf8-91ab-6aacd0f3a084)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:30.653649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.683787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.691323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 21b6bec6-30bc-4e93-aae0-68702e3e874d yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:30.707974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660535b7-ebd4-40c9-b03a-d35268496777 req-a22495bc-3246-4667-8d39-c843a16d2621 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.709256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.717953 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-a22495bc-3246-4667-8d39-c843a16d2621 service neutron] 10.222.0.32 "GET /v2.0/networks?id=118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 200 len: 912 time: 0.2054112 Nov 05 14:51:30.723033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f00e2a-eb34-4f3b-94eb-62ecd5e2ad76 None None] Pushing event updated for resources: {'Port': ['ID=1833b765-8f4a-4d30-ac51-faaa7d49f66d,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:30.734719 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7d614411-948e-4ef4-9ce7-6677c94872bf req-f12a3790-c90e-49a5-a57c-8640ea9cefe2 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424787 Nov 05 14:51:30.810573 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-d160823c-f245-485a-8493-4ea5d7e51f27 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 200 len: 217 time: 0.0454113 Nov 05 14:51:30.825288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.14 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/a5e7070d-a62e-4d91-8d2b-1a0aaab29007) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:30.921917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660535b7-ebd4-40c9-b03a-d35268496777 req-e838fd98-75ae-4b96-bda6-ae61895678a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:30.923399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-e838fd98-75ae-4b96-bda6-ae61895678a2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=2adc5528-6869-48c4-a553-e6664c363034 HTTP/1.1" status: 200 len: 851 time: 0.1048911 Nov 05 14:51:30.971367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:30.983097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-678ddffb-097e-4cb4-ac6d-e20f0dfa166a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=118716b0-934b-459d-b87c-bcebda6b65cb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0511467 Nov 05 14:51:31.009761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.050114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:31.055154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:31.057718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.9 (23cfead9-1069-4401-ba2e-c7a78daf1bd8/4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6/21b6bec6-30bc-4e93-aae0-68702e3e874d) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:31.058893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:31.086623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:31.144184 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-6acb561b-07a0-4d71-a53e-8dd8dbec0e8b service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1490436 Nov 05 14:51:31.197571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1833b765-8f4a-4d30-ac51-faaa7d49f66d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:31.260946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1833b765-8f4a-4d30-ac51-faaa7d49f66d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:31.261499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.332239 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-660535b7-ebd4-40c9-b03a-d35268496777 req-e5b03141-f57f-41aa-83e8-21843b101fc9 service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1656687 Nov 05 14:51:31.334957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.335130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.352999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.378021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.387511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1833b765-8f4a-4d30-ac51-faaa7d49f66d,segment=NetworkSegment(2f29a027-5987-4bf8-91ab-6aacd0f3a084),segment_id=2f29a027-5987-4bf8-91ab-6aacd0f3a084)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:31.393380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.431905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:31.435861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:31.446016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:31.451048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=21b6bec6-30bc-4e93-aae0-68702e3e874d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:31.475073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dbed45f6-5a06-4297-8146-dbb3a29f0ec6 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:31.505515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: dbed45f6-5a06-4297-8146-dbb3a29f0ec6 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:31.505867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dbed45f6-5a06-4297-8146-dbb3a29f0ec6 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:31.511455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=1833b765-8f4a-4d30-ac51-faaa7d49f66d,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:31.513583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.514815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.534869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-44d8655f-513c-4166-a591-5e9b1cdad642 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.1912968 Nov 05 14:51:31.537637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45490) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:31.592478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7373b2a5-23d3-4e5f-afaa-c38e50199112 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.596548 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7373b2a5-23d3-4e5f-afaa-c38e50199112 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 922 time: 0.0543950 Nov 05 14:51:31.596799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45492) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:31.611791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.658796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89d17df4-c110-4097-8054-4fb4fd34e66c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.665041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89d17df4-c110-4097-8054-4fb4fd34e66c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.671182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89d17df4-c110-4097-8054-4fb4fd34e66c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.675450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-89d17df4-c110-4097-8054-4fb4fd34e66c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.0752263 Nov 05 14:51:31.675692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45494) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:31.750239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router defa989d-42e0-4df7-972d-4f912f93ce3d is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:51:31.773382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 21b6bec6-30bc-4e93-aae0-68702e3e874d {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:31.773720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.859496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bcd945d-4098-4382-b9ac-d61453234a33 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:31.881426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.888845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:31.898830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 21b6bec6-30bc-4e93-aae0-68702e3e874d owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:31.905186 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Sync routers for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:31.912652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c533b422-35da-41dc-a21b-12c3c71e31e6 None None] Provisioning complete for port 1833b765-8f4a-4d30-ac51-faaa7d49f66d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:31.912984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c533b422-35da-41dc-a21b-12c3c71e31e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.914783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dff494b-be32-48cd-8c68-b8b137186f46 req-177830e9-e558-47cc-821e-51365f16bcbc tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:31.918764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dff494b-be32-48cd-8c68-b8b137186f46 req-177830e9-e558-47cc-821e-51365f16bcbc tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 943 time: 0.0751760 Nov 05 14:51:31.926511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:31.926945 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:31.927952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d98c86be-2a98-4971-b49c-413d5b238b8b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.8032525 Nov 05 14:51:31.928821 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:31.937107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45498) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:31.977924 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e6fc4452-9014-4071-8b94-0ddb86543572 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0396318 Nov 05 14:51:31.981689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45500) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.022177 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dff494b-be32-48cd-8c68-b8b137186f46 req-99bb98ca-79d1-4729-adcf-35d27f53b649 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878172 Nov 05 14:51:32.032066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bcd945d-4098-4382-b9ac-d61453234a33 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:32.068203 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:32.130869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d00b72c9-d740-4001-96de-bfa3b99bbcc6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:32.135304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.135468 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d00b72c9-d740-4001-96de-bfa3b99bbcc6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1506553 Nov 05 14:51:32.136634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.164926 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d3bd44f7-10ca-4cd9-ae3c-d4bdab8da4ae tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0288880 Nov 05 14:51:32.167350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.169481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=21b6bec6-30bc-4e93-aae0-68702e3e874d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:32.172874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1736693103', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:32.206156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:51:32.249651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.255714 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a83f85c4-b0bd-4bc2-ad05-37838fe46637 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/21b6bec6-30bc-4e93-aae0-68702e3e874d HTTP/1.1" status: 204 len: 168 time: 0.5790546 Nov 05 14:51:32.256330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.276212 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:31Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:32.285729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-afddeecf-0978-4085-be92-66aa1b2001ed tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:32.289041 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-afddeecf-0978-4085-be92-66aa1b2001ed tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/21b6bec6-30bc-4e93-aae0-68702e3e874d HTTP/1.1" status: 404 len: 333 time: 0.0315373 Nov 05 14:51:32.292427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.292627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:32.296610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.314091 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Checking router: defa989d-42e0-4df7-972d-4f912f93ce3d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:32.314829 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Updating router defa989d-42e0-4df7-972d-4f912f93ce3d port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:51:32.346921 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.405516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 34d79fb0-aa32-4b54-bc17-06a5db1bed18 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:32.406089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,segment=NetworkSegment(a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1),segment_id=a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:32.406974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.425088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645', 'network_id': '118716b0-934b-459d-b87c-bcebda6b65cb', 'port_id': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645', 'mac_address': 'fa:16:3e:51:4f:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 605, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2adc5528-6869-48c4-a553-e6664c363034', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:51:32.514411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.529283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.532417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:51:32.562017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,segment=NetworkSegment(a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1),segment_id=a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:32.568647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.576745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.595248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 34d79fb0-aa32-4b54-bc17-06a5db1bed18 owned by {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:32.628979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:32.633444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=68c6fc61-cadd-441b-83cf-35abc1a4569e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:32.656793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:32.656793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:32.679191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:32.692353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:32.700798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:32.701499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.705036 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.716223 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.730777 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c096c2d4-703d-4287-9a8e-43934de0efab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5583138 Nov 05 14:51:32.731038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45510) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.770381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.780897 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Attempting to bind port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:32.781547 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Attempting to bind port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:32.781981 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Attempting to bind port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:32.789438 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Pushing event updated for resources: {'Port': ['ID=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:32.793094 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:32.793553 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:32.794026 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.794488 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:32.795040 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Bound port: a5e7070d-a62e-4d91-8d2b-1a0aaab29007, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:32.795805 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.811736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=34d79fb0-aa32-4b54-bc17-06a5db1bed18,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:32.820828 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.821281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.821873 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.822431 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.823001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.823578 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.824166 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.824795 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.825472 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.826036 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.826585 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.827147 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:51:32.834942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:51:32.888217 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] For port a5e7070d-a62e-4d91-8d2b-1a0aaab29007, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:32.895284 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] For port a5e7070d-a62e-4d91-8d2b-1a0aaab29007, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:32.903072 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.926266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:32.932515 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6579a534-71e2-4e6b-95cb-ccee2e4e954e tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/34d79fb0-aa32-4b54-bc17-06a5db1bed18 HTTP/1.1" status: 204 len: 168 time: 0.6389151 Nov 05 14:51:32.936690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45512) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:32.971501 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:32.972955 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:33.007812 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a568156-d8a3-4982-ba75-cab64b8d6fd6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:33.009525 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0a568156-d8a3-4982-ba75-cab64b8d6fd6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/34d79fb0-aa32-4b54-bc17-06a5db1bed18 HTTP/1.1" status: 404 len: 333 time: 0.0718610 Nov 05 14:51:33.014261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45514) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:33.123930 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:33.143053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:33.152664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.224606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1833b765-8f4a-4d30-ac51-faaa7d49f66d up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:33.258967 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6d947a-fc19-48d7-b41d-fc2834caeda8 None None] Pushing event updated for resources: {'Port': ['ID=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:33.294154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.299063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7277d9be-75c4-4179-b1f0-d86c2240c6ac None None] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:33.366774 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:31Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:33.374951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4625d307-a0dc-41ae-935d-d20d7356260a req-7fa93dd0-fa3b-4809-8cdf-486059ad522f tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:33.376821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4625d307-a0dc-41ae-935d-d20d7356260a req-7fa93dd0-fa3b-4809-8cdf-486059ad522f tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 944 time: 0.1781211 Nov 05 14:51:33.399634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-423b3262-22fd-4b6c-aaeb-7f305d32d6b3 None None] The sync data for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv is: [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:31Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:33.420107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1833b765-8f4a-4d30-ac51-faaa7d49f66d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:33.420107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7277d9be-75c4-4179-b1f0-d86c2240c6ac None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:33.433875 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:33.462437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c5f3aa4-affa-4eda-8e4d-a45a5d2b8bb5 None None] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:33.491615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.538813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d72fba4b-576e-48ee-a0fe-9e020d101fc8 None None] Provisioning complete for port 1833b765-8f4a-4d30-ac51-faaa7d49f66d triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:33.540033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d72fba4b-576e-48ee-a0fe-9e020d101fc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.581909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4625d307-a0dc-41ae-935d-d20d7356260a req-003f4330-89a5-40cd-b474-5c896f3189b3 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1055658 Nov 05 14:51:33.599481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.628845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.635657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6 HTTP/1.1" status: 204 len: 168 time: 0.6178668 Nov 05 14:51:33.650138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45518) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:33.656683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f8fcb5-4f17-4861-a789-12505533d0dc tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2c5f3aa4-affa-4eda-8e4d-a45a5d2b8bb5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:33.673703 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:33.804826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d72fba4b-576e-48ee-a0fe-9e020d101fc8 None None] Could not find standard attr ID for object 34d79fb0-aa32-4b54-bc17-06a5db1bed18. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:33.818864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.899861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44eac8e4-814c-47bf-a074-9baa1531a249 None None] Network 23cfead9-1069-4401-ba2e-c7a78daf1bd8 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:33.900599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:33.965720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8444d319-986d-490e-ad48-fdb7435c4cdf None None] Could not find standard attr ID for object 21b6bec6-30bc-4e93-aae0-68702e3e874d. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:33.971717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8444d319-986d-490e-ad48-fdb7435c4cdf None None] Could not find standard attr ID for object 34d79fb0-aa32-4b54-bc17-06a5db1bed18. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:33.978319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 1833b765-8f4a-4d30-ac51-faaa7d49f66d {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:33.978666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.087521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] DHCP port deletion for 23cfead9-1069-4401-ba2e-c7a78daf1bd8 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:34.091442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] For port 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1833b765-8f4a-4d30-ac51-faaa7d49f66d,segment=NetworkSegment(2f29a027-5987-4bf8-91ab-6aacd0f3a084),segment_id=2f29a027-5987-4bf8-91ab-6aacd0f3a084)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:34.091812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.112247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 1833b765-8f4a-4d30-ac51-faaa7d49f66d owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:34.141715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Deleting port 1833b765-8f4a-4d30-ac51-faaa7d49f66d {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:34.142101 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.327981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.339332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (64ec4940-bfdd-445b-8f53-bbe9cebb2ca0/68c6fc61-cadd-441b-83cf-35abc1a4569e/2e222a34-52e4-4d3c-b6bf-199a8f3fd81c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:34.342988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:34.365619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=1833b765-8f4a-4d30-ac51-faaa7d49f66d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:34.372292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No DVR routers for this DVR port 1833b765-8f4a-4d30-ac51-faaa7d49f66d on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:34.392407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] For port 1833b765-8f4a-4d30-ac51-faaa7d49f66d, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1833b765-8f4a-4d30-ac51-faaa7d49f66d,segment=NetworkSegment(2f29a027-5987-4bf8-91ab-6aacd0f3a084),segment_id=2f29a027-5987-4bf8-91ab-6aacd0f3a084)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:34.392830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.410154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Calling delete_port for 1833b765-8f4a-4d30-ac51-faaa7d49f66d owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:34.473568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:51:34.481067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:34.481437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.512802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.548489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.549408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23cfead9-1069-4401-ba2e-c7a78daf1bd8']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:34.563997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f29a027-5987-4bf8-91ab-6aacd0f3a084') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:34.564288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f29a027-5987-4bf8-91ab-6aacd0f3a084') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:34.582421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.592629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] Pushing event deleted for resources: {'Port': ['ID=1833b765-8f4a-4d30-ac51-faaa7d49f66d,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:34.598092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1a23389-9cc9-4345-b3ae-3a88c820844c None None] No DVR routers for this DVR port 1833b765-8f4a-4d30-ac51-faaa7d49f66d on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:34.613473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.614822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.616546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.627092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:34.627390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:34.631049 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:34.641177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-933774f3-3d63-42d7-b2d5-a16f29a02049 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:34.673069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:34.675318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c69389c1-18f5-448f-8091-d948104cdd05" -d '{"events": [{"server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "name": "network-vif-plugged", "status": "completed", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:34.694962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,segment=NetworkSegment(a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1),segment_id=a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:34.705479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.737384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b471f8f8-ce9c-404e-9dae-c67e6cd004b3 x-openstack-request-id: req-b471f8f8-ce9c-404e-9dae-c67e6cd004b3 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:34.737683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "name": "network-vif-plugged", "status": "completed", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:34.738108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b471f8f8-ce9c-404e-9dae-c67e6cd004b3 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:34.738668 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645', 'code': 200} Nov 05 14:51:34.754738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.777417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.786652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45524) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:34.789200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/23cfead9-1069-4401-ba2e-c7a78daf1bd8 HTTP/1.1" status: 204 len: 168 time: 1.1372130 Nov 05 14:51:34.791740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91d110cd-8212-4308-96b1-ecaab4cc8df8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=23cfead9-1069-4401-ba2e-c7a78daf1bd8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:34.791933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-899316126'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:34.797399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.821021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:34.825461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.835379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:34.846847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-933774f3-3d63-42d7-b2d5-a16f29a02049 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:34.855825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d73ee76-6613-47c9-9675-c6521558f985 req-fc93bae7-309b-468a-ad7c-367986e25f01 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:34.864924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 633} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:51:34.865779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6d73ee76-6613-47c9-9675-c6521558f985 req-fc93bae7-309b-468a-ad7c-367986e25f01 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 944 time: 0.1947327 Nov 05 14:51:34.879800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:34.880481 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Added segment b304e0ac-8bad-49b2-b4a4-44adb84e2549 of type vlan for network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e Nov 05 14:51:34.931107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:34.943857 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6d73ee76-6613-47c9-9675-c6521558f985 req-4c4e9c2f-b209-4861-8d02-10b40d594d6f tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771229 Nov 05 14:51:34.949956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:34.953995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:34.957112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:34.993055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.005686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.024731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c365bbc8-dd95-4225-9202-1f0b18b7318f req-280c8a9b-815f-4669-aced-b75a71736f2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:35.026539 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c365bbc8-dd95-4225-9202-1f0b18b7318f req-280c8a9b-815f-4669-aced-b75a71736f2f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 1098 time: 0.1443310 Nov 05 14:51:35.028079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.033479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:35.034048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.114808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.3269532 Nov 05 14:51:35.119449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45526) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:35.132390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:35.135083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00fba257-29e4-40f8-a2e5-3ea71ffb14f9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Network': ['ID=259ed6d8-93c4-49f3-9d2a-13ffb66e018e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.151452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:35.151669 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c365bbc8-dd95-4225-9202-1f0b18b7318f req-5b106b90-dda0-40ac-8f06-2767669bb8c5 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1140583 Nov 05 14:51:35.151798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.173876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:51:35.233164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.283633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a5e7070d-a62e-4d91-8d2b-1a0aaab29007 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:35.295024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:35.298713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.398562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Allocated IP 172.20.0.2 (64ec4940-bfdd-445b-8f53-bbe9cebb2ca0/68c6fc61-cadd-441b-83cf-35abc1a4569e/18f82970-1aa0-49be-9c4d-5a3cbbe76043) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:35.407095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:35.407610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.564242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.610232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port a5e7070d-a62e-4d91-8d2b-1a0aaab29007, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:35.618526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.651809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.669672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.670446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.684498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1833b765-8f4a-4d30-ac51-faaa7d49f66d no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:35.711288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.713911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 1833b765-8f4a-4d30-ac51-faaa7d49f66d {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:35.714071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1833b765-8f4a-4d30-ac51-faaa7d49f66d not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:35.721525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:35.747358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:35.747633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.750461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:35.762463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.771195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=b269c6a4-dcb1-443b-a1e9-05d19287fad2,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.787698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Pushing event updated for resources: {'Port': ['ID=18f82970-1aa0-49be-9c4d-5a3cbbe76043,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.819380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Attempting to bind port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:35.819588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Checking segment: {'id': 'b304e0ac-8bad-49b2-b4a4-44adb84e2549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:35.819737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network hostable DHCP agents. Network: 259ed6d8-93c4-49f3-9d2a-13ffb66e018e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:51:35.819883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Attempting to bind port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:35.820332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Attempting to bind port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 on network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:35.825958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:35.826401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Checking segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:35.826805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.827194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Bound using segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:35.827656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Bound port: 18f82970-1aa0-49be-9c4d-5a3cbbe76043, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:35.828032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.850046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.860829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.864125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:51:35.877997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 259ed6d8-93c4-49f3-9d2a-13ffb66e018e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:35.897582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] For port 18f82970-1aa0-49be-9c4d-5a3cbbe76043, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:35.901094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] For port 18f82970-1aa0-49be-9c4d-5a3cbbe76043, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=18f82970-1aa0-49be-9c4d-5a3cbbe76043,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:35.905489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.919513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:35.920106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.946742 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be824c66-ba89-4e3a-a91b-758a8d7917db tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8186769 Nov 05 14:51:35.947600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45528) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:35.951440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-447466793', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:35.978686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4f7d93-ff15-43bd-8074-4b492247da87 None None] Pushing event updated for resources: {'Port': ['ID=18f82970-1aa0-49be-9c4d-5a3cbbe76043,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:35.998356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:35.999412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.013148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:36.017980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:36.090492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e0b644-6c9b-47a7-b9a7-b510104188ff req-fb3f2c61-484a-46b2-b4f3-65a96b411634 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.099017 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-30e0b644-6c9b-47a7-b9a7-b510104188ff req-fb3f2c61-484a-46b2-b4f3-65a96b411634 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.0802963 Nov 05 14:51:36.104688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.117942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.163914 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-30e0b644-6c9b-47a7-b9a7-b510104188ff req-8af3f041-67b4-443e-9393-254cb92d94d3 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637643 Nov 05 14:51:36.180373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.182854 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1d2ab86f-6e9b-4357-a65c-0bab344feeec tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 701 time: 0.2349398 Nov 05 14:51:36.188034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:36.196696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e', 'name': 'tempest-PortsTestJSON-943155836'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:36.265227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router defa989d-42e0-4df7-972d-4f912f93ce3d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:36.401085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:36.405125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.431739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:36.433723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 57b1080d-a514-4326-94de-716a271d1b62 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:36.441108 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d7e2f6cf-1d67-43c2-9c10-1a708745b481 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/defa989d-42e0-4df7-972d-4f912f93ce3d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7091446 Nov 05 14:51:36.441773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Sync routers for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:36.444445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45534) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:36.454486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:36.455089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:36.564879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:36.784362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:36.818806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Checking router: defa989d-42e0-4df7-972d-4f912f93ce3d for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:36.819578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Updating router defa989d-42e0-4df7-972d-4f912f93ce3d port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:51:36.848262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:36.945954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.2 (259ed6d8-93c4-49f3-9d2a-13ffb66e018e/b269c6a4-dcb1-443b-a1e9-05d19287fad2/57b1080d-a514-4326-94de-716a271d1b62) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:36.949336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.949910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.950242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.950964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.951897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.952073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.952374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.952843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.953290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.954010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:36.957379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa94818f-d736-4cbc-9652-80f45b4cf493 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7025 time: 0.5102181 Nov 05 14:51:36.958666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:36.994042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72700149-d286-4f0c-89f6-a1f9d0561cab None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:37.049048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.049506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.049955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.050391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.050826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.051261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.051699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.052134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.052588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.054511 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-182541e6-c357-4787-9b61-0aba5932a052 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 5876 time: 0.0943823 Nov 05 14:51:37.057703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45538) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:37.074176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:37.074541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.165129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:37.211888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Provisioning complete for port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:37.211888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.240360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.259211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72700149-d286-4f0c-89f6-a1f9d0561cab None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:37.325807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.385239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ade6cd-ca19-4462-9b1c-567388731513 req-4a72e0de-9d5c-4595-b522-aedbc483868d tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.387406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88ade6cd-ca19-4462-9b1c-567388731513 req-4a72e0de-9d5c-4595-b522-aedbc483868d tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1119542 Nov 05 14:51:37.395465 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-63816f98-3561-4704-8257-f5e633cd2b0f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3574 time: 0.3340082 Nov 05 14:51:37.418575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:37.430080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:37.432037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=57b1080d-a514-4326-94de-716a271d1b62,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:37.434347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:37.447445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a5e7070d-a62e-4d91-8d2b-1a0aaab29007 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:37.455442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.510456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.511093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.516250 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88ade6cd-ca19-4462-9b1c-567388731513 req-7ca89fd3-d44c-4026-9e72-2f05a2abaee0 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187456 Nov 05 14:51:37.518576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.543780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-66090136-34f6-417a-b1b5-e074f507c1f3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.3514695 Nov 05 14:51:37.544139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45544) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:37.630319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.697691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45548) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:37.703305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1830235744', 'description': 'tempest-secgroup-smoke-1830235744 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:37.711397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b024960-4ca3-443c-9d02-12ad11ed5bee None None] Pushing event updated for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:37.732041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.750875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ed1ae4-71e5-4693-bd0b-9790f002fd07 req-c82ef2da-45ad-43bc-b148-794977d237c5 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:37.752626 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41ed1ae4-71e5-4693-bd0b-9790f002fd07 req-c82ef2da-45ad-43bc-b148-794977d237c5 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1284208 Nov 05 14:51:37.754334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] For port 18f82970-1aa0-49be-9c4d-5a3cbbe76043, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=18f82970-1aa0-49be-9c4d-5a3cbbe76043,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:37.767067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:37.767699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.776516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.806633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Attempting to bind port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:37.806999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Attempting to bind port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:37.807360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Attempting to bind port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c on network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:37.809784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.813839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.842666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:37.843081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Checking segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:37.843436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.844049 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Bound using segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:37.844722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Bound port: 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:37.845287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.851680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.852960 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1532581 Nov 05 14:51:37.853825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb26bc8d-3aea-4d59-81eb-7f4565dfc1b1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=274f8d39-73c1-4a35-baa9-3fea6350753d,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:37.857356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:37.861925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:37.893492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:37.915661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41ed1ae4-71e5-4693-bd0b-9790f002fd07 req-c2becacb-f3a7-4291-88da-e06283d63fdf tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1318626 Nov 05 14:51:37.946044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d583a9b-b1d8-4076-bbba-fd7d7e93e349 None None] Pushing event updated for resources: {'Port': ['ID=18f82970-1aa0-49be-9c4d-5a3cbbe76043,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:37.994733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.002545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.020768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.028128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c06727a5-7244-4313-8cf1-74d1bffd3706,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.043582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.046956 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a2621bbd-069c-47a8-bb2b-57a9c2258f28 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1886535 Nov 05 14:51:38.049888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45554) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:38.061987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:38.085072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] For port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:38.112126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 18f82970-1aa0-49be-9c4d-5a3cbbe76043 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:38.115640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] For port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:38.130964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.143138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.182766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-259ed6d8-93c4-49f3-9d2a-13ffb66e018e', 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': 'b269c6a4-dcb1-443b-a1e9-05d19287fad2'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:38.184259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.238296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.243504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.259779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:38.260434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:38.261381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80ffbdda-01d3-430d-ba82-d4d42ab700da,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.264137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b024960-4ca3-443c-9d02-12ad11ed5bee None None] Pushing event updated for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.289206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.292399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ef8a0aec-4244-46f9-882d-8bf7b684188c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2395861 Nov 05 14:51:38.293915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45558) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:38.300420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:38.340383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.417505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:38.417505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.425264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.427484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3ea8cf-c778-4422-9c8a-7fdd7687a1bb req-fbdfbe66-8aed-4a8f-99b5-44c70a33d7fa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:38.429496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8f3ea8cf-c778-4422-9c8a-7fdd7687a1bb req-fbdfbe66-8aed-4a8f-99b5-44c70a33d7fa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.0855036 Nov 05 14:51:38.439167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.467259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.471761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1733336 Nov 05 14:51:38.471761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45560) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:38.475917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:38.491731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4c8e5a-c9e6-44f4-9cdc-92d11fc35054 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b69a229d-603f-49f8-842c-b12298a3ddd3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.493720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.519490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.535310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.538041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:38.548219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Allocated IP 172.20.0.3 (259ed6d8-93c4-49f3-9d2a-13ffb66e018e/b269c6a4-dcb1-443b-a1e9-05d19287fad2/dd1474ca-b332-4382-a19c-f92bbd8c02cc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:38.592773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8f3ea8cf-c778-4422-9c8a-7fdd7687a1bb req-0c52aff7-6472-453f-84dd-66484b654521 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1445029 Nov 05 14:51:38.628944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.635343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.666922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.669103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=57b1080d-a514-4326-94de-716a271d1b62,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.671178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1989322 Nov 05 14:51:38.672047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45562) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:38.676605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:38.686542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ab8292-b242-4c2c-892f-51987b7fd8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65853b4a-28cf-4126-85d2-a42ac84dd0f2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.718657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:51:38.723999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.826518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.831829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.848828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f926a7a9-8c03-4fb6-a305-3bf15e5c7500,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:38.861020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.862246 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-39573b7d-fcce-4028-8c33-0a17f10a46d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1891084 Nov 05 14:51:38.865484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45564) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:38.867153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.871616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '274f8d39-73c1-4a35-baa9-3fea6350753d', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:38.898237 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:51:38.910479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.961389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.975168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:38.991124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.000786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.020152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0f1407e-6afa-43a8-9867-a7f3d0c57dcb,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:39.023328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.034359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.034983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:39.035881 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7d94c3e5-0aa9-4d3d-87fe-65d59de81f5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1689808 Nov 05 14:51:39.039945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:39.047651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Pushing event updated for resources: {'Port': ['ID=dd1474ca-b332-4382-a19c-f92bbd8c02cc,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:39.050166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:39.057884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:39.109581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33776336-596c-421c-b3e1-730ab760e1a2 None None] The sync data for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv is: [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:39.147802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:39.148168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.199445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Attempting to bind port dd1474ca-b332-4382-a19c-f92bbd8c02cc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:39.199803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Attempting to bind port dd1474ca-b332-4382-a19c-f92bbd8c02cc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b304e0ac-8bad-49b2-b4a4-44adb84e2549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:39.200613 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Attempting to bind port dd1474ca-b332-4382-a19c-f92bbd8c02cc on network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:39.216106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:39.216501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Checking segment: {'id': 'b304e0ac-8bad-49b2-b4a4-44adb84e2549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:39.216911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.217307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Bound using segment: {'id': 'b304e0ac-8bad-49b2-b4a4-44adb84e2549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:39.217775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Bound port: dd1474ca-b332-4382-a19c-f92bbd8c02cc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b304e0ac-8bad-49b2-b4a4-44adb84e2549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 633, 'network_id': '259ed6d8-93c4-49f3-9d2a-13ffb66e018e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:39.218159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.233400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 18f82970-1aa0-49be-9c4d-5a3cbbe76043 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:39.375742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-c1ae0f06-d750-43e4-897b-fe80a9fa492d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1830235744&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0642598 Nov 05 14:51:39.403287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.410880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.492145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-afb573d0-5bc3-4611-a718-7026e40e8684 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:39.494478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-afb573d0-5bc3-4611-a718-7026e40e8684 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 200 len: 797 time: 0.1169868 Nov 05 14:51:39.500520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=57b1080d-a514-4326-94de-716a271d1b62,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:39.508595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.524267 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-a022e52a-8c56-473c-b91f-ec589aa57716 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0145819 Nov 05 14:51:39.525444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.565459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] For port dd1474ca-b332-4382-a19c-f92bbd8c02cc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:39.588172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] For port dd1474ca-b332-4382-a19c-f92bbd8c02cc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dd1474ca-b332-4382-a19c-f92bbd8c02cc,segment=NetworkSegment(b304e0ac-8bad-49b2-b4a4-44adb84e2549),segment_id=b304e0ac-8bad-49b2-b4a4-44adb84e2549)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:39.599856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.603965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] For port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:39.608782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:39.609363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.636213 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-9253a804-a3d1-4b95-b344-ba0ff0bd1852 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1042144 Nov 05 14:51:39.637021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:39.638495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:39.653833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.711164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fe9325-3be0-4101-99c0-9c29bceb5dcb None None] Pushing event updated for resources: {'Port': ['ID=dd1474ca-b332-4382-a19c-f92bbd8c02cc,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:39.816329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Provisioning complete for port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:39.816743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:39.817359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-902c7e90-f2f3-4257-a4d1-f26237d1ebda service neutron] 10.222.0.30 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1537101 Nov 05 14:51:39.866845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293fdc2b-7a9f-4f77-90c0-a0591caf9027 req-e0b1ba0f-dcd7-470e-9a51-f0929f682063 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:39.868921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-293fdc2b-7a9f-4f77-90c0-a0591caf9027 req-e0b1ba0f-dcd7-470e-9a51-f0929f682063 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1808839 Nov 05 14:51:39.894829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e74c3a4-a410-46a3-b603-b8face090ecd None None] Pushing event updated for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:39.914370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Router 345e5833-5b7a-4228-8d79-de9f7fa4c71c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:51:39.963163 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-35d46d14-6451-49f3-85bd-90ac52baf961 service neutron] 10.222.0.30 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386621 Nov 05 14:51:40.089726 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-293fdc2b-7a9f-4f77-90c0-a0591caf9027 req-d6bf9840-44a7-4dae-8721-5f4449335a6c tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2090557 Nov 05 14:51:40.109005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:40.116804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d6d3dc9d-fc39-4da4-93ef-e6675e3d612c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/routers/345e5833-5b7a-4228-8d79-de9f7fa4c71c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5692837 Nov 05 14:51:40.118558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45580) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:40.123984 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] Sync routers for ids ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:40.140645 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] Routers {'345e5833-5b7a-4228-8d79-de9f7fa4c71c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:40.145171 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:40.214886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faf159ac-ea0a-4e33-a825-1feed6da2339 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:40.216465 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-faf159ac-ea0a-4e33-a825-1feed6da2339 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?device_id=345e5833-5b7a-4228-8d79-de9f7fa4c71c HTTP/1.1" status: 200 len: 981 time: 0.0874290 Nov 05 14:51:40.219521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45588) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:40.236578 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:40.250407 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] Routers {'345e5833-5b7a-4228-8d79-de9f7fa4c71c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:40.251510 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:40.298818 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:40.299998 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc7fe7cc-75ec-49f0-b95a-d78724701a63 None None] The sync data for ids ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:40.339320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f4869364-d3e5-40fb-8e35-33d0e9f39afa req-d3c6554c-a0c7-4063-b4fd-7ae8e168d27b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 210 time: 0.0641665 Nov 05 14:51:40.465393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-72e7de57-a99f-4228-bab2-06f407af924c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:40.467273 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-72e7de57-a99f-4228-bab2-06f407af924c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=de6b84a04f00477c855a9f7319208b60&device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 1098 time: 0.0627928 Nov 05 14:51:40.550182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f9ecf1-0b39-4e84-8447-c4c5156ad580 req-a001ad17-8b74-4caa-b7c9-d23266e29107 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:40.551685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f2f9ecf1-0b39-4e84-8447-c4c5156ad580 req-a001ad17-8b74-4caa-b7c9-d23266e29107 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1176012 Nov 05 14:51:40.597129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-ed82a089-766a-405c-bc37-c539a8ee8b86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:40.598679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-ed82a089-766a-405c-bc37-c539a8ee8b86 service neutron] 10.222.0.32 "GET /v2.0/networks?id=118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 200 len: 912 time: 0.1235502 Nov 05 14:51:40.660609 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-0990c711-5a95-4c62-9c7b-66813ca1fc76 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 200 len: 217 time: 0.0542340 Nov 05 14:51:40.687033 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f2f9ecf1-0b39-4e84-8447-c4c5156ad580 req-d138841c-e9a4-4a14-b862-4feb62814336 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1018021 Nov 05 14:51:40.737436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-e4021422-8bc5-4776-9502-bd7e9f9c7005 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:40.739007 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-e4021422-8bc5-4776-9502-bd7e9f9c7005 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=2adc5528-6869-48c4-a553-e6664c363034 HTTP/1.1" status: 200 len: 851 time: 0.0716746 Nov 05 14:51:40.779360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-37fe71a2-129a-4f61-b632-ad0a088ee178 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=118716b0-934b-459d-b87c-bcebda6b65cb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0334580 Nov 05 14:51:40.855944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:40.899262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-018f1732-7d32-453c-a019-625cdb61be9c service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1119752 Nov 05 14:51:41.092102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f21078b-a570-4fe3-9f4f-9b0597d34a90 None None] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:41.149834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 57b1080d-a514-4326-94de-716a271d1b62 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:41.150341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.252251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Provisioning complete for port 57b1080d-a514-4326-94de-716a271d1b62 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.252831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.284656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4f21078b-a570-4fe3-9f4f-9b0597d34a90 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:41.290608 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:41.316908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ada98ec-0eb4-43b4-ad10-bdf231cdbea8 None None] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:41.335895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Port 57b1080d-a514-4326-94de-716a271d1b62 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:41.344324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.387103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 57b1080d-a514-4326-94de-716a271d1b62 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:41.421838 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b80b763f-82b4-4b37-8430-696df7a5dcf8 req-1cb2c36c-255c-47e1-b5a5-8f0513b11c65 service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5151329 Nov 05 14:51:41.447513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.448057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.510847 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5115f90-c1e6-454f-bdaa-d247fb17951e req-adfaf249-7715-4085-babb-fe3cb6a31bc5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 210 time: 0.0345612 Nov 05 14:51:41.543889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.544547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4ada98ec-0eb4-43b4-ad10-bdf231cdbea8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:41.553584 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:41.618673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-4b9f096d-596b-4d7f-adb3-e617832be529 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:41.620406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-4b9f096d-596b-4d7f-adb3-e617832be529 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 200 len: 797 time: 0.1546075 Nov 05 14:51:41.697364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dd1474ca-b332-4382-a19c-f92bbd8c02cc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:41.739701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Provisioning complete for port dd1474ca-b332-4382-a19c-f92bbd8c02cc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.740313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.831638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port dd1474ca-b332-4382-a19c-f92bbd8c02cc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.832010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.867550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.910765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] For port dd1474ca-b332-4382-a19c-f92bbd8c02cc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dd1474ca-b332-4382-a19c-f92bbd8c02cc,segment=NetworkSegment(b304e0ac-8bad-49b2-b4a4-44adb84e2549),segment_id=b304e0ac-8bad-49b2-b4a4-44adb84e2549)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:41.923652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:41.992375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Provisioning complete for port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:41.992783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.040625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17410b27-a564-42c0-8ac2-cd07cf3e04dc None None] Pushing event updated for resources: {'Port': ['ID=dd1474ca-b332-4382-a19c-f92bbd8c02cc,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:42.178392 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-d29b8358-2419-47f1-ac7c-ce59d798e557 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 380 time: 0.5385063 Nov 05 14:51:42.200929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['274f8d39-73c1-4a35-baa9-3fea6350753d']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:42.246530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beae43c2-b004-4ab3-bff4-0f7daa2865b4 req-0ff193cd-3392-43cf-91fd-b080edac32ea tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:42.256560 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-beae43c2-b004-4ab3-bff4-0f7daa2865b4 req-0ff193cd-3392-43cf-91fd-b080edac32ea tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1797104 Nov 05 14:51:42.264355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-aba5b00f-d5b6-446f-893d-e8698a89d93e None None] Provisioning complete for port 57b1080d-a514-4326-94de-716a271d1b62 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:42.264944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aba5b00f-d5b6-446f-893d-e8698a89d93e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.314037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-aba5b00f-d5b6-446f-893d-e8698a89d93e None None] Port 57b1080d-a514-4326-94de-716a271d1b62 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:42.324697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-aba5b00f-d5b6-446f-893d-e8698a89d93e None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:42.325213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aba5b00f-d5b6-446f-893d-e8698a89d93e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.366235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.390494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-beae43c2-b004-4ab3-bff4-0f7daa2865b4 req-2a34aa34-50ef-46b2-b467-90d0a25289f8 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1328273 Nov 05 14:51:42.430306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=57b1080d-a514-4326-94de-716a271d1b62,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:42.515043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:42.518453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.530322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f3e35fa8-a6d6-49ce-9e81-ed1d96613fab None None] Could not find standard attr ID for object 57b1080d-a514-4326-94de-716a271d1b62. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:42.542000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f3e35fa8-a6d6-49ce-9e81-ed1d96613fab None None] Provisioning complete for port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:42.542000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f3e35fa8-a6d6-49ce-9e81-ed1d96613fab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.611154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:42.620899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-048d97e5-244b-4afb-97a0-f69560a4543a req-2a20c9e4-7668-4fdb-bc0c-b02983c3ad1b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 210 time: 0.0320880 Nov 05 14:51:42.837158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.3 (64ec4940-bfdd-445b-8f53-bbe9cebb2ca0/68c6fc61-cadd-441b-83cf-35abc1a4569e/6187c4a7-83b5-4932-8807-464950065f8f) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:42.852771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Router 345e5833-5b7a-4228-8d79-de9f7fa4c71c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:42.993201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:42.998145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd2c5cce-5b3d-4021-b6bd-6fdf25ecf1ec None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:42.999950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-92265d7e-f67d-4ca8-a3a3-b60b8a6f32e8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/routers/345e5833-5b7a-4228-8d79-de9f7fa4c71c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7793093 Nov 05 14:51:43.002710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45608) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:43.022624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] Sync routers for ids ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:43.032594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-13797691-3455-4cd3-b7a1-50547b6408fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:43.034245 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-13797691-3455-4cd3-b7a1-50547b6408fd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/57b1080d-a514-4326-94de-716a271d1b62 HTTP/1.1" status: 404 len: 333 time: 0.0304880 Nov 05 14:51:43.037141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45610) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:43.043951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] Routers {'345e5833-5b7a-4228-8d79-de9f7fa4c71c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:43.044595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:43.082701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:43.117181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] Routers {'345e5833-5b7a-4228-8d79-de9f7fa4c71c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:43.117687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:43.135755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.163593 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dd1474ca-b332-4382-a19c-f92bbd8c02cc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:43.168358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:43.168997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2309606-5aae-4850-a96a-224bd7243da4 None None] The sync data for ids ['345e5833-5b7a-4228-8d79-de9f7fa4c71c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:43.180648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.203153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd2c5cce-5b3d-4021-b6bd-6fdf25ecf1ec None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:43.274013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port dd1474ca-b332-4382-a19c-f92bbd8c02cc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:43.274709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.313215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.316341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.359796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.371258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.371743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Fanout notify agent at l3_agent the message router_deleted on router 345e5833-5b7a-4228-8d79-de9f7fa4c71c {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:51:43.400496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.401598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ddd69ab9-5b39-4841-98ca-04b0f2486ee3 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/routers/345e5833-5b7a-4228-8d79-de9f7fa4c71c HTTP/1.1" status: 204 len: 168 time: 0.3637350 Nov 05 14:51:43.405057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45612) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:43.416384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:43.421904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:43.425845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:43.432582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:43.468348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet b269c6a4-dcb1-443b-a1e9-05d19287fad2 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:43.472196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.490103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:43.490741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.509344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-23bd7b60-3a6a-4982-9dce-c0345d299d42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3185642 Nov 05 14:51:43.523998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Request body: {'port': {'device_id': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:43.528004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.618233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.622041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.635145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f049f351-a2bc-463d-8d06-c3e532a0c83c req-375cc3c2-e00a-4df5-bbb3-bde5c40655a4 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:43.636809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f049f351-a2bc-463d-8d06-c3e532a0c83c req-375cc3c2-e00a-4df5-bbb3-bde5c40655a4 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1075683 Nov 05 14:51:43.690683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.727025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=b269c6a4-dcb1-443b-a1e9-05d19287fad2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:43.740104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.743817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bd6eed8f-5268-4778-b4b6-613dae710ba6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/b269c6a4-dcb1-443b-a1e9-05d19287fad2 HTTP/1.1" status: 204 len: 168 time: 0.3377049 Nov 05 14:51:43.758573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45618) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:43.794489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f049f351-a2bc-463d-8d06-c3e532a0c83c req-4dc1c33a-d418-4e32-a6b0-ed5405a82c9a tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1497729 Nov 05 14:51:43.846312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e558f517-9c06-4fc8-be65-855da150360a req-c1fa8c7c-877b-4d96-85e9-ed88d65a0d7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:43.847877 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e558f517-9c06-4fc8-be65-855da150360a req-c1fa8c7c-877b-4d96-85e9-ed88d65a0d7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 931 time: 0.1235774 Nov 05 14:51:43.853678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:43.932950 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e558f517-9c06-4fc8-be65-855da150360a req-b331493a-cb59-49f5-bf82-03e9ab6aad56 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0762949 Nov 05 14:51:43.970713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port dd1474ca-b332-4382-a19c-f92bbd8c02cc {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:43.971327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.044861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] For port dd1474ca-b332-4382-a19c-f92bbd8c02cc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=dd1474ca-b332-4382-a19c-f92bbd8c02cc,segment=NetworkSegment(b304e0ac-8bad-49b2-b4a4-44adb84e2549),segment_id=b304e0ac-8bad-49b2-b4a4-44adb84e2549)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:44.045096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.058362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6187c4a7-83b5-4932-8807-464950065f8f {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:51:44.066422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.072273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for dd1474ca-b332-4382-a19c-f92bbd8c02cc owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:44.084570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Transition to ACTIVE for port object 6187c4a7-83b5-4932-8807-464950065f8f will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:51:44.088992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.147368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Pushing event updated for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:44.158132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094aff33-d89e-4317-b19a-02624ee9f1e3 req-137b865f-40e1-4ff8-ace4-53d443390bf7 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.159707 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-094aff33-d89e-4317-b19a-02624ee9f1e3 req-137b865f-40e1-4ff8-ace4-53d443390bf7 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1011963 Nov 05 14:51:44.205984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4963414-befd-463a-86ce-addce8794e89 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:44.225105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.229645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Attempting to bind port 6187c4a7-83b5-4932-8807-464950065f8f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:44.230522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Attempting to bind port 6187c4a7-83b5-4932-8807-464950065f8f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:44.230876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Attempting to bind port 6187c4a7-83b5-4932-8807-464950065f8f on network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:44.235993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Port 6187c4a7-83b5-4932-8807-464950065f8f on network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:51:44.236808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Attempting to bind port 6187c4a7-83b5-4932-8807-464950065f8f on network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:44.239695 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-094aff33-d89e-4317-b19a-02624ee9f1e3 req-0187a245-1ba3-45cb-92ea-d51ce523b8ff tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695376 Nov 05 14:51:44.244111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:44.244858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Checking segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:44.245027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Bound using segment: {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:44.246026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Bound port: 6187c4a7-83b5-4932-8807-464950065f8f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '31d54faf-467f-4166-88f4-413d4f86ed30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:44.246389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.268977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4535de34-2a2f-4ddc-b48b-7108f83026b8 None None] Could not find standard attr ID for object dd1474ca-b332-4382-a19c-f92bbd8c02cc. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:44.269489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=dd1474ca-b332-4382-a19c-f92bbd8c02cc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:44.275958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No DVR routers for this DVR port dd1474ca-b332-4382-a19c-f92bbd8c02cc on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:44.302852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4963414-befd-463a-86ce-addce8794e89 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:44.337598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:44.341521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6187c4a7-83b5-4932-8807-464950065f8f,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:44.347736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.358844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.381977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.382604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.382967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['259ed6d8-93c4-49f3-9d2a-13ffb66e018e']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:44.384031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] 10.222.0.32 "PUT /v2.0/ports/6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 200 len: 1093 time: 0.8659678 Nov 05 14:51:44.384494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:44.387713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7a89b53-c363-496b-911f-9126cee312be" -d '{"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:44.393690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b304e0ac-8bad-49b2-b4a4-44adb84e2549') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:44.394127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b304e0ac-8bad-49b2-b4a4-44adb84e2549') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:44.406946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.418496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0083ef27-317d-4153-b593-e8d83f0ce749 service neutron] Pushing event updated for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:44.424155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.433702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 633 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:44.434195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:44.438052 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:44.528870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.531081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3614404-21fc-42f1-b423-ed5c3b334080 x-openstack-request-id: req-e3614404-21fc-42f1-b423-ed5c3b334080 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:44.531299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:44.531637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e3614404-21fc-42f1-b423-ed5c3b334080 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:44.531956 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f', 'status': 'completed', 'code': 200} Nov 05 14:51:44.537409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.545003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/259ed6d8-93c4-49f3-9d2a-13ffb66e018e HTTP/1.1" status: 204 len: 168 time: 0.7811818 Nov 05 14:51:44.547538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45628) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:44.560596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b062b4a-db45-41e3-8419-60af08883555 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=259ed6d8-93c4-49f3-9d2a-13ffb66e018e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:44.569565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-f790de74-9729-4f45-b972-87132747ba7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.571092 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-f790de74-9729-4f45-b972-87132747ba7d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1096 time: 0.1393602 Nov 05 14:51:44.653871 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-da642d08-e319-4889-aa70-ef62cc69fade service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 200 len: 217 time: 0.0616901 Nov 05 14:51:44.660834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1929d8f-e5aa-4b92-b435-345d6b794e66 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.662112 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a1929d8f-e5aa-4b92-b435-345d6b794e66 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/88fbe395-fa9d-43e6-bbfe-e1e7831bad59 HTTP/1.1" status: 200 len: 841 time: 0.1127014 Nov 05 14:51:44.666084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45630) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:44.722194 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ca99da43-beb8-441d-bcf6-04f2d9b4b3d5 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/88fbe395-fa9d-43e6-bbfe-e1e7831bad59?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0509999 Nov 05 14:51:44.722428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-3bd2f50e-a7eb-4465-b443-2c173db5ca94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.722428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-3bd2f50e-a7eb-4465-b443-2c173db5ca94 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=68c6fc61-cadd-441b-83cf-35abc1a4569e HTTP/1.1" status: 200 len: 835 time: 0.0575235 Nov 05 14:51:44.722660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45632) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:44.727402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:44.777904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c06fd5dc-0817-40db-a1a3-379ec3e3109f None None] Network 259ed6d8-93c4-49f3-9d2a-13ffb66e018e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c06fd5dc-0817-40db-a1a3-379ec3e3109f None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 14:51:44.795832 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:44.799386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d2e0c945-c53a-4055-a063-496d235b5f0b None None] Could not find standard attr ID for object dd1474ca-b332-4382-a19c-f92bbd8c02cc. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:44.809990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-1071268c-4da2-4c66-a039-56c3c4087f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:44.812129 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-1071268c-4da2-4c66-a039-56c3c4087f56 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0845149 Nov 05 14:51:44.835411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:44.840845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:44.889878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-609323b6-f536-460a-80c4-950798fe4073 None None] DHCP port deletion for 259ed6d8-93c4-49f3-9d2a-13ffb66e018e request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:44.936264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-5ec617b2-e152-4b64-b059-68b5c59c8244 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1161511 Nov 05 14:51:45.053921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5df55dd6-3a34-4f77-a96e-724a87d3c936 req-4c977976-f434-493e-9283-4a2a90a6c112 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1100221 Nov 05 14:51:45.110319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.170154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827bbc68-f3d6-4858-8680-05b069dbbd69 req-30c940d7-9339-4ffa-a0a7-c5d1188703fc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.178315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-827bbc68-f3d6-4858-8680-05b069dbbd69 req-30c940d7-9339-4ffa-a0a7-c5d1188703fc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 943 time: 0.1247036 Nov 05 14:51:45.189293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a89b53-c363-496b-911f-9126cee312be req-0eaa71be-4d42-4ff4-9b72-6525468fc495 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.189575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dd1474ca-b332-4382-a19c-f92bbd8c02cc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:45.191389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-0eaa71be-4d42-4ff4-9b72-6525468fc495 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1096 time: 0.0786653 Nov 05 14:51:45.192265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:45.209603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:45.215258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: dd1474ca-b332-4382-a19c-f92bbd8c02cc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:45.215707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device dd1474ca-b332-4382-a19c-f92bbd8c02cc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:45.216862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.217564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.221423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:45.239645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a11daf2-a3e9-4ca3-bfe6-0a8c2d029a78 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:45.258507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-506dd166-7e35-4441-8274-defab79108c6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5350478 Nov 05 14:51:45.274813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45636) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:45.277091 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-827bbc68-f3d6-4858-8680-05b069dbbd69 req-12003068-3bf2-4bd1-ad15-a44959813bc2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970521 Nov 05 14:51:45.286325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'security_group': {'name': 'tempest-secgroup-404360621'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1a11daf2-a3e9-4ca3-bfe6-0a8c2d029a78 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:45.345905 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:45.493278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88594005-fc1f-4624-acfe-bcb4c2ad3ce0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:45.598509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88594005-fc1f-4624-acfe-bcb4c2ad3ce0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:45.671562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.762270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b806d1-dad2-401f-8b42-fb709952e66c req-294a5f23-e74e-4876-add7-034603af1f44 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.763794 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f6b806d1-dad2-401f-8b42-fb709952e66c req-294a5f23-e74e-4876-add7-034603af1f44 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.4342158 Nov 05 14:51:45.764802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a89b53-c363-496b-911f-9126cee312be req-f4a8dccf-63f0-4e8b-84f5-8b22d7e786a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.766101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-f4a8dccf-63f0-4e8b-84f5-8b22d7e786a5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 200 len: 898 time: 0.5677564 Nov 05 14:51:45.833456 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-b6074b9d-2384-4816-940e-5322592c8596 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 200 len: 217 time: 0.0521700 Nov 05 14:51:45.842604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'tenant_id': 'a503af5aa1e240d1b3c3ad6d39477549', 'fixed_ips': [{'subnet_id': 'f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:51:45.843473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.906122 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f6b806d1-dad2-401f-8b42-fb709952e66c req-b9058e21-fa58-49b5-a06b-199b4c1a7f0e tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1339169 Nov 05 14:51:45.916275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.922819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.947674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a89b53-c363-496b-911f-9126cee312be req-2863a881-43ce-402b-83b4-a4df94ea18fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:45.949741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-2863a881-43ce-402b-83b4-a4df94ea18fd service neutron] 10.222.0.32 "GET /v2.0/subnets?id=68c6fc61-cadd-441b-83cf-35abc1a4569e HTTP/1.1" status: 200 len: 835 time: 0.1071291 Nov 05 14:51:45.971890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:45.973074 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.6973686 Nov 05 14:51:45.977095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45642) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:45.995741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Allocated IP 172.20.0.2 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26/5e649bf2-381c-4631-8673-a8429d33e537) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:45.995997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'security_group': {'name': 'tempest-secgroup-680875636'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:46.003992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766df4a1-7809-4d15-a557-f0bb59f43103 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8fb6909-48f6-4b3a-9b59-b60b5bd7280b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:46.027592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.038342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a89b53-c363-496b-911f-9126cee312be req-bbdcf058-788e-4c45-8c13-da0f36efc7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.039865 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-bbdcf058-788e-4c45-8c13-da0f36efc7d3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0819519 Nov 05 14:51:46.161875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-e6b728f4-0be4-4ece-81ac-ad8a28458e22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.164162 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-e6b728f4-0be4-4ece-81ac-ad8a28458e22 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=de6b84a04f00477c855a9f7319208b60&device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 1098 time: 0.0474966 Nov 05 14:51:46.189650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.196708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.206590 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-0b9cc540-1fc6-4442-8661-d94c3dfb38ea service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1583352 Nov 05 14:51:46.213220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.221931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c208519-f3e3-427a-a1ad-49e8f48c999c req-3d18e724-bee8-466e-b673-f74f6641667e tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.223667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c208519-f3e3-427a-a1ad-49e8f48c999c req-3d18e724-bee8-466e-b673-f74f6641667e tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1270466 Nov 05 14:51:46.234912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.243841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:46.251455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:46.253867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:46.262008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:46.278010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-aff1b42c-bde3-4a0a-a84a-770ca0126332 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.280428 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-aff1b42c-bde3-4a0a-a84a-770ca0126332 service neutron] 10.222.0.32 "GET /v2.0/networks?id=118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 200 len: 912 time: 0.1079018 Nov 05 14:51:46.328214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.329490 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3514526 Nov 05 14:51:46.333991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45648) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:46.340765 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-cd357f28-420f-48cd-9c33-6dd7a0b4dedb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 200 len: 217 time: 0.0530801 Nov 05 14:51:46.341641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Attempting to bind port 5e649bf2-381c-4631-8673-a8429d33e537 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:51:46.342016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Attempting to bind port 5e649bf2-381c-4631-8673-a8429d33e537 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '45ed7a9f-3390-4f59-81f4-13bc1b71301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:51:46.342514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Attempting to bind port 5e649bf2-381c-4631-8673-a8429d33e537 on network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:51:46.344422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-692538454', 'security_groups': ['46378cd7-4f3b-4f0f-88ca-f237fd3050bf'], 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:46.347792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:51:46.348798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Checking segment: {'id': '45ed7a9f-3390-4f59-81f4-13bc1b71301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:51:46.349217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.349614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Bound using segment: {'id': '45ed7a9f-3390-4f59-81f4-13bc1b71301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:51:46.350344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Bound port: 5e649bf2-381c-4631-8673-a8429d33e537, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45ed7a9f-3390-4f59-81f4-13bc1b71301c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:51:46.350496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.351653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5232da71-bdfc-4e02-b067-fa4146c7e943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=46378cd7-4f3b-4f0f-88ca-f237fd3050bf,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:46.430552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:51:46.433760 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c208519-f3e3-427a-a1ad-49e8f48c999c req-70fa3815-c336-48ea-a69f-3aab359e24e7 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1782510 Nov 05 14:51:46.437570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:51:46.438646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f22cb6c-c9a7-41a1-a8a6-8f69a8678e2c req-d75027ed-d3e6-42dc-bf4f-4edd4b19fdc8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.440386 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7f22cb6c-c9a7-41a1-a8a6-8f69a8678e2c req-d75027ed-d3e6-42dc-bf4f-4edd4b19fdc8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 943 time: 0.0942783 Nov 05 14:51:46.444926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-fcedf9be-5ce4-48e6-a243-83f3a1cfdf14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:46.445463 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a7a89b53-c363-496b-911f-9126cee312be req-b44d50e1-0e5d-4eeb-8fd6-9789dfa0f849 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2204318 Nov 05 14:51:46.446605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-fcedf9be-5ce4-48e6-a243-83f3a1cfdf14 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=2adc5528-6869-48c4-a553-e6664c363034 HTTP/1.1" status: 200 len: 851 time: 0.0693722 Nov 05 14:51:46.450206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.503145 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-e4be0688-d8aa-45ed-8821-602f8cb0cd65 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=118716b0-934b-459d-b87c-bcebda6b65cb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435312 Nov 05 14:51:46.523747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff3a8bf-e504-4d79-bb33-8d5424c9085a None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:46.533036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:46.600129 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7f22cb6c-c9a7-41a1-a8a6-8f69a8678e2c req-61cdccf7-cd12-44cc-ac5a-2a4c009a90e2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1465652 Nov 05 14:51:46.637050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:46.642204 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-403de155-1228-4946-ac85-6a844b6cadb8 service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306016 Nov 05 14:51:46.656387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port 1d97b312-2168-4292-9c17-b0420c1e039e yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:46.759234 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3ac3b8-a609-4d43-a1a0-1a6c6b3e96ee req-e13d5d7a-d341-4195-ab05-39c572611e2d service neutron] 10.222.0.32 "GET /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1100821 Nov 05 14:51:46.846713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.5 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26/1d97b312-2168-4292-9c17-b0420c1e039e) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:46.981327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.013568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.060106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:47.065080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:47.069105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:47.075396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=1d97b312-2168-4292-9c17-b0420c1e039e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:47.122222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:47.122863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.144668 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-caff40f9-1b51-49b3-a774-5dcf0389dacf tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 0.8041141 Nov 05 14:51:47.144875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45650) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:47.150148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:47.203814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:47.261940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:47.262268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.270671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:47.280587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.350508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.382637 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26 (CIDR: 172.20.0.0/28) Nov 05 14:51:47.386187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:47.388099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:51:47.388993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:47.391437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.412182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4f2b300e-68db-4f21-8a8c-7ffea4cb1a70 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.2660675 Nov 05 14:51:47.415503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45652) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:47.421671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:47.460293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:47.563328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:47.567304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.570547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c14123-5d51-4252-8ac7-25663d66ecb0 req-706d197b-54f7-4837-9d07-cb63fbace93b tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:47.572440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dbbb90d-4e26-4235-9834-85c67836a8cb None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:47.572667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a8c14123-5d51-4252-8ac7-25663d66ecb0 req-706d197b-54f7-4837-9d07-cb63fbace93b tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.0554731 Nov 05 14:51:47.640374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a8c14123-5d51-4252-8ac7-25663d66ecb0 req-32735265-ceec-475c-a138-e41a0d6e3cb1 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502727 Nov 05 14:51:47.665450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-82f8cd23-7c14-43c2-84aa-5d93d87c29d8 None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:47.665896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82f8cd23-7c14-43c2-84aa-5d93d87c29d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.720829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dbbb90d-4e26-4235-9834-85c67836a8cb None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:47.722712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-82f8cd23-7c14-43c2-84aa-5d93d87c29d8 None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:47.755921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-82f8cd23-7c14-43c2-84aa-5d93d87c29d8 None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:47.756394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82f8cd23-7c14-43c2-84aa-5d93d87c29d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.790290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585a6b0f-662b-41a7-8983-6087539e3114 req-3420093f-4746-48f7-8602-3fe2bc720718 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:47.792609 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-585a6b0f-662b-41a7-8983-6087539e3114 req-3420093f-4746-48f7-8602-3fe2bc720718 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 943 time: 0.0936837 Nov 05 14:51:47.889034 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-585a6b0f-662b-41a7-8983-6087539e3114 req-e0911f75-788c-491e-bfb2-7abaef98a905 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0856318 Nov 05 14:51:47.908974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4feab7da-3e67-4ed6-87d9-33226f081c8c req-8cc560b7-0f81-4e69-9c75-8b010fa51901 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:47.910535 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4feab7da-3e67-4ed6-87d9-33226f081c8c req-8cc560b7-0f81-4e69-9c75-8b010fa51901 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.0611529 Nov 05 14:51:47.924151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.964309 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4feab7da-3e67-4ed6-87d9-33226f081c8c req-6bc4a438-32c7-4a15-8c0f-622c6ed195fb tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469968 Nov 05 14:51:47.969214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:47.972551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:47.979350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:47.979960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:47.994714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=05d80909-5680-4c49-88a4-46f54715fac1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:48.001929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a9c73ea9-5270-411a-8ca4-bddba1317f2c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.5851531 Nov 05 14:51:48.005291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45662) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:48.010728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-506022107', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '05d80909-5680-4c49-88a4-46f54715fac1'}], 'security_groups': ['e8fb6909-48f6-4b3a-9b59-b60b5bd7280b']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:48.077575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.114642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Update dhcp port {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'fixed_ips': [{'subnet_id': 'f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26', 'ip_address': '172.20.0.2'}, {'subnet_id': '05d80909-5680-4c49-88a4-46f54715fac1'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '5e649bf2-381c-4631-8673-a8429d33e537'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:51:48.139982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.184570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.272494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6187c4a7-83b5-4932-8807-464950065f8f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:51:48.369558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Allocated IP 172.20.0.18 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/05d80909-5680-4c49-88a4-46f54715fac1/5e649bf2-381c-4631-8673-a8429d33e537) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:48.464724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6187c4a7-83b5-4932-8807-464950065f8f,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:48.483718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '6187c4a7-83b5-4932-8807-464950065f8f', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'port_id': '6187c4a7-83b5-4932-8807-464950065f8f', 'mac_address': 'fa:16:3e:9f:e0:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:51:48.530647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:48.551723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.577207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6187c4a7-83b5-4932-8807-464950065f8f {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:51:48.582757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.591463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.626104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6187c4a7-83b5-4932-8807-464950065f8f,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:48.635449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.695913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Delete allocated IP 172.20.0.5 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26) {{(pid=113580) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:51:48.697703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ec2644-5cc8-4ae3-bbfb-d6bfcb8d123b None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:48.708683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.23 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/05d80909-5680-4c49-88a4-46f54715fac1/1d97b312-2168-4292-9c17-b0420c1e039e) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:48.754521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:48.870050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.874639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:48.907275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['6187c4a7-83b5-4932-8807-464950065f8f'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:51:48.972154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=1d97b312-2168-4292-9c17-b0420c1e039e,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:48.999840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] In _notify_port_updated(), no bound segment for port 1d97b312-2168-4292-9c17-b0420c1e039e on network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:51:49.006127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:49.006863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.011462 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-46c48e61-b2ae-4fdd-b180-bf0b3a643f9a tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/ports/1d97b312-2168-4292-9c17-b0420c1e039e HTTP/1.1" status: 200 len: 920 time: 1.0019405 Nov 05 14:51:49.011902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45668) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:49.093079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ccc5942-32e2-4ac1-88fb-2a7c1cdefd57 req-2ae4ad03-25dd-444b-92bf-997dfce706c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:49.094594 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9ccc5942-32e2-4ac1-88fb-2a7c1cdefd57 req-2ae4ad03-25dd-444b-92bf-997dfce706c3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 944 time: 0.1315746 Nov 05 14:51:49.162939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 1d97b312-2168-4292-9c17-b0420c1e039e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:49.163172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.180888 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9ccc5942-32e2-4ac1-88fb-2a7c1cdefd57 req-15886ce9-ed29-4c6e-93c0-d2ba9f0a8332 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0796330 Nov 05 14:51:49.207406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:49.217878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3985e8-0fb5-4f32-8803-f0cacecc1a6c req-cbdb75de-ff07-4b29-9b5b-148fa89d34c9 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:49.219443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d3985e8-0fb5-4f32-8803-f0cacecc1a6c req-cbdb75de-ff07-4b29-9b5b-148fa89d34c9 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.1344402 Nov 05 14:51:49.289528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:49.289906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.302266 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d3985e8-0fb5-4f32-8803-f0cacecc1a6c req-1f86010a-4236-41b0-b022-9e05b4fcfbda tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/security-groups?id=5a45e52b-7884-4895-87b4-88437d02e4e5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753937 Nov 05 14:51:49.305851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.329351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 1d97b312-2168-4292-9c17-b0420c1e039e owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:49.393237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:49.393799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.433516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:49.444822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Provisioning complete for port 1d97b312-2168-4292-9c17-b0420c1e039e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:49.445196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.476746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.484651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Port 1d97b312-2168-4292-9c17-b0420c1e039e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:49.496279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:49.497159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d216fa85-3714-40d1-890f-cab2f0d11f45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.513245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=1d97b312-2168-4292-9c17-b0420c1e039e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:49.553189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fa1b016-85d1-4f57-b0bc-4a16570e1201 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:49.586113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.589309 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0f2fd8be-6d93-4d54-a93c-844c69b27792 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/1d97b312-2168-4292-9c17-b0420c1e039e HTTP/1.1" status: 204 len: 168 time: 0.5766439 Nov 05 14:51:49.591883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45670) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:49.615283 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-0124775c-5fa4-4415-b2e2-aeb3e85ac943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:49.616770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0124775c-5fa4-4415-b2e2-aeb3e85ac943 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/1d97b312-2168-4292-9c17-b0420c1e039e HTTP/1.1" status: 404 len: 333 time: 0.0239608 Nov 05 14:51:49.621433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45672) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7fa1b016-85d1-4f57-b0bc-4a16570e1201 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:49.662460 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:49.675994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.707786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.769722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-4db03616-97dd-44f6-9872-1d89a58bfd01 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:49.771151 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-4db03616-97dd-44f6-9872-1d89a58bfd01 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.32 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 945 time: 0.0792627 Nov 05 14:51:49.779032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.781565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.782616 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/security-groups/46378cd7-4f3b-4f0f-88ca-f237fd3050bf HTTP/1.1" status: 204 len: 168 time: 0.1599922 Nov 05 14:51:49.783687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e85f37fa-51f3-43c0-acb1-832280514015 None None] Could not find standard attr ID for object 1d97b312-2168-4292-9c17-b0420c1e039e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:49.785385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45674) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:49.815778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c475bc-372b-4b8c-8f51-45b4ec15b4b6 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=46378cd7-4f3b-4f0f-88ca-f237fd3050bf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:49.848268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.870143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.877854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Deleting port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:49.878193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.910047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.912876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.913964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/security-groups/e8fb6909-48f6-4b3a-9b59-b60b5bd7280b HTTP/1.1" status: 204 len: 168 time: 0.1275480 Nov 05 14:51:49.917199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45676) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:49.931280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce902620-9eab-4cc5-a989-bc9272882b74 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8fb6909-48f6-4b3a-9b59-b60b5bd7280b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:49.971253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] For port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,segment=NetworkSegment(a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1),segment_id=a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:49.971615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.974419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:49.977585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:49.985016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Calling delete_port for e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:50.031196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.051626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0fd8643f-1d80-461e-98f4-b46392b39628 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.133449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.147415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.160437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:51:50.182939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Pushing event deleted for resources: {'Port': ['ID=e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:50.260623 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] No DVR routers for this DVR port e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:50.264036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.267742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-805c1956-c271-4cf0-b30b-5049a3982a5d req-1536cf26-2339-4918-bdb8-f3358fc245aa tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.32 "DELETE /v2.0/ports/e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 HTTP/1.1" status: 204 len: 173 time: 0.4897587 Nov 05 14:51:50.269487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'name': 'network-vif-deleted', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:50.274851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b82cb9ad-09ed-42d2-8980-ccb2c8b7706f" -d '{"events": [{"server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "name": "network-vif-deleted", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:50.282041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.288519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6187c4a7-83b5-4932-8807-464950065f8f up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:50.331430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.334925 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26 HTTP/1.1" status: 204 len: 168 time: 0.4156535 Nov 05 14:51:50.336019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308cd5e0-2b95-4417-8010-d16f08883721 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:50.339449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45684) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:50.344522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:50.440350 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bfa9c3c5-9a8b-460f-aa73-1d4a1b4f13f0 x-openstack-request-id: req-bfa9c3c5-9a8b-460f-aa73-1d4a1b4f13f0 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:50.442120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc1dd580-89a7-4364-9390-1d38ae6256e3", "name": "network-vif-deleted", "tag": "e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:50.442259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bfa9c3c5-9a8b-460f-aa73-1d4a1b4f13f0 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:50.443992 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc1dd580-89a7-4364-9390-1d38ae6256e3', 'name': 'network-vif-deleted', 'tag': 'e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645', 'status': 'completed', 'code': 200} Nov 05 14:51:50.471756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c0b896d3-ca73-46fd-869f-81ae45c21718 None None] Could not find standard attr ID for object 1d97b312-2168-4292-9c17-b0420c1e039e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:50.480978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95128ef-44c6-4574-958b-c94ba7dd1f43 req-d94d42ca-904f-45ed-a309-7b8154146f65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:50.483084 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d95128ef-44c6-4574-958b-c94ba7dd1f43 req-d94d42ca-904f-45ed-a309-7b8154146f65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 944 time: 0.1691723 Nov 05 14:51:50.493381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 6187c4a7-83b5-4932-8807-464950065f8f completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:51:50.500054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 6187c4a7-83b5-4932-8807-464950065f8f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:50.500927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.537221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:50.541238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.588201 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d95128ef-44c6-4574-958b-c94ba7dd1f43 req-23235b77-7985-454f-83a5-4d32cacd0b5d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0957091 Nov 05 14:51:50.620507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.636543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4381fc60-55b9-41ae-b9d8-a9098782274a req-6e02a9a7-ffa5-44b4-902b-fd258cf91df9 tempest-TestServerAdvancedOps-1201624260 tempest-TestServerAdvancedOps-1201624260-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc1dd580-89a7-4364-9390-1d38ae6256e3 HTTP/1.1" status: 200 len: 210 time: 0.0729501 Nov 05 14:51:50.657110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5523a0e1-2e95-46ee-a46f-c22444ff1b5f None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:50.859951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.891237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:50.893878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb49ef9b-6ef2-423f-9767-73e431bf7b31" -d '{"events": [{"server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "name": "network-vif-plugged", "status": "completed", "tag": "6187c4a7-83b5-4932-8807-464950065f8f"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:50.907005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:50.912070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:50.917724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:50.918316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.924635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6187c4a7-83b5-4932-8807-464950065f8f,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:50.928412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=30765ed4-e4af-4d87-a6c7-d91d515ef18e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:50.939812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:50.947049 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e899701-e0a8-4537-925c-02c7e6bcd548 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6039836 Nov 05 14:51:50.947784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45688) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:50.954457 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'security_group': {'name': 'tempest-secgroup-1224509050'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:50.989187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8759e793-1a0f-41b3-b87e-9e95eabbc7fd x-openstack-request-id: req-8759e793-1a0f-41b3-b87e-9e95eabbc7fd {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:50.989976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "name": "network-vif-plugged", "status": "completed", "tag": "6187c4a7-83b5-4932-8807-464950065f8f", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:50.989976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8759e793-1a0f-41b3-b87e-9e95eabbc7fd {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:50.990231 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f', 'code': 200} Nov 05 14:51:50.990989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5523a0e1-2e95-46ee-a46f-c22444ff1b5f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:51.018959 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:51.030541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:51.036282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad64a082-d7a1-45f9-93e9-17bd6e7b68eb None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-ad64a082-d7a1-45f9-93e9-17bd6e7b68eb None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:51.133522 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:51.143738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.146692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7be041ad-b6c4-44e4-b1cd-71a6cb4dd8e8 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:51.152363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.224706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.226217 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2770622 Nov 05 14:51:51.229049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45690) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:51.234009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'security_group': {'name': 'tempest-secgroup-1678348822'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:51.242848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17921a77-f7a4-47fc-9fd9-e0489586c75b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5abca0f7-cb5d-489c-9371-91988baa6ef5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:51.254447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053727a0-a532-41d8-9c5d-b81c7c5f7995 req-398e7749-56d6-438a-a3c1-57a6a1f683b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:51.255259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7be041ad-b6c4-44e4-b1cd-71a6cb4dd8e8 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:51.256235 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-053727a0-a532-41d8-9c5d-b81c7c5f7995 req-398e7749-56d6-438a-a3c1-57a6a1f683b8 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1098 time: 0.0725241 Nov 05 14:51:51.272668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.312226 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-053727a0-a532-41d8-9c5d-b81c7c5f7995 req-d28768c8-5285-4d5d-90fc-38dbcc2c488c service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485203 Nov 05 14:51:51.351290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.357590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.391879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.395747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1629150 Nov 05 14:51:51.396028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45692) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:51.401388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'security_group': {'name': 'tempest-secgroup-133561357'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:51.408539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae634cf4-9c2b-4c14-8675-90367e0f1b51 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1099de12-01e7-4304-a2dc-b3d4b33566dd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:51.430098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.507891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.514035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.548998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fcca37b8-ee9e-4b4f-aaf5-6942f8daf71f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:51.554444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.558777 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5c31670a-cd19-47fd-bc4b-9138b7294263 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.1585896 Nov 05 14:51:51.558777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45694) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:51.563473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1316316525', 'security_groups': ['fcca37b8-ee9e-4b4f-aaf5-6942f8daf71f'], 'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '30765ed4-e4af-4d87-a6c7-d91d515ef18e'}]}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:51.580090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Update dhcp port {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'fixed_ips': [{'subnet_id': '05d80909-5680-4c49-88a4-46f54715fac1', 'ip_address': '172.20.0.18'}, {'subnet_id': '30765ed4-e4af-4d87-a6c7-d91d515ef18e'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '5e649bf2-381c-4631-8673-a8429d33e537'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:51:51.607794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.709050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45700) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:51.759382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:51.779445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Deleting subnet 2adc5528-6869-48c4-a553-e6664c363034 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:51.784359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Allocated IP 172.20.0.2 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/30765ed4-e4af-4d87-a6c7-d91d515ef18e/5e649bf2-381c-4631-8673-a8429d33e537) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:51.815797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f81b490d-9725-42f9-b6d7-1414dd3d6c10 req-1c108a16-f976-43e0-8282-34f88e7f3178 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:51.817542 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f81b490d-9725-42f9-b6d7-1414dd3d6c10 req-1c108a16-f976-43e0-8282-34f88e7f3178 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.1474636 Nov 05 14:51:51.818222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.871685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.880766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:51.909955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.914921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.963850 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f81b490d-9725-42f9-b6d7-1414dd3d6c10 req-860c1817-6a25-4288-ae72-fb669c770f1e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1267498 Nov 05 14:51:51.964882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:51.988021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.013511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] device_id is not set on port c9d81399-a396-402d-b3fd-1820b099b430 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:51:52.016204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-853b962b-8b80-4009-a024-9a820d984bd7 None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:52.077031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.113373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.119732 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/2adc5528-6869-48c4-a553-e6664c363034 HTTP/1.1" status: 204 len: 168 time: 0.4097054 Nov 05 14:51:52.120315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45702) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:52.146295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e4da9c-c453-4219-8b1b-5c0bac758e22 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2adc5528-6869-48c4-a553-e6664c363034,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:52.242595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.248127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.9 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/30765ed4-e4af-4d87-a6c7-d91d515ef18e/c9d81399-a396-402d-b3fd-1820b099b430) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:52.359996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.387321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a28d013-4b6a-4f5a-b04b-c070deb3e1c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.400896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['118716b0-934b-459d-b87c-bcebda6b65cb']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:52.413112 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:52.413405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a25a1aa5-18d2-45e9-98a7-b3f3aabfcea1') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:52.424852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.433613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.442947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.451292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Releasing vlan 605 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:52.451894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:52.454144 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:52.474377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.526811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.527537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:52.531825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:52.535101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.536873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:52.541343 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] 10.222.0.30 "DELETE /v2.0/networks/118716b0-934b-459d-b87c-bcebda6b65cb HTTP/1.1" status: 204 len: 168 time: 0.4170339 Nov 05 14:51:52.543748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45704) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:52.551088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99be05f7-d6f7-4906-9b76-5fa76ed9659b admin admin] Pushing event deleted for resources: {'Network': ['ID=118716b0-934b-459d-b87c-bcebda6b65cb,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:52.600960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=c9d81399-a396-402d-b3fd-1820b099b430,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:52.623146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7c19cb0-41c8-489a-af15-6e3bd145c1fb None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:52.629731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-0430318c-1e4c-43d1-ba38-30372d4067d7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0444522 Nov 05 14:51:52.633024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:52.633638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.646578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Deleting subnet 7838aa32-9a19-4d4d-9538-7cb2dbb125c9 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:52.651624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.674587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-af925298-929d-4c00-b892-5e3de9ecf0b7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.1149921 Nov 05 14:51:52.678531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:52.683932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:52.696411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-06f8d2ed-e84f-4c0e-8ddd-a5c470358f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:52.697693 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-06f8d2ed-e84f-4c0e-8ddd-a5c470358f22 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 1099 time: 0.0452785 Nov 05 14:51:52.731174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f23fa004-f2df-429d-889a-08e630ce60b7 None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:52.731618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f23fa004-f2df-429d-889a-08e630ce60b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.739113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.765244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7c19cb0-41c8-489a-af15-6e3bd145c1fb None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:52.777859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f23fa004-f2df-429d-889a-08e630ce60b7 None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:52.802128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.809866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-a15297d6-4cf1-476a-8034-2c313dd407fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:52.811356 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-a15297d6-4cf1-476a-8034-2c313dd407fc service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.0948980 Nov 05 14:51:52.833702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f23fa004-f2df-429d-889a-08e630ce60b7 None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:52.834055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f23fa004-f2df-429d-889a-08e630ce60b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.868175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:52.873569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.891266 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-a01c3c76-bee6-4325-af4c-0454187c2d01 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 200 len: 1002 time: 0.0717852 Nov 05 14:51:52.932749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.948732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-6276aa5f-cf1a-483a-baac-06c72f8b51ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:52.950292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-6276aa5f-cf1a-483a-baac-06c72f8b51ac service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0525374 Nov 05 14:51:52.965799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7838aa32-9a19-4d4d-9538-7cb2dbb125c9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:52.977934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:52.981725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ca17a89d-5736-4f3f-b283-78c3856ca2af admin admin] 10.222.0.30 "DELETE /v2.0/subnets/7838aa32-9a19-4d4d-9538-7cb2dbb125c9 HTTP/1.1" status: 204 len: 168 time: 0.4363127 Nov 05 14:51:52.984763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45708) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:53.024432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-4206c58a-8ec4-4bd1-baa1-2e14f6cdfc77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:53.025987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-4206c58a-8ec4-4bd1-baa1-2e14f6cdfc77 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0679383 Nov 05 14:51:53.068171 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 30765ed4-e4af-4d87-a6c7-d91d515ef18e (CIDR: 172.20.0.0/28) Nov 05 14:51:53.078369 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:51:53.078851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:53.092155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.109549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6dd45f66-55db-4e02-8bc4-ca47696aab1b tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4299760 Nov 05 14:51:53.110317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:53.116192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:53.150378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7660fa7-975c-4a3f-b526-46dc8ce3c369 req-b499ccf3-bf30-4a3a-8418-8cf5c5258f83 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:53.152336 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7660fa7-975c-4a3f-b526-46dc8ce3c369 req-b499ccf3-bf30-4a3a-8418-8cf5c5258f83 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.1098766 Nov 05 14:51:53.189130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:53.226684 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7660fa7-975c-4a3f-b526-46dc8ce3c369 req-74568680-8a2f-42d2-b9ff-9d940a3708ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0652561 Nov 05 14:51:53.228865 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-641c51a8-6ff0-4864-9b5e-45be1767cfbf service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1946516 Nov 05 14:51:53.254416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:53.255069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.352166 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4c2176f1-7daa-40ee-9c3b-9d394d35eb14 req-2b37a624-908c-4635-a670-e92a7c8ba909 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1148078 Nov 05 14:51:53.389727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.685019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.725141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d69ff73c-63e4-4635-bfb5-efdd4d3e17e1']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:53.727088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:53.727576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.735262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4dfee0c-5af2-4dfa-9aa5-b73b8d2ef391 req-dcedbe74-8f10-404c-a786-cfca4a3e4bf3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:53.736944 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a4dfee0c-5af2-4dfa-9aa5-b73b8d2ef391 req-dcedbe74-8f10-404c-a786-cfca4a3e4bf3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.1179605 Nov 05 14:51:53.758746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '17e0be91-2702-4c17-a898-e417f2e8190c') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:53.759037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '17e0be91-2702-4c17-a898-e417f2e8190c') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:53.766403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:53.766886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:53.769887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.778597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Provisioning complete for port c9d81399-a396-402d-b3fd-1820b099b430 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:53.778971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.782173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.814563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Port c9d81399-a396-402d-b3fd-1820b099b430 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:53.824999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:53.825371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-51f2a807-af44-4ed7-8fde-f61bcb43e270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.855345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.873958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Releasing vlan 639 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:53.874752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:53.878517 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:53.939162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a4dfee0c-5af2-4dfa-9aa5-b73b8d2ef391 req-675369c1-b686-4010-a30e-1438704493b8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1928544 Nov 05 14:51:53.964855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:53.969472 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.ipam_backend_mixin [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 05d80909-5680-4c49-88a4-46f54715fac1 (CIDR: 172.20.0.16/28) Nov 05 14:51:53.970621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.975318 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 14:51:53.975800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:53.981081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:53.984210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] 10.222.0.30 "DELETE /v2.0/networks/d69ff73c-63e4-4635-bfb5-efdd4d3e17e1 HTTP/1.1" status: 204 len: 168 time: 0.9990590 Nov 05 14:51:53.999243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d636b1-c1bb-45b1-98bb-8cb6e3510267 admin admin] Pushing event deleted for resources: {'Network': ['ID=d69ff73c-63e4-4635-bfb5-efdd4d3e17e1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:54.010642 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-50007257-3fb7-4dc2-ae4b-25e41fb92936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.8990262 Nov 05 14:51:54.012117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9525885-5bf7-457e-bf52-9899cd2c0cbb tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:54.013370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45720) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:54.018767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'subnet': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:54.024064 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c9525885-5bf7-457e-bf52-9899cd2c0cbb tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1093 time: 0.0581088 Nov 05 14:51:54.027846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45722) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:54.028519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de827134-80a4-47ca-a35a-2836861036db None None] Provisioning complete for port c9d81399-a396-402d-b3fd-1820b099b430 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:54.029172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de827134-80a4-47ca-a35a-2836861036db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.032850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '6187c4a7-83b5-4932-8807-464950065f8f', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.3'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:54.058217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.074321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-de827134-80a4-47ca-a35a-2836861036db None None] Port c9d81399-a396-402d-b3fd-1820b099b430 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:54.150192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Made reservation on behalf of a503af5aa1e240d1b3c3ad6d39477549 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:51:54.154417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.176983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.184921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45724) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:54.275291 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1caec0a4-b435-438e-a1c5-6d5bea9a5012 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=de6b84a04f00477c855a9f7319208b60&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0868175 Nov 05 14:51:54.275662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:54.313715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:54.319166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.81 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/f32579d2-40f8-4877-87e8-96e62066b243) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:54.337521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:54.337866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e7a18ecb-bc7f-4fb7-98c7-aa2a9aab1645 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:54.384776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.421477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.427075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.448594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.457637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.509564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:54.512613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:51:54.515639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:54.516562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:51:54.519386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:51:54.520951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:54.521551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.532149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65a26ef0-1378-41d8-8339-7cae438bf706 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:54.534202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Subnet': ['ID=3a86ba71-b13e-4040-8470-12d412f6429a,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:54.537651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.540226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.541413 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5a45e52b-7884-4895-87b4-88437d02e4e5 HTTP/1.1" status: 204 len: 168 time: 0.2647245 Nov 05 14:51:54.564541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-207c1a71-488f-4c69-ae3f-542ec7789f7c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.5498254 Nov 05 14:51:54.565603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d3f123-fe67-49e9-ac33-d05c2848687d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a45e52b-7884-4895-87b4-88437d02e4e5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:54.567152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45730) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:54.572531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-26889620', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '3a86ba71-b13e-4040-8470-12d412f6429a'}], 'security_groups': ['5abca0f7-cb5d-489c-9371-91988baa6ef5', '1099de12-01e7-4304-a2dc-b3d4b33566dd']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:51:54.582063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=f32579d2-40f8-4877-87e8-96e62066b243,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-65a26ef0-1378-41d8-8339-7cae438bf706 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:54.635823 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:54.649849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70afcd98-381a-45e6-8191-af79a316e52f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:54.669825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.756403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70afcd98-381a-45e6-8191-af79a316e52f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:54.858331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:54.938192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.014376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.024862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:55.033830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Delete allocated IP 172.20.0.9 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/30765ed4-e4af-4d87-a6c7-d91d515ef18e) {{(pid=113580) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 05 14:51:55.050544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Allocated IP 172.20.0.46 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/3a86ba71-b13e-4040-8470-12d412f6429a/c9d81399-a396-402d-b3fd-1820b099b430) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:55.095127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9952bf5b-ee46-4fab-bc1e-4e2c220d7bcb admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bd04573eae1b48a9b0189847c94eba44&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0690053 Nov 05 14:51:55.098443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45736) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:55.115642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Update dhcp port {'port': {'network_id': 'fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40', 'fixed_ips': [{'subnet_id': '05d80909-5680-4c49-88a4-46f54715fac1', 'ip_address': '172.20.0.18'}, {'subnet_id': '30765ed4-e4af-4d87-a6c7-d91d515ef18e', 'ip_address': '172.20.0.2'}, {'subnet_id': '3a86ba71-b13e-4040-8470-12d412f6429a'}], 'binding:host_id': 'dv-neutron-816850-1-hyperv'}, 'id': '5e649bf2-381c-4631-8673-a8429d33e537'} from dv-neutron-816850-1-hyperv. {{(pid=113582) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:333}} Nov 05 14:51:55.142682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.178663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.186050 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.214838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.254150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.273908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.275837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=f32579d2-40f8-4877-87e8-96e62066b243,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:55.334916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.340167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.351279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.353917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.358177 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a4a15ac5-179d-414b-8d83-1ed78946fe04 HTTP/1.1" status: 204 len: 168 time: 0.2562876 Nov 05 14:51:55.394260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Allocated IP 172.20.0.34 (fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40/3a86ba71-b13e-4040-8470-12d412f6429a/5e649bf2-381c-4631-8673-a8429d33e537) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:51:55.400736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a6449f0-691e-48c2-a3d2-1530f403c828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4a15ac5-179d-414b-8d83-1ed78946fe04,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:55.502098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] In _notify_port_updated(), no bound segment for port c9d81399-a396-402d-b3fd-1820b099b430 on network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:51:55.510066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:55.511586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.513776 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "PUT /v2.0/ports/c9d81399-a396-402d-b3fd-1820b099b430 HTTP/1.1" status: 200 len: 958 time: 0.9454250 Nov 05 14:51:55.520395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45740) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:55.578881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b323aad-757a-41ed-94c7-84a9a2016b67 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event updated for resources: {'Port': ['ID=c9d81399-a396-402d-b3fd-1820b099b430,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:55.584378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:55.621283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.630118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.654683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port c9d81399-a396-402d-b3fd-1820b099b430 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:55.655082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.751768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c5fea9-a70e-4d50-b41a-e2dc999ac691 None None] Pushing event updated for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:55.786329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.789851 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 5f594617-79f7-486d-a3e2-f7687866a3d6 associated. External IP: 172.26.5.81, port: 6187c4a7-83b5-4932-8807-464950065f8f. Nov 05 14:51:55.799984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for c9d81399-a396-402d-b3fd-1820b099b430 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:55.887616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.946528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:55.976719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=c9d81399-a396-402d-b3fd-1820b099b430,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:56.021441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router defa989d-42e0-4df7-972d-4f912f93ce3d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:51:56.050224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.055981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2bd9b27d-eea9-41d4-a296-9c6f55678bac tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/c9d81399-a396-402d-b3fd-1820b099b430 HTTP/1.1" status: 204 len: 168 time: 0.5317392 Nov 05 14:51:56.056250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45742) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.086107 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-781f8e1d-7788-41ff-8708-7bd2cb73d1f2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] GET failed (client error): The resource could not be found. Nov 05 14:51:56.087690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-781f8e1d-7788-41ff-8708-7bd2cb73d1f2 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports/c9d81399-a396-402d-b3fd-1820b099b430 HTTP/1.1" status: 404 len: 333 time: 0.0305049 Nov 05 14:51:56.090970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45744) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.142144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:51:56.145774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.158555 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Sync routers for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:51:56.168776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.172801 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:56.173425 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:56.187463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.204989 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f7569007-8a23-4105-bd2a-f50dfd933407 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1735396 Nov 05 14:51:56.204989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:51:56.206028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45746) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.206751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b469a0a1-094a-445a-9989-5fc734daa7e5" -d '{"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:51:56.254680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:51:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8033b4f3-9ca6-48b6-96dd-b5623d7f3f02 x-openstack-request-id: req-8033b4f3-9ca6-48b6-96dd-b5623d7f3f02 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:51:56.255010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:51:56.255268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8033b4f3-9ca6-48b6-96dd-b5623d7f3f02 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:51:56.255685 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f', 'status': 'completed', 'code': 200} Nov 05 14:51:56.319948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-32ef51d1-5dfc-40bd-9cf6-4f0f63ac9073 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/5f594617-79f7-486d-a3e2-f7687866a3d6 HTTP/1.1" status: 200 len: 990 time: 0.1115768 Nov 05 14:51:56.320388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.323139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.326683 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/security-groups/fcca37b8-ee9e-4b4f-aaf5-6942f8daf71f HTTP/1.1" status: 204 len: 168 time: 0.2323799 Nov 05 14:51:56.326841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-8db3ba35-a9e6-4439-8a7b-bb031941df5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:56.327918 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-8db3ba35-a9e6-4439-8a7b-bb031941df5b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1098 time: 0.0504637 Nov 05 14:51:56.334165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58eb280a-07c8-4123-aea1-bbb6c246a05c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcca37b8-ee9e-4b4f-aaf5-6942f8daf71f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:56.337693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45750) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.397934 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:56.415306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:56.415939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.454271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:56.458490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Could not find standard attr ID for object c9d81399-a396-402d-b3fd-1820b099b430. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:56.464703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.469300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:56.469670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b97bda4b-9db7-45b5-928c-828dfe7eb28c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.486355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-1ea027c8-88dd-40b2-a2a9-f1d930942d8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:56.487844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-1ea027c8-88dd-40b2-a2a9-f1d930942d8a service neutron] 10.222.0.32 "GET /v2.0/networks?id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 200 len: 898 time: 0.1471908 Nov 05 14:51:56.505923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.591927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-5cff71bd-8bdf-4adf-bd8a-eefbd233ee89 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 200 len: 998 time: 0.0962648 Nov 05 14:51:56.603048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.606287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.607365 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/security-groups/1099de12-01e7-4304-a2dc-b3d4b33566dd HTTP/1.1" status: 204 len: 168 time: 0.2681270 Nov 05 14:51:56.610336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45752) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.645386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ffcf11-66e1-486a-809d-bf6d7d160583 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1099de12-01e7-4304-a2dc-b3d4b33566dd,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:56.664780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-ad331dc5-e1ca-426e-917f-ddc9363bc09c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:56.666262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-ad331dc5-e1ca-426e-917f-ddc9363bc09c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=68c6fc61-cadd-441b-83cf-35abc1a4569e HTTP/1.1" status: 200 len: 835 time: 0.0578229 Nov 05 14:51:56.670413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.672908 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '5f594617-79f7-486d-a3e2-f7687866a3d6', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.81', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'port_id': '6187c4a7-83b5-4932-8807-464950065f8f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1313, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'mac_address': 'fa:16:3e:9f:e0:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:51:54Z', 'updated_at': '2021-11-05T14:51:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:56.694904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.701191 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Checking router: defa989d-42e0-4df7-972d-4f912f93ce3d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:51:56.710084 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:51:56.714722 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:56.719222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-405536c0-4389-4a1e-9903-8a1718c5fecd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:51:56.720967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-405536c0-4389-4a1e-9903-8a1718c5fecd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0457568 Nov 05 14:51:56.742942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.746620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.748134 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/security-groups/5abca0f7-cb5d-489c-9371-91988baa6ef5 HTTP/1.1" status: 204 len: 168 time: 0.1367559 Nov 05 14:51:56.751606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45754) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:56.759651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5378bd74-5eec-4ead-80b4-3f325c399b8c tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5abca0f7-cb5d-489c-9371-91988baa6ef5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:56.847744 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:51:56.856442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 30765ed4-e4af-4d87-a6c7-d91d515ef18e {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:56.863511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:56.918539 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-767c8948-42f5-42bc-b5eb-a42a11ff5720 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1898212 Nov 05 14:51:56.925908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.082887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9d8b33d3-1026-4156-ba35-9b538d75bcab None None] Could not find standard attr ID for object c9d81399-a396-402d-b3fd-1820b099b430. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:57.089976 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b469a0a1-094a-445a-9989-5fc734daa7e5 req-aafe9521-e756-4460-866e-bdc8a3404956 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1420355 Nov 05 14:51:57.092539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.116973 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '5f594617-79f7-486d-a3e2-f7687866a3d6', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.81', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'port_id': '6187c4a7-83b5-4932-8807-464950065f8f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1313, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'mac_address': 'fa:16:3e:9f:e0:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:51:54Z', 'updated_at': '2021-11-05T14:51:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:57.148561 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30b316b9-a38c-46ed-b4fd-94cab0040f4b None None] The sync data for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv is: [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '5f594617-79f7-486d-a3e2-f7687866a3d6', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.81', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'port_id': '6187c4a7-83b5-4932-8807-464950065f8f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1313, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'mac_address': 'fa:16:3e:9f:e0:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:51:54Z', 'updated_at': '2021-11-05T14:51:54Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:51:57.177388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.213009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:51:57.215670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.219361 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/30765ed4-e4af-4d87-a6c7-d91d515ef18e HTTP/1.1" status: 204 len: 168 time: 0.4665494 Nov 05 14:51:57.220887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd156203-130e-4fa0-94b7-a190dc05b201 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=30765ed4-e4af-4d87-a6c7-d91d515ef18e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:57.226407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45756) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.247071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4029afc3-7f65-4891-baed-5d2e2c6a8566 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:57.287559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 3a86ba71-b13e-4040-8470-12d412f6429a {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:57.291390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.322355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45758) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.340335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.403331 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6a47af8f-911a-4de9-8b48-fa80e94ca1ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/5f594617-79f7-486d-a3e2-f7687866a3d6 HTTP/1.1" status: 200 len: 990 time: 0.0796084 Nov 05 14:51:57.448310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.451568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ebe25b2-cb84-4bc3-b942-553fe6965e21 None None] New status for floating IP 5f594617-79f7-486d-a3e2-f7687866a3d6: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:51:57.510703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.538832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=3a86ba71-b13e-4040-8470-12d412f6429a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:57.542671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.545947 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f078cd61-a508-455d-b408-16510335b3bd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/3a86ba71-b13e-4040-8470-12d412f6429a HTTP/1.1" status: 204 len: 168 time: 0.3171964 Nov 05 14:51:57.548548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45760) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.575635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:57.576002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.580102 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-e292cb3b-b007-4e1c-b5d0-a60b721ebf89 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-4029afc3-7f65-4891-baed-5d2e2c6a8566 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:57.580503 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:57.581771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e292cb3b-b007-4e1c-b5d0-a60b721ebf89 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:57.589936 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e292cb3b-b007-4e1c-b5d0-a60b721ebf89 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/30765ed4-e4af-4d87-a6c7-d91d515ef18e HTTP/1.1" status: 404 len: 337 time: 0.0348613 Nov 05 14:51:57.589936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.604565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbc38ac7-ea93-4d6f-a2f3-654d8f064b09 None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:57.638967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting subnet 05d80909-5680-4c49-88a4-46f54715fac1 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:51:57.642076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.682789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fbc38ac7-ea93-4d6f-a2f3-654d8f064b09 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:51:57.748925 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:51:57.761557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bac01a2-809b-4847-9041-7dc4f70caa42 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:57.777150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.836747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.855952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bac01a2-809b-4847-9041-7dc4f70caa42 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:57.866359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Subnet': ['ID=05d80909-5680-4c49-88a4-46f54715fac1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:57.868337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:57.872494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-65fef061-7023-4cbd-8cfc-1f88e099eaeb tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/05d80909-5680-4c49-88a4-46f54715fac1 HTTP/1.1" status: 204 len: 168 time: 0.2829835 Nov 05 14:51:57.873914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.899475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4f6714c8-985d-4849-9c14-a43e3ae4f6a9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:57.899922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4f6714c8-985d-4849-9c14-a43e3ae4f6a9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:57.903649 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4f6714c8-985d-4849-9c14-a43e3ae4f6a9 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/f3b6f94c-656c-40e4-b1b6-ab2b9aa1aa26 HTTP/1.1" status: 404 len: 337 time: 0.0287793 Nov 05 14:51:57.906174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45766) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.933065 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-242ce518-5501-4af1-93cb-d2e0b99f33ed tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "GET /v2.0/ports?device_id=345e5833-5b7a-4228-8d79-de9f7fa4c71c HTTP/1.1" status: 200 len: 205 time: 0.0258105 Nov 05 14:51:57.935565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45768) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:57.976429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-fefd8107-a8b5-4f20-9944-4521071b723f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] delete failed (client error): The resource could not be found. Nov 05 14:51:57.977525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fefd8107-a8b5-4f20-9944-4521071b723f tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/routers/345e5833-5b7a-4228-8d79-de9f7fa4c71c HTTP/1.1" status: 404 len: 336 time: 0.0409877 Nov 05 14:51:57.980680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45770) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.007245 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc736027-c023-4244-abf4-a2b857c3c021 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.007716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dc736027-c023-4244-abf4-a2b857c3c021 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.010819 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc736027-c023-4244-abf4-a2b857c3c021 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/b269c6a4-dcb1-443b-a1e9-05d19287fad2 HTTP/1.1" status: 404 len: 337 time: 0.0292339 Nov 05 14:51:58.013301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45772) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.037963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-0ee92e61-80ce-41bc-9462-a18b9307a9c4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.038407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0ee92e61-80ce-41bc-9462-a18b9307a9c4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.041952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ee92e61-80ce-41bc-9462-a18b9307a9c4 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/4330c0c9-6d8e-4af5-bcbb-989a7e1b8be6 HTTP/1.1" status: 404 len: 337 time: 0.0272355 Nov 05 14:51:58.044310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45774) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.070113 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-d39966dd-9984-44e5-bbb3-614bedc9b340 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.070561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d39966dd-9984-44e5-bbb3-614bedc9b340 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.075916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d39966dd-9984-44e5-bbb3-614bedc9b340 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/11ceccaf-3d48-4fd5-a907-518913b99bc1 HTTP/1.1" status: 404 len: 337 time: 0.0285063 Nov 05 14:51:58.076158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45776) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.096409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5221e51-b6c8-4471-ae57-a539259bf75d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:51:58.098679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-b73c6795-4c44-47fa-bef8-9a303e527d59 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.099344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b73c6795-4c44-47fa-bef8-9a303e527d59 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.102475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b73c6795-4c44-47fa-bef8-9a303e527d59 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/173cd8d3-ed48-49cd-a059-02b64f7ce161 HTTP/1.1" status: 404 len: 333 time: 0.0253870 Nov 05 14:51:58.105463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45778) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.135107 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-9191f009-c6b6-4f0c-8dfa-2661d6aa980d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.135948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9191f009-c6b6-4f0c-8dfa-2661d6aa980d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.139205 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9191f009-c6b6-4f0c-8dfa-2661d6aa980d tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/7f6d99db-0d5a-4fce-9488-068e3003910d HTTP/1.1" status: 404 len: 337 time: 0.0327089 Nov 05 14:51:58.142275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45780) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.144672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-65f32229-aebb-48bb-acea-6d766b93690b None None] Provisioning complete for port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:58.145102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-65f32229-aebb-48bb-acea-6d766b93690b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.167821 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-07dff9b0-8f54-49a7-97b3-d7573c995ae8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.168265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-07dff9b0-8f54-49a7-97b3-d7573c995ae8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.171232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-07dff9b0-8f54-49a7-97b3-d7573c995ae8 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/d1404318-14e3-4edd-880e-92ec2576089c HTTP/1.1" status: 404 len: 337 time: 0.0280454 Nov 05 14:51:58.173841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45782) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.196324 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-60668b26-2ef3-43b0-b112-6803bf0983a7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.196972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60668b26-2ef3-43b0-b112-6803bf0983a7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.199963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-60668b26-2ef3-43b0-b112-6803bf0983a7 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/54c513f4-4f43-4c6a-a6c5-5bd63becb620 HTTP/1.1" status: 404 len: 333 time: 0.0252311 Nov 05 14:51:58.202646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45784) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.205418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-65f32229-aebb-48bb-acea-6d766b93690b None None] Port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:51:58.228742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5221e51-b6c8-4471-ae57-a539259bf75d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:51:58.229491 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-be3324dd-dfcf-492e-95c7-c792b77f55cd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.229972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-be3324dd-dfcf-492e-95c7-c792b77f55cd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.232642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-65f32229-aebb-48bb-acea-6d766b93690b None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:58.232851 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-be3324dd-dfcf-492e-95c7-c792b77f55cd tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/879d6116-1256-4917-a983-251dbc30f714 HTTP/1.1" status: 404 len: 337 time: 0.0292237 Nov 05 14:51:58.233032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-65f32229-aebb-48bb-acea-6d766b93690b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.235366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45786) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.261916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.pecan_wsgi.hooks.translation [None req-4e5afe00-64bc-442a-b562-29036ccdf0ea tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] DELETE failed (client error): The resource could not be found. Nov 05 14:51:58.262392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4e5afe00-64bc-442a-b562-29036ccdf0ea tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113580) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 14:51:58.265452 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e5afe00-64bc-442a-b562-29036ccdf0ea tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/subnets/e48d5a4b-9b90-4eb4-9c00-fed479f2bb14 HTTP/1.1" status: 404 len: 337 time: 0.0286143 Nov 05 14:51:58.268210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.360141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:58.360506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.405622 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45790) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.429906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.453164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 88fbe395-fa9d-43e6-bbfe-e1e7831bad59 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:58.485742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85ef6529-2a4c-436e-b2db-f6495489cff5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/5f594617-79f7-486d-a3e2-f7687866a3d6 HTTP/1.1" status: 200 len: 992 time: 0.0711269 Nov 05 14:51:58.538376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40c3cd0d-1cf7-4128-91dc-adff407cf50a None None] Network fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:51:58.540137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.570247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=88fbe395-fa9d-43e6-bbfe-e1e7831bad59,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:58.575226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.580822 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-337e7454-4ed1-4579-8fbb-6d49b4033f86 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/ports/88fbe395-fa9d-43e6-bbfe-e1e7831bad59 HTTP/1.1" status: 204 len: 168 time: 0.3095388 Nov 05 14:51:58.581202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45792) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:58.624209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2767cc18-edfa-455f-a6e4-c5f1e198a1f3 None None] Could not find standard attr ID for object 88fbe395-fa9d-43e6-bbfe-e1e7831bad59. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 14:51:58.641441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2767cc18-edfa-455f-a6e4-c5f1e198a1f3 None None] Provisioning complete for port 5e649bf2-381c-4631-8673-a8429d33e537 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:51:58.641815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2767cc18-edfa-455f-a6e4-c5f1e198a1f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.665991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.725795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Deleting port 5e649bf2-381c-4631-8673-a8429d33e537 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:58.726822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.729776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] DHCP port deletion for fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:51:58.784275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Deleting port 5e649bf2-381c-4631-8673-a8429d33e537 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:51:58.784680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.790464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:58.790824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.804079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Calling delete_port for 5e649bf2-381c-4631-8673-a8429d33e537 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:58.846072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] For port 5e649bf2-381c-4631-8673-a8429d33e537, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=5e649bf2-381c-4631-8673-a8429d33e537,segment=NetworkSegment(45ed7a9f-3390-4f59-81f4-13bc1b71301c),segment_id=45ed7a9f-3390-4f59-81f4-13bc1b71301c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:51:58.846459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.859845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Calling delete_port for 5e649bf2-381c-4631-8673-a8429d33e537 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:51:58.886244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.912215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:58.916163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] No DVR routers for this DVR port 5e649bf2-381c-4631-8673-a8429d33e537 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:58.941496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:58.967177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] Pushing event deleted for resources: {'Port': ['ID=5e649bf2-381c-4631-8673-a8429d33e537,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:58.970512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12e46135-85bc-4b46-b0c9-a4c9e2429f0c None None] No DVR routers for this DVR port 5e649bf2-381c-4631-8673-a8429d33e537 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:51:59.000968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.021210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:59.030932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45ed7a9f-3390-4f59-81f4-13bc1b71301c') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:59.031227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45ed7a9f-3390-4f59-81f4-13bc1b71301c') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:51:59.041041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.053880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.060288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Releasing vlan 645 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:51:59.060914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:51:59.063856 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:51:59.122240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.129380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.132582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] 10.222.0.30 "DELETE /v2.0/networks/fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40 HTTP/1.1" status: 204 len: 168 time: 0.5503676 Nov 05 14:51:59.146320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff7edf95-3d34-46a2-a569-4acab0634936 tempest-PortsTestJSON-822292104 tempest-PortsTestJSON-822292104-project] Pushing event deleted for resources: {'Network': ['ID=fc8df8f8-2fc0-42cd-a14f-c4792c1cbd40,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:51:59.171131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:51:59.190909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 5e649bf2-381c-4631-8673-a8429d33e537 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:51:59.191250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 5e649bf2-381c-4631-8673-a8429d33e537 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:51:59.375455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45798) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:59.504680 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5c3b6fcc-7240-48cb-b147-b2ee339a0f43 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a503af5aa1e240d1b3c3ad6d39477549&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1279750 Nov 05 14:51:59.507696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:51:59.538529 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:51:59.560365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.581466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.627296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.629912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:51:59.631082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e0866fe1-458f-4345-8403-cbccaacd9294 HTTP/1.1" status: 204 len: 168 time: 0.1224608 Nov 05 14:51:59.639260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b25e02-5357-4f0a-ab73-602e244fcc47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0866fe1-458f-4345-8403-cbccaacd9294,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.064417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45842) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.069417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1801618266', 'description': 'tempest-secgroup-smoke-1801618266 description', 'project_id': '2b0f272512b04566b8ddf36f25b004d1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.090699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.099109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.173056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.176804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.217120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2942af1b-6bf4-48a0-b6fa-832393ea8610,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.251621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.256150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.285103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.286328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2208242 Nov 05 14:52:01.288178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c0cfec-b7f7-4937-bdb5-44f330c649da tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a8815d62-7f5a-4ffc-944d-3d215cc116c0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.289438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45844) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.295520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.322517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.368186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.372147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.390223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e2f1e2d-0c5d-4092-9309-684f5d49ad75,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.397659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.398852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-575181b7-f8c1-4f0e-9e7d-4dd4606e00c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1077621 Nov 05 14:52:01.401667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45846) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.405898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.431387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.489373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.493258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.512595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1f053ae-f80a-4021-9bed-102383bb6048,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.517705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.521008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cb376a0a-443a-4acb-b2c8-6c15a4613b40 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1182735 Nov 05 14:52:01.521680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45848) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.526350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.555382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.614868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.618401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.637479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6976436-646f-41a0-b032-9b62c485162d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.642827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.644037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-956f1a1e-3f39-41c5-b2be-839049c2a757 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1213415 Nov 05 14:52:01.646943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45850) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.651485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.676569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.734602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.737943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.757454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1da21a8d-9fe9-4ea3-891f-46c843f19d90,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.764696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.765899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c2a9a55-db5d-4e14-b1fc-2a83fa66272e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1179538 Nov 05 14:52:01.768777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45852) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.773851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.802035 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Project 2b0f272512b04566b8ddf36f25b004d1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:52:01.807025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.864570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.868121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.887010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32184c6b-b4ea-459b-a426-3334f1576d19,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:01.891880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.893156 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7ffe1ac9-da8f-48c5-b59f-4f07d3f34c9d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1231272 Nov 05 14:52:01.895795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45854) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:01.900055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'security_group_rule': {'security_group_id': 'a8815d62-7f5a-4ffc-944d-3d215cc116c0', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:01.921972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Project 2b0f272512b04566b8ddf36f25b004d1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:52:01.926677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.985173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:01.988727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.007222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e944e4e-00ca-4099-94bf-c418855b3d1f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:02.012583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.013594 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-41e607eb-7acc-40b1-8db1-9051a2902dd3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1168571 Nov 05 14:52:02.016695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45856) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:02.021414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'network': {'name': 'tempest-network-smoke--950959001', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:02.042573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Made reservation on behalf of 2b0f272512b04566b8ddf36f25b004d1 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:02.046074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.072056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 602} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:52:02.080808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.081147 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Added segment c3ba3128-586f-468a-879d-b1d2cfb2aa00 of type vlan for network 89254426-06c9-4956-8912-99f06b3d5e5b Nov 05 14:52:02.121789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.150455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.156868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:02.157460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.212717 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1949532 Nov 05 14:52:02.216174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45858) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:02.220739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'admin_state_up': True, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:02.227330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f993cc4f-551a-4620-97ca-6dc96894a550 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Network': ['ID=89254426-06c9-4956-8912-99f06b3d5e5b,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:02.238906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 89254426-06c9-4956-8912-99f06b3d5e5b details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:52:02.244846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.245841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.298329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.437631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.630459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.653267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.754726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Allocated IP 172.26.5.54 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/876da516-1543-489e-a545-63dcb621d3aa) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:02.859196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.893358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:02.929240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:02.932178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:02.937911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:02.964530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=876da516-1543-489e-a545-63dcb621d3aa,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:03.196770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:03.397659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:03.524951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:52:03.631633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:03.641801 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Sync routers for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:03.653074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:03.653300 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:03.657226 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:03.657412 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5a35ebf7-aee9-43f3-9306-f47b9bcef84d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.4370072 Nov 05 14:52:03.657412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45862) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:03.761932 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:03.777593 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e36e6d5-6592-45de-a0f9-bb0b8c4e3a5a tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2b0f272512b04566b8ddf36f25b004d1&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1190965 Nov 05 14:52:03.780319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45866) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:03.876680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9e03f6a-c087-4a70-9bd3-d76ab36b7054 tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:03.878195 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c9e03f6a-c087-4a70-9bd3-d76ab36b7054 tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0969326 Nov 05 14:52:03.881074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45868) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:03.950605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:03Z', 'revision_number': 3, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:03.982272 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Checking router: 9ef78c4d-c236-4042-9316-3b2fa973d8b3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:03.982610 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Updating router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 port 876da516-1543-489e-a545-63dcb621d3aa binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:52:04.008747 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.250066 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4ff04b4f-fa92-4273-888b-de946858206f tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.3654301 Nov 05 14:52:04.250325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45870) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:04.255383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-374105592', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:04.267854 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.274178 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.333276 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22cf8b3f-3f3e-4e50-8b6d-31c9626ec8c7 None None] Pushing event updated for resources: {'Port': ['ID=876da516-1543-489e-a545-63dcb621d3aa,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:04.335661 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Attempting to bind port 876da516-1543-489e-a545-63dcb621d3aa on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:04.336127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Attempting to bind port 876da516-1543-489e-a545-63dcb621d3aa by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:04.336424 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Attempting to bind port 876da516-1543-489e-a545-63dcb621d3aa on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:04.341803 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:04.342181 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:04.342583 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.343138 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:04.343426 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Bound port: 876da516-1543-489e-a545-63dcb621d3aa, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:04.343804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.349956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Made reservation on behalf of 2b0f272512b04566b8ddf36f25b004d1 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:04.353928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.393379 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] For port 876da516-1543-489e-a545-63dcb621d3aa, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:04.396685 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] For port 876da516-1543-489e-a545-63dcb621d3aa, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=876da516-1543-489e-a545-63dcb621d3aa,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:04.401394 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.460559 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:04.461173 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:04.464517 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22cf8b3f-3f3e-4e50-8b6d-31c9626ec8c7 None None] Pushing event updated for resources: {'Port': ['ID=876da516-1543-489e-a545-63dcb621d3aa,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:04.540357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.600285 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Subnet': ['ID=7372d027-f074-48e5-b9ed-280658f34d1e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:04.610938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Checking segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:04.611294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network hostable DHCP agents. Network: 89254426-06c9-4956-8912-99f06b3d5e5b, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:52:04.627220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 89254426-06c9-4956-8912-99f06b3d5e5b is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:52:04.635869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 89254426-06c9-4956-8912-99f06b3d5e5b) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:04.641056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:04.641989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:04.646079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f207c9a3-490e-4b4a-b853-186c33dd1934 None None] Network 89254426-06c9-4956-8912-99f06b3d5e5b requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:52:04.662190 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0cdbce66-4af1-4171-b554-f85ce72dce64 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4080796 Nov 05 14:52:04.662410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45872) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:04.664915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f207c9a3-490e-4b4a-b853-186c33dd1934 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:52:04.718737 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:52:04.731767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bf51798-19b6-4cd8-913b-938c11f4cb78 None None] Network 89254426-06c9-4956-8912-99f06b3d5e5b requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3bf51798-19b6-4cd8-913b-938c11f4cb78 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:52:04.808395 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:52:04.819772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30e2ebeb-1e86-4a1c-8ba9-1ce354443ab6 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:52:04.854913 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:03Z', 'revision_number': 3, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:04.880514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3018908-1a50-445d-9cc7-7c0b9bbc82ee None None] The sync data for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv is: [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:03Z', 'revision_number': 3, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:04.915842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30e2ebeb-1e86-4a1c-8ba9-1ce354443ab6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:52:05.189573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-89254426-06c9-4956-8912-99f06b3d5e5b', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:52:05.190735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.195025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.277501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 876da516-1543-489e-a545-63dcb621d3aa up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:05.386983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Allocated IP 172.20.0.2 (89254426-06c9-4956-8912-99f06b3d5e5b/7372d027-f074-48e5-b9ed-280658f34d1e/b078214b-f2a9-44c0-bfb9-73d6e1cab4c5) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:05.394095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 876da516-1543-489e-a545-63dcb621d3aa triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:05.394095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.571389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.617230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 876da516-1543-489e-a545-63dcb621d3aa, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=876da516-1543-489e-a545-63dcb621d3aa,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:05.626358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.651335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.659678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.689141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Network 89254426-06c9-4956-8912-99f06b3d5e5b is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:05.692644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=876da516-1543-489e-a545-63dcb621d3aa,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:05.695457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:05.699448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:05.709885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Allocated IP 172.20.0.1 (89254426-06c9-4956-8912-99f06b3d5e5b/7372d027-f074-48e5-b9ed-280658f34d1e/aaef3cca-d268-4060-8b42-9d6a2f26db83) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:05.843924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.886491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.927170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Pushing event updated for resources: {'Port': ['ID=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:05.927659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 89254426-06c9-4956-8912-99f06b3d5e5b is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:05.934339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:05.938715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:05.944546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Attempting to bind port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:05.944918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Attempting to bind port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:05.945277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Attempting to bind port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 on network 89254426-06c9-4956-8912-99f06b3d5e5b {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:05.950957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:05.951327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Checking segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:05.951722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.952109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Bound using segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:05.952602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Bound port: b078214b-f2a9-44c0-bfb9-73d6e1cab4c5, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:05.952978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:05.968902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:05.993654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.019794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] For port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:06.022774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] For port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:06.027395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.089365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9366f2-0bc1-4670-ab1a-8ee8a872887f None None] Pushing event updated for resources: {'Port': ['ID=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:06.152801 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.455570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.460355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.862621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:06.865211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:06.965924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 89254426-06c9-4956-8912-99f06b3d5e5b is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:06.967669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:07.087404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:07.173826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8169b8df-aa9b-406f-98f0-d801dc4f2ba0 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:52:07.209186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:07.214541 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0c7a1586-8fa4-4177-b71b-e42ecc6c67bc tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "PUT /v2.0/routers/9ef78c4d-c236-4042-9316-3b2fa973d8b3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5510457 Nov 05 14:52:07.226063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Sync routers for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:07.261970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:07.292372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f6058605-259e-48ad-a425-6fdece782335 None None] Provisioning complete for port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:07.292775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6058605-259e-48ad-a425-6fdece782335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:07.294246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:07.294882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:07.373674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d7d57708-d587-4bdd-b8c5-93b0b7008c05 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1801618266&fields=id&tenant_id=2b0f272512b04566b8ddf36f25b004d1 HTTP/1.1" status: 200 len: 267 time: 0.0464220 Nov 05 14:52:07.402010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8169b8df-aa9b-406f-98f0-d801dc4f2ba0 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:52:07.480163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-b4e016e5-d7e1-48b0-aaba-057532be7f83 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:07.481970 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-b4e016e5-d7e1-48b0-aaba-057532be7f83 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/networks?id=89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 200 len: 796 time: 0.1013117 Nov 05 14:52:07.498422 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-c5e972e0-ae09-4e4d-a518-a878e0e92295 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/quotas/2b0f272512b04566b8ddf36f25b004d1 HTTP/1.1" status: 200 len: 375 time: 0.0099299 Nov 05 14:52:07.518730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:07.519106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:07.556393 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-48915b53-2d8e-4ba8-a6f6-cf2fd5a5a520 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2b0f272512b04566b8ddf36f25b004d1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0521305 Nov 05 14:52:07.572197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:07.648021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6058605-259e-48ad-a425-6fdece782335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:07.651852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-7af07a73-c64e-4b84-bd40-234233ef0430 service neutron] 10.222.0.30 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830219 Nov 05 14:52:07.746106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-e8e27a14-f54e-4f15-a794-0ee2caaca7a4 service neutron] 10.222.0.30 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877869 Nov 05 14:52:07.808444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f6058605-259e-48ad-a425-6fdece782335 None None] For port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:07.831327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6058605-259e-48ad-a425-6fdece782335 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:07.898639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:07.906884 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-50ec503f-7931-48c1-ba39-d66a886bdc75 req-0a5ff290-114c-4f3f-b489-2a7c6095737b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 210 time: 0.0300045 Nov 05 14:52:07.982647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6058605-259e-48ad-a425-6fdece782335 None None] Pushing event updated for resources: {'Port': ['ID=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:08.070719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:52:08.071077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:52:08.093080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 2, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:08.124089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Checking router: 9ef78c4d-c236-4042-9316-3b2fa973d8b3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:08.124450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Updating router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 port aaef3cca-d268-4060-8b42-9d6a2f26db83 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:52:08.154376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.444107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.451198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.506702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c48ade-51af-42e2-85c6-c1b860cd6bee None None] Pushing event updated for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:08.561873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Attempting to bind port aaef3cca-d268-4060-8b42-9d6a2f26db83 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:08.562243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Attempting to bind port aaef3cca-d268-4060-8b42-9d6a2f26db83 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:08.562612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Attempting to bind port aaef3cca-d268-4060-8b42-9d6a2f26db83 on network 89254426-06c9-4956-8912-99f06b3d5e5b {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:08.568192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:08.568655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Checking segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:08.569411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.569411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Bound using segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:08.569959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Bound port: aaef3cca-d268-4060-8b42-9d6a2f26db83, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:08.570237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.635688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 876da516-1543-489e-a545-63dcb621d3aa up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:08.706561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] For port aaef3cca-d268-4060-8b42-9d6a2f26db83, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:08.711632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] For port aaef3cca-d268-4060-8b42-9d6a2f26db83, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aaef3cca-d268-4060-8b42-9d6a2f26db83,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:08.716687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Provisioning complete for port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:08.717061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.720284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.791458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 876da516-1543-489e-a545-63dcb621d3aa triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:08.791843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:08.845473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:08.846056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:08.961606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-4be78d23-daf9-474c-b50e-40b61a05ce42 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:08.963392 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-4be78d23-daf9-474c-b50e-40b61a05ce42 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.32 "GET /v2.0/networks?id=89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 200 len: 796 time: 0.1287200 Nov 05 14:52:09.044434 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3370bfef-e842-47d4-9770-b5977799b96f req-f48f035c-19f7-45e1-9714-d29922f35aa6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 210 time: 0.0371540 Nov 05 14:52:09.076619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c48ade-51af-42e2-85c6-c1b860cd6bee None None] Pushing event updated for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:09.085382 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-0c395ce0-8159-4a6d-8f0c-4beb39ce28ad tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2b0f272512b04566b8ddf36f25b004d1 HTTP/1.1" status: 200 len: 380 time: 0.1100755 Nov 05 14:52:09.096562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'port': {'device_id': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'admin_state_up': True, 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'security_groups': ['a8815d62-7f5a-4ffc-944d-3d215cc116c0']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:09.218185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Provisioning complete for port aaef3cca-d268-4060-8b42-9d6a2f26db83 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:09.218508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.231089 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Made reservation on behalf of 2b0f272512b04566b8ddf36f25b004d1 for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:09.234946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.273062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:09.376179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:09.401943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Allocated IP 172.20.0.4 (89254426-06c9-4956-8912-99f06b3d5e5b/7372d027-f074-48e5-b9ed-280658f34d1e/8ee2fdf7-0060-475b-978c-30d28e8465fd) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:09.460097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.538919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] For port aaef3cca-d268-4060-8b42-9d6a2f26db83, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aaef3cca-d268-4060-8b42-9d6a2f26db83,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:09.545388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.557223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.575243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:09.575451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.592695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.638302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 89254426-06c9-4956-8912-99f06b3d5e5b is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:09.643434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:09.647264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:09.662109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3adfa8-2396-461d-ac90-4637e926d309 None None] Pushing event updated for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:09.672877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:09.698095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3199c5df-1776-4170-9eb7-09e0c4fe762e None None] Provisioning complete for port aaef3cca-d268-4060-8b42-9d6a2f26db83 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:09.698451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3199c5df-1776-4170-9eb7-09e0c4fe762e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.706146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:09.706864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:09.724367 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-f6966f43-5061-44e1-ba20-7ebfdccdf588 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6318686 Nov 05 14:52:09.725220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:08Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:09.737409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Request body: {'port': {'device_id': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:09.780632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7a83c26-ce93-4f3a-b556-3e6b9208d2b3 None None] The sync data for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv is: [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:08Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:09.796256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.115512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-30494a8a-d673-4dc9-b419-d113292d2c07 None None] Provisioning complete for port 8ee2fdf7-0060-475b-978c-30d28e8465fd triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:10.116041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-30494a8a-d673-4dc9-b419-d113292d2c07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.154678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:52:10.165777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.182770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa7ba52-2770-473b-bcb5-e4124b52a8fd req-63aa9bfb-0f19-44a8-9c36-7d11acf35314 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:10.184638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-30494a8a-d673-4dc9-b419-d113292d2c07 None None] Port 8ee2fdf7-0060-475b-978c-30d28e8465fd cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:52:10.185387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0aa7ba52-2770-473b-bcb5-e4124b52a8fd req-63aa9bfb-0f19-44a8-9c36-7d11acf35314 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 931 time: 0.0595906 Nov 05 14:52:10.190351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Transition to ACTIVE for port object 8ee2fdf7-0060-475b-978c-30d28e8465fd will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:52:10.195124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.245977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:10.246904 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0aa7ba52-2770-473b-bcb5-e4124b52a8fd req-8aef1a14-8f62-4a93-a3d5-3cc5ae07349c tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554020 Nov 05 14:52:10.327197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Attempting to bind port 8ee2fdf7-0060-475b-978c-30d28e8465fd on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:10.327541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Attempting to bind port 8ee2fdf7-0060-475b-978c-30d28e8465fd by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:10.327875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Attempting to bind port 8ee2fdf7-0060-475b-978c-30d28e8465fd on network 89254426-06c9-4956-8912-99f06b3d5e5b {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:10.333592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Port 8ee2fdf7-0060-475b-978c-30d28e8465fd on network 89254426-06c9-4956-8912-99f06b3d5e5b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:52:10.333918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Attempting to bind port 8ee2fdf7-0060-475b-978c-30d28e8465fd on network 89254426-06c9-4956-8912-99f06b3d5e5b {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:10.340186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 51, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:10.340935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Checking segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:10.341448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Bound using segment: {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:10.341892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Bound port: 8ee2fdf7-0060-475b-978c-30d28e8465fd, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c3ba3128-586f-468a-879d-b1d2cfb2aa00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:10.342398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.418776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:10.422510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:10.427923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.463859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:10.464402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:10.465827 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] 10.222.0.32 "PUT /v2.0/ports/8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 200 len: 1093 time: 0.7328243 Nov 05 14:52:10.468208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:10.471386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa192ca3-e2ce-4280-ac6f-78a696d47293" -d '{"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:10.501035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f389d6-b8d2-4e43-aed7-fd40be50f480 service neutron] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:10.550870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49a17a74-3f9f-4232-842a-05efde96e86d x-openstack-request-id: req-49a17a74-3f9f-4232-842a-05efde96e86d {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:10.551246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:10.551596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-49a17a74-3f9f-4232-842a-05efde96e86d {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:10.552077 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'status': 'completed', 'code': 200} Nov 05 14:52:10.585128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-3039e3e7-3263-4d29-907c-5e6a8498dd27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:10.586688 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-3039e3e7-3263-4d29-907c-5e6a8498dd27 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2b0f272512b04566b8ddf36f25b004d1&device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1096 time: 0.0618033 Nov 05 14:52:10.636783 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-578c28ec-36f8-4f9e-91b1-c6b06a219483 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 200 len: 217 time: 0.0419075 Nov 05 14:52:10.692565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-9fa8dec9-9459-4409-846b-743fb2a398c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:10.694048 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-9fa8dec9-9459-4409-846b-743fb2a398c1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7372d027-f074-48e5-b9ed-280658f34d1e HTTP/1.1" status: 200 len: 834 time: 0.0500560 Nov 05 14:52:10.743907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44369e7e-b515-4376-ad55-a38174aaad37 req-9efe5ce9-5bbb-476d-ab04-191880eb5b53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:10.745449 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-9efe5ce9-5bbb-476d-ab04-191880eb5b53 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=89254426-06c9-4956-8912-99f06b3d5e5b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0443752 Nov 05 14:52:10.845619 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-a4380fdd-b543-426a-b6b0-d269292dcef3 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901532 Nov 05 14:52:10.941605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44369e7e-b515-4376-ad55-a38174aaad37 req-23bd46cd-c897-41bc-835c-e500f8a10fac service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889463 Nov 05 14:52:11.034161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-756cb0c1-12e7-4832-ad52-ef5cf01b12b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:11.035653 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-756cb0c1-12e7-4832-ad52-ef5cf01b12b5 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2b0f272512b04566b8ddf36f25b004d1&device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1096 time: 0.0440118 Nov 05 14:52:11.126953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-4c997b63-eb6f-46d4-be16-0db91580d623 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:11.128429 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-4c997b63-eb6f-46d4-be16-0db91580d623 service neutron] 10.222.0.32 "GET /v2.0/networks?id=89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 200 len: 897 time: 0.0857029 Nov 05 14:52:11.170871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-0f0dcc9d-47f0-4196-ab23-fa116fc0a3de service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 200 len: 217 time: 0.0346050 Nov 05 14:52:11.225132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-bf951451-2128-4e01-a0bc-68ed78409aab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:11.226562 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-bf951451-2128-4e01-a0bc-68ed78409aab service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7372d027-f074-48e5-b9ed-280658f34d1e HTTP/1.1" status: 200 len: 834 time: 0.0482183 Nov 05 14:52:11.272825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-3453d14e-2245-4fe5-af96-e4cff8e37edc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:11.274349 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-3453d14e-2245-4fe5-af96-e4cff8e37edc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=89254426-06c9-4956-8912-99f06b3d5e5b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408921 Nov 05 14:52:11.362402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aaef3cca-d268-4060-8b42-9d6a2f26db83 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:11.376047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57a93f-36c1-45e1-b3f1-f69e977d6f5e req-a3411e33-6785-41d9-b00a-f330e4b1a54f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:11.378820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0a57a93f-36c1-45e1-b3f1-f69e977d6f5e req-a3411e33-6785-41d9-b00a-f330e4b1a54f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 943 time: 0.0593431 Nov 05 14:52:11.389882 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-b0d86d16-513e-4fb9-8ae5-1ba33f411469 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1069374 Nov 05 14:52:11.414374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port aaef3cca-d268-4060-8b42-9d6a2f26db83 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:11.414911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:11.429901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0a57a93f-36c1-45e1-b3f1-f69e977d6f5e req-53d08fc7-b41f-40e2-9234-5999c738a630 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435860 Nov 05 14:52:11.488685 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aa192ca3-e2ce-4280-ac6f-78a696d47293 req-e4906cb2-ae89-4336-9c05-6eb9354420de service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905476 Nov 05 14:52:12.551372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5989a8d-c573-4409-9223-596d8425d876 req-d20cef11-607e-4ce5-b4d6-fc4eb9cc3b1b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:12.552871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f5989a8d-c573-4409-9223-596d8425d876 req-d20cef11-607e-4ce5-b4d6-fc4eb9cc3b1b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 943 time: 0.0504806 Nov 05 14:52:12.602773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f5989a8d-c573-4409-9223-596d8425d876 req-b64eb000-a133-47fe-b068-599c87d9f0fe tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432181 Nov 05 14:52:13.715264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb55972-5993-446f-824a-d55a57ea0f2d req-d8fb08af-dd74-4f57-a43b-eeff10c592e6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:13.716788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fb55972-5993-446f-824a-d55a57ea0f2d req-d8fb08af-dd74-4f57-a43b-eeff10c592e6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 943 time: 0.0488324 Nov 05 14:52:13.766142 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fb55972-5993-446f-824a-d55a57ea0f2d req-48f13416-e048-4b23-a1d4-0f20df9a8431 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434487 Nov 05 14:52:14.364197 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:52:14.460090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:14.471591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'mac_address': 'fa:16:3e:2a:1d:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 602, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:52:14.507117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:14.520733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:52:14.540733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:14.544676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:14.595142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:14.780160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8ee2fdf7-0060-475b-978c-30d28e8465fd'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:52:14.886152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46647013-6813-400c-b37b-26572c0613c1 req-b1e67ae4-70fe-407c-b7cc-1bab80ea8ccf tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:14.887630 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-46647013-6813-400c-b37b-26572c0613c1 req-b1e67ae4-70fe-407c-b7cc-1bab80ea8ccf tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 944 time: 0.0539937 Nov 05 14:52:14.939804 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-46647013-6813-400c-b37b-26572c0613c1 req-1fccef2a-79fd-4e6c-8930-52812d643147 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458992 Nov 05 14:52:16.052400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63fdb760-db53-4c3d-842b-8bafbe0ddaab req-ed4d6d33-d63a-40e5-9382-129d0b4b355a tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:16.053898 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63fdb760-db53-4c3d-842b-8bafbe0ddaab req-ed4d6d33-d63a-40e5-9382-129d0b4b355a tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 944 time: 0.0479972 Nov 05 14:52:16.106262 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63fdb760-db53-4c3d-842b-8bafbe0ddaab req-c312d029-16b8-472a-bc6f-2040ce5061c0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458677 Nov 05 14:52:16.379991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:16.429914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 8ee2fdf7-0060-475b-978c-30d28e8465fd completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:52:16.434459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8ee2fdf7-0060-475b-978c-30d28e8465fd triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:16.434817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:16.514454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:16.537860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:16.540163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82d3e18e-a5e4-46be-b9af-02400e302f95" -d '{"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-plugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:16.552775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:16.558100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:16.583498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e711e08-7fbe-4a1c-a46c-5a88ecf63843 x-openstack-request-id: req-7e711e08-7fbe-4a1c-a46c-5a88ecf63843 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:16.583782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-plugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:16.584032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7e711e08-7fbe-4a1c-a46c-5a88ecf63843 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:16.584418 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'code': 200} Nov 05 14:52:16.607238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:16.747184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7770b83b-0dfe-4e8d-99d9-453d6fb7e2ae req-4e61fe37-57ff-4e9f-860c-06888189d788 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:16.748601 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7770b83b-0dfe-4e8d-99d9-453d6fb7e2ae req-4e61fe37-57ff-4e9f-860c-06888189d788 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1098 time: 0.0401108 Nov 05 14:52:16.794890 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7770b83b-0dfe-4e8d-99d9-453d6fb7e2ae req-9d5958df-b099-4a50-8606-8fd0f8358025 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384047 Nov 05 14:52:17.224500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015f8bf5-37ac-49a8-9843-909b31b84d54 req-661d5518-69c2-442a-a4d2-959107c7a7b1 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:17.225986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-015f8bf5-37ac-49a8-9843-909b31b84d54 req-661d5518-69c2-442a-a4d2-959107c7a7b1 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0530627 Nov 05 14:52:17.276323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-015f8bf5-37ac-49a8-9843-909b31b84d54 req-c1f3ea9c-baad-4940-8167-0cabe31e860e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433667 Nov 05 14:52:18.152957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:18.390282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e766126-c349-4b74-b063-cdf79c917c2b req-906f1784-4108-426b-a00f-9d7d5e5a32c2 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:18.391777 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3e766126-c349-4b74-b063-cdf79c917c2b req-906f1784-4108-426b-a00f-9d7d5e5a32c2 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0484400 Nov 05 14:52:18.446417 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3e766126-c349-4b74-b063-cdf79c917c2b req-f9f199f8-b9cd-4601-bf9f-693cb916c4eb tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481887 Nov 05 14:52:18.561660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa55bf2c-7def-4c89-954b-0cdabe91dbb9 req-5bceb395-b328-4419-9240-177799c444b3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:18.562940 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa55bf2c-7def-4c89-954b-0cdabe91dbb9 req-5bceb395-b328-4419-9240-177799c444b3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0511091 Nov 05 14:52:18.612866 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa55bf2c-7def-4c89-954b-0cdabe91dbb9 req-01b73e92-92c9-4e26-97d8-f50081f2ae0c tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436080 Nov 05 14:52:18.633899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45926) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:18.708325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f83a6d43-b70f-43df-ba00-ac9880c1dcfb tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:18.709810 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f83a6d43-b70f-43df-ba00-ac9880c1dcfb tempest-TestNetworkAdvancedServerOps-1878355859 tempest-TestNetworkAdvancedServerOps-1878355859-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1093 time: 0.0749307 Nov 05 14:52:18.712735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45930) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:18.717169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'fixed_ip_address': '172.20.0.4'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:18.740017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:18.836135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:18.939306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Allocated IP 172.26.5.253 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:19.044758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.078023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.113125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:19.115884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:19.121349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:19.147523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:19.606183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.724551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.873468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.877753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:19.945605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event updated for resources: {'Port': ['ID=0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:19.954157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:20.043165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f64506f3-a432-43ba-9269-84d71074cdd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:20.055246 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Floating IP b444ece1-e48f-4a42-9894-72dd390bc92b associated. External IP: 172.26.5.253, port: 8ee2fdf7-0060-475b-978c-30d28e8465fd. Nov 05 14:52:20.260974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:20.368448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:20.380269 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Sync routers for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:20.387640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:20.390498 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:20.391102 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:20.414708 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-30f45aab-0231-4c68-b647-8b1cad39c0df tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7009304 Nov 05 14:52:20.415278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:20.418135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-518e0655-9274-4462-bcdc-15e92581621e" -d '{"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:20.463281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9add79a8-2e2c-4c61-bc5d-1b4f93a9fdd2 x-openstack-request-id: req-9add79a8-2e2c-4c61-bc5d-1b4f93a9fdd2 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:20.463573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:20.463827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9add79a8-2e2c-4c61-bc5d-1b4f93a9fdd2 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:20.464232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'status': 'completed', 'code': 200} Nov 05 14:52:20.501924 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:20.535331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518e0655-9274-4462-bcdc-15e92581621e req-26cf146f-7f68-428e-875e-4109c2180811 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:20.537001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-26cf146f-7f68-428e-875e-4109c2180811 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2b0f272512b04566b8ddf36f25b004d1&device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1098 time: 0.0480311 Nov 05 14:52:20.537842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64e2c48-558d-46db-b07c-c25c197edf23 req-41473c95-68ee-401d-9e15-bf97d0c3fc18 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:20.539387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e64e2c48-558d-46db-b07c-c25c197edf23 req-41473c95-68ee-401d-9e15-bf97d0c3fc18 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0632164 Nov 05 14:52:20.594963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e64e2c48-558d-46db-b07c-c25c197edf23 req-71973e94-e7f5-4d20-a19e-6a5656a83d5c tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490725 Nov 05 14:52:20.618877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45936) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:20.631408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518e0655-9274-4462-bcdc-15e92581621e req-9a00179e-0de9-4cdc-bce0-cfb26119fe85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:20.633040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-9a00179e-0de9-4cdc-bce0-cfb26119fe85 service neutron] 10.222.0.32 "GET /v2.0/networks?id=89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 200 len: 897 time: 0.0871961 Nov 05 14:52:20.686200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fca73741-de31-4e26-89e5-6592848b38f9 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/floatingips/b444ece1-e48f-4a42-9894-72dd390bc92b HTTP/1.1" status: 200 len: 991 time: 0.0659156 Nov 05 14:52:20.705731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-e581df96-b71c-406d-a35d-2f9fc38a2026 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 200 len: 999 time: 0.0649557 Nov 05 14:52:20.741046 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'b444ece1-e48f-4a42-9894-72dd390bc92b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'floating_ip_address': '172.26.5.253', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1337, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'mac_address': 'fa:16:3e:2a:1d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:19Z', 'updated_at': '2021-11-05T14:52:19Z', 'revision_number': 0, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:20.756220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518e0655-9274-4462-bcdc-15e92581621e req-2f26b9ff-1d7c-4527-9cc6-f5cdb76f742d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:20.757716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-2f26b9ff-1d7c-4527-9cc6-f5cdb76f742d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7372d027-f074-48e5-b9ed-280658f34d1e HTTP/1.1" status: 200 len: 834 time: 0.0443342 Nov 05 14:52:20.766734 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Checking router: 9ef78c4d-c236-4042-9316-3b2fa973d8b3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:20.774901 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:20.775495 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:51:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:20.802676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518e0655-9274-4462-bcdc-15e92581621e req-49ec33d9-4691-4673-84dd-4c26911bf80d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:20.804098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-49ec33d9-4691-4673-84dd-4c26911bf80d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=89254426-06c9-4956-8912-99f06b3d5e5b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396373 Nov 05 14:52:20.880104 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:20.904296 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-0cbbf27b-e6d7-4c3e-8d06-5151daea1e60 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923243 Nov 05 14:52:20.996583 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-518e0655-9274-4462-bcdc-15e92581621e req-ed04246b-2da6-4de4-9dc5-44d91f5c32d1 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851853 Nov 05 14:52:21.106408 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'b444ece1-e48f-4a42-9894-72dd390bc92b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'floating_ip_address': '172.26.5.253', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1337, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'mac_address': 'fa:16:3e:2a:1d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:19Z', 'updated_at': '2021-11-05T14:52:19Z', 'revision_number': 0, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:21.134594 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae527df-bab6-4060-ba52-ba0374674b3e None None] The sync data for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv is: [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'b444ece1-e48f-4a42-9894-72dd390bc92b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'floating_ip_address': '172.26.5.253', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1337, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'mac_address': 'fa:16:3e:2a:1d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:19Z', 'updated_at': '2021-11-05T14:52:19Z', 'revision_number': 0, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:21.333191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5658a964-3c51-4d75-9e7d-acead1177db4 None None] New status for floating IP b444ece1-e48f-4a42-9894-72dd390bc92b: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:52:21.689116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45940) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:21.748173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8b95f8cc-26b5-4cbf-adde-2cf1357ae815 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/floatingips/b444ece1-e48f-4a42-9894-72dd390bc92b HTTP/1.1" status: 200 len: 993 time: 0.0578253 Nov 05 14:52:22.383777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31abc5f6-1c27-4cb5-b3fe-761047a5481f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:23.379957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:24.848517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:24.877516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45944) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:24.952066 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eb327cb1-50db-40b7-b4e2-d12c544b1c12 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/5f594617-79f7-486d-a3e2-f7687866a3d6 HTTP/1.1" status: 200 len: 992 time: 0.0733175 Nov 05 14:52:25.234117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45950) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:25.387402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port f32579d2-40f8-4877-87e8-96e62066b243 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:25.387736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.460727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.461056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.472939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for f32579d2-40f8-4877-87e8-96e62066b243 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:25.618570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.642581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=f32579d2-40f8-4877-87e8-96e62066b243,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:25.654114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.654459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.654795 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.655126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.655451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.655778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.656100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.656422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.656769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.657085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.657400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.657713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:25.714522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.714854 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 5f594617-79f7-486d-a3e2-f7687866a3d6 disassociated (deleted). External IP: 172.26.5.81, port: 6187c4a7-83b5-4932-8807-464950065f8f. Nov 05 14:52:25.888506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:25.920125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router defa989d-42e0-4df7-972d-4f912f93ce3d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:26.031073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:26.036215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:26.042318 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Sync routers for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:26.052687 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:26.053281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:26.064871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-96e25504-ffda-47dd-a149-961457eadd65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/5f594617-79f7-486d-a3e2-f7687866a3d6 HTTP/1.1" status: 204 len: 168 time: 0.8296325 Nov 05 14:52:26.065589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:26.068079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac" -d '{"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:26.114531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9396ef44-d83b-4bce-942c-e3d8d2a23cb0 x-openstack-request-id: req-9396ef44-d83b-4bce-942c-e3d8d2a23cb0 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:26.115090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "tag": "6187c4a7-83b5-4932-8807-464950065f8f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:26.115366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9396ef44-d83b-4bce-942c-e3d8d2a23cb0 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:26.115909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f', 'status': 'completed', 'code': 200} Nov 05 14:52:26.168702 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:26.197379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-755208ae-5574-439b-bce9-746d7e4e2cde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:26.199176 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-755208ae-5574-439b-bce9-746d7e4e2cde service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 1098 time: 0.0555363 Nov 05 14:52:26.349141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b0c561e-8f3d-4959-9bc4-6847eef989d8 req-8ed54a97-9df0-4b30-b1ca-238ff3f24f2a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:26.350883 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b0c561e-8f3d-4959-9bc4-6847eef989d8 req-8ed54a97-9df0-4b30-b1ca-238ff3f24f2a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.0804889 Nov 05 14:52:26.368658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-04c4dd73-c67e-4ca3-9f8c-4a209916383a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:26.370224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-04c4dd73-c67e-4ca3-9f8c-4a209916383a service neutron] 10.222.0.32 "GET /v2.0/networks?id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 200 len: 898 time: 0.1490266 Nov 05 14:52:26.387201 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:26.419884 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Checking router: defa989d-42e0-4df7-972d-4f912f93ce3d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:26.429588 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:26.430204 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:26.434527 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-4367a98b-2ccd-405f-8473-565ce28b54bd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 200 len: 217 time: 0.0533824 Nov 05 14:52:26.640588 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:26.842081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:26.846173 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b0c561e-8f3d-4959-9bc4-6847eef989d8 req-1ec0b731-6ec8-4f06-bf3c-08853ed68297 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4869258 Nov 05 14:52:26.865693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-f1aa1009-9d38-4536-9730-1bc915cc696f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:26.867148 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd9b7bd-d11f-4621-9eef-7230e365df85 None None] The sync data for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv is: [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '2e222a34-52e4-4d3c-b6bf-199a8f3fd81c', 'name': '', 'network_id': '64ec4940-bfdd-445b-8f53-bbe9cebb2ca0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:49:23:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1272, 'fixed_ips': [{'subnet_id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:34Z', 'updated_at': '2021-11-05T14:51:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '68c6fc61-cadd-441b-83cf-35abc1a4569e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:26.867372 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-f1aa1009-9d38-4536-9730-1bc915cc696f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=68c6fc61-cadd-441b-83cf-35abc1a4569e HTTP/1.1" status: 200 len: 835 time: 0.4212174 Nov 05 14:52:26.918813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-bb64b14b-1d02-4a55-9901-b55f28640fe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:26.920329 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-bb64b14b-1d02-4a55-9901-b55f28640fe1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0418169 Nov 05 14:52:27.024937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-a6d49a5d-54e8-4cd3-a98f-34fd6d4a4015 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926871 Nov 05 14:52:27.101021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-760cd379-310d-47df-87db-2f6785157e12 None None] New status for floating IP 5f594617-79f7-486d-a3e2-f7687866a3d6: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:52:27.134825 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32fd3aa-4dc6-46ad-b060-c64b8066ddac req-56ecb56c-18bb-4b08-9256-2b1ac2d499d8 service neutron] 10.222.0.32 "GET /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902061 Nov 05 14:52:27.948567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-afb51502-26c9-400d-806c-4516deee67fe tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:27.950076 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-afb51502-26c9-400d-806c-4516deee67fe tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.0503933 Nov 05 14:52:27.970411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eadca0a7-f162-4262-82f7-7b52a97ad5ba req-24b2a4b3-cbb9-45f1-9a6d-b6fcc57866a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:27.971949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eadca0a7-f162-4262-82f7-7b52a97ad5ba req-24b2a4b3-cbb9-45f1-9a6d-b6fcc57866a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=52563ed6-b90c-4570-b310-ae79efb1bff0 HTTP/1.1" status: 200 len: 945 time: 0.0550156 Nov 05 14:52:28.026617 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eadca0a7-f162-4262-82f7-7b52a97ad5ba req-ff67acaf-f711-4dad-9547-58023e764206 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=274f8d39-73c1-4a35-baa9-3fea6350753d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458019 Nov 05 14:52:28.048095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 6187c4a7-83b5-4932-8807-464950065f8f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:28.048434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:28.134656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 6187c4a7-83b5-4932-8807-464950065f8f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6187c4a7-83b5-4932-8807-464950065f8f,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:28.134936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:28.147493 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 6187c4a7-83b5-4932-8807-464950065f8f owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:28.277192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:28.310015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=6187c4a7-83b5-4932-8807-464950065f8f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:28.357470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 6187c4a7-83b5-4932-8807-464950065f8f on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:52:28.360052 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:28.363532 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e6e01d78-f2c4-4565-bf71-2cda73c21ed9 req-294b5753-deb2-4ebf-a52e-cace7fa2082f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/6187c4a7-83b5-4932-8807-464950065f8f HTTP/1.1" status: 204 len: 173 time: 0.4068024 Nov 05 14:52:28.363954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'name': 'network-vif-deleted', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:28.366355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88a19fd6-1ff9-4c02-9b02-c9418945bbbb" -d '{"events": [{"server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "name": "network-vif-deleted", "tag": "6187c4a7-83b5-4932-8807-464950065f8f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:28.405636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ecabf92-ee41-448f-a7ac-337d9272e3bb x-openstack-request-id: req-6ecabf92-ee41-448f-a7ac-337d9272e3bb {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:28.405934 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "52563ed6-b90c-4570-b310-ae79efb1bff0", "name": "network-vif-deleted", "tag": "6187c4a7-83b5-4932-8807-464950065f8f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:28.406188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6ecabf92-ee41-448f-a7ac-337d9272e3bb {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:28.406589 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '52563ed6-b90c-4570-b310-ae79efb1bff0', 'name': 'network-vif-deleted', 'tag': '6187c4a7-83b5-4932-8807-464950065f8f', 'status': 'completed', 'code': 200} Nov 05 14:52:29.081163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45964) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:29.137453 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.162569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.220125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.222921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.224049 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/274f8d39-73c1-4a35-baa9-3fea6350753d HTTP/1.1" status: 204 len: 168 time: 0.1418982 Nov 05 14:52:29.233093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa02f65e-71c9-46f2-aabe-c649e9f03f59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=274f8d39-73c1-4a35-baa9-3fea6350753d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:29.256432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45968) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:29.611918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.864651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:29.864939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.950964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:29.951321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:29.964580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:30.144288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.172076 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=2e222a34-52e4-4d3c-b6bf-199a8f3fd81c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:30.342924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.562138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router defa989d-42e0-4df7-972d-4f912f93ce3d has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:30.678341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:30.684049 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-69cb3125-a190-41bd-9b9b-d198d4d123de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/defa989d-42e0-4df7-972d-4f912f93ce3d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4265776 Nov 05 14:52:30.686827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45970) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:30.687935 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Sync routers for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:30.702220 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:30.702814 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:30.737474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet 68c6fc61-cadd-441b-83cf-35abc1a4569e {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:52:30.740568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.780141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.804106 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:30.866219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.924887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.956696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=68c6fc61-cadd-441b-83cf-35abc1a4569e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:30.960187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:30.966814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45972) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:30.967339 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ae94c71a-811d-4e08-8d3c-b58a85cc61ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/68c6fc61-cadd-441b-83cf-35abc1a4569e HTTP/1.1" status: 204 len: 168 time: 0.2790706 Nov 05 14:52:30.972567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19b04ea5-ebe6-43c8-a380-a0e70a2364ab None None] Network 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:52:30.988092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:52:30Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:31.013702 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Checking router: defa989d-42e0-4df7-972d-4f912f93ce3d for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:31.022111 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Routers {'defa989d-42e0-4df7-972d-4f912f93ce3d'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:31.022706 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['defa989d-42e0-4df7-972d-4f912f93ce3d'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:31.108213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.131180 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] Set router defa989d-42e0-4df7-972d-4f912f93ce3d gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:31.226013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.285283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port a5e7070d-a62e-4d91-8d2b-1a0aaab29007 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:31.285625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.320235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] DHCP port deletion for 64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:52:31.325447 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:52:30Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:31.358745 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb00241f-e2d3-4159-adfd-e5c8ba322df4 None None] The sync data for ids ['defa989d-42e0-4df7-972d-4f912f93ce3d'] in dv-neutron-816850-1-hyperv is: [{'id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'name': 'tempest-TestNetworkBasicOps-router-1855004553', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14'}], 'enable_snat': True}, 'gw_port_id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:52:30Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'a5e7070d-a62e-4d91-8d2b-1a0aaab29007', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:67:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defa989d-42e0-4df7-972d-4f912f93ce3d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1270, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:51:30Z', 'updated_at': '2021-11-05T14:51:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:31.373797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Deleting port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:31.374153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.386651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port a5e7070d-a62e-4d91-8d2b-1a0aaab29007, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:31.387020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.407000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for a5e7070d-a62e-4d91-8d2b-1a0aaab29007 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:31.441867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] For port 18f82970-1aa0-49be-9c4d-5a3cbbe76043, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=18f82970-1aa0-49be-9c4d-5a3cbbe76043,segment=NetworkSegment(31d54faf-467f-4166-88f4-413d4f86ed30),segment_id=31d54faf-467f-4166-88f4-413d4f86ed30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:31.442265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.456604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Calling delete_port for 18f82970-1aa0-49be-9c4d-5a3cbbe76043 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:31.538231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.562707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Pushing event deleted for resources: {'Port': ['ID=18f82970-1aa0-49be-9c4d-5a3cbbe76043,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:31.573124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.573596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.573899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.574281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.574504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.574809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.575156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.575700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.576079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.576397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.576765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.577092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.580048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ea886f4-281f-45b4-b706-22541e29a37e None None] No DVR routers for this DVR port 18f82970-1aa0-49be-9c4d-5a3cbbe76043 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:52:31.753155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 18f82970-1aa0-49be-9c4d-5a3cbbe76043 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:52:31.778702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 18f82970-1aa0-49be-9c4d-5a3cbbe76043 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:52:31.779055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 18f82970-1aa0-49be-9c4d-5a3cbbe76043 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:52:31.890980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:31.917481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=a5e7070d-a62e-4d91-8d2b-1a0aaab29007,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:31.928590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.928938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.929273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.929621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.929951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.930277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.930640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.930964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.931289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.931610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.931928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.932250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:31.991096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.084155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.086267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.130757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.131411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router defa989d-42e0-4df7-972d-4f912f93ce3d {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:52:32.138662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.139756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4f63f8ec-da7f-4d5e-b051-8638a6fabb89 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/defa989d-42e0-4df7-972d-4f912f93ce3d HTTP/1.1" status: 204 len: 168 time: 1.1716177 Nov 05 14:52:32.142394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45974) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:32.221649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.312703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.332565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['64ec4940-bfdd-445b-8f53-bbe9cebb2ca0']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:32.341360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '31d54faf-467f-4166-88f4-413d4f86ed30') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:32.341655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '31d54faf-467f-4166-88f4-413d4f86ed30') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:32.350544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.362965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.369041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 609 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:52:32.369414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:52:32.372216 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:52:32.425890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.433829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.436332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/64ec4940-bfdd-445b-8f53-bbe9cebb2ca0 HTTP/1.1" status: 204 len: 168 time: 0.2930033 Nov 05 14:52:32.437634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6187c4a7-83b5-4932-8807-464950065f8f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:52:32.447823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45976) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:32.453004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1853917614', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:32.454800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8faee6-ea0b-474c-adb2-d568bf353873 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=64ec4940-bfdd-445b-8f53-bbe9cebb2ca0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:32.476668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 6187c4a7-83b5-4932-8807-464950065f8f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:52:32.477022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6187c4a7-83b5-4932-8807-464950065f8f not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:52:32.482973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:32.486515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.510374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:52:32.521481 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.521853 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment 58d5a39f-a834-47b9-a818-d1af60e85cf9 of type vlan for network 7ea2b701-9991-42a5-8ec4-91131668ab84 Nov 05 14:52:32.567625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.597069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.603126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:32.603701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.664260 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2152967 Nov 05 14:52:32.667560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45978) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:32.671843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:32.687989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20fd8284-8dbf-4bc0-ac2c-902f746a6c57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=7ea2b701-9991-42a5-8ec4-91131668ab84,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:32.698734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:52:32.703293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.704416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.757610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:32.906921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:33.100137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:33.122136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:33.223446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.68 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/469927e4-42b2-4555-af1b-6aaa41641e1f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:33.330755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:33.342679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a5e7070d-a62e-4d91-8d2b-1a0aaab29007 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:52:33.361657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: a5e7070d-a62e-4d91-8d2b-1a0aaab29007 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:52:33.361934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a5e7070d-a62e-4d91-8d2b-1a0aaab29007 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:52:33.362338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:52:33.369262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:33.381826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:52:33.382177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2e222a34-52e4-4d3c-b6bf-199a8f3fd81c not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:52:33.408178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:33.412986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:33.416548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:33.421913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=469927e4-42b2-4555-af1b-6aaa41641e1f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:33.663503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.180115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.310084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:52:34.413598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:34.425031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:34.433641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.434783 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dc2d97fe-acf2-4a92-945f-7056337e49f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.7663171 Nov 05 14:52:34.434940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:34.435563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:34.438175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45980) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:34.471941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9880ec3e-55a9-49f6-9fa8-e0b4706bf511 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0320563 Nov 05 14:52:34.474514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45982) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:34.545221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:34.560944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-439f5766-e0c2-46ef-8f34-7b0ba077dcb8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:34.562480 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-439f5766-e0c2-46ef-8f34-7b0ba077dcb8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0870590 Nov 05 14:52:34.565365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45984) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:34.594439 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5b5fb78e-8826-4078-a6d5-00529a7c04f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0279918 Nov 05 14:52:34.598059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45986) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:34.603904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-89389174', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:34.692811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:34.696966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.722866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:33Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:34.752401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:34.752778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Updating router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 port 469927e4-42b2-4555-af1b-6aaa41641e1f binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:52:34.777970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.874292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.938557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:34.943990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:34.944323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 7ea2b701-9991-42a5-8ec4-91131668ab84, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:52:34.970102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:52:34.981399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 7ea2b701-9991-42a5-8ec4-91131668ab84) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:34.985966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:34.986723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:34.991904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cbab33a-d592-4497-adc3-a3b6ce45f3b2 None None] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:52:35.003518 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8c80b47a-8753-4684-bad3-0098405c0004 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.4042830 Nov 05 14:52:35.006423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45988) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:35.081157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.091669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3cbab33a-d592-4497-adc3-a3b6ce45f3b2 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:52:35.132371 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:52:35.151421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45af9ff9-d15b-4163-822c-b1a7b59fc0db None None] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:52:35.201916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Attempting to bind port 469927e4-42b2-4555-af1b-6aaa41641e1f on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:35.202204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Attempting to bind port 469927e4-42b2-4555-af1b-6aaa41641e1f by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:35.202572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Attempting to bind port 469927e4-42b2-4555-af1b-6aaa41641e1f on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:35.204442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd22cf41-fd76-4d8f-b85b-1aeadaf4c063 None None] Pushing event updated for resources: {'Port': ['ID=469927e4-42b2-4555-af1b-6aaa41641e1f,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:35.213614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:35.213988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:35.214399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.214785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:35.215264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Bound port: 469927e4-42b2-4555-af1b-6aaa41641e1f, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:35.215644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-45af9ff9-d15b-4163-822c-b1a7b59fc0db None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:52:35.287871 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:52:35.290106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] For port 469927e4-42b2-4555-af1b-6aaa41641e1f, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:35.293575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] For port 469927e4-42b2-4555-af1b-6aaa41641e1f, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=469927e4-42b2-4555-af1b-6aaa41641e1f,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:35.298013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.307055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e04ed060-f6f8-4768-bf93-fe61522d9c62 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:52:35.410165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:35.410776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:35.412433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd22cf41-fd76-4d8f-b85b-1aeadaf4c063 None None] Pushing event updated for resources: {'Port': ['ID=469927e4-42b2-4555-af1b-6aaa41641e1f,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:35.467555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.491158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e04ed060-f6f8-4768-bf93-fe61522d9c62 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:52:35.590182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:35.736430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (7ea2b701-9991-42a5-8ec4-91131668ab84/88b19ff2-7c4a-4a25-afa8-1ee7b614e54e/4902c44f-369d-4d4a-846e-5c30cd334507) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:35.847207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.880540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.894853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:33Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:35.922611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:35.923781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-7ea2b701-9991-42a5-8ec4-91131668ab84', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:52:35.924674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:35.928242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60e594be-195c-459d-a0a8-875f1ddefe2a None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:33Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:35.929748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:35.934246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:35.940742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:35.985755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.069645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Allocated IP 172.20.0.2 (7ea2b701-9991-42a5-8ec4-91131668ab84/88b19ff2-7c4a-4a25-afa8-1ee7b614e54e/fdd99d97-ee58-4355-8949-375d6c700936) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:36.172400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.245428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.252524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.294556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:36.297654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:36.301178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:36.319763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Pushing event updated for resources: {'Port': ['ID=fdd99d97-ee58-4355-8949-375d6c700936,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:36.371817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Attempting to bind port fdd99d97-ee58-4355-8949-375d6c700936 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:36.372181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Attempting to bind port fdd99d97-ee58-4355-8949-375d6c700936 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:36.372676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Attempting to bind port fdd99d97-ee58-4355-8949-375d6c700936 on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:36.378040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:36.378410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Checking segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:36.378934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.379354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Bound using segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:36.379913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Bound port: fdd99d97-ee58-4355-8949-375d6c700936, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:36.380214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.450077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] For port fdd99d97-ee58-4355-8949-375d6c700936, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:36.453358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] For port fdd99d97-ee58-4355-8949-375d6c700936, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=fdd99d97-ee58-4355-8949-375d6c700936,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:36.459001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.502936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.509664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.541320 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:52:36.586442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:36.588870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:36.680840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34699cc3-1013-456f-911a-b37bbff51b75 None None] Pushing event updated for resources: {'Port': ['ID=fdd99d97-ee58-4355-8949-375d6c700936,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:36.706722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:36.708359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:36.829981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:37.214895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:37.219901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6e8fabb9-9881-4a97-8871-6c5b24ea5e77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/d10e7857-3bee-4cb3-bfa7-925c1ca6eb10/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2123995 Nov 05 14:52:37.222671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 45990) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:37.413228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.413566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 469927e4-42b2-4555-af1b-6aaa41641e1f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:37.413707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.414137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.414586 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.415587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.416029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.416537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.418332 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cda9975a-a87e-4f24-ab7f-e5a3416c0660 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4969 time: 0.1946347 Nov 05 14:52:37.421214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45992) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:37.468013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 469927e4-42b2-4555-af1b-6aaa41641e1f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:37.468394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.514575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.515140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.515471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.515912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.516354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.516946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.517357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:37.519230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a276f987-3f92-4958-903d-8205db9d54a4 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4625 time: 0.0970197 Nov 05 14:52:37.522065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45994) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:37.551171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.577650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 469927e4-42b2-4555-af1b-6aaa41641e1f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=469927e4-42b2-4555-af1b-6aaa41641e1f,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:37.581830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.582615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device fdd99d97-ee58-4355-8949-375d6c700936 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:37.645494 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:37.655357 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:37.656289 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:37.663253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=469927e4-42b2-4555-af1b-6aaa41641e1f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:37.669647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port fdd99d97-ee58-4355-8949-375d6c700936 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:37.670023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.749890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.771810 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:37.774962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-707bfde1-84a9-4fa3-809c-20642380c66e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3774 time: 0.2503479 Nov 05 14:52:37.786658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port fdd99d97-ee58-4355-8949-375d6c700936, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=fdd99d97-ee58-4355-8949-375d6c700936,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:37.790268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:37.841180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=fdd99d97-ee58-4355-8949-375d6c700936,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:37.975240 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:38.088544 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:38.088902 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Updating router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 port 4902c44f-369d-4d4a-846e-5c30cd334507 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:52:38.115362 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.254398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 45998) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.259017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1736800134', 'description': 'tempest-secgroup-smoke-1736800134 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:38.294854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.373759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.379164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.386110 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.391451 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.393256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6df64fe6-9f59-47f5-87d6-762f6e84cd6d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:52:38.412268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7dafee3b-dd13-49d9-98d2-bb1412b49273,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.418028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.422358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46000) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.426974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:38.431597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-605b3f12-66cf-48ab-89ac-bc71425d690c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1760762 Nov 05 14:52:38.435839 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Pushing event updated for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.450628 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.451189 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.451970 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.452221 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.452970 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.454623 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.455284 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.455644 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.455999 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.456331 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.456696 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.457012 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:52:38.468887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.491794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-255bcb38-8d6a-42a3-aeee-c98bdbae6fd3 None None] Provisioning complete for port fdd99d97-ee58-4355-8949-375d6c700936 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:38.492317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-255bcb38-8d6a-42a3-aeee-c98bdbae6fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.523306 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Attempting to bind port 4902c44f-369d-4d4a-846e-5c30cd334507 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:38.524183 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Attempting to bind port 4902c44f-369d-4d4a-846e-5c30cd334507 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:38.524789 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Attempting to bind port 4902c44f-369d-4d4a-846e-5c30cd334507 on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:38.532275 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:38.532989 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Checking segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:38.533396 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.533792 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Bound using segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:38.534267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Bound port: 4902c44f-369d-4d4a-846e-5c30cd334507, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:38.534819 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.538019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.543042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.547475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6df64fe6-9f59-47f5-87d6-762f6e84cd6d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:52:38.565025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5dd9b08b-f719-44ba-a015-75d793a1585e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.571763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.576165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46002) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.576708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a06da8c0-8b6a-46b8-a179-6c34caac6948 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1530530 Nov 05 14:52:38.582024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:38.606338 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] For port 4902c44f-369d-4d4a-846e-5c30cd334507, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:38.610137 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] For port 4902c44f-369d-4d4a-846e-5c30cd334507, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4902c44f-369d-4d4a-846e-5c30cd334507,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:38.613970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.615082 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.676049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.681193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.693670 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c6c43b-0ae0-4088-b21f-28dbb8279b17 None None] Pushing event updated for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.699526 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:38.700345 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:38.700814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d25c57bd-218d-4e5a-843c-4813bceea206,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.710772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.712201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0258fe96-2cb0-43d8-b143-d06fb78488e7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1339190 Nov 05 14:52:38.714906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46004) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.719522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:38.746498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.807055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.811512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.826187 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:38.827219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e354f4f-209b-46c7-915a-153829c959df,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.840402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.844668 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d9ab5c3c-5805-43a3-867a-950f3278cbc6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1256781 Nov 05 14:52:38.844769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46006) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.849506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:38.879459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.940406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.946524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.967514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0fffa263-0544-436f-a90e-50c5924bff65,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:38.975090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:38.976349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-75bc7892-f964-4782-a1a5-674987defb42 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1305599 Nov 05 14:52:38.979407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46008) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:38.984688 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:39.018690 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:52:39.024629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.059582 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:39.089912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.091099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6199998-f98a-4350-add7-55c8c78350e2 None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:39.097758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.119573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6d6cffe-1a9b-4a7e-9a28-db9d460f5444,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:39.125645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.130118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:39.130296 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a520c404-58a5-4735-b918-106d4b96764b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1497746 Nov 05 14:52:39.146625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7dafee3b-dd13-49d9-98d2-bb1412b49273', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:39.177935 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:52:39.184355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.255731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.265502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.286131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f4fd7d9-5d84-47c5-83e3-df47e71f0395,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:39.297207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.298717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-62f7b7d7-f97c-45cb-93c7-c1e1545418e3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1675804 Nov 05 14:52:39.459496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 469927e4-42b2-4555-af1b-6aaa41641e1f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:39.526469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:39.526971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.583820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 469927e4-42b2-4555-af1b-6aaa41641e1f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:39.584269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.589217 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-e661a0db-f128-4c19-8411-56a5ec43e5b7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1736800134&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0677989 Nov 05 14:52:39.676017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.719640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-ed4e3cec-12a2-4406-8eb2-a6a97a93b321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:39.727767 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-ed4e3cec-12a2-4406-8eb2-a6a97a93b321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 797 time: 0.1370404 Nov 05 14:52:39.741345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] For port 4902c44f-369d-4d4a-846e-5c30cd334507, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4902c44f-369d-4d4a-846e-5c30cd334507,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:39.746968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-350e8d34-e961-4db5-89ef-8b82dae3d627 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0178320 Nov 05 14:52:39.752755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.763459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4902c44f-369d-4d4a-846e-5c30cd334507 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:39.804889 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-312fa5ba-fe2b-4077-aa00-338bae9bfc1e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0560963 Nov 05 14:52:39.825097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Provisioning complete for port fdd99d97-ee58-4355-8949-375d6c700936 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:39.825467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.880158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4048f9fd-4b61-434a-a4b9-2b1f0ee8fca2 None None] Pushing event updated for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:39.919276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:39.919751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:39.926765 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-e539c17d-03c0-4a21-898a-e6a677ee2328 service neutron] 10.222.0.30 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1059275 Nov 05 14:52:40.043936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device fdd99d97-ee58-4355-8949-375d6c700936 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:40.058572 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-ec54a671-0ae9-435b-95fe-4aa0fe63828d service neutron] 10.222.0.30 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1086493 Nov 05 14:52:40.107698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port fdd99d97-ee58-4355-8949-375d6c700936 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:40.108079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:40.133460 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1fac1444-0704-4cd6-b6d8-4094144a0f50 None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:40.133826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1fac1444-0704-4cd6-b6d8-4094144a0f50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:40.271358 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-197b2b7c-8a5a-4606-b6c3-3c716ad551af req-5404586b-5487-4b7f-9065-28375086788a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 210 time: 0.0360138 Nov 05 14:52:40.399974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9253296c-3c85-4efe-8a6c-0af0209a96d9 None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:40.400306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9253296c-3c85-4efe-8a6c-0af0209a96d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:40.608282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ba0d55fa-3313-4aac-8e64-aef1f7facaa2 None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:40.609035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ba0d55fa-3313-4aac-8e64-aef1f7facaa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.222626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-568dcc39-77ae-4073-b490-521bcd238c86 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:41.224123 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-568dcc39-77ae-4073-b490-521bcd238c86 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 797 time: 0.1103384 Nov 05 14:52:41.289569 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-0d4d4a7e-6fc6-4ad6-922a-9df3d87857c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 380 time: 0.0564651 Nov 05 14:52:41.301509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['7dafee3b-dd13-49d9-98d2-bb1412b49273']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:41.359514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4902c44f-369d-4d4a-846e-5c30cd334507 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:41.388322 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7e5039ce-89e8-4d70-a019-1e2312bf2126 req-846d91fd-fb39-4922-95ad-d0cd071fca14 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 210 time: 0.0362463 Nov 05 14:52:41.410530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4902c44f-369d-4d4a-846e-5c30cd334507 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:41.411133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.440659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:41.444444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.567171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.13 (7ea2b701-9991-42a5-8ec4-91131668ab84/88b19ff2-7c4a-4a25-afa8-1ee7b614e54e/8aeb63b2-4d73-404a-b469-f262a8c6c28c) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:41.703249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.735543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.776675 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:41.781500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:41.785159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:41.808568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:41.838103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:41.838740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:41.855247 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-a9773f9c-b494-4686-8066-b6307562a720 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5592315 Nov 05 14:52:41.869238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Request body: {'port': {'device_id': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:41.928485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.019554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0b02a936-ed2d-40c6-825e-af84814ef72d None None] Provisioning complete for port 8aeb63b2-4d73-404a-b469-f262a8c6c28c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:42.020143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0b02a936-ed2d-40c6-825e-af84814ef72d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.052080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0b02a936-ed2d-40c6-825e-af84814ef72d None None] Port 8aeb63b2-4d73-404a-b469-f262a8c6c28c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:52:42.185277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8aeb63b2-4d73-404a-b469-f262a8c6c28c {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:52:42.193002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.204566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Transition to ACTIVE for port object 8aeb63b2-4d73-404a-b469-f262a8c6c28c will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:52:42.208589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.260568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Pushing event updated for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:42.329812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Attempting to bind port 8aeb63b2-4d73-404a-b469-f262a8c6c28c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:42.330142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Attempting to bind port 8aeb63b2-4d73-404a-b469-f262a8c6c28c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:42.330471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Attempting to bind port 8aeb63b2-4d73-404a-b469-f262a8c6c28c on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:42.335157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Port 8aeb63b2-4d73-404a-b469-f262a8c6c28c on network 7ea2b701-9991-42a5-8ec4-91131668ab84 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:52:42.335472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Attempting to bind port 8aeb63b2-4d73-404a-b469-f262a8c6c28c on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:42.340677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 52, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:42.341015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Checking segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:42.341450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Bound using segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:42.341875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Bound port: 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:42.342237 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.413936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:42.418523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:42.421973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.457490 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.458113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:42.459562 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] 10.222.0.32 "PUT /v2.0/ports/8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 1094 time: 0.5952268 Nov 05 14:52:42.459927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:42.462215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6335e23f-9c1a-4c88-8296-1f0628158cba" -d '{"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:42.506547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb19e80-171b-49cb-96ce-980a419e45dd service neutron] Pushing event updated for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:42.527978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44d2fa07-cdfe-44fd-8063-2ecaedd5afd0 x-openstack-request-id: req-44d2fa07-cdfe-44fd-8063-2ecaedd5afd0 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:42.528335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:42.528646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-44d2fa07-cdfe-44fd-8063-2ecaedd5afd0 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:42.528939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'status': 'completed', 'code': 200} Nov 05 14:52:42.543962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5606a75a-52a2-4a90-ae30-e490051cfd87 req-134bd418-18fe-49ff-a556-a4dc74cd1adc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.546640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5606a75a-52a2-4a90-ae30-e490051cfd87 req-134bd418-18fe-49ff-a556-a4dc74cd1adc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 944 time: 0.0897856 Nov 05 14:52:42.571090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-e8423b96-4868-47a3-ba8d-3dd1ddd0c38a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.572735 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-e8423b96-4868-47a3-ba8d-3dd1ddd0c38a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1097 time: 0.0558240 Nov 05 14:52:42.599413 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5606a75a-52a2-4a90-ae30-e490051cfd87 req-37fcbc73-397c-4730-adbc-01d9b96eed8c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468299 Nov 05 14:52:42.622479 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-c3f36754-5b60-4ea0-88c3-470322b8ef69 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 217 time: 0.0413301 Nov 05 14:52:42.674071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-b56a49d0-2da9-4acc-9ba9-2d6289029f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.675542 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-b56a49d0-2da9-4acc-9ba9-2d6289029f73 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0453250 Nov 05 14:52:42.726790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-cbebe190-11b3-4aad-bb59-528967e5bdb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.728334 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-cbebe190-11b3-4aad-bb59-528967e5bdb4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0455565 Nov 05 14:52:42.823491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-09cfd372-aca5-4835-9ab6-1ce0e23aa08b service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856543 Nov 05 14:52:42.919643 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37fce491-8020-49d3-9d4f-b927bbf6357e req-09f1bfb6-f403-4942-b1a1-461ab12f4868 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891633 Nov 05 14:52:42.933631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97f3e96-9a99-4af6-95d1-a359cf51d192 req-2b9c16bc-a55e-492b-a2b7-484936f59bb9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:42.935216 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c97f3e96-9a99-4af6-95d1-a359cf51d192 req-2b9c16bc-a55e-492b-a2b7-484936f59bb9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0564289 Nov 05 14:52:42.987957 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c97f3e96-9a99-4af6-95d1-a359cf51d192 req-a4726aab-4480-4bea-ab62-0c3a34eeda3f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459795 Nov 05 14:52:43.010575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-5299e986-3359-43b7-a8a1-da4e771c83f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:43.012068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-5299e986-3359-43b7-a8a1-da4e771c83f5 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1097 time: 0.0439131 Nov 05 14:52:43.102542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-9609bb43-6b7b-467c-b40f-9d2f8b3992e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:43.103901 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-9609bb43-6b7b-467c-b40f-9d2f8b3992e5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0819871 Nov 05 14:52:43.149825 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-3c48d4d4-78ff-4f04-ba20-1d7717f80414 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 217 time: 0.0372672 Nov 05 14:52:43.198435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-c3a1d60d-c7e6-4c29-b321-a1a90d4fb101 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:43.199809 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-c3a1d60d-c7e6-4c29-b321-a1a90d4fb101 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0428872 Nov 05 14:52:43.249281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-88c4dd3e-6174-466a-a3d7-b881c74b6a25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:43.250781 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-88c4dd3e-6174-466a-a3d7-b881c74b6a25 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0402262 Nov 05 14:52:43.345457 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-8f81d7b8-af2e-4c8d-94e8-5b1598ee6f6a service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850403 Nov 05 14:52:43.436445 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6335e23f-9c1a-4c88-8296-1f0628158cba req-a1891d2a-b229-4c6d-9b4e-15ea0f427b0d service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826948 Nov 05 14:52:43.718917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7e3466-3c06-4b2e-acb3-fc6e6584ec0a req-162fb92c-5b02-41b2-a5bc-0083c115bcaa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:43.720296 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fb7e3466-3c06-4b2e-acb3-fc6e6584ec0a req-162fb92c-5b02-41b2-a5bc-0083c115bcaa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 944 time: 0.0491874 Nov 05 14:52:43.773315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fb7e3466-3c06-4b2e-acb3-fc6e6584ec0a req-60165e6c-0b81-45c0-8eb5-7d5eb2ee7517 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470908 Nov 05 14:52:44.099782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a58255-7875-4368-95e3-7c6fd6443598 req-df380bff-950a-4243-9163-4f24fc217953 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:44.101315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52a58255-7875-4368-95e3-7c6fd6443598 req-df380bff-950a-4243-9163-4f24fc217953 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0487092 Nov 05 14:52:44.152167 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52a58255-7875-4368-95e3-7c6fd6443598 req-4365829a-57ae-4430-bcaf-b302712037ce tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443945 Nov 05 14:52:44.467662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8aeb63b2-4d73-404a-b469-f262a8c6c28c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:52:44.565271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:44.567142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-0b127fb7-60e7-4451-b11f-6fe70a9ba3ec tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:44.568635 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-0b127fb7-60e7-4451-b11f-6fe70a9ba3ec tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 946 time: 0.0485117 Nov 05 14:52:44.578121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'port_id': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'mac_address': 'fa:16:3e:08:b9:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 606, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:52:44.614467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.627631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8aeb63b2-4d73-404a-b469-f262a8c6c28c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:52:44.646264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:44.650644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.663023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port 958cd8d3-99e2-4811-9479-162a57c857cb {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:52:44.663359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.696395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:44.749588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] For port 958cd8d3-99e2-4811-9479-162a57c857cb, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=958cd8d3-99e2-4811-9479-162a57c857cb,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:44.749872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.890755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8aeb63b2-4d73-404a-b469-f262a8c6c28c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:52:44.897304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b94a69a-c7e7-4aa5-9807-551a76356fab req-d09462e0-57d2-4896-ae65-09c66915f366 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:44.899434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9b94a69a-c7e7-4aa5-9807-551a76356fab req-d09462e0-57d2-4896-ae65-09c66915f366 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 945 time: 0.0531900 Nov 05 14:52:44.954676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9b94a69a-c7e7-4aa5-9807-551a76356fab req-e556fad2-b120-49bc-a20c-fd6e27150fbc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488472 Nov 05 14:52:44.998013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.998746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:44.998746 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP baa1f31b-d39c-407b-9a15-cc4161256e47 disassociated. External IP: 172.26.5.162, port: 958cd8d3-99e2-4811-9479-162a57c857cb. Nov 05 14:52:44.999004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for 958cd8d3-99e2-4811-9479-162a57c857cb owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:52:45.129004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:45.155742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=958cd8d3-99e2-4811-9479-162a57c857cb,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:45.613889 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-747c0f04-e24b-40b7-9020-19933fdf90f7 req-0c853111-62ec-4ea5-b1a6-c08390c5d25b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0339031 Nov 05 14:52:45.632145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:45.739045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:45.749738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:45.763343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:45.763950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:45.777926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] No DVR routers for this DVR port 958cd8d3-99e2-4811-9479-162a57c857cb on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:52:45.780316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:45.783579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e8272f52-0b54-4d2c-8349-19f7c6586e4f req-c9f3c30b-d9cc-4155-a48b-2287536274a2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "DELETE /v2.0/ports/958cd8d3-99e2-4811-9479-162a57c857cb HTTP/1.1" status: 204 len: 173 time: 1.2086916 Nov 05 14:52:45.784019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'name': 'network-vif-deleted', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:45.786311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2e7e244-3d19-4ec0-9cce-1139559154ca" -d '{"events": [{"server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "name": "network-vif-deleted", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:45.826019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f95e4708-93b8-43ed-9848-8035d134c639 x-openstack-request-id: req-f95e4708-93b8-43ed-9848-8035d134c639 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:45.826320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3505a2c4-8b2b-40f3-a1ae-9ae009751f09", "name": "network-vif-deleted", "tag": "958cd8d3-99e2-4811-9479-162a57c857cb", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:45.826590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f95e4708-93b8-43ed-9848-8035d134c639 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:45.826976 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3505a2c4-8b2b-40f3-a1ae-9ae009751f09', 'name': 'network-vif-deleted', 'tag': '958cd8d3-99e2-4811-9479-162a57c857cb', 'status': 'completed', 'code': 200} Nov 05 14:52:45.878534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:46.091567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfcc4c66-a642-464a-a871-46ffe98d6d78 req-dabac0ad-9d10-439f-aa31-5b85d53ff4f8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:46.093526 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cfcc4c66-a642-464a-a871-46ffe98d6d78 req-dabac0ad-9d10-439f-aa31-5b85d53ff4f8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 945 time: 0.0589848 Nov 05 14:52:46.152787 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cfcc4c66-a642-464a-a871-46ffe98d6d78 req-fc3fcebd-50e7-4bb3-9721-5291650e0ef9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524309 Nov 05 14:52:46.233408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:46.259426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:46.267722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:46.268324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:46.381429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:46.491025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8aeb63b2-4d73-404a-b469-f262a8c6c28c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:52:46.610557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 8aeb63b2-4d73-404a-b469-f262a8c6c28c completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:52:46.618427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8aeb63b2-4d73-404a-b469-f262a8c6c28c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:46.618803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:46.670324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:46.704373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b34155f-1077-4ad9-a86f-3e6f519e788b None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:46.724712 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c4228acb-bcf4-4411-a16f-6a46b4553950 req-8a9d5e45-342f-4396-9f7c-54c511cdd395 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0341506 Nov 05 14:52:46.748714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:46.776691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:46.779135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f9dd779-7d34-4db8-bef4-2722b7b75c20" -d '{"events": [{"server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "name": "network-vif-plugged", "status": "completed", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:46.793964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:52:46.800644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:46.801517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 958cd8d3-99e2-4811-9479-162a57c857cb no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:52:46.843281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ae5a762-6588-4fe9-a28d-dfe38ceffa8c x-openstack-request-id: req-9ae5a762-6588-4fe9-a28d-dfe38ceffa8c {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:46.843642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "name": "network-vif-plugged", "status": "completed", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:46.844029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9ae5a762-6588-4fe9-a28d-dfe38ceffa8c {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:46.844430 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'code': 200} Nov 05 14:52:46.845091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 958cd8d3-99e2-4811-9479-162a57c857cb {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:52:46.845430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 958cd8d3-99e2-4811-9479-162a57c857cb not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:52:46.876011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:47.006716 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-505a71a9-bf39-45d6-8c34-599c151d102f None None] New status for floating IP baa1f31b-d39c-407b-9a15-cc4161256e47: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:52:47.020944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d684d5d-07f1-47e5-b761-00790afbc93f req-d5091f2d-9b22-48ac-b3e7-7a4c6ace4010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:47.022450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5d684d5d-07f1-47e5-b761-00790afbc93f req-d5091f2d-9b22-48ac-b3e7-7a4c6ace4010 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1099 time: 0.0420692 Nov 05 14:52:47.069575 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5d684d5d-07f1-47e5-b761-00790afbc93f req-6bd63306-0d45-4377-bd3c-b037c04b02f2 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395675 Nov 05 14:52:47.269889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2333dae-62fb-4bc0-a37b-088e18300046 req-2ce7ddf6-515a-45e6-b80c-be3fc34f372c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:47.271438 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b2333dae-62fb-4bc0-a37b-088e18300046 req-2ce7ddf6-515a-45e6-b80c-be3fc34f372c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0491178 Nov 05 14:52:47.321147 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b2333dae-62fb-4bc0-a37b-088e18300046 req-4b7ce0a6-652b-432d-be16-cfe5a56a2de7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432472 Nov 05 14:52:47.821403 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ed6145bc-f746-49b2-9c76-f01e0d4a48f2 req-6202adcb-a487-4c0f-b452-e877acff1576 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0274034 Nov 05 14:52:48.158986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:48.439584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fa83fc-7d76-4b44-b5b3-4d02b2e5113d req-9c8f80f4-5db7-4971-8350-47ab5cfd36de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:48.441474 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3fa83fc-7d76-4b44-b5b3-4d02b2e5113d req-9c8f80f4-5db7-4971-8350-47ab5cfd36de tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0543063 Nov 05 14:52:48.499285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3fa83fc-7d76-4b44-b5b3-4d02b2e5113d req-51d4332f-54eb-40c7-b20b-717439803424 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457058 Nov 05 14:52:48.614130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d04159e-ab6e-4661-90b7-5c9f48eff170 req-d91f90c0-f696-4116-9e8e-e22141f39440 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:48.615568 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5d04159e-ab6e-4661-90b7-5c9f48eff170 req-d91f90c0-f696-4116-9e8e-e22141f39440 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0501637 Nov 05 14:52:48.669061 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5d04159e-ab6e-4661-90b7-5c9f48eff170 req-856f9477-8812-467e-9c0c-68fbdeec6967 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475390 Nov 05 14:52:48.691534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46080) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:48.731862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38d287fa-e5cb-46ec-8636-51090a90c053 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:48.733441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-38d287fa-e5cb-46ec-8636-51090a90c053 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1094 time: 0.0408812 Nov 05 14:52:48.736245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46082) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:48.740588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.13'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:48.761840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:48.862808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:48.935609 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b8a0659-823d-45ee-b6c5-f4435baad543 req-477cd907-543c-47f5-b5fc-2e015808329d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0359130 Nov 05 14:52:48.999837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.45 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b311e1de-f09a-49f2-8423-88050c310336) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:49.111803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.147339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.194889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:49.196946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=b311e1de-f09a-49f2-8423-88050c310336,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:49.200669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:49.202824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:49.563029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.642448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.800911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.805786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:49.876125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=b311e1de-f09a-49f2-8423-88050c310336,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:49.889619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:50.007054 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01 associated. External IP: 172.26.5.45, port: 8aeb63b2-4d73-404a-b469-f262a8c6c28c. Nov 05 14:52:50.047798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f37803c6-c810-4915-9c97-2a7164339574 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:50.052560 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0c0274cd-8c45-4747-9679-f18cd511da93 req-7944a48d-9328-4104-b223-b5b40430b881 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=3505a2c4-8b2b-40f3-a1ae-9ae009751f09 HTTP/1.1" status: 200 len: 210 time: 0.0296497 Nov 05 14:52:50.246316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:52:50.359070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:52:50.373249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:52:50.380912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:50.389597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:50.390316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:50.539722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:50.675041 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fdb9cad5-62ee-444c-bedd-67e0a0524060 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9376457 Nov 05 14:52:50.675679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:50.677830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46090) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:50.678026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95" -d '{"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:50.720324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98997a22-ad7b-4d17-b24f-f6aa46ea8169 x-openstack-request-id: req-98997a22-ad7b-4d17-b24f-f6aa46ea8169 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:50.721127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:50.721127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-98997a22-ad7b-4d17-b24f-f6aa46ea8169 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:50.721520 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'status': 'completed', 'code': 200} Nov 05 14:52:50.784212 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa2fe6ff-a260-4899-8b34-5757c1cba760 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 991 time: 0.1051683 Nov 05 14:52:50.799484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-8e54b236-7ed3-46ff-95e9-a56633678778 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:50.801444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-8e54b236-7ed3-46ff-95e9-a56633678778 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1099 time: 0.0526567 Nov 05 14:52:50.812911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:08:b9:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:52:49Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:50.842988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:52:50.852146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:52:50.852781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:50.893914 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-20003ca3-c80e-44a2-a5a5-18d69b41f803 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:50.895392 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-20003ca3-c80e-44a2-a5a5-18d69b41f803 service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0873086 Nov 05 14:52:50.959683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:52:50.970178 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-a24b7464-2101-4a1a-a605-6d7f3fbdf5bd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 999 time: 0.0656013 Nov 05 14:52:51.022413 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-45a47f49-d3c7-40aa-a010-3738820c11c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:51.023933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-45a47f49-d3c7-40aa-a010-3738820c11c5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0467446 Nov 05 14:52:51.071498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-359e8bd6-0c69-4e43-82b2-ffe16fc8e17d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:51.073138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-359e8bd6-0c69-4e43-82b2-ffe16fc8e17d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0416930 Nov 05 14:52:51.192532 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-8cacfc1a-3d4e-4a50-aad7-cccd44d2dbd5 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062975 Nov 05 14:52:51.217716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:08:b9:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:52:49Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:52:51.253773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1116acf8-e6aa-4d8c-b38f-f64803434f1e None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:08:b9:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:52:49Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:52:51.314602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1a21b35c-802b-44aa-8f6d-2cd64d2f0a95 req-ac27b8b6-f6af-4cbe-9e5d-825b100c8b1f service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1137221 Nov 05 14:52:51.352689 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-f6b84051-515c-432f-88ee-bf5b3e8ba3bc tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-343465885&fields=id&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 267 time: 0.0598135 Nov 05 14:52:51.464843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-52ed9027-778b-421a-81ba-87648653a6f2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:51.466369 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-52ed9027-778b-421a-81ba-87648653a6f2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.1068094 Nov 05 14:52:51.482623 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-0514316d-b667-43aa-ba63-1abcd3b7eb84 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/quotas/747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 375 time: 0.0105300 Nov 05 14:52:51.491785 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59bf2570-a14f-4939-8127-88c4a80e690d None None] New status for floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:52:51.572394 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-a058b031-a466-43f9-b774-bcd7cd741412 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0819569 Nov 05 14:52:51.672933 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-2c005e7c-6d0b-4826-8876-582363ed6773 service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891187 Nov 05 14:52:51.766338 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-a210520d-d935-479f-86f6-bd1f5ee9bfa1 service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872111 Nov 05 14:52:51.787989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46104) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:52:51.854393 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1e0b61ed-f7ca-4b80-97f0-9daee7ca62cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 993 time: 0.0651994 Nov 05 14:52:52.051499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7c76d0d1-1a75-484d-87fb-208ca70ec123 req-e73fd2db-0b50-4aea-b19f-586d50c01d29 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0298653 Nov 05 14:52:52.396782 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c75e739a-ddd1-4652-9889-99a986f1dd5b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:52.978418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-e354249f-6b1a-4a74-9f84-c900506680f1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:52.979876 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-e354249f-6b1a-4a74-9f84-c900506680f1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.1033199 Nov 05 14:52:53.050218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-1f86f5bd-a81a-439a-a81f-415908c01fd1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 379 time: 0.0561244 Nov 05 14:52:53.059355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'port': {'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'admin_state_up': True, 'tenant_id': '747df015bfd341929de773100c6c68ae', 'security_groups': ['04822744-30be-4b89-a4f8-6ca1fd516d0f']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:53.154777 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05a33539-7584-4aaa-b221-47b454c63a18 req-d176fe8a-a0b5-4741-8991-93deac4b41d7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0335677 Nov 05 14:52:53.178360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Made reservation on behalf of 747df015bfd341929de773100c6c68ae for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:52:53.182767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.314398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.20.0.12 (45055355-0dd4-4c48-858a-f131e1d1f8bc/a738c6ea-0bb8-45cf-87bb-1b3689e6e451/07a948f8-d693-4462-8a00-71b63cbd0ee0) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:52:53.381940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.456918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.491209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.545136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:52:53.549010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:53.551418 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:52:53.553461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:52:53.603214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:53.603986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.622729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-4d153db8-cc62-4a2f-b50e-c583c0513311 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5668075 Nov 05 14:52:53.637270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Request body: {'port': {'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:52:53.694470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.802327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c659a6ee-dc98-431b-ae33-817327f9a8e4 None None] Provisioning complete for port 07a948f8-d693-4462-8a00-71b63cbd0ee0 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:52:53.803345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c659a6ee-dc98-431b-ae33-817327f9a8e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.840557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c659a6ee-dc98-431b-ae33-817327f9a8e4 None None] Port 07a948f8-d693-4462-8a00-71b63cbd0ee0 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:52:53.967035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07a948f8-d693-4462-8a00-71b63cbd0ee0 {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:52:53.974385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:53.986966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Transition to ACTIVE for port object 07a948f8-d693-4462-8a00-71b63cbd0ee0 will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:52:53.992450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:54.044706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Pushing event updated for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:54.113907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Attempting to bind port 07a948f8-d693-4462-8a00-71b63cbd0ee0 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:52:54.114331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Attempting to bind port 07a948f8-d693-4462-8a00-71b63cbd0ee0 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:52:54.114725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Attempting to bind port 07a948f8-d693-4462-8a00-71b63cbd0ee0 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:54.120053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Port 07a948f8-d693-4462-8a00-71b63cbd0ee0 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:52:54.120372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Attempting to bind port 07a948f8-d693-4462-8a00-71b63cbd0ee0 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:52:54.126527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 52, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:52:54.126867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:52:54.127245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Bound using segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:52:54.127671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Bound port: 07a948f8-d693-4462-8a00-71b63cbd0ee0, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:52:54.128009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:54.196735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:52:54.200779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:52:54.208704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:54.262756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.263503 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:54.265034 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] 10.222.0.32 "PUT /v2.0/ports/07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 1094 time: 0.6327097 Nov 05 14:52:54.265637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:52:54.268019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-661483bf-ba5d-4fda-8180-a48e00e515a9" -d '{"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:52:54.344862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:52:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41cc1e9d-d23e-49b4-af41-e119de41f18c x-openstack-request-id: req-41cc1e9d-d23e-49b4-af41-e119de41f18c {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:52:54.345299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:52:54.345660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-41cc1e9d-d23e-49b4-af41-e119de41f18c {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:52:54.346152 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'status': 'completed', 'code': 200} Nov 05 14:52:54.354378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed4a5ab-4290-4ef1-bbf2-3ab38f98a48e service neutron] Pushing event updated for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:52:54.378974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824ac1d8-2697-4962-9b9c-6e991237c833 req-bed6d1e7-0c5c-447c-adcd-0117775dab0f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.380667 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-824ac1d8-2697-4962-9b9c-6e991237c833 req-bed6d1e7-0c5c-447c-adcd-0117775dab0f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.1336880 Nov 05 14:52:54.383288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-e48168ff-c020-4fa6-8e8c-7d794b92ff51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.384720 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-e48168ff-c020-4fa6-8e8c-7d794b92ff51 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1097 time: 0.0733235 Nov 05 14:52:54.441733 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6bf0b559-4582-4a0b-ac44-97b6fc7d7c46 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 217 time: 0.0477581 Nov 05 14:52:54.509542 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-824ac1d8-2697-4962-9b9c-6e991237c833 req-c8ea6942-cdc8-4d8f-87e5-0316253669d1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1222098 Nov 05 14:52:54.521008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-ac0b10eb-cfbf-4fa9-bb06-dbd7c25ee563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.522448 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-ac0b10eb-cfbf-4fa9-bb06-dbd7c25ee563 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0683856 Nov 05 14:52:54.573879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-2e3594cb-3bf9-4b27-a6fc-1ad735d383ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.575344 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-2e3594cb-3bf9-4b27-a6fc-1ad735d383ff service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0448217 Nov 05 14:52:54.672709 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-6aca76b3-9c6c-4127-a0b9-b33bce26d364 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881178 Nov 05 14:52:54.769931 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6732f791-a3b7-416d-9533-9c0edcb104b8 req-bf524eac-c9aa-4a8f-b513-07e9b74ecb98 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900335 Nov 05 14:52:54.859079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:54.869976 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-caadd72c-2a95-4eff-bf91-dbe07fa088b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.871552 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-caadd72c-2a95-4eff-bf91-dbe07fa088b2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1097 time: 0.0530064 Nov 05 14:52:54.987127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-be435c09-b423-4366-977b-a5d4ec808f21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:54.988820 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-be435c09-b423-4366-977b-a5d4ec808f21 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.1089280 Nov 05 14:52:55.051022 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-17ac6a45-fc41-4f47-80d3-b48554118cb4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 217 time: 0.0541973 Nov 05 14:52:55.144436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8730c20a-a1ff-46d2-a0c4-a75ee1d5a31d req-57e9e3ec-8f8c-49aa-8e66-cbf6a5c3d201 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:55.144852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8730c20a-a1ff-46d2-a0c4-a75ee1d5a31d req-57e9e3ec-8f8c-49aa-8e66-cbf6a5c3d201 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0979464 Nov 05 14:52:55.146683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-6448615b-913a-4a03-91c4-d088f3fb9716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:55.148001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-6448615b-913a-4a03-91c4-d088f3fb9716 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0866821 Nov 05 14:52:55.225281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-be2f37f3-4048-4c35-917a-fe90f14ac322 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:55.227404 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-be2f37f3-4048-4c35-917a-fe90f14ac322 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0689225 Nov 05 14:52:55.232927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8730c20a-a1ff-46d2-a0c4-a75ee1d5a31d req-ef02be09-e848-4b98-b1d0-f75f8b2cf81e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0816901 Nov 05 14:52:55.337347 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-92cf48ae-e4b6-4ba3-85b3-6ba9d649a79e service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0991058 Nov 05 14:52:55.438666 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-661483bf-ba5d-4fda-8180-a48e00e515a9 req-bfc23048-3ecb-4f90-b864-aa9ef09bc9b8 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907824 Nov 05 14:52:55.625530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f51d48-3cec-479a-8667-ddb767732c0b req-0d7226c5-ff59-4396-9dcd-5341f241ba01 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:55.627011 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a2f51d48-3cec-479a-8667-ddb767732c0b req-0d7226c5-ff59-4396-9dcd-5341f241ba01 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0497315 Nov 05 14:52:55.676630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a2f51d48-3cec-479a-8667-ddb767732c0b req-ecb3ca56-c046-42f7-971e-efd1a921505a tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434418 Nov 05 14:52:55.891299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:52:56.349127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab0ee93-f7d0-4400-9016-62b25ef4704f req-6f2c719b-b6fa-4393-a26f-d78dad5a5b70 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:56.350630 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fab0ee93-f7d0-4400-9016-62b25ef4704f req-6f2c719b-b6fa-4393-a26f-d78dad5a5b70 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0494723 Nov 05 14:52:56.400302 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fab0ee93-f7d0-4400-9016-62b25ef4704f req-c484c44c-5305-4a11-8e22-99bffc608e79 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430346 Nov 05 14:52:56.793451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca2649d-50df-4696-824c-e4f8cb4ca05c req-b276d005-d776-4a87-a7c4-325e49bde32f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:56.794971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ca2649d-50df-4696-824c-e4f8cb4ca05c req-b276d005-d776-4a87-a7c4-325e49bde32f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0506060 Nov 05 14:52:56.851415 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ca2649d-50df-4696-824c-e4f8cb4ca05c req-f7497a6a-6154-48ae-9dd8-fc03c26ce1d4 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501838 Nov 05 14:52:57.522073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdec03a5-4e17-4eaa-91fe-b31ff6df1ba2 req-2392044a-c6fc-4979-8092-9431749e672f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:57.523637 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdec03a5-4e17-4eaa-91fe-b31ff6df1ba2 req-2392044a-c6fc-4979-8092-9431749e672f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0541453 Nov 05 14:52:57.574618 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdec03a5-4e17-4eaa-91fe-b31ff6df1ba2 req-59f4e12b-f68a-49f3-b484-dbbbf9d15696 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438337 Nov 05 14:52:57.982105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82468af1-9683-4f82-83e2-f1b1dae74adc req-6d3a46b1-9678-4e12-99dd-109833d760ba tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:57.984228 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-82468af1-9683-4f82-83e2-f1b1dae74adc req-6d3a46b1-9678-4e12-99dd-109833d760ba tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0549860 Nov 05 14:52:58.035015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-82468af1-9683-4f82-83e2-f1b1dae74adc req-5260857f-f87f-443f-ad8e-3dcbbb80b53d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454297 Nov 05 14:52:58.688246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a27850-cc0d-49de-8cc3-2563cfb775d9 req-5731f2a0-34ec-4f76-aa7c-59d7d9cad954 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:58.689744 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18a27850-cc0d-49de-8cc3-2563cfb775d9 req-5731f2a0-34ec-4f76-aa7c-59d7d9cad954 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0483010 Nov 05 14:52:58.739385 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18a27850-cc0d-49de-8cc3-2563cfb775d9 req-dcd860fd-28f9-4bfe-aa08-c334e4360e0f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429442 Nov 05 14:52:59.148634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f40c78-e9b8-4e3b-8c77-2b4898b72573 req-7a675e20-f949-4783-aa56-9abded0639df tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:59.150106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f9f40c78-e9b8-4e3b-8c77-2b4898b72573 req-7a675e20-f949-4783-aa56-9abded0639df tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0489347 Nov 05 14:52:59.198524 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f9f40c78-e9b8-4e3b-8c77-2b4898b72573 req-f88b4b47-a44b-4267-aa3e-635e3d9ba198 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426524 Nov 05 14:52:59.855643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8923b16-3070-4043-b932-649aae777ea0 req-4e1628fa-34b3-416a-933a-6dea3fd07f69 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:52:59.857228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c8923b16-3070-4043-b932-649aae777ea0 req-4e1628fa-34b3-416a-933a-6dea3fd07f69 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0532882 Nov 05 14:52:59.905651 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c8923b16-3070-4043-b932-649aae777ea0 req-ba4c8c99-24fa-4cd7-9690-3166da3354c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426495 Nov 05 14:53:00.309649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0f3daa7-8ac2-4f0a-8390-6134185dbba5 req-d55f71d1-7484-4213-b8f3-623f749a4e95 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:00.311118 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c0f3daa7-8ac2-4f0a-8390-6134185dbba5 req-d55f71d1-7484-4213-b8f3-623f749a4e95 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0481880 Nov 05 14:53:00.362630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c0f3daa7-8ac2-4f0a-8390-6134185dbba5 req-884ed4e6-a874-4ab0-8add-d6886ae0d592 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454636 Nov 05 14:53:01.018593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f375d3-c58b-420a-a7e1-766c8dbf7cc5 req-9efb4b91-be53-4a99-b297-7c4190206283 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:01.020035 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5f375d3-c58b-420a-a7e1-766c8dbf7cc5 req-9efb4b91-be53-4a99-b297-7c4190206283 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0481248 Nov 05 14:53:01.068100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5f375d3-c58b-420a-a7e1-766c8dbf7cc5 req-1e13521b-17eb-46c5-99fe-51b5e59c97fd tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421777 Nov 05 14:53:01.482464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4efee40-6406-41c1-a324-76a4a2ce7d74 req-dc6cb2fa-c7f1-43c5-b27a-1aea75792eeb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:01.483958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b4efee40-6406-41c1-a324-76a4a2ce7d74 req-dc6cb2fa-c7f1-43c5-b27a-1aea75792eeb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0489783 Nov 05 14:53:01.534072 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b4efee40-6406-41c1-a324-76a4a2ce7d74 req-b9c1fa90-703f-4e22-93cd-89948e9f7b38 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441256 Nov 05 14:53:02.180046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baffd0bc-6cdf-42af-999f-9d2a9b2fe046 req-eebd00e9-cb0e-4b68-8fb4-79ae12e6b81e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:02.181522 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-baffd0bc-6cdf-42af-999f-9d2a9b2fe046 req-eebd00e9-cb0e-4b68-8fb4-79ae12e6b81e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0475647 Nov 05 14:53:02.233526 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-baffd0bc-6cdf-42af-999f-9d2a9b2fe046 req-0966892b-cc33-4396-9099-161791a8f8b2 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462534 Nov 05 14:53:02.646558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62cae4c1-b0f2-4be0-b5ba-a07f4c6caf7f req-c278f6a1-ce2d-4505-820f-93a41e843720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:02.648609 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-62cae4c1-b0f2-4be0-b5ba-a07f4c6caf7f req-c278f6a1-ce2d-4505-820f-93a41e843720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0485380 Nov 05 14:53:02.699311 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-62cae4c1-b0f2-4be0-b5ba-a07f4c6caf7f req-ebb96eb5-a31e-439a-ab00-6bce82554004 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447910 Nov 05 14:53:03.345071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4017120-ed33-4145-b098-56568bbf2561 req-1bf85931-4cee-48a6-8f21-a54a89479183 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:03.346546 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c4017120-ed33-4145-b098-56568bbf2561 req-1bf85931-4cee-48a6-8f21-a54a89479183 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0480008 Nov 05 14:53:03.408483 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c4017120-ed33-4145-b098-56568bbf2561 req-e73a9e0c-cee6-4d69-8b7f-35cda9eef088 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554512 Nov 05 14:53:03.828811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65152af-d7fe-485d-a32e-c3a292a8880c req-e0fac72d-fec1-4c36-aa2a-1a1334b48023 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:03.830510 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e65152af-d7fe-485d-a32e-c3a292a8880c req-e0fac72d-fec1-4c36-aa2a-1a1334b48023 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0638425 Nov 05 14:53:03.882982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e65152af-d7fe-485d-a32e-c3a292a8880c req-e667de2a-f0d0-43be-a06c-678f36f79622 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461345 Nov 05 14:53:04.525681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1dd96f-4c11-4108-a7be-bfdf72e5841d req-4042f670-2faf-4259-a70c-48d8b896cb06 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:04.527269 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5a1dd96f-4c11-4108-a7be-bfdf72e5841d req-4042f670-2faf-4259-a70c-48d8b896cb06 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0492380 Nov 05 14:53:04.577305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5a1dd96f-4c11-4108-a7be-bfdf72e5841d req-58d8fa0f-b263-4987-a5da-d945b2202a1d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432305 Nov 05 14:53:05.000292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72479121-8655-4487-93a9-036009c95bd9 req-cbac008a-ae5f-4bf2-8d43-91bcf4ff6875 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:05.001818 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-72479121-8655-4487-93a9-036009c95bd9 req-cbac008a-ae5f-4bf2-8d43-91bcf4ff6875 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0494952 Nov 05 14:53:05.051467 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-72479121-8655-4487-93a9-036009c95bd9 req-9553521b-153a-4249-afc1-d36526460dc6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432363 Nov 05 14:53:05.939629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6873314-c0d7-44e4-aa5b-532122d70ec7 req-8e5096d7-8207-4d56-b807-7ba6f664a2c0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:05.941379 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d6873314-c0d7-44e4-aa5b-532122d70ec7 req-8e5096d7-8207-4d56-b807-7ba6f664a2c0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.2975652 Nov 05 14:53:05.989907 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d6873314-c0d7-44e4-aa5b-532122d70ec7 req-44800b85-e277-408c-8c8e-b50ca31085b9 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420725 Nov 05 14:53:06.167076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b99b9d-68b7-4bc5-b54c-20d8cfe43c54 req-f9942803-3ec1-4805-b8ca-bf57ca23f929 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:06.168553 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27b99b9d-68b7-4bc5-b54c-20d8cfe43c54 req-f9942803-3ec1-4805-b8ca-bf57ca23f929 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 944 time: 0.0522909 Nov 05 14:53:06.216861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27b99b9d-68b7-4bc5-b54c-20d8cfe43c54 req-582c6c43-9cb3-467b-aade-0bfbd768fb4f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423999 Nov 05 14:53:06.581962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 07a948f8-d693-4462-8a00-71b63cbd0ee0 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:53:06.674195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:06.685919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 644, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:53:06.726161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:06.738505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07a948f8-d693-4462-8a00-71b63cbd0ee0 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:53:06.757157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:06.761429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:06.806339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:06.990411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['07a948f8-d693-4462-8a00-71b63cbd0ee0'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:53:07.104198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b931331-bf4e-471f-b024-5265c73b0e9c req-5a7f8c3f-0858-4469-8558-3e64e4eebd80 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:07.105683 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b931331-bf4e-471f-b024-5265c73b0e9c req-5a7f8c3f-0858-4469-8558-3e64e4eebd80 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0478642 Nov 05 14:53:07.153968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b931331-bf4e-471f-b024-5265c73b0e9c req-65bd5b21-5b1d-42e7-849f-3c1b0996f76e tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423322 Nov 05 14:53:07.331065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1bcd5a-dc41-4433-badd-843362c4a313 req-f5d66470-8ae9-4110-bd59-5fcfed606917 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:07.332577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4d1bcd5a-dc41-4433-badd-843362c4a313 req-f5d66470-8ae9-4110-bd59-5fcfed606917 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 945 time: 0.0493686 Nov 05 14:53:07.383107 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4d1bcd5a-dc41-4433-badd-843362c4a313 req-079a44db-19a4-4466-a72b-8ca32661f779 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441236 Nov 05 14:53:08.266658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c30e865-58ec-4896-a945-6c422dcea3ba req-d974fe63-c3f9-4264-b390-e6a8a7fd65ae tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:08.268092 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9c30e865-58ec-4896-a945-6c422dcea3ba req-d974fe63-c3f9-4264-b390-e6a8a7fd65ae tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0479376 Nov 05 14:53:08.321458 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9c30e865-58ec-4896-a945-6c422dcea3ba req-279f0a19-5b88-4fa6-b8f0-9bc8b8ca451f tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466881 Nov 05 14:53:08.498265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e67bff-8e94-413f-bc1b-247ba161e730 req-aaf4c917-b4a7-4b08-95b2-67cb9871192c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:08.499690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9e67bff-8e94-413f-bc1b-247ba161e730 req-aaf4c917-b4a7-4b08-95b2-67cb9871192c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 945 time: 0.0502830 Nov 05 14:53:08.554761 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9e67bff-8e94-413f-bc1b-247ba161e730 req-55bb8e61-db20-4e80-89d6-94ee6a8a8481 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485768 Nov 05 14:53:08.596112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 07a948f8-d693-4462-8a00-71b63cbd0ee0 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:53:08.643708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 07a948f8-d693-4462-8a00-71b63cbd0ee0 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:53:08.648248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 07a948f8-d693-4462-8a00-71b63cbd0ee0 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:53:08.648657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:08.735424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:08.756837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:08.759777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3ad3740-4a41-429d-b352-6bba368f1438" -d '{"events": [{"server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "name": "network-vif-plugged", "status": "completed", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:08.773368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:08.777500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:08.801882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b982320a-8e8b-4fed-a011-b021f25e8dbb x-openstack-request-id: req-b982320a-8e8b-4fed-a011-b021f25e8dbb {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:08.802202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "name": "network-vif-plugged", "status": "completed", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:08.802461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b982320a-8e8b-4fed-a011-b021f25e8dbb {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:08.802844 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'code': 200} Nov 05 14:53:08.827929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:08.986422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a95437-6a99-44af-87de-3b8b6be26441 req-8740219e-9201-4074-a326-32922f41c1bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:08.987925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b9a95437-6a99-44af-87de-3b8b6be26441 req-8740219e-9201-4074-a326-32922f41c1bc service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1099 time: 0.0387237 Nov 05 14:53:09.035192 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b9a95437-6a99-44af-87de-3b8b6be26441 req-36ceee1a-0b8a-4348-ab32-1ceb256ce07d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388134 Nov 05 14:53:09.436929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c90b880b-45f1-4a04-a940-022691731301 req-e3b6a565-2bf0-4f25-a3f0-296244b63850 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:09.438380 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c90b880b-45f1-4a04-a940-022691731301 req-e3b6a565-2bf0-4f25-a3f0-296244b63850 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0482943 Nov 05 14:53:09.485985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c90b880b-45f1-4a04-a940-022691731301 req-ef21ba40-2a37-4d84-af37-9bc224a122c6 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415609 Nov 05 14:53:09.668690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5842ea0a-78da-483e-8fa7-84ac84809d70 req-579877a2-02c2-4345-8954-57eb523eaee3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:09.670173 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5842ea0a-78da-483e-8fa7-84ac84809d70 req-579877a2-02c2-4345-8954-57eb523eaee3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0485120 Nov 05 14:53:09.717937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5842ea0a-78da-483e-8fa7-84ac84809d70 req-3246553c-dcc1-4063-bc14-bcf2e4aaeb92 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419865 Nov 05 14:53:10.599846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727d007a-c7b6-4894-9bcf-ec395f233701 req-c4890a89-1371-43b2-a605-4038a5346993 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:10.601999 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-727d007a-c7b6-4894-9bcf-ec395f233701 req-c4890a89-1371-43b2-a605-4038a5346993 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0493183 Nov 05 14:53:10.650364 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-727d007a-c7b6-4894-9bcf-ec395f233701 req-5925d67e-bdf6-4313-8e6a-46530fa27905 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425475 Nov 05 14:53:10.832231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f001934-7358-4344-882a-6800cc859608 req-3257a5d0-ecfd-4e4a-8f7c-7f07aa655452 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:10.833716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f001934-7358-4344-882a-6800cc859608 req-3257a5d0-ecfd-4e4a-8f7c-7f07aa655452 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0505571 Nov 05 14:53:10.880804 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f001934-7358-4344-882a-6800cc859608 req-1abaa06e-3596-4837-b73c-cd7d7b3ef7c7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405457 Nov 05 14:53:10.994226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e943db67-c62e-4e54-ada8-898d079e8e56 req-dbe3b605-bd6b-4b96-afd5-63c7ff2959ab tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:10.995669 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e943db67-c62e-4e54-ada8-898d079e8e56 req-dbe3b605-bd6b-4b96-afd5-63c7ff2959ab tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0517015 Nov 05 14:53:11.043225 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e943db67-c62e-4e54-ada8-898d079e8e56 req-3cdde116-449c-4383-84d7-5804ea70878c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415828 Nov 05 14:53:11.065376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46216) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:11.104306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23a41bee-5f14-4d1a-a0d5-430bf6373349 tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:11.105844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23a41bee-5f14-4d1a-a0d5-430bf6373349 tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1094 time: 0.0394864 Nov 05 14:53:11.108642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46218) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:11.112777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address': '172.20.0.12'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:11.136324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:11.231784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:11.330296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.26.5.101 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/4d63c552-0888-4a13-9ff9-8f64aa581a1f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:53:11.429401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:11.460966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:11.496683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:53:11.499399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:53:11.505364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:53:11.530471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=4d63c552-0888-4a13-9ff9-8f64aa581a1f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:11.887718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e2c50b-c6c3-4901-bedb-faba890d903d req-bcce7192-54d3-454f-8c96-ea07dfb90183 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:11.889224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5e2c50b-c6c3-4901-bedb-faba890d903d req-bcce7192-54d3-454f-8c96-ea07dfb90183 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.1686158 Nov 05 14:53:12.064254 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5e2c50b-c6c3-4901-bedb-faba890d903d req-f8c838c5-6c5a-4445-b21f-10676a08574d tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1640978 Nov 05 14:53:12.068016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:12.169298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:12.313713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:12.318137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:12.382985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=4d63c552-0888-4a13-9ff9-8f64aa581a1f,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:12.395544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:12.492662 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP dc53ad19-0686-4aae-b0e8-341b11ad5bd4 associated. External IP: 172.26.5.101, port: 07a948f8-d693-4462-8a00-71b63cbd0ee0. Nov 05 14:53:12.931079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:53:13.039214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:53:13.050254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:53:13.058948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:13.069495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:13.070184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:13.087930 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-36499c2a-e99c-4aab-bf02-e47981d98dd3 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9767802 Nov 05 14:53:13.088593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:13.090908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64" -d '{"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:13.129674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22a4e96f-8077-4596-8dc7-961f243da11e x-openstack-request-id: req-22a4e96f-8077-4596-8dc7-961f243da11e {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:13.130044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:13.130373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-22a4e96f-8077-4596-8dc7-961f243da11e {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:13.130856 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'status': 'completed', 'code': 200} Nov 05 14:53:13.207528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-49627f5c-a277-40b1-b837-5a19a67902aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.209677 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-49627f5c-a277-40b1-b837-5a19a67902aa service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1099 time: 0.0537481 Nov 05 14:53:13.250280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6d67b2-cc86-489d-9a4b-e30cfb1050ed req-3fb58f6c-44e0-460d-8379-745bca6a15e7 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.251918 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1d6d67b2-cc86-489d-9a4b-e30cfb1050ed req-3fb58f6c-44e0-460d-8379-745bca6a15e7 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0925560 Nov 05 14:53:13.257995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0861281-ee09-425d-a8bc-7c745aa81c92 req-2af47c51-4d70-4e44-a0db-f6f767fce37f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.259809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a0861281-ee09-425d-a8bc-7c745aa81c92 req-2af47c51-4d70-4e44-a0db-f6f767fce37f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1098 time: 0.0614984 Nov 05 14:53:13.313203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-505ad94b-9365-40d8-bab5-059e3e1981b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.314849 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-505ad94b-9365-40d8-bab5-059e3e1981b2 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.0977473 Nov 05 14:53:13.348340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1d6d67b2-cc86-489d-9a4b-e30cfb1050ed req-96c3b941-10c7-4c2b-9f31-0ea1fe85e4ea tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0872257 Nov 05 14:53:13.352279 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a0861281-ee09-425d-a8bc-7c745aa81c92 req-19204aa5-c475-4d6d-9f4f-54e9c1503ef9 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842016 Nov 05 14:53:13.368167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:13.390296 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-09960014-2ccf-4372-a3b1-788b4f9197d0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 1000 time: 0.0684714 Nov 05 14:53:13.541528 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:53:13.588123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:11Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:13.599256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-3bb12797-e8f1-40ed-abed-2b8f0aba396f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.601257 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-3bb12797-e8f1-40ed-abed-2b8f0aba396f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0484180 Nov 05 14:53:13.614509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:53:13.623475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:13.624081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:52:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:13.648259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-bdcc707d-6089-4e44-91d5-e5387c3c434f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:13.649801 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-bdcc707d-6089-4e44-91d5-e5387c3c434f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407050 Nov 05 14:53:13.736512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:13.742704 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-2cf5a18a-d647-4447-b63c-714acc986c91 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836463 Nov 05 14:53:13.843752 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4dd1c425-f82a-42ec-87cd-6bcbdd622e64 req-ad0a4ec0-dff3-4a09-a143-8435d0d751cc service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930052 Nov 05 14:53:13.959884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:11Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:13.985404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4b2b95-ed48-4ad9-8fd4-d24fd040d37b None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:11Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:53:14.173255 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9fc78a0-8191-41fb-bd6c-ce361e4e8375 None None] New status for floating IP dc53ad19-0686-4aae-b0e8-341b11ad5bd4: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:53:14.469319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863d2e63-268a-4fcb-9c1d-f0c0ab95968d req-cf8ecc4b-9843-46b0-9d59-8c71b3033da2 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:14.470807 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-863d2e63-268a-4fcb-9c1d-f0c0ab95968d req-cf8ecc4b-9843-46b0-9d59-8c71b3033da2 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0507205 Nov 05 14:53:14.522895 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-863d2e63-268a-4fcb-9c1d-f0c0ab95968d req-73a34d59-6430-4744-b144-f1ddb4fc6135 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455744 Nov 05 14:53:14.545109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46234) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:14.604939 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f48a5285-6a61-4631-b95a-7bb9528429b4 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/floatingips/b444ece1-e48f-4a42-9894-72dd390bc92b HTTP/1.1" status: 200 len: 993 time: 0.0585721 Nov 05 14:53:14.615032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:53:14.617773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:53:14.767874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:14.770041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:14.787139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'port_id': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'mac_address': 'fa:16:3e:2a:1d:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 602, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:53:14.802231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:14.804489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b40d30a-796f-44fa-807c-82fa45a01059" -d '{"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-unplugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:14.839464 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:14.841122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33917feb-7b39-4c70-935a-bf99afe534d3 x-openstack-request-id: req-33917feb-7b39-4c70-935a-bf99afe534d3 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:14.841395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-unplugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:14.841682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-33917feb-7b39-4c70-935a-bf99afe534d3 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:14.842024 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'code': 200} Nov 05 14:53:14.846006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:14.873102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:14.893276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:53:14.912997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:14.946547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:53:14.946901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:53:15.482672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:15.498187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:53:15.518748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:15.523116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:15.571196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:15.789563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8ee2fdf7-0060-475b-978c-30d28e8465fd'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:53:16.615275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:53:16.662727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8ee2fdf7-0060-475b-978c-30d28e8465fd triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:53:16.663695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:16.742020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:16.773500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:16.778011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:16.824577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:16.842731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:16.845052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e4fce96-9c6b-4c88-80f9-8bebaaca6a06" -d '{"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-plugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:16.879649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9aeb4418-a731-4cdc-b379-de51ded9fdc7 x-openstack-request-id: req-9aeb4418-a731-4cdc-b379-de51ded9fdc7 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:16.879940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-plugged", "status": "completed", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:16.880193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9aeb4418-a731-4cdc-b379-de51ded9fdc7 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:16.880648 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'code': 200} Nov 05 14:53:18.165374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:20.051176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7384697b-5ad2-487a-a40f-e279aa5039b3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:22.391296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e24b7f21-328d-46f6-b3b6-b3c57ed2eb24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:23.386021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:24.853740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:25.893275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:26.902001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:26.975775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14248174-dca9-4045-bb37-aa8620b4b993 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:26.976239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14248174-dca9-4045-bb37-aa8620b4b993 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:26.976727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14248174-dca9-4045-bb37-aa8620b4b993 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:26.978385 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-14248174-dca9-4045-bb37-aa8620b4b993 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?project_id=2691099d79834234a0e6e846d81eed9c&network_id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 3000 time: 0.0753667 Nov 05 14:53:29.542068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46260) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:29.596033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-105e731f-2120-4af4-9831-dd49880176aa tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:29.597459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-105e731f-2120-4af4-9831-dd49880176aa tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 HTTP/1.1" status: 200 len: 814 time: 0.0543852 Nov 05 14:53:30.565641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46266) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:30.571047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'port_id': None}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:30.625366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:30.776763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:30.780071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:30.780410 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01 disassociated. External IP: 172.26.5.45, port: 8aeb63b2-4d73-404a-b469-f262a8c6c28c. Nov 05 14:53:30.983658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:53:31.091843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:53:31.096898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:31.102360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:53:31.112785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:31.113392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:31.125792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6408506d-ac11-4705-a79d-08c3ca1db5ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 689 time: 0.5589795 Nov 05 14:53:31.126396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:31.128671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79b60673-688f-448d-840a-bacf8135791e" -d '{"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:31.128844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46268) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:31.167476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54569a44-a0f3-430e-921b-9b39e01b9d45 x-openstack-request-id: req-54569a44-a0f3-430e-921b-9b39e01b9d45 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:31.167778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:31.168043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-54569a44-a0f3-430e-921b-9b39e01b9d45 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:31.168447 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'status': 'completed', 'code': 200} Nov 05 14:53:31.181368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0297e027-58b6-4f08-8036-364ae6f8b3ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 689 time: 0.0512505 Nov 05 14:53:31.222068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:31.233489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b60673-688f-448d-840a-bacf8135791e req-59dc73be-d3a4-4157-9eef-ec41af1067ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:31.235108 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-59dc73be-d3a4-4157-9eef-ec41af1067ed service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1099 time: 0.0407414 Nov 05 14:53:31.329889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b60673-688f-448d-840a-bacf8135791e req-ce43f78f-a307-4307-b4d1-16e6c6256013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:31.331386 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-ce43f78f-a307-4307-b4d1-16e6c6256013 service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0874529 Nov 05 14:53:31.378266 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-6db9bdd0-365c-4284-b6a6-7584b6c8dc7b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 217 time: 0.0388889 Nov 05 14:53:31.425686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:31.432145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b60673-688f-448d-840a-bacf8135791e req-6e1ab83b-c484-4d24-a171-9ee1a278c29e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:31.433655 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-6e1ab83b-c484-4d24-a171-9ee1a278c29e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0454388 Nov 05 14:53:31.454242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:53:31.462877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:31.463474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:31.483173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b60673-688f-448d-840a-bacf8135791e req-b367d205-b2ca-45ab-a042-493d2fb5a474 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:31.484777 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-b367d205-b2ca-45ab-a042-493d2fb5a474 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0434623 Nov 05 14:53:31.577456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:31.587015 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-e50f0484-3e0d-4597-ab8a-1563d96bbeb3 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938342 Nov 05 14:53:31.684270 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-79b60673-688f-448d-840a-bacf8135791e req-cc3c343c-2d61-4676-a055-d6ad2acd024a service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857685 Nov 05 14:53:31.912334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:31.941626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c65c97-e07e-4f39-aa24-c9daab9b0af9 None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:53:32.161888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d252f689-1162-4bb2-a07e-042d472fa2e5 None None] New status for floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:53:32.183468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46272) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:32.233787 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8ca28eb6-a888-4100-a15f-978f1a9d29d4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 689 time: 0.0489850 Nov 05 14:53:33.237506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46274) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:33.281488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fd969636-7038-48cd-8d4c-041066220d5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 687 time: 0.0428605 Nov 05 14:53:34.470415 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:34.475562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1040737229', 'description': 'tempest-secgroup-smoke-1040737229 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:34.498863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.567453 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.571532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.603518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.604744 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1333091 Nov 05 14:53:34.607953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46282) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:34.608710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:34.612801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:34.616170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.616540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.616882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.617218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.617571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.617873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.618197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.618521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.618845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.619166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.619486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.619803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adda647f-0400-4fe4-9e82-e6faae87945e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.640922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.696208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.699937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.717379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6d340c99-e2da-4639-a0e2-6efea914234d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:34.728422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.729742 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1207349 Nov 05 14:53:34.730986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.731327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.731712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.731998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.732400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.732672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.732901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46284) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:34.733168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.733566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.733895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.734239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.734545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.734865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea89d7c9-1a9e-4cb3-9fa5-69bcb771f277 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:34.737678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:34.765468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.820975 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.824523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.841335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a00fb6c9-5588-46bb-9b3f-b20313491aa5,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:34.851075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.852261 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85d575fe-b24b-4e38-a634-aba2d47b4ebb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1185310 Nov 05 14:53:34.855011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46286) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:34.859372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:34.884902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.941519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.945593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.962393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a4f60e69-031e-45de-83f6-188ebf774bd2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:34.970289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:34.971810 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-10cab08a-7441-4ef7-828c-1973f5546e2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1155150 Nov 05 14:53:34.974215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46288) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:34.978580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:35.002915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.058381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.061699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.080113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d63d9f0e-ed5e-4b40-a49b-ba11072493e5,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:35.087336 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.088400 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-22451e5b-feba-45ef-bf66-3c0cfbedc848 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1132157 Nov 05 14:53:35.091434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46290) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:35.095955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:35.117605 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:53:35.122281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.182448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.185807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.203958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2200b833-e3ac-4f3c-ac08-7936dd3ec98b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:35.209596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.211380 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a39f1918-c58d-441d-9a24-14e4da7eb534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1190248 Nov 05 14:53:35.213999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46292) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:35.218437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'c97b8ebe-a1e7-452e-b68f-b57df7a63c5a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:35.239826 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:53:35.245126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.304992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.309141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.329916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f367609b-6878-4692-8fc4-fd483faba4bb,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:35.334672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:35.343757 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d6c3fe65-2c8b-4eec-ade3-6bb478ac9b2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1208377 Nov 05 14:53:35.487916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-a264780a-d6cf-4f04-b19f-80be19a70f25 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1040737229&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0445669 Nov 05 14:53:35.602033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-d28af9d2-083f-49e8-809e-125f03720459 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:35.603414 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-d28af9d2-083f-49e8-809e-125f03720459 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 797 time: 0.1082926 Nov 05 14:53:35.620778 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-aaf6d109-cb09-4ab1-8506-7ac955de8723 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0116134 Nov 05 14:53:35.682762 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-89afa4d0-1c75-47e1-b5c2-209abfefae72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0557876 Nov 05 14:53:35.787545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-4e396f28-7fda-45db-acf0-26a87c01e933 service neutron] 10.222.0.30 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847681 Nov 05 14:53:35.875922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-67450a8e-874e-46e4-a437-245cfa535737 service neutron] 10.222.0.30 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821795 Nov 05 14:53:36.035495 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-443ff360-9f29-40f0-966a-1763404cab44 req-de731c6b-9c87-43a9-bb64-9f7727df7b4d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 210 time: 0.0278590 Nov 05 14:53:37.044244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-4178062b-1bff-452e-b0d6-a5518e07e524 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:37.046070 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-4178062b-1bff-452e-b0d6-a5518e07e524 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 797 time: 0.1087928 Nov 05 14:53:37.144474 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-c01cf2ad-9e6a-45ed-ae8c-cb3abd69abf9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 473 time: 0.0879040 Nov 05 14:53:37.160014 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-05386899-729b-409d-8296-433471ac8279 req-21f10af1-6d5a-465f-9808-07ff7b8be0cf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 210 time: 0.0451221 Nov 05 14:53:37.163903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['c97b8ebe-a1e7-452e-b68f-b57df7a63c5a']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:37.270642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:53:37.274345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.400775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.6 (7ea2b701-9991-42a5-8ec4-91131668ab84/88b19ff2-7c4a-4a25-afa8-1ee7b614e54e/2a7a7637-5241-4070-9ec4-38e10c180dae) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:53:37.545404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.580930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.627857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:53:37.632786 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:53:37.635430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:53:37.666162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:37.701097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:37.701936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.719739 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-2aa02434-8c1c-490e-b75e-ded42fbf746b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5618210 Nov 05 14:53:37.733277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Request body: {'port': {'device_id': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:37.801762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.897939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-11f9c962-6a91-457b-adbf-e5a475085993 None None] Provisioning complete for port 2a7a7637-5241-4070-9ec4-38e10c180dae triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:53:37.899024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-11f9c962-6a91-457b-adbf-e5a475085993 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:37.935487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-11f9c962-6a91-457b-adbf-e5a475085993 None None] Port 2a7a7637-5241-4070-9ec4-38e10c180dae cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:53:38.080025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2a7a7637-5241-4070-9ec4-38e10c180dae {{(pid=113581) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:53:38.087989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:38.099462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.provisioning_blocks [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Transition to ACTIVE for port object 2a7a7637-5241-4070-9ec4-38e10c180dae will not be triggered until provisioned by entity L2. {{(pid=113581) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:53:38.103255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:38.153813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Pushing event updated for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:38.226954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Attempting to bind port 2a7a7637-5241-4070-9ec4-38e10c180dae on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:53:38.227288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Attempting to bind port 2a7a7637-5241-4070-9ec4-38e10c180dae by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:53:38.227624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Attempting to bind port 2a7a7637-5241-4070-9ec4-38e10c180dae on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:53:38.232378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Port 2a7a7637-5241-4070-9ec4-38e10c180dae on network 7ea2b701-9991-42a5-8ec4-91131668ab84 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:53:38.232899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Attempting to bind port 2a7a7637-5241-4070-9ec4-38e10c180dae on network 7ea2b701-9991-42a5-8ec4-91131668ab84 {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:53:38.238083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 53, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:53:38.238423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Checking segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:53:38.238808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Bound using segment: {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'} {{(pid=113581) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:53:38.239238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.managers [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Bound port: 2a7a7637-5241-4070-9ec4-38e10c180dae, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '58d5a39f-a834-47b9-a818-d1af60e85cf9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84'}}] {{(pid=113581) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:53:38.239597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:38.282036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0112338-8129-4e23-9fc3-92a064cc4a5b req-dd03300d-7487-4d3e-85ad-6b580dee48f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.284409 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d0112338-8129-4e23-9fc3-92a064cc4a5b req-dd03300d-7487-4d3e-85ad-6b580dee48f2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 943 time: 0.0514750 Nov 05 14:53:38.307639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:53:38.311476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2a7a7637-5241-4070-9ec4-38e10c180dae,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113581) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:53:38.316378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:38.351607 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d0112338-8129-4e23-9fc3-92a064cc4a5b req-cab4032e-3711-4cf3-96f7-5bce580167dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591335 Nov 05 14:53:38.374884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.375473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:38.377058 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-1a9e271d-fa27-465e-a274-172803182fec service neutron] 10.222.0.32 "PUT /v2.0/ports/2a7a7637-5241-4070-9ec4-38e10c180dae HTTP/1.1" status: 200 len: 1093 time: 0.6483223 Nov 05 14:53:38.379562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:38.383529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4" -d '{"events": [{"name": "network-changed", "server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:38.404962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a9e271d-fa27-465e-a274-172803182fec service neutron] Pushing event updated for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=3']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:38.454036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52011b50-2ac1-4001-b9a4-d1d1f3df2855 x-openstack-request-id: req-52011b50-2ac1-4001-b9a4-d1d1f3df2855 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:38.454421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:38.454685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-52011b50-2ac1-4001-b9a4-d1d1f3df2855 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:38.455116 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'status': 'completed', 'code': 200} Nov 05 14:53:38.490702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-00c30d48-a273-4baa-b8f0-a859dbdfd431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.492223 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-00c30d48-a273-4baa-b8f0-a859dbdfd431 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 1096 time: 0.0502074 Nov 05 14:53:38.540955 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-fd61ade8-a452-46b9-8ca1-03fe0325cf7a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2a7a7637-5241-4070-9ec4-38e10c180dae HTTP/1.1" status: 200 len: 217 time: 0.0359528 Nov 05 14:53:38.591260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-8d08787d-11ef-4e24-8b3e-1d3a2c1ce313 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.592745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-8d08787d-11ef-4e24-8b3e-1d3a2c1ce313 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0447783 Nov 05 14:53:38.642365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-d693bea7-d2ba-4dd0-86b1-14ed33029a5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.643766 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-d693bea7-d2ba-4dd0-86b1-14ed33029a5a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0432725 Nov 05 14:53:38.737021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-c021054c-de6d-4776-93e8-a1a9812173aa service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850062 Nov 05 14:53:38.831708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0a7e1eb-2c1c-4afc-92df-da23d0d3d222 req-e8aaf06d-8584-4b94-a5b6-fb0ca73be541 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875483 Nov 05 14:53:38.919136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-45dee5d5-ea94-4edb-b4ee-07449e6c2c20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:38.920640 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-45dee5d5-ea94-4edb-b4ee-07449e6c2c20 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 1096 time: 0.0409551 Nov 05 14:53:39.015992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-7dc8b8b3-d802-48e8-a967-d69e7c46707b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:39.017538 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-7dc8b8b3-d802-48e8-a967-d69e7c46707b service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0851254 Nov 05 14:53:39.066376 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-bee273e5-1ba6-4f43-93a1-770bb5cbd18d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2a7a7637-5241-4070-9ec4-38e10c180dae HTTP/1.1" status: 200 len: 217 time: 0.0402498 Nov 05 14:53:39.115034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-983cd2f2-0346-4102-a5f3-2d6983cb525d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:39.116354 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-983cd2f2-0346-4102-a5f3-2d6983cb525d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0425994 Nov 05 14:53:39.163195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-877c2d57-9786-4b0d-b154-d14a3f317bde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:39.164659 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-877c2d57-9786-4b0d-b154-d14a3f317bde service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0392852 Nov 05 14:53:39.258090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-853a7371-b002-47ce-a9f9-d58d9ae149c6 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831022 Nov 05 14:53:39.350591 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ddcffb10-eac0-4a77-9a13-79228d1bcfa4 req-befd3dce-20c5-43c4-90a6-71403603c87f service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846531 Nov 05 14:53:39.462786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c80be2f-5681-4e6d-bd5e-73ee6bff6fff req-a8ae4684-baf6-403b-9a3a-1f4e8258bcf0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:39.464526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7c80be2f-5681-4e6d-bd5e-73ee6bff6fff req-a8ae4684-baf6-403b-9a3a-1f4e8258bcf0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 943 time: 0.0482495 Nov 05 14:53:39.514507 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7c80be2f-5681-4e6d-bd5e-73ee6bff6fff req-d23a751e-be2b-4ab7-8145-fc18f3f756d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440533 Nov 05 14:53:40.630239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19cecb49-c620-47cd-ad15-76f1726d7544 req-88de9d42-99a2-48e2-a939-9f0002185a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:40.631725 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-19cecb49-c620-47cd-ad15-76f1726d7544 req-88de9d42-99a2-48e2-a939-9f0002185a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 943 time: 0.0495858 Nov 05 14:53:40.684584 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-19cecb49-c620-47cd-ad15-76f1726d7544 req-90895961-846d-43d5-8c21-445e60dc0feb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469289 Nov 05 14:53:40.735722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2a7a7637-5241-4070-9ec4-38e10c180dae details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:53:40.829382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2a7a7637-5241-4070-9ec4-38e10c180dae,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:40.840939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'port_id': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'mac_address': 'fa:16:3e:d2:3f:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 606, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:53:40.876204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:40.892299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2a7a7637-5241-4070-9ec4-38e10c180dae {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:53:40.911060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2a7a7637-5241-4070-9ec4-38e10c180dae,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:40.914950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:40.960848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:40.967523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.967872 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.968212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.968571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.968916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.969235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.969563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.969888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.970212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.970536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.970856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:40.971164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:53:41.153833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['2a7a7637-5241-4070-9ec4-38e10c180dae'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:53:41.797302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7590763b-5f50-4799-8327-84f5e5118f0a req-e4820d36-e988-413a-bb55-999d81f8aab6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:41.798692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7590763b-5f50-4799-8327-84f5e5118f0a req-e4820d36-e988-413a-bb55-999d81f8aab6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 944 time: 0.0479136 Nov 05 14:53:41.851514 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7590763b-5f50-4799-8327-84f5e5118f0a req-7a1965a7-5d83-45ea-b7c2-d7818d28802b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421481 Nov 05 14:53:42.776774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2a7a7637-5241-4070-9ec4-38e10c180dae up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:53:42.823578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 2a7a7637-5241-4070-9ec4-38e10c180dae completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:53:42.827223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 2a7a7637-5241-4070-9ec4-38e10c180dae triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:53:42.827588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:42.906866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:42.930580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:42.932986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc0c45e4-28da-4278-85fa-40027cf25d69" -d '{"events": [{"server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "name": "network-vif-plugged", "status": "completed", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:42.946784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2a7a7637-5241-4070-9ec4-38e10c180dae,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:42.951129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:42.972144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dd91e5-de86-4e8e-91f2-35d34a0e1ce5 req-b16ee7e8-72c3-4e53-bbba-612918e4aa32 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:42.973734 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41dd91e5-de86-4e8e-91f2-35d34a0e1ce5 req-b16ee7e8-72c3-4e53-bbba-612918e4aa32 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 944 time: 0.0580418 Nov 05 14:53:42.974827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59859d0e-9f7e-46f1-aa9e-87055c3c0290 x-openstack-request-id: req-59859d0e-9f7e-46f1-aa9e-87055c3c0290 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:42.975119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "name": "network-vif-plugged", "status": "completed", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:42.975368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-59859d0e-9f7e-46f1-aa9e-87055c3c0290 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:42.975751 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'code': 200} Nov 05 14:53:43.003622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:43.035770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41dd91e5-de86-4e8e-91f2-35d34a0e1ce5 req-9ef2c3d2-e3d1-498b-97aa-f65c752ed389 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541546 Nov 05 14:53:43.138422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83075aa7-a8a2-41d6-8347-1f0955399fd6 req-b04a81e2-313b-40d7-b10d-f9e5855b2026 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:43.139883 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-83075aa7-a8a2-41d6-8347-1f0955399fd6 req-b04a81e2-313b-40d7-b10d-f9e5855b2026 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 1098 time: 0.0392849 Nov 05 14:53:43.185547 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-83075aa7-a8a2-41d6-8347-1f0955399fd6 req-ee1178e8-caf8-46b5-8ea8-a94fcad3aeba service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385892 Nov 05 14:53:44.153492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565170ec-16e4-40b7-84aa-3bcae0e7681b req-bb07ea83-b50b-43be-abb4-cb8968455426 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:44.154946 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-565170ec-16e4-40b7-84aa-3bcae0e7681b req-bb07ea83-b50b-43be-abb4-cb8968455426 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0512300 Nov 05 14:53:44.203082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-565170ec-16e4-40b7-84aa-3bcae0e7681b req-28d9c16f-e83d-496c-8c37-45b71b50d87f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422525 Nov 05 14:53:45.319053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9d8056-e45e-400d-926a-69c38172502e req-ada3e4e0-7f1a-4002-8816-6c62f4b54ff5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:45.320517 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3c9d8056-e45e-400d-926a-69c38172502e req-ada3e4e0-7f1a-4002-8816-6c62f4b54ff5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0518029 Nov 05 14:53:45.367827 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3c9d8056-e45e-400d-926a-69c38172502e req-e27a79c4-06b7-4f59-a78c-eb6cb742e1c6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414739 Nov 05 14:53:45.480596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fc6c3-62f1-4b80-9abe-bb9ee388f7cc req-2269dbc5-d5db-443b-aad9-858e1c584759 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:45.482001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7b0fc6c3-62f1-4b80-9abe-bb9ee388f7cc req-2269dbc5-d5db-443b-aad9-858e1c584759 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0479758 Nov 05 14:53:45.531500 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7b0fc6c3-62f1-4b80-9abe-bb9ee388f7cc req-782a5175-f6e2-4a53-a26a-9974b2c336d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436101 Nov 05 14:53:45.553815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46350) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:45.596588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fdb470f-0b01-4e9b-bec7-d6625eee99f5 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:45.598078 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5fdb470f-0b01-4e9b-bec7-d6625eee99f5 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 1093 time: 0.0433047 Nov 05 14:53:45.600999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46352) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:45.605327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'port_id': '2a7a7637-5241-4070-9ec4-38e10c180dae'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:53:45.643685 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:46.330221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:46.334424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:46.430880 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01 associated. External IP: 172.26.5.45, port: 2a7a7637-5241-4070-9ec4-38e10c180dae. Nov 05 14:53:46.629909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:53:46.734263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:53:46.739273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:46.744302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:53:46.753155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:46.753749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:46.768312 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53e20d23-f9b5-44e5-b88e-a0b2e39e1890 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 990 time: 1.1662769 Nov 05 14:53:46.768927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:46.771196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11ec9ce5-82fa-4f85-8002-e406514c98f7" -d '{"events": [{"name": "network-changed", "server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:46.772059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46354) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:46.810008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9961542e-b4ea-4df4-ab7a-88f83581aab8 x-openstack-request-id: req-9961542e-b4ea-4df4-ab7a-88f83581aab8 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:46.810301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:46.810549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9961542e-b4ea-4df4-ab7a-88f83581aab8 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:46.810947 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'status': 'completed', 'code': 200} Nov 05 14:53:46.837454 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0d15dde5-93a3-49d3-897b-3c260cdee835 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 990 time: 0.0624566 Nov 05 14:53:46.861566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:46.872965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-cad3f5ee-8a1a-4d40-ad39-8c12dd737de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:46.874557 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-cad3f5ee-8a1a-4d40-ad39-8c12dd737de3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 1098 time: 0.0407219 Nov 05 14:53:46.963123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-c1be5bde-91c3-47ee-8db1-3fe15669924d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:46.964602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-c1be5bde-91c3-47ee-8db1-3fe15669924d service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0826178 Nov 05 14:53:47.035305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-cd1191b1-7f54-4982-a69f-1656376faf52 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2a7a7637-5241-4070-9ec4-38e10c180dae HTTP/1.1" status: 200 len: 998 time: 0.0631022 Nov 05 14:53:47.090704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-4df1e1ce-99c3-4e3d-8623-139c0b0b37da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:47.091051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:d2:3f:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:53:46Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:47.092169 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-4df1e1ce-99c3-4e3d-8623-139c0b0b37da service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0499895 Nov 05 14:53:47.118816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:53:47.127367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:47.127968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:47.138402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-71cb2d73-616d-440f-b7a3-a2dc3bdc9505 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:47.139896 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-71cb2d73-616d-440f-b7a3-a2dc3bdc9505 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0406914 Nov 05 14:53:47.232866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:47.233158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-f26c14ed-3aa9-4897-b9cd-71ca46d37ba4 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859067 Nov 05 14:53:47.324049 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11ec9ce5-82fa-4f85-8002-e406514c98f7 req-aebcadca-7388-40db-b8a2-a114b9fd006d service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839057 Nov 05 14:53:47.455701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:d2:3f:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:53:46Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:47.481361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4434e03-936b-43a8-bd05-8d6a5e609208 None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '04a222d3-fb07-4bdb-a23a-625c14e3eb01', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.45', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'port_id': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 1356, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'mac_address': 'fa:16:3e:d2:3f:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:52:49Z', 'updated_at': '2021-11-05T14:53:46Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:53:47.667599 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de35c249-163a-4064-8851-621c43371a10 None None] New status for floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:53:47.840266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46360) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:47.902850 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-091d7bb5-ee2e-446c-aff6-2f4981eafe5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 200 len: 992 time: 0.0614188 Nov 05 14:53:48.167800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:50.056682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40070f6e-c520-4f03-b253-f90e5b80523f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:50.542092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:53:51.687857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46366) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:51.852023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Deleting port 0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:53:51.852358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:51.929842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:51.930171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:51.941883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Calling delete_port for 0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:53:52.086800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:52.112327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Port': ['ID=0e48c863-9ff4-4bc9-9b6f-c537ebb1d1b0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:52.171377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:52.171678 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Floating IP b444ece1-e48f-4a42-9894-72dd390bc92b disassociated (deleted). External IP: 172.26.5.253, port: 8ee2fdf7-0060-475b-978c-30d28e8465fd. Nov 05 14:53:52.381868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:53:52.391779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f19e9c76-2d2c-45ef-9fd1-ea73496e2334 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:52.496845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:53:52.501365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:52.506933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Sync routers for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:53:52.516768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:52.517367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:52.528451 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ed23c9ac-a995-4ec1-b49b-03d6c748e81b tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "DELETE /v2.0/floatingips/b444ece1-e48f-4a42-9894-72dd390bc92b HTTP/1.1" status: 204 len: 168 time: 0.8395102 Nov 05 14:53:52.529153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:52.531582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abe09fe3-10b5-4787-ae98-44ce6c33984c" -d '{"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:52.579664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b07e8e44-6d7e-461e-b5c2-bcfce9eda6a3 x-openstack-request-id: req-b07e8e44-6d7e-461e-b5c2-bcfce9eda6a3 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:52.579966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:52.580223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b07e8e44-6d7e-461e-b5c2-bcfce9eda6a3 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:52.580679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'status': 'completed', 'code': 200} Nov 05 14:53:52.632236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:52.658712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-f11df068-c739-4b48-8421-b5b3b88b5948 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:52.660416 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-f11df068-c739-4b48-8421-b5b3b88b5948 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2b0f272512b04566b8ddf36f25b004d1&device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 1098 time: 0.0553291 Nov 05 14:53:52.780712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-5d38f245-64bd-43f0-a66f-bc117ae7cb0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:52.782287 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-5d38f245-64bd-43f0-a66f-bc117ae7cb0b service neutron] 10.222.0.32 "GET /v2.0/networks?id=89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 200 len: 897 time: 0.1148779 Nov 05 14:53:52.831151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126ec58e-8d01-47c7-aafe-a860fcceb4ef req-cc2c7911-484c-4c29-a1d7-861948872e58 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:52.833794 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-1eed2903-05ca-4f34-b6c6-61550a91ba44 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 200 len: 217 time: 0.0423892 Nov 05 14:53:52.839940 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-126ec58e-8d01-47c7-aafe-a860fcceb4ef req-cc2c7911-484c-4c29-a1d7-861948872e58 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0639660 Nov 05 14:53:52.856312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:52.882600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Checking router: 9ef78c4d-c236-4042-9316-3b2fa973d8b3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:53:52.891180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:52.892002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:52.900195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-da57264f-0607-4cca-8b11-1d274e349da5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:52.902170 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-da57264f-0607-4cca-8b11-1d274e349da5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7372d027-f074-48e5-b9ed-280658f34d1e HTTP/1.1" status: 200 len: 834 time: 0.0596206 Nov 05 14:53:52.905125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-126ec58e-8d01-47c7-aafe-a860fcceb4ef req-25915f8c-871a-4450-a389-d200deef66b5 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638478 Nov 05 14:53:52.954217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-61bf139d-f340-4d42-88c7-73666e9f1dc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:52.955770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-61bf139d-f340-4d42-88c7-73666e9f1dc5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=89254426-06c9-4956-8912-99f06b3d5e5b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0446005 Nov 05 14:53:53.012290 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:53.049740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-522fe1eb-cccf-469f-95ae-d3d2917cc784 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866251 Nov 05 14:53:53.143723 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-abe09fe3-10b5-4787-ae98-44ce6c33984c req-d8a983d2-3876-440c-bd4c-a70d8b34f3e4 service neutron] 10.222.0.32 "GET /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864594 Nov 05 14:53:53.214373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:53.243820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7227767-502a-457d-9fb7-3062642e5f7a None None] The sync data for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv is: [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:06Z', 'revision_number': 4, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'aaef3cca-d268-4060-8b42-9d6a2f26db83', 'name': '', 'network_id': '89254426-06c9-4956-8912-99f06b3d5e5b', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'mac_address': 'fa:16:3e:67:64:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1334, 'fixed_ips': [{'subnet_id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:05Z', 'updated_at': '2021-11-05T14:52:09Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'subnets': [{'id': '7372d027-f074-48e5-b9ed-280658f34d1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:53:53.388514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:53.450165 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b044847d-57ce-4fd8-97bc-f4eaedff6bcd None None] New status for floating IP b444ece1-e48f-4a42-9894-72dd390bc92b: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:53:53.610902 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-991cc2a8-5146-4deb-93eb-43c06c493c58 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396996 Nov 05 14:53:53.697121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-e424daf7-286e-4220-957a-8d4a9cc87c76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:53.698497 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-e424daf7-286e-4220-957a-8d4a9cc87c76 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 1099 time: 0.0400498 Nov 05 14:53:53.816916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-b50a9b87-f40f-46d9-81db-96b72752a17f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:53.819040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-b50a9b87-f40f-46d9-81db-96b72752a17f service neutron] 10.222.0.32 "GET /v2.0/networks?id=7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 200 len: 898 time: 0.0990744 Nov 05 14:53:53.863614 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-fd6d1b1b-b074-43fc-a470-f5716206ec1b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 200 len: 217 time: 0.0336263 Nov 05 14:53:53.914161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-3ae9f2fd-0439-4d35-8ab8-6d49ca6f7e9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:53.915631 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-3ae9f2fd-0439-4d35-8ab8-6d49ca6f7e9b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 200 len: 833 time: 0.0432026 Nov 05 14:53:53.991454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-7f81a1b2-19a4-4c75-b253-683906cbb601 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:53.992869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-7f81a1b2-19a4-4c75-b253-683906cbb601 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=7ea2b701-9991-42a5-8ec4-91131668ab84&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0689459 Nov 05 14:53:54.027313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000be23e-47d6-4ef3-b130-8fa3dee74b27 req-1ea5958d-ae56-423e-abdf-465ea99d6929 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:54.028793 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-000be23e-47d6-4ef3-b130-8fa3dee74b27 req-1ea5958d-ae56-423e-abdf-465ea99d6929 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0691319 Nov 05 14:53:54.121249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-45264e01-7b8c-4912-bf1e-a5268d9805cf tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:53:54.123169 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-45264e01-7b8c-4912-bf1e-a5268d9805cf tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.32 "GET /v2.0/ports?device_id=bc49ee0c-2238-4af5-a00d-e053fd1f6b04 HTTP/1.1" status: 200 len: 945 time: 0.0529745 Nov 05 14:53:54.131133 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-000be23e-47d6-4ef3-b130-8fa3dee74b27 req-03e41d15-7bef-49ce-826e-936e9c40b740 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "GET /v2.0/security-groups?id=a8815d62-7f5a-4ffc-944d-3d215cc116c0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0780284 Nov 05 14:53:54.149331 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-14fb1a73-d81d-44f3-ae7a-81c9d989b603 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1433299 Nov 05 14:53:54.221268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Deleting port 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:53:54.221610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:54.235097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfba7285-c88a-40bf-9b9d-50cefc98ebc5 req-58cd6ae8-332e-45d4-a590-c7ed0008acc1 service neutron] 10.222.0.32 "GET /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834999 Nov 05 14:53:54.309609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] For port 8ee2fdf7-0060-475b-978c-30d28e8465fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8ee2fdf7-0060-475b-978c-30d28e8465fd,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:54.309881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:54.326333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Calling delete_port for 8ee2fdf7-0060-475b-978c-30d28e8465fd owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:53:54.452257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:54.480111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Port': ['ID=8ee2fdf7-0060-475b-978c-30d28e8465fd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:54.524134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] No DVR routers for this DVR port 8ee2fdf7-0060-475b-978c-30d28e8465fd on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:53:54.526678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:54.529897 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f8dbbf47-0843-4d07-8ef0-6fb685d2008c req-cbcc9737-0b7a-48d9-8470-7287c0351437 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.32 "DELETE /v2.0/ports/8ee2fdf7-0060-475b-978c-30d28e8465fd HTTP/1.1" status: 204 len: 173 time: 0.3984790 Nov 05 14:53:54.530342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-deleted', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:53:54.532781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd6e4eca-e6e8-435b-a0a0-d6dcd8327af8" -d '{"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-deleted", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:53:54.576092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:53:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a56f4d80-9e2a-4773-bc5a-922ac7924e95 x-openstack-request-id: req-a56f4d80-9e2a-4773-bc5a-922ac7924e95 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:53:54.576387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bc49ee0c-2238-4af5-a00d-e053fd1f6b04", "name": "network-vif-deleted", "tag": "8ee2fdf7-0060-475b-978c-30d28e8465fd", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:53:54.576664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a56f4d80-9e2a-4773-bc5a-922ac7924e95 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:53:54.577062 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bc49ee0c-2238-4af5-a00d-e053fd1f6b04', 'name': 'network-vif-deleted', 'tag': '8ee2fdf7-0060-475b-978c-30d28e8465fd', 'status': 'completed', 'code': 200} Nov 05 14:53:54.858876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:55.185442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46380) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:55.552432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:55.895073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.056408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Deleting port aaef3cca-d268-4060-8b42-9d6a2f26db83 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:53:56.056764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.142781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] For port aaef3cca-d268-4060-8b42-9d6a2f26db83, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aaef3cca-d268-4060-8b42-9d6a2f26db83,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:56.143137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.156030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Calling delete_port for aaef3cca-d268-4060-8b42-9d6a2f26db83 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:53:56.334067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.364606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Port': ['ID=aaef3cca-d268-4060-8b42-9d6a2f26db83,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:56.527917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.743696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:53:56.823821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:53:56.846041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 8ee2fdf7-0060-475b-978c-30d28e8465fd {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:53:56.846476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8ee2fdf7-0060-475b-978c-30d28e8465fd not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:53:56.857022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:53:56.861965 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8b72d3bd-c056-43e4-8d76-ce809685c7de tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "PUT /v2.0/routers/9ef78c4d-c236-4042-9316-3b2fa973d8b3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6755104 Nov 05 14:53:56.865297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:56.865898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Sync routers for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:53:56.875933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:56.876876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:56.921563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Deleting subnet 7372d027-f074-48e5-b9ed-280658f34d1e {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:53:56.925071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.965134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:56.987750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:57.057415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.122251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.149736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Subnet': ['ID=7372d027-f074-48e5-b9ed-280658f34d1e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:57.153296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.159097 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9122e6fb-44d7-43da-acea-4bae81567956 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "DELETE /v2.0/subnets/7372d027-f074-48e5-b9ed-280658f34d1e HTTP/1.1" status: 204 len: 168 time: 0.2902527 Nov 05 14:53:57.159569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46386) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:57.168073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17b45bd8-667e-4b96-a3a4-ef4826dd4a3a None None] Network 89254426-06c9-4956-8912-99f06b3d5e5b requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:53:57.256952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54'}], 'enable_snat': True}, 'gw_port_id': '876da516-1543-489e-a545-63dcb621d3aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:53:56Z', 'revision_number': 5, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port': {'id': '876da516-1543-489e-a545-63dcb621d3aa', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:7a:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1331, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:52:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:57.267364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.389449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.448532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Checking router: 9ef78c4d-c236-4042-9316-3b2fa973d8b3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:53:57.452574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Deleting port 876da516-1543-489e-a545-63dcb621d3aa {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:53:57.452918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.464095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Routers {'9ef78c4d-c236-4042-9316-3b2fa973d8b3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:53:57.464963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:53:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:57.555753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] DHCP port deletion for 89254426-06c9-4956-8912-99f06b3d5e5b request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:53:57.566978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] For port 876da516-1543-489e-a545-63dcb621d3aa, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=876da516-1543-489e-a545-63dcb621d3aa,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:57.567520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.571662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] Set router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:53:57.579973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Calling delete_port for 876da516-1543-489e-a545-63dcb621d3aa owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:53:57.645681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:53:57Z', 'revision_number': 6, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:57.674609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac41670-8957-49a5-b01e-f57f3ee02508 None None] The sync data for ids ['9ef78c4d-c236-4042-9316-3b2fa973d8b3'] in dv-neutron-816850-1-hyperv is: [{'id': '9ef78c4d-c236-4042-9316-3b2fa973d8b3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1502699604', 'tenant_id': '2b0f272512b04566b8ddf36f25b004d1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:02Z', 'updated_at': '2021-11-05T14:53:57Z', 'revision_number': 6, 'project_id': '2b0f272512b04566b8ddf36f25b004d1', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:53:57.704952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Deleting port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:53:57.705335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.778977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] For port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,segment=NetworkSegment(c3ba3128-586f-468a-879d-b1d2cfb2aa00),segment_id=c3ba3128-586f-468a-879d-b1d2cfb2aa00)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:53:57.779394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.793644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Calling delete_port for b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:53:57.883279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:57.913596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] Pushing event deleted for resources: {'Port': ['ID=b078214b-f2a9-44c0-bfb9-73d6e1cab4c5,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:57.918640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0566331d-ab73-4d31-ae46-942095cdae8d None None] No DVR routers for this DVR port b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:53:58.061279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.087631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Port': ['ID=876da516-1543-489e-a545-63dcb621d3aa,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:58.156641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.255570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.257864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.303398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.304111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Fanout notify agent at l3_agent the message router_deleted on router 9ef78c4d-c236-4042-9316-3b2fa973d8b3 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:53:58.311658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.312788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ce836943-e5cb-43c2-8572-40e01c14fef0 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "DELETE /v2.0/routers/9ef78c4d-c236-4042-9316-3b2fa973d8b3 HTTP/1.1" status: 204 len: 168 time: 1.1525517 Nov 05 14:53:58.315671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46388) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:58.399426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.492238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.512151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['89254426-06c9-4956-8912-99f06b3d5e5b']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:58.521101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c3ba3128-586f-468a-879d-b1d2cfb2aa00') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:58.521913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c3ba3128-586f-468a-879d-b1d2cfb2aa00') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:53:58.531448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.546355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.552343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Releasing vlan 602 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:53:58.552922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:53:58.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:53:58.619253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.626588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.629118 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "DELETE /v2.0/networks/89254426-06c9-4956-8912-99f06b3d5e5b HTTP/1.1" status: 204 len: 168 time: 0.3124835 Nov 05 14:53:58.632012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46390) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:58.640585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624a2c07-5e9f-4b25-8e49-62ff350d80a3 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'Network': ['ID=89254426-06c9-4956-8912-99f06b3d5e5b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:58.692263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.720223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.781087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.784302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:58.785521 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] 10.222.0.30 "DELETE /v2.0/security-groups/a8815d62-7f5a-4ffc-944d-3d215cc116c0 HTTP/1.1" status: 204 len: 168 time: 0.1523585 Nov 05 14:53:58.795192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a63dd8d-9a5e-4116-ae8f-bf7bcd56ac71 tempest-TestNetworkAdvancedServerOps-1895457219 tempest-TestNetworkAdvancedServerOps-1895457219-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8815d62-7f5a-4ffc-944d-3d215cc116c0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:59.077363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46398) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:59.226560 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dffa8af7-2adf-4096-829d-2f8178d0875b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2b0f272512b04566b8ddf36f25b004d1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1479354 Nov 05 14:53:59.229236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46402) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:59.284233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.309425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.358641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.361127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.362270 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2942af1b-6bf4-48a0-b6fa-832393ea8610 HTTP/1.1" status: 204 len: 168 time: 0.1321404 Nov 05 14:53:59.370869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8be4a75-7f74-4c4c-af40-0e7e529b31ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2942af1b-6bf4-48a0-b6fa-832393ea8610,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:59.392119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:53:59.416162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:53:59.416537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b078214b-f2a9-44c0-bfb9-73d6e1cab4c5 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:53:59.416897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 876da516-1543-489e-a545-63dcb621d3aa no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:53:59.436048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 876da516-1543-489e-a545-63dcb621d3aa {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:53:59.436386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 876da516-1543-489e-a545-63dcb621d3aa not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:53:59.436819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aaef3cca-d268-4060-8b42-9d6a2f26db83 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:53:59.457910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: aaef3cca-d268-4060-8b42-9d6a2f26db83 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:53:59.458205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aaef3cca-d268-4060-8b42-9d6a2f26db83 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:53:59.637846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46408) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:59.654102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88407e5-9bf1-4f99-b5d8-abd8ed002ebe admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.728977 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88407e5-9bf1-4f99-b5d8-abd8ed002ebe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.732651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88407e5-9bf1-4f99-b5d8-abd8ed002ebe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.771229 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b88407e5-9bf1-4f99-b5d8-abd8ed002ebe admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=55bf0e82171e40ebbeefdb637e87ac96&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1322825 Nov 05 14:53:59.772104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88407e5-9bf1-4f99-b5d8-abd8ed002ebe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c23585c2-ae58-4b9d-9937-852ba2d43d47,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:53:59.774482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46410) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:53:59.828153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.850714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.898881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.901702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:53:59.902904 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c23585c2-ae58-4b9d-9937-852ba2d43d47 HTTP/1.1" status: 204 len: 168 time: 0.1275120 Nov 05 14:53:59.913002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd944580-d4c2-448d-ae33-c333e1db6159 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c23585c2-ae58-4b9d-9937-852ba2d43d47,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:18.177102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:20.048356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f747b832-c34e-4b35-bf9d-fa1e5a7ffefa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:21.595880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9765d1c7-e5ae-4e2e-8eef-c2df4ed31fc5 req-a1e68b08-b7e6-4b30-a74b-a862ce117323 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:21.597307 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9765d1c7-e5ae-4e2e-8eef-c2df4ed31fc5 req-a1e68b08-b7e6-4b30-a74b-a862ce117323 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0513742 Nov 05 14:54:21.645368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9765d1c7-e5ae-4e2e-8eef-c2df4ed31fc5 req-3011f04d-465e-4b3a-bb61-f90d9b05405f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416884 Nov 05 14:54:22.393686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d4274431-2268-4182-82bb-fbad1e00cb08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:22.765648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba747f75-ad41-4a26-8785-477371300779 req-925c5044-ae6c-404a-a373-f69cd2e151ba tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:22.767108 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ba747f75-ad41-4a26-8785-477371300779 req-925c5044-ae6c-404a-a373-f69cd2e151ba tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0480118 Nov 05 14:54:22.814700 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ba747f75-ad41-4a26-8785-477371300779 req-ddd122ed-c0d6-472c-ad62-06fea2c63d65 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411601 Nov 05 14:54:22.884526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-511a3671-aa5b-4182-ac85-a8f8c29fe049 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:22.885962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-511a3671-aa5b-4182-ac85-a8f8c29fe049 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 945 time: 0.0509510 Nov 05 14:54:22.974795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 2a7a7637-5241-4070-9ec4-38e10c180dae {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:22.975034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.079446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 2a7a7637-5241-4070-9ec4-38e10c180dae, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=2a7a7637-5241-4070-9ec4-38e10c180dae,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:23.079823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.294054 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.294326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.294637 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01 disassociated. External IP: 172.26.5.45, port: 2a7a7637-5241-4070-9ec4-38e10c180dae. Nov 05 14:54:23.294971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 2a7a7637-5241-4070-9ec4-38e10c180dae owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:23.391522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.417489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.443780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=2a7a7637-5241-4070-9ec4-38e10c180dae,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:23.556709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:54:23.661563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:54:23.671489 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:54:23.681105 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:23.681708 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:23.704995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 2a7a7637-5241-4070-9ec4-38e10c180dae on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:54:23.707810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:23.711417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa73a8be-2f88-4b4b-ab32-83a3bf56fc67 req-8de4115a-d543-4495-b8de-4cea5c30c8df tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/2a7a7637-5241-4070-9ec4-38e10c180dae HTTP/1.1" status: 204 len: 173 time: 0.8178370 Nov 05 14:54:23.711885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'name': 'network-vif-deleted', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:23.714950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-723c96d3-74ff-461f-8dd1-ff729c0650df" -d '{"events": [{"server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "name": "network-vif-deleted", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:23.755223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-248f1ef1-4676-4815-8e7a-00efe90a2d7e x-openstack-request-id: req-248f1ef1-4676-4815-8e7a-00efe90a2d7e {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:23.755535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a", "name": "network-vif-deleted", "tag": "2a7a7637-5241-4070-9ec4-38e10c180dae", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:23.755789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-248f1ef1-4676-4815-8e7a-00efe90a2d7e {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:23.757007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a', 'name': 'network-vif-deleted', 'tag': '2a7a7637-5241-4070-9ec4-38e10c180dae', 'status': 'completed', 'code': 200} Nov 05 14:54:23.792337 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:23.937089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92e0c33f-c75f-46dd-ae2c-c4efc9fea628 req-b3780df0-ba72-4270-afe7-015d253dee93 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6a2cc52-b28c-49f8-a3eb-13b5fb5f1a5a HTTP/1.1" status: 200 len: 210 time: 0.0277719 Nov 05 14:54:23.998634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:24.029054 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:54:24.042980 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:24.044762 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:24.158554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:24.352410 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:24.377199 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4311fb3-890c-4b48-aa09-ae3d4754e23f None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:52:36Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '4902c44f-369d-4d4a-846e-5c30cd334507', 'name': '', 'network_id': '7ea2b701-9991-42a5-8ec4-91131668ab84', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:01:64:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_interface', 'standard_attr_id': 1343, 'fixed_ips': [{'subnet_id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:35Z', 'updated_at': '2021-11-05T14:52:39Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '88b19ff2-7c4a-4a25-afa8-1ee7b614e54e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:54:24.602878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbc0dead-28c1-49ea-ad13-5fbceb6d081e None None] New status for floating IP 04a222d3-fb07-4bdb-a23a-625c14e3eb01: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:54:24.858648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:24.994861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46444) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:25.057040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.082080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.140770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.143369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.144551 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/c97b8ebe-a1e7-452e-b68f-b57df7a63c5a HTTP/1.1" status: 204 len: 168 time: 0.1486318 Nov 05 14:54:25.153387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54439ff7-bfce-46b0-b362-68c70ce321ef tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c97b8ebe-a1e7-452e-b68f-b57df7a63c5a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:25.178797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46448) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:25.305920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port b311e1de-f09a-49f2-8423-88050c310336 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:25.306162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.388814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.389159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.401369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for b311e1de-f09a-49f2-8423-88050c310336 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:25.529807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.554988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=b311e1de-f09a-49f2-8423-88050c310336,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:25.614496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.617259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:25.618408 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-94671368-026f-442b-af1a-33511c0b0e57 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/04a222d3-fb07-4bdb-a23a-625c14e3eb01 HTTP/1.1" status: 204 len: 168 time: 0.4391007 Nov 05 14:54:25.825654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d67de8d-2628-4ab2-b2b3-53c589ed44a4 req-4a336522-fc77-4600-8702-c638dc9bda92 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:25.827028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d67de8d-2628-4ab2-b2b3-53c589ed44a4 req-4a336522-fc77-4600-8702-c638dc9bda92 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0481215 Nov 05 14:54:25.874915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d67de8d-2628-4ab2-b2b3-53c589ed44a4 req-48f549f4-130c-42f2-95ed-37d3d7e7d953 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418808 Nov 05 14:54:25.899751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:26.963265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2a7a7637-5241-4070-9ec4-38e10c180dae no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:26.983802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 2a7a7637-5241-4070-9ec4-38e10c180dae {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:54:26.984146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 2a7a7637-5241-4070-9ec4-38e10c180dae not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:26.996757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e765f70-2d6b-44ef-a0e2-3ed18c68a157 req-dca86e27-7186-465e-aaaf-61d0d0f54b0b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:26.998239 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8e765f70-2d6b-44ef-a0e2-3ed18c68a157 req-dca86e27-7186-465e-aaaf-61d0d0f54b0b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0540218 Nov 05 14:54:27.048297 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8e765f70-2d6b-44ef-a0e2-3ed18c68a157 req-dd4f125a-1a92-461e-a66a-ae0cd40ad777 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7dafee3b-dd13-49d9-98d2-bb1412b49273&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441504 Nov 05 14:54:27.124544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-4955a9b8-a63d-4385-81b7-56d119402631 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:27.125973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-4955a9b8-a63d-4385-81b7-56d119402631 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=ab4fdc22-517d-40ec-9279-a187d96be48d HTTP/1.1" status: 200 len: 946 time: 0.0510547 Nov 05 14:54:27.214934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 8aeb63b2-4d73-404a-b469-f262a8c6c28c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:27.215192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:27.303484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 8aeb63b2-4d73-404a-b469-f262a8c6c28c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8aeb63b2-4d73-404a-b469-f262a8c6c28c,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:27.303842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:27.316716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 8aeb63b2-4d73-404a-b469-f262a8c6c28c owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:27.438449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:27.470293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=8aeb63b2-4d73-404a-b469-f262a8c6c28c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:27.511125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 8aeb63b2-4d73-404a-b469-f262a8c6c28c on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:54:27.513652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:27.517299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6dcae26b-48b2-4908-bd54-c40352a472cf req-50f5ba40-7217-4e6b-a4e0-61597eb6440e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/8aeb63b2-4d73-404a-b469-f262a8c6c28c HTTP/1.1" status: 204 len: 173 time: 0.3848555 Nov 05 14:54:27.517755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'name': 'network-vif-deleted', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:27.520437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a349d439-2afd-4045-ab00-5b05f87d3341" -d '{"events": [{"server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "name": "network-vif-deleted", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:27.542437 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:54:27.563064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0b216ef-0d3d-441b-98d1-4854e156084c x-openstack-request-id: req-e0b216ef-0d3d-441b-98d1-4854e156084c {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:27.563368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ab4fdc22-517d-40ec-9279-a187d96be48d", "name": "network-vif-deleted", "tag": "8aeb63b2-4d73-404a-b469-f262a8c6c28c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:27.563834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e0b216ef-0d3d-441b-98d1-4854e156084c {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:27.564394 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ab4fdc22-517d-40ec-9279-a187d96be48d', 'name': 'network-vif-deleted', 'tag': '8aeb63b2-4d73-404a-b469-f262a8c6c28c', 'status': 'completed', 'code': 200} Nov 05 14:54:28.104211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46460) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:28.159832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.185045 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.241539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.244311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.245511 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/7dafee3b-dd13-49d9-98d2-bb1412b49273 HTTP/1.1" status: 204 len: 168 time: 0.1402302 Nov 05 14:54:28.254905 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340c6f31-dd7c-4a3b-b793-f7280c2f9609 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dafee3b-dd13-49d9-98d2-bb1412b49273,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:28.276941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46464) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:28.640939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.898095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 4902c44f-369d-4d4a-846e-5c30cd334507 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:28.898426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:28.986949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 4902c44f-369d-4d4a-846e-5c30cd334507, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4902c44f-369d-4d4a-846e-5c30cd334507,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:28.987301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:29.002498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 4902c44f-369d-4d4a-846e-5c30cd334507 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:29.193119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:29.221710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=4902c44f-369d-4d4a-846e-5c30cd334507,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:29.414964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:29.890149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:54:29.992366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:54:29.997311 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9c208325-9dd9-450f-807d-dff50447f013 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/d10e7857-3bee-4cb3-bfa7-925c1ca6eb10/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7194512 Nov 05 14:54:30.000073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46466) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:30.002713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Sync routers for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:54:30.012835 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:30.013429 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:30.049933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet 88b19ff2-7c4a-4a25-afa8-1ee7b614e54e {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:54:30.053880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.096250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.183689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.205209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:30.241533 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.268447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=88b19ff2-7c4a-4a25-afa8-1ee7b614e54e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:30.272294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.278085 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-550b11cb-c3fd-469d-adea-06597d0dd278 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/88b19ff2-7c4a-4a25-afa8-1ee7b614e54e HTTP/1.1" status: 204 len: 168 time: 0.2745810 Nov 05 14:54:30.278364 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:30.282246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d03d50f6-f7f7-419f-bd36-1c12b7e72ee8 None None] Network 7ea2b701-9991-42a5-8ec4-91131668ab84 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:54:30.390214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.394223 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:54:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:30.420770 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Checking router: d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:54:30.429366 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Routers {'d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:30.429962 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:30.454639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] DHCP port deletion for 7ea2b701-9991-42a5-8ec4-91131668ab84 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:54:30.500370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.508931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Deleting port fdd99d97-ee58-4355-8949-375d6c700936 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:30.509435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.551070 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] Set router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:30.556940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 469927e4-42b2-4555-af1b-6aaa41641e1f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:54:30.557352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.577689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] For port fdd99d97-ee58-4355-8949-375d6c700936, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=fdd99d97-ee58-4355-8949-375d6c700936,segment=NetworkSegment(58d5a39f-a834-47b9-a818-d1af60e85cf9),segment_id=58d5a39f-a834-47b9-a818-d1af60e85cf9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:30.578440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.591226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Calling delete_port for fdd99d97-ee58-4355-8949-375d6c700936 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:30.641538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 469927e4-42b2-4555-af1b-6aaa41641e1f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=469927e4-42b2-4555-af1b-6aaa41641e1f,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:30.641963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.656174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 469927e4-42b2-4555-af1b-6aaa41641e1f owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:54:30.674645 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.713014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] Pushing event deleted for resources: {'Port': ['ID=fdd99d97-ee58-4355-8949-375d6c700936,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:30.717163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9edd589c-8c08-4342-978c-dd69cd2654d2 None None] No DVR routers for this DVR port fdd99d97-ee58-4355-8949-375d6c700936 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:54:30.744259 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:54:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:30.777681 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d83f375-7c3b-4064-9838-5132f924f8cb None None] The sync data for ids ['d10e7857-3bee-4cb3-bfa7-925c1ca6eb10'] in dv-neutron-816850-1-hyperv is: [{'id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'name': 'tempest-TestNetworkBasicOps-router-1183902141', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68'}], 'enable_snat': True}, 'gw_port_id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:52:32Z', 'updated_at': '2021-11-05T14:54:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '469927e4-42b2-4555-af1b-6aaa41641e1f', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:ae:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd10e7857-3bee-4cb3-bfa7-925c1ca6eb10', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1341, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:52:33Z', 'updated_at': '2021-11-05T14:52:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:54:30.832312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.856356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=469927e4-42b2-4555-af1b-6aaa41641e1f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:30.919068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:30.985633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8aeb63b2-4d73-404a-b469-f262a8c6c28c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:31.006622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 8aeb63b2-4d73-404a-b469-f262a8c6c28c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:54:31.006990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8aeb63b2-4d73-404a-b469-f262a8c6c28c not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:31.026729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.028897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.088692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.089250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:54:31.096574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.097684 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-30b4ebea-3b84-41e4-8c08-bb2e756b9d9a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/d10e7857-3bee-4cb3-bfa7-925c1ca6eb10 HTTP/1.1" status: 204 len: 168 time: 0.8184092 Nov 05 14:54:31.100917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46470) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:31.180900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.274165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.294489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ea2b701-9991-42a5-8ec4-91131668ab84']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:31.315570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58d5a39f-a834-47b9-a818-d1af60e85cf9') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:31.315880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58d5a39f-a834-47b9-a818-d1af60e85cf9') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:31.331932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.355792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.363208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:54:31.368655 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:54:31.429235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.434654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.438786 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/7ea2b701-9991-42a5-8ec4-91131668ab84 HTTP/1.1" status: 204 len: 168 time: 0.3368311 Nov 05 14:54:31.457817 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46472) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:31.464331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1976641603', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:31.468070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e8fea0-4d93-473c-8a29-b7ad14b5f47f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=7ea2b701-9991-42a5-8ec4-91131668ab84,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:31.485509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4902c44f-369d-4d4a-846e-5c30cd334507 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:31.493843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:54:31.497736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.506886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 4902c44f-369d-4d4a-846e-5c30cd334507 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:54:31.507236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4902c44f-369d-4d4a-846e-5c30cd334507 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:31.507656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device fdd99d97-ee58-4355-8949-375d6c700936 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:31.524408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:54:31.528373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: fdd99d97-ee58-4355-8949-375d6c700936 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:54:31.528743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device fdd99d97-ee58-4355-8949-375d6c700936 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:31.534621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.534954 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment 4e026e42-23c3-4bb6-aec4-57555ebfb198 of type vlan for network a5de5a3e-8530-4d22-a002-d8454ed4666a Nov 05 14:54:31.578308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.602845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.608290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:31.608894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.662357 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2034230 Nov 05 14:54:31.665205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46474) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:31.669491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-255039042', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:31.689369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07763d3-7865-4abf-80b4-9ad34c95d7c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=a5de5a3e-8530-4d22-a002-d8454ed4666a,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:31.699837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a5de5a3e-8530-4d22-a002-d8454ed4666a details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:54:31.702379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.703613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.760450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:31.898387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:32.085829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:32.103768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:32.206970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.107 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/abcfb310-8a7e-48f2-819a-6c63046320c5) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:54:32.301997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:32.335818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:32.374249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:32.376897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:32.382775 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:54:32.406830 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=abcfb310-8a7e-48f2-819a-6c63046320c5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:32.878984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:33.079180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:33.213258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:54:33.317682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:54:33.327900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Sync routers for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:54:33.339527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:33.339695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:33.340263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:33.344103 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-24e6b817-0e31-4dd0-a1fa-c4a1ad3592a4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.6750255 Nov 05 14:54:33.344248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46476) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:33.377793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 469927e4-42b2-4555-af1b-6aaa41641e1f no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:33.407686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 469927e4-42b2-4555-af1b-6aaa41641e1f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:54:33.408190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 469927e4-42b2-4555-af1b-6aaa41641e1f not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:33.480260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:33.545957 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-673556bc-c004-40f8-9da4-3ce1056e00e9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1981754 Nov 05 14:54:33.546218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46480) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:33.655934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:32Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:33.681810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Checking router: 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:54:33.682158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Updating router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 port abcfb310-8a7e-48f2-819a-6c63046320c5 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:54:33.693980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c2beef6-81e9-47ed-ae7f-1bcab0b6e4a7 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:33.698082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0c2beef6-81e9-47ed-ae7f-1bcab0b6e4a7 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1484239 Nov 05 14:54:33.698422 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46482) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:33.706603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:33.733024 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ab308368-8dca-43f4-bf18-a83ad65d1e45 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0333450 Nov 05 14:54:33.735281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46484) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:33.739926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1651373817', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:33.832208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:54:33.835889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.018852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.077743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=7a2e0af8-2aa2-490b-b6f8-e472773de905,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:34.094700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:34.095056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: a5de5a3e-8530-4d22-a002-d8454ed4666a, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:54:34.106618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.111860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network a5de5a3e-8530-4d22-a002-d8454ed4666a is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:54:34.112274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.121535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a5de5a3e-8530-4d22-a002-d8454ed4666a) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:34.125634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:34.126230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.144506 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-43362137-c69d-42ca-a4a7-4c14ef3e4bbf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4081938 Nov 05 14:54:34.147323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46486) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:34.153567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7f98b2f-4f17-43ef-bbbd-3de7cb320dba None None] Network a5de5a3e-8530-4d22-a002-d8454ed4666a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:54:34.213181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Attempting to bind port abcfb310-8a7e-48f2-819a-6c63046320c5 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:54:34.213549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Attempting to bind port abcfb310-8a7e-48f2-819a-6c63046320c5 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:54:34.213912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Attempting to bind port abcfb310-8a7e-48f2-819a-6c63046320c5 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:34.215752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a866cc3-5b0a-4023-9932-0772feafdb76 None None] Pushing event updated for resources: {'Port': ['ID=abcfb310-8a7e-48f2-819a-6c63046320c5,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:34.225425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:54:34.225801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:34.226199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.226588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:54:34.227056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Bound port: abcfb310-8a7e-48f2-819a-6c63046320c5, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:54:34.227430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f7f98b2f-4f17-43ef-bbbd-3de7cb320dba None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:54:34.293963 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:54:34.303340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] For port abcfb310-8a7e-48f2-819a-6c63046320c5, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:34.306531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfcd31d4-b4e5-49b5-a5ee-be3801ca0030 None None] Network a5de5a3e-8530-4d22-a002-d8454ed4666a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:54:34.309304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] For port abcfb310-8a7e-48f2-819a-6c63046320c5, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=abcfb310-8a7e-48f2-819a-6c63046320c5,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:54:34.345803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.431557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:34.432174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:34.436969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a866cc3-5b0a-4023-9932-0772feafdb76 None None] Pushing event updated for resources: {'Port': ['ID=abcfb310-8a7e-48f2-819a-6c63046320c5,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-dfcd31d4-b4e5-49b5-a5ee-be3801ca0030 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:54:34.473481 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:54:34.489248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ccd697a-e28f-4d45-b2df-f1d073771e9b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:54:34.590458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:34.594031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:34.704934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ccd697a-e28f-4d45-b2df-f1d073771e9b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:54:34.859985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (a5de5a3e-8530-4d22-a002-d8454ed4666a/7a2e0af8-2aa2-490b-b6f8-e472773de905/3cbed2a7-0da4-4d8f-a686-cce419a0f8e8) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:54:34.897400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:32Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:34.931855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31dbd2a8-be30-425f-9860-cd6b12034c90 None None] The sync data for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv is: [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:32Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:54:34.974944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.015622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a5de5a3e-8530-4d22-a002-d8454ed4666a', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:54:35.016742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.021036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.071861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network a5de5a3e-8530-4d22-a002-d8454ed4666a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:35.075330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:35.077947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:54:35.109250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:35.124280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.124419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.124870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.125000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.125324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.125720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.126047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.126367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.126591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.126854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.127172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.127488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:35.146186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.183903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Allocated IP 172.20.0.2 (a5de5a3e-8530-4d22-a002-d8454ed4666a/7a2e0af8-2aa2-490b-b6f8-e472773de905/07d8539a-bcc5-45fb-9b0f-0c18e57dbf04) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:54:35.306556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.372806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.380090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.433294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Pushing event updated for resources: {'Port': ['ID=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:35.445748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Network a5de5a3e-8530-4d22-a002-d8454ed4666a is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:35.447337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:35.450234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:54:35.509498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device abcfb310-8a7e-48f2-819a-6c63046320c5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:35.544165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Attempting to bind port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:54:35.544555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Attempting to bind port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:54:35.544920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Attempting to bind port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:35.556858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:54:35.557232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Checking segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:35.557631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.558846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Bound using segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:54:35.558846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Bound port: 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:54:35.558846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.626102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port abcfb310-8a7e-48f2-819a-6c63046320c5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:35.626471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.649289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.655291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.658483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] For port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:35.677008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] For port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:54:35.683793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.738432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.740286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:35.779616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d19eb9-71c1-4551-ae63-d7a721a0d2d9 None None] Pushing event updated for resources: {'Port': ['ID=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:35.782113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.812181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port abcfb310-8a7e-48f2-819a-6c63046320c5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=abcfb310-8a7e-48f2-819a-6c63046320c5,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:35.817345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:35.868993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=abcfb310-8a7e-48f2-819a-6c63046320c5,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:35.871354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network a5de5a3e-8530-4d22-a002-d8454ed4666a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:35.873114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:36.278160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:54:36.383257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:54:36.390764 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0e21f8c1-04e2-4302-ae9c-1f30bafe6386 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/9ea90ae0-e2d5-4e35-8583-315a1e07eb45/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2399228 Nov 05 14:54:36.390948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46488) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:36.491449 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.491910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.492359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.492832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.493325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.493734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.495538 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-417ffdd4-e508-4834-b6fd-4b27ac0c846c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1036744 Nov 05 14:54:36.498361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46490) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:36.589627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.590082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.590518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.590951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.591378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.591804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:36.593595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-23d41916-d758-4fb8-8421-3174edbea9cd tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4005 time: 0.0943274 Nov 05 14:54:36.596390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46492) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:36.818745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-239ee2db-f6b8-4915-b88a-48df839c6c1a tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3047 time: 0.2212360 Nov 05 14:54:36.821590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46494) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:36.826344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'name': 'tempest-TestNetworkBasicOps-1745445061', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:36.935373 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:54:36.939253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:36.966200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] device_id is not set on port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:54:37.087507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.14 (a5de5a3e-8530-4d22-a002-d8454ed4666a/7a2e0af8-2aa2-490b-b6f8-e472773de905/5c3c9dbf-eb02-4e10-b23d-1333163dfea7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:54:37.134289 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Sync routers for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:54:37.139678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-430cb25c-50fa-44d3-ae77-4ad5b88de325 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:54:37.146685 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:37.147300 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:37.216639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] Provisioning complete for port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:37.217006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.253634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-430cb25c-50fa-44d3-ae77-4ad5b88de325 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:54:37.254838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.261513 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:37.293776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.338053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network a5de5a3e-8530-4d22-a002-d8454ed4666a is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:37.345636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:37.351149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:54:37.355095 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:37.380692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.406113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:37.406894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.434167 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2227e74c-7306-49c8-9a74-79db13d4c1c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.6115162 Nov 05 14:54:37.491573 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:37.525007 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Checking router: 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:54:37.525566 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Updating router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:54:37.558132 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.600858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:37.613399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46498) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:37.617995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1485443916', 'description': 'tempest-secgroup-smoke-1485443916 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:37.640751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.658133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] For port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:37.684250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.720354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.725194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.754625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.756756 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1423211 Nov 05 14:54:37.759714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46500) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:37.763163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83e4cf2-43b5-4337-99da-549d963f1ab1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=160f3064-995e-4c83-a432-82e261c3a9ee,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:37.774100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:37.797773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:37.798249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.799728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61899f43-5cd7-4502-b626-e3eb9877fc7b None None] Pushing event updated for resources: {'Port': ['ID=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:37.804066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.835998 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.842534 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.874654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.879483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.897914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Pushing event updated for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:37.902571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b5609c0-c1cf-4ce7-a1ec-dded0c254cb4,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:37.910967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device abcfb310-8a7e-48f2-819a-6c63046320c5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:37.918249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.918900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.919345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.919937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.920365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.921138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.921881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.922532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.923208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.923898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.924491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.925149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.933020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.935665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e0ea947f-9973-4437-b4d2-590192d1ad2e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1743722 Nov 05 14:54:37.938664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46502) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:37.943804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:37.959610 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.959954 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.961751 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.962709 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.963255 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.964425 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.964988 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.965326 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.965790 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.966059 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.966369 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.966659 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:37.975148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port abcfb310-8a7e-48f2-819a-6c63046320c5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:37.975487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.983580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:37.992683 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Attempting to bind port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:54:37.993052 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Attempting to bind port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:54:37.993416 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Attempting to bind port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:37.999079 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:54:37.999750 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Checking segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:38.000335 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.000929 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Bound using segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:54:38.001560 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Bound port: 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:54:38.002138 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.055326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.065993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.076595 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] For port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:38.080296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] For port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:54:38.086427 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.094139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b2f31292-beef-4b03-b050-33f6b82f1b81,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.099908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.102000 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e5d0ed1-3f96-47c0-817e-234c8f2cefd5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1619141 Nov 05 14:54:38.104231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46504) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:38.111002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:38.147944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.171776 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d96a4441-5605-4830-9161-28e317eb3b36 None None] Pushing event updated for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.175931 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:38.176662 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:38.214764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.218967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.239049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1ab6dafb-8cd7-46e7-9d9e-1a8cd31187f9,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.249862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.251514 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5753e57d-fab4-4641-bc40-71db7b1d5069 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1455755 Nov 05 14:54:38.254218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46506) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:38.259474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:38.288886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.355458 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.360519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.382100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a8f64e1-3bf0-4326-ac14-33eeb14356f0,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.390459 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.394188 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:38.394830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46508) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:38.394959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c22225a0-a8b2-4d89-9749-2f088c855b0a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1396515 Nov 05 14:54:38.400616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:38.422790 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:54:38.428909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.516082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.516402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:38.517375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.523831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.544289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=89b8ea21-b4fc-48a8-b55b-b3c2721a1c5e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.566856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.568671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:54:38.568905 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a23772b8-d201-474d-98ac-82edf63afe69 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1729140 Nov 05 14:54:38.572787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46510) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:38.578077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '160f3064-995e-4c83-a432-82e261c3a9ee', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:38.582315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Provisioning complete for port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:38.582697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.616184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:54:38.628189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.640147 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:38.669615 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a9d8d6-fc6a-4a33-8030-9feacbb4e54c None None] The sync data for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv is: [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:54:38.675182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.716689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.727396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.728154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] For port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:38.734744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.752072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db608954-fefd-421e-b92b-76b698e1ab3a,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.767908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.769307 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-09b4107e-84fa-4c54-92fe-27e754064145 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1954336 Nov 05 14:54:38.793713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Provisioning complete for port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:38.794097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:38.831966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de49ff8e-2abb-4e59-8055-44bde6bf1cdf None None] Pushing event updated for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:38.961268 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-22912f72-acf4-4005-997b-bf36ab1f889e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1485443916&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0492678 Nov 05 14:54:39.020236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-72bc6a3a-7a92-4436-b0fe-bc3ffacb1947 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:39.023119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-72bc6a3a-7a92-4436-b0fe-bc3ffacb1947 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 931 time: 0.0504775 Nov 05 14:54:39.041744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7101824f-ae32-4615-bcb1-23e96f7de4bc None None] Provisioning complete for port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.042424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7101824f-ae32-4615-bcb1-23e96f7de4bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:39.085035 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-e269e8ab-1c83-420a-a2e7-e63f31748bbe service neutron] 10.222.0.30 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0468915 Nov 05 14:54:39.191852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-34a9cdbb-489f-4698-a7b8-b6bad1d6efa1 service neutron] 10.222.0.30 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1002018 Nov 05 14:54:39.267915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-90abd5dd-8368-4624-aacd-534e0338f69a None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.268299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90abd5dd-8368-4624-aacd-534e0338f69a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:39.292338 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-d250ffd9-5007-4858-ab8d-379241263c34 service neutron] 10.222.0.30 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931242 Nov 05 14:54:39.314949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-90abd5dd-8368-4624-aacd-534e0338f69a None None] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:54:39.460363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b6c2b119-70fd-4d13-ac61-6022243abbf0 None None] Provisioning complete for port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.460758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b6c2b119-70fd-4d13-ac61-6022243abbf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:39.620938 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-81cba2ba-8459-47b5-8596-b1f50a35dbe7 req-f30c6b6f-e3e6-4d5b-ba0f-c54ef9d6a280 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 210 time: 0.1320462 Nov 05 14:54:39.647682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:39.703542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.704019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:39.793233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bca4857d-fb73-4eb2-8b17-7e796c580cdc None None] Provisioning complete for port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.793724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bca4857d-fb73-4eb2-8b17-7e796c580cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:39.832867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:39.940203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:39.940672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:40.549149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-dd9b39a1-44a7-4981-8e2a-07e5aa65af36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:40.550543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-dd9b39a1-44a7-4981-8e2a-07e5aa65af36 service neutron] 10.222.0.32 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1027 time: 0.0359159 Nov 05 14:54:40.660796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-c6a5a5a0-928e-4ffb-a3b2-957d3e0525a6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:40.662351 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-c6a5a5a0-928e-4ffb-a3b2-957d3e0525a6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 797 time: 0.1061115 Nov 05 14:54:40.728771 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c8bd497a-42b6-462c-ac64-574467e65778 req-aeba40ad-7b12-4347-a4b9-e5a7e758cbfa tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 210 time: 0.0331957 Nov 05 14:54:40.753096 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-8b7b57e7-b283-4815-aa57-badf0151357b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 380 time: 0.0776577 Nov 05 14:54:40.764898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Request body: {'port': {'device_id': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:40.822558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.071887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:54:41.079226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.091342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Transition to ACTIVE for port object 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:54:41.095342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.143598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:41.217980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:54:41.218310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:54:41.218638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:41.223150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:54:41.223486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:41.228636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:54:41.228973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Checking segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:41.229355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Bound using segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:54:41.229779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Bound port: 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:54:41.230131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.294595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:41.297696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:54:41.302800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.336312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.336956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:41.338384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] 10.222.0.32 "PUT /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1132 time: 0.5778165 Nov 05 14:54:41.338863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:41.341155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a321761-054f-4cc5-93ad-dbe75439a4f8" -d '{"events": [{"name": "network-changed", "server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:41.374496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86095c7-7308-4875-84c0-a0c1ed8e52c6 service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:41.388528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d53c89b-da6f-44f6-96c5-abcc39d0b417 x-openstack-request-id: req-8d53c89b-da6f-44f6-96c5-abcc39d0b417 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:41.389254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:41.389513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8d53c89b-da6f-44f6-96c5-abcc39d0b417 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:41.390115 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'status': 'completed', 'code': 200} Nov 05 14:54:41.444126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-f2fc00c3-697b-4055-840d-1c11dfcb2a57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.445864 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-f2fc00c3-697b-4055-840d-1c11dfcb2a57 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 1135 time: 0.0472593 Nov 05 14:54:41.489904 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-96d0264b-4e82-46af-a710-2fef26e66774 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 217 time: 0.0359502 Nov 05 14:54:41.540078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-3463b173-6030-4369-93eb-f30972420eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.541620 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-3463b173-6030-4369-93eb-f30972420eb0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 200 len: 835 time: 0.0452418 Nov 05 14:54:41.590795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-3005e5b5-9d99-451d-8faf-b0d6eb0dbacc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.592305 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-3005e5b5-9d99-451d-8faf-b0d6eb0dbacc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0435376 Nov 05 14:54:41.679815 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-9f2b77aa-c27b-434d-a809-74e17fe2b223 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806723 Nov 05 14:54:41.771511 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95e920f8-29d6-44d1-8a5c-3c37a001322b req-fb4725c6-7865-4e40-986c-47d239b0e6e9 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836453 Nov 05 14:54:41.868623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-c92e578e-31d5-4dd3-8823-36c9789de42d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.870061 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-c92e578e-31d5-4dd3-8823-36c9789de42d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 1135 time: 0.0502794 Nov 05 14:54:41.956750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a14d5fb-c9d6-45b1-805b-81eb0c881a5b req-3a7e9487-0c5f-434d-baf8-98fd668a83c2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:41.958232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2a14d5fb-c9d6-45b1-805b-81eb0c881a5b req-3a7e9487-0c5f-434d-baf8-98fd668a83c2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 982 time: 0.1619313 Nov 05 14:54:42.007915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-403511ea-f785-4ddc-b9cc-2cbdecbbf236 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:42.009365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-403511ea-f785-4ddc-b9cc-2cbdecbbf236 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 898 time: 0.1231289 Nov 05 14:54:42.056509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2a14d5fb-c9d6-45b1-805b-81eb0c881a5b req-712484d5-8c28-4bfb-a628-b5ea06faeef8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876465 Nov 05 14:54:42.058104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-f647a13c-3f2e-4626-8a69-2be67e67c72d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 217 time: 0.0398071 Nov 05 14:54:42.111361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-dd9b4ea2-6e17-498d-bfeb-f95539c848eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:42.112735 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-dd9b4ea2-6e17-498d-bfeb-f95539c848eb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 200 len: 835 time: 0.0468833 Nov 05 14:54:42.157830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-8a094f93-97e1-45a2-90a3-ef08d094378c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:42.159277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-8a094f93-97e1-45a2-90a3-ef08d094378c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397274 Nov 05 14:54:42.248960 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-fe8054f2-0335-4e23-8a7a-7bbf9ccedb8b service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820127 Nov 05 14:54:42.340173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a321761-054f-4cc5-93ad-dbe75439a4f8 req-90ad4976-5769-4f30-9ba2-88a6f192c92e service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834599 Nov 05 14:54:43.086015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:54:43.171392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5daa1da2-2300-42b4-9830-2feec7804fe2 req-4ddee210-2494-46d5-a2cf-23f9194e8e68 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:43.172902 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5daa1da2-2300-42b4-9830-2feec7804fe2 req-4ddee210-2494-46d5-a2cf-23f9194e8e68 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 982 time: 0.0480418 Nov 05 14:54:43.181796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:43.193738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'mac_address': 'fa:16:3e:46:07:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 606, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:54:43.222928 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5daa1da2-2300-42b4-9830-2feec7804fe2 req-a0547892-6e94-48f7-8e7e-2e591770d80a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434060 Nov 05 14:54:43.229478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:43.243305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:54:43.262514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:43.266587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:43.316167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:43.322944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.323294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.323633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.323967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.324296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.324648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.324976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.325301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.325623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.325947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.326288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.326603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:54:43.485507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['5c3c9dbf-eb02-4e10-b23d-1333163dfea7'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:54:44.336390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3cb420-81c2-4d0f-9ab2-3a91979b1813 req-18db7cee-e261-41d3-81e0-f45a33269d1c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:44.337886 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bb3cb420-81c2-4d0f-9ab2-3a91979b1813 req-18db7cee-e261-41d3-81e0-f45a33269d1c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 983 time: 0.0497813 Nov 05 14:54:44.383334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bb3cb420-81c2-4d0f-9ab2-3a91979b1813 req-08bf8584-f82c-45bb-92ce-5da4ba496211 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395935 Nov 05 14:54:45.093844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:54:45.145130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:54:45.149482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:45.149848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:45.224281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:45.245952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:45.248210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2aebbfe-3108-485c-ac5f-fcb4f9f73802" -d '{"events": [{"server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "name": "network-vif-plugged", "status": "completed", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:45.261414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:45.265236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:45.289533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c162728-8132-4e18-be34-8c30b1dbfdc7 x-openstack-request-id: req-4c162728-8132-4e18-be34-8c30b1dbfdc7 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:45.289826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "name": "network-vif-plugged", "status": "completed", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:45.290569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4c162728-8132-4e18-be34-8c30b1dbfdc7 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:45.290967 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'code': 200} Nov 05 14:54:45.322185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:45.481488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e55a42a-8cf9-4eba-a05c-ee7667ef8439 req-f8cf707e-5406-4aba-99cf-41a007dfa94b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:45.482966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e55a42a-8cf9-4eba-a05c-ee7667ef8439 req-f8cf707e-5406-4aba-99cf-41a007dfa94b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 1137 time: 0.0712676 Nov 05 14:54:45.515670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e1139a-e413-44da-aead-366e3c5181d2 req-f1d95a7c-a661-494c-8d43-3a9299808a30 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:45.517184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33e1139a-e413-44da-aead-366e3c5181d2 req-f1d95a7c-a661-494c-8d43-3a9299808a30 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0668397 Nov 05 14:54:45.553709 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e55a42a-8cf9-4eba-a05c-ee7667ef8439 req-c5f66704-3d48-4989-af74-beba5b12315a service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633550 Nov 05 14:54:45.580587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33e1139a-e413-44da-aead-366e3c5181d2 req-2f781839-289e-46dc-9550-04a76391d5ca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543535 Nov 05 14:54:46.693348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e92ae8-8494-47a6-a825-c8aa3b810368 req-de7e2fad-2a9e-4e3f-ae94-c7ef6d79db14 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:46.695308 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d6e92ae8-8494-47a6-a825-c8aa3b810368 req-de7e2fad-2a9e-4e3f-ae94-c7ef6d79db14 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0486941 Nov 05 14:54:46.741425 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d6e92ae8-8494-47a6-a825-c8aa3b810368 req-06f8d35f-1f56-4781-8fd3-29c2c3cab769 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402181 Nov 05 14:54:46.853440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f8feb-bec3-46ea-a3f9-962d2472915c req-c7c6dd89-1fc7-42f2-bbe8-753caedda0ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:46.854901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-354f8feb-bec3-46ea-a3f9-962d2472915c req-c7c6dd89-1fc7-42f2-bbe8-753caedda0ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0490065 Nov 05 14:54:46.905122 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-354f8feb-bec3-46ea-a3f9-962d2472915c req-f7c2acce-4012-4dbd-8b1f-fff944a2b754 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443408 Nov 05 14:54:46.926139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46564) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:46.965372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e5b9463-1234-4151-8db8-20e8e8dafb69 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:46.966849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6e5b9463-1234-4151-8db8-20e8e8dafb69 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 1132 time: 0.0397632 Nov 05 14:54:46.969606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46566) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:46.973785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.14'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:46.995083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:47.091477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:47.456188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.3 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/f9686c29-593f-4aa1-b3ca-749abafa9133) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:54:47.558169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:47.589545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:47.626070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:54:47.631191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:54:47.634771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:54:47.655653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=f9686c29-593f-4aa1-b3ca-749abafa9133,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:47.980678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.043537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.176304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.193453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.198837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.273619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=f9686c29-593f-4aa1-b3ca-749abafa9133,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:48.282580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.381210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP c27bfc85-1e0e-41a6-8707-f349181224a9 associated. External IP: 172.26.5.3, port: 5c3c9dbf-eb02-4e10-b23d-1333163dfea7. Nov 05 14:54:48.592619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:54:48.698969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:54:48.708487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Sync routers for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:54:48.716727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:48.718419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:48.719038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:48.743500 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bc0a4e9f-59e9-4da5-9f06-fbf378e1066a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 1033 time: 1.7729042 Nov 05 14:54:48.744104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:48.746399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f" -d '{"events": [{"name": "network-changed", "server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:48.746805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46568) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:48.782351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25fcd8ec-992e-4202-82fa-daaa8ead7318 x-openstack-request-id: req-25fcd8ec-992e-4202-82fa-daaa8ead7318 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:48.782801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb4f4aaa-0641-4f1a-8fac-4166c4954607", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:48.783084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-25fcd8ec-992e-4202-82fa-daaa8ead7318 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:48.783496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'status': 'completed', 'code': 200} Nov 05 14:54:48.825424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4beeb625-7759-4d0a-935a-65ff3ff7460f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:48.829504 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4beeb625-7759-4d0a-935a-65ff3ff7460f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607&network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 1132 time: 0.0791600 Nov 05 14:54:48.833026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:48.854618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-7102b684-c2ba-4892-9fba-94f47a84ae94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:48.856161 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-7102b684-c2ba-4892-9fba-94f47a84ae94 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 1137 time: 0.0516717 Nov 05 14:54:48.959528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-4d68e77f-cdd9-4a33-aba1-f62491c5ea7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:48.961114 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-4d68e77f-cdd9-4a33-aba1-f62491c5ea7f service neutron] 10.222.0.32 "GET /v2.0/networks?id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 898 time: 0.0983331 Nov 05 14:54:49.063582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68127b7-4687-49d3-8ff1-20593689dcc3 req-178eca67-a0fa-4191-afb0-a8e2b351a98d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:49.065899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c68127b7-4687-49d3-8ff1-20593689dcc3 req-178eca67-a0fa-4191-afb0-a8e2b351a98d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0617115 Nov 05 14:54:49.073999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'c27bfc85-1e0e-41a6-8707-f349181224a9', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.3', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1393, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1745445061', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'mac_address': 'fa:16:3e:46:07:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:54:47Z', 'updated_at': '2021-11-05T14:54:47Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:49.081487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-88aac56b-5ae5-426d-b162-4dfb344ba478 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1036 time: 0.1085129 Nov 05 14:54:49.104343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Checking router: 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:54:49.112822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:54:49.113376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:49.118422 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c68127b7-4687-49d3-8ff1-20593689dcc3 req-3901455b-a93d-490c-93b2-4209397315b0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453377 Nov 05 14:54:49.134328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-808bae3f-1afd-4ba6-bc7a-64dd757024d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:49.135587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-808bae3f-1afd-4ba6-bc7a-64dd757024d0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 200 len: 835 time: 0.0469830 Nov 05 14:54:49.182343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-e1b28c52-e96a-4e4b-85ac-fb76da72739d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:49.183837 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-e1b28c52-e96a-4e4b-85ac-fb76da72739d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0402555 Nov 05 14:54:49.226956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:54:49.278821 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-fdf1a2bb-1f47-4ccb-b24d-b3d18855bd95 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863760 Nov 05 14:54:49.369057 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c7ba48e-163b-4f1c-9c40-14aa5f85894f req-67cfb0b5-86c5-46e8-af72-6e6e401028fd service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820181 Nov 05 14:54:49.451923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'c27bfc85-1e0e-41a6-8707-f349181224a9', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.3', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1393, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1745445061', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'mac_address': 'fa:16:3e:46:07:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:54:47Z', 'updated_at': '2021-11-05T14:54:47Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:54:49.481368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46d0a93f-cd33-4bb0-85e3-46bc51a6a9ce None None] The sync data for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv is: [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'c27bfc85-1e0e-41a6-8707-f349181224a9', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.3', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1393, 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1745445061', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'mac_address': 'fa:16:3e:46:07:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb4f4aaa-0641-4f1a-8fac-4166c4954607', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:54:47Z', 'updated_at': '2021-11-05T14:54:47Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:54:49.678037 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-332f774c-e227-4e7c-95b0-0bd06d0165eb None None] New status for floating IP c27bfc85-1e0e-41a6-8707-f349181224a9: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:54:50.199199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2df3781a-544f-44ad-bf02-55932620ede3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:50.252326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896db84f-26eb-44a5-953f-47ad53f08d31 req-c6a757b1-b120-48fc-8ecf-54c639bd7701 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:50.253747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-896db84f-26eb-44a5-953f-47ad53f08d31 req-c6a757b1-b120-48fc-8ecf-54c639bd7701 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0547647 Nov 05 14:54:50.326774 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-896db84f-26eb-44a5-953f-47ad53f08d31 req-8cdedc22-2149-4751-9ddb-084d7a20a01c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664155 Nov 05 14:54:50.354267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-047bbcae-b551-448d-8c71-6b56c66c5a6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:50.355754 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-047bbcae-b551-448d-8c71-6b56c66c5a6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 984 time: 0.0687845 Nov 05 14:54:50.399862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-d2d69087-3624-4390-be1e-06be55a11de4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:50.401340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-d2d69087-3624-4390-be1e-06be55a11de4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0390048 Nov 05 14:54:50.509144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-3e2bd669-64a5-4da0-b02d-77b91fecd592 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1014469 Nov 05 14:54:50.520120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:50.573589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:50.711235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:50.746831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:50.779543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] device_id is not set on port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 yet. {{(pid=113580) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:54:50.788805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:50.795615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:50.908326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=6']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:50.972326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] No DVR routers for this DVR port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:54:51.083815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dc9fdf1b-3470-46a6-9afb-53326f4d4051 None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:54:51.084912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dc9fdf1b-3470-46a6-9afb-53326f4d4051 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:51.107563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] In _notify_port_updated(), no bound segment for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113580) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:54:51.108582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:51.109336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:51.110679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8f48d2c-a9ce-4d7d-bfe8-34a6a0589647 req-f3cb4b7e-08ea-4f4f-8d3c-941ffc44f42c service neutron] 10.222.0.32 "PUT /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1027 time: 0.5944638 Nov 05 14:54:51.124875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dc9fdf1b-3470-46a6-9afb-53326f4d4051 None None] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:54:51.431256 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-04df0052-1359-45b4-af67-e791d738cac4 req-cb6c8bd8-7dc3-4f5f-b497-bbf2cef2e4a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=eb4f4aaa-0641-4f1a-8fac-4166c4954607 HTTP/1.1" status: 200 len: 210 time: 0.0265613 Nov 05 14:54:52.396365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dbb668ae-12c6-4ad5-b5cc-071df96dd337 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.492575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46596) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:52.536252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44aa3012-196d-427d-9b5b-f9dac566cec8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:52.538005 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-44aa3012-196d-427d-9b5b-f9dac566cec8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 926 time: 0.0444369 Nov 05 14:54:52.706019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46600) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:52.710703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-390178761', 'description': 'tempest-secgroup-smoke-390178761 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:52.732583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.801199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.805120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.838165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6cea3aec-e153-4274-9cf6-33b1e4faf8ba,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:52.844695 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.845969 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a30a98d-44a1-4226-a3cc-f3223a763183 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1388843 Nov 05 14:54:52.853884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46602) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:52.859620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:52.887051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.945119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.948705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.963085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d12ed5fd-af66-4fe5-92a6-59fa624985ef,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:52.975198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:52.976402 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c0114de-2971-4f24-bd2a-8771942bf7ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1215198 Nov 05 14:54:52.979293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46604) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:52.983647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:53.014456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.075478 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.079374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.096196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cf2a00f-e708-4803-bdb1-ec2a19736330,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:53.111482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:54:53.126583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.131128 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c7ed9909-4cff-4cc6-986a-76d342bf6941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1508343 Nov 05 14:54:53.134033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46606) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:53.143316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:53.174848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:54:53.181308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.250238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.254509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.280174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=644fa2be-2f45-4078-abb6-cd7af648e6e0,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:53.285983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.288029 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-237d8881-ad5f-4818-8a23-3ee60debe7f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1524365 Nov 05 14:54:53.290882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46608) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:53.295956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:53.324778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.398392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.404433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.405635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.424856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cc849e9c-49a8-4810-8a3c-1d92d0414c04,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:53.433514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.434786 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5e1466a6-2110-4068-8e1d-4318c9798487 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1427255 Nov 05 14:54:53.437865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46612) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:53.442516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:53.466505 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:54:53.471897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.539352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.547553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.566442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e66f2036-da79-4ffc-bfd2-0ba68e6d8feb,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:53.583818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.592335 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7d086d80-bc96-49f4-855d-20819462e3f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1505332 Nov 05 14:54:53.592627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46614) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:54:53.598160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '6cea3aec-e153-4274-9cf6-33b1e4faf8ba', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:53.654390 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:54:53.660264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.727360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.731694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.752497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25994c9c-9b1f-411f-8f2d-90324aef00ec,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:53.763847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:53.764959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6a19d40b-80e2-4242-becf-87a967fdfcb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1713853 Nov 05 14:54:53.922285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-a9dad316-b800-4031-ade5-b022ad6b004b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-390178761&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0477719 Nov 05 14:54:53.972258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-d271555a-145c-4cee-ba58-cde7aac43105 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:53.973594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-d271555a-145c-4cee-ba58-cde7aac43105 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 931 time: 0.0437086 Nov 05 14:54:53.988789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-9712c7ba-b7d9-4f10-a7ee-d7642976ce22 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:54:53.989705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-9712c7ba-b7d9-4f10-a7ee-d7642976ce22 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048299 Nov 05 14:54:54.030454 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-2740f8c3-4b15-4c56-9769-78e6f1cf517f service neutron] 10.222.0.30 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0343637 Nov 05 14:54:54.117134 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-85792ca4-8775-4598-9463-58b9d537803a service neutron] 10.222.0.30 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808706 Nov 05 14:54:54.211359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-44a42930-6879-4d52-aef9-88515dd42be5 service neutron] 10.222.0.30 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883613 Nov 05 14:54:54.373585 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-33d0c0df-6fe5-4a60-9fe6-4a2d372152ec req-fcd7c9c7-c4fb-44f3-9fd5-b1c74e9a03fc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 210 time: 0.0318024 Nov 05 14:54:54.865274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:55.265591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-0303c381-22e6-4e76-83b7-8e6f762edc0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.267183 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-0303c381-22e6-4e76-83b7-8e6f762edc0f service neutron] 10.222.0.32 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1027 time: 0.0860143 Nov 05 14:54:55.378692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-63173d6e-72e7-4139-87a6-c751e4dd3b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.380496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-63173d6e-72e7-4139-87a6-c751e4dd3b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 797 time: 0.1057146 Nov 05 14:54:55.485529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab69549-42fa-490a-ad15-7c953a26cc2f req-c66924f6-0a0a-42f2-9778-296f0419106a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 210 time: 0.0376008 Nov 05 14:54:55.494603 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-028fbb0b-e628-447d-a85f-7d5e09df99e8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 472 time: 0.1047475 Nov 05 14:54:55.508433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-ecc78251-6ca9-4f7f-bb49-d5a8a177b1e0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:54:55.509605 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-ecc78251-6ca9-4f7f-bb49-d5a8a177b1e0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0074427 Nov 05 14:54:55.522172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Request body: {'port': {'device_id': '8cf68723-fa29-44ed-ac06-3756cd6f5079', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:54:55.583765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:55.595434 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-b9f57f5d-2d25-42db-b134-847ae22de832 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0476131 Nov 05 14:54:55.661529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9faa69a-f83f-4785-897f-670202abad60 req-34e3173c-f35f-4e11-aae8-4659cf6384be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.663491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-34e3173c-f35f-4e11-aae8-4659cf6384be service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1099 time: 0.0448623 Nov 05 14:54:55.794532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9faa69a-f83f-4785-897f-670202abad60 req-79590aa9-b357-408f-9a74-bc1d4d84b822 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.796032 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-79590aa9-b357-408f-9a74-bc1d4d84b822 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.1115522 Nov 05 14:54:55.866087 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-7d24cd1c-7de5-41a5-a5f4-903701f92c8e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 1002 time: 0.0632832 Nov 05 14:54:55.915160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:55.927916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9faa69a-f83f-4785-897f-670202abad60 req-a465f31d-74ad-4487-9df4-e1ab4e197658 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.929602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-a465f31d-74ad-4487-9df4-e1ab4e197658 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0568607 Nov 05 14:54:55.981355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9faa69a-f83f-4785-897f-670202abad60 req-7fbe0167-17b5-4be3-85a4-68bcf1ff5634 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:55.982857 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-7fbe0167-17b5-4be3-85a4-68bcf1ff5634 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0465295 Nov 05 14:54:56.074898 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-b66ab61d-9761-404b-88ff-d6787472fd54 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849884 Nov 05 14:54:56.146564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:54:56.153946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:56.165901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Transition to ACTIVE for port object 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:54:56.170409 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9faa69a-f83f-4785-897f-670202abad60 req-874774be-f7d2-4daa-ae6a-5dbe814df41e service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889108 Nov 05 14:54:56.171038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:56.273835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=7']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:56.365894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:54:56.366234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:54:56.366568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:56.371156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:54:56.371478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Attempting to bind port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:54:56.376395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:54:56.376759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Checking segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:54:56.377143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Bound using segment: {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:54:56.377565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Bound port: 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4e026e42-23c3-4bb6-aec4-57555ebfb198', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:54:56.377924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:56.441018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:54:56.444077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:54:56.448595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:56.493954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:56.494575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:56.495923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] 10.222.0.32 "PUT /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1132 time: 0.9785364 Nov 05 14:54:56.496363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8cf68723-fa29-44ed-ac06-3756cd6f5079', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:54:56.498620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6758d844-57ab-4299-943f-076f3d77f163" -d '{"events": [{"name": "network-changed", "server_uuid": "8cf68723-fa29-44ed-ac06-3756cd6f5079", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:54:56.514513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393bb65f-815f-4aa6-b5d4-aa182886c7fa service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=8']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:56.562738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:54:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e7f52b6-71fc-42e4-8b4e-1b2576cd59fe x-openstack-request-id: req-8e7f52b6-71fc-42e4-8b4e-1b2576cd59fe {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:54:56.563029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8cf68723-fa29-44ed-ac06-3756cd6f5079", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:54:56.563277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8e7f52b6-71fc-42e4-8b4e-1b2576cd59fe {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:54:56.563677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8cf68723-fa29-44ed-ac06-3756cd6f5079', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'status': 'completed', 'code': 200} Nov 05 14:54:56.624670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-107fcb7a-3fea-441e-8f6a-2e60b99a6f68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:56.626370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-107fcb7a-3fea-441e-8f6a-2e60b99a6f68 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 1135 time: 0.0791998 Nov 05 14:54:56.652183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f4d5d2-fa81-426c-a106-527e7163e210 req-3055a6f9-596b-4919-8b35-3e4f39307886 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:56.653863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-74f4d5d2-fa81-426c-a106-527e7163e210 req-3055a6f9-596b-4919-8b35-3e4f39307886 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 982 time: 0.0706704 Nov 05 14:54:56.742516 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-bd73a9f6-31b9-4286-8164-3ed5ad896faf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1036 time: 0.1085258 Nov 05 14:54:56.766994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-74f4d5d2-fa81-426c-a106-527e7163e210 req-65ae3da0-5736-4879-8f2a-ce05b41abfda tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782888 Nov 05 14:54:56.816268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-e7c7f988-104f-492f-bf5e-3c5d2f014962 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:56.817736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-e7c7f988-104f-492f-bf5e-3c5d2f014962 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 200 len: 835 time: 0.0682802 Nov 05 14:54:56.865369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-4f8d6533-ef3b-4736-891c-57118b888fb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:56.866875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-4f8d6533-ef3b-4736-891c-57118b888fb0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0416636 Nov 05 14:54:56.959839 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-f1026399-2135-48e1-8034-e0b38b9617a3 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850747 Nov 05 14:54:57.049820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a602e08-eab7-4856-bc80-6b87e4b0826f req-10cff551-ed9d-4a68-9cfa-c0cf1b5c9709 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829728 Nov 05 14:54:57.142049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758d844-57ab-4299-943f-076f3d77f163 req-cc6e776a-4bec-467e-b268-4ab4cba0d945 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:57.143473 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-cc6e776a-4bec-467e-b268-4ab4cba0d945 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 1135 time: 0.0413728 Nov 05 14:54:57.237341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758d844-57ab-4299-943f-076f3d77f163 req-637b173b-fc92-49d0-be84-4f775b249cd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:57.238758 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-637b173b-fc92-49d0-be84-4f775b249cd4 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 898 time: 0.0883353 Nov 05 14:54:57.312804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-25220fd0-0a64-448a-ab66-3de240d79383 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1036 time: 0.0641422 Nov 05 14:54:57.369724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758d844-57ab-4299-943f-076f3d77f163 req-983fb6a0-3643-4c15-9d38-8e2b48baeb70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:57.371221 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-983fb6a0-3643-4c15-9d38-8e2b48baeb70 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 200 len: 835 time: 0.0501101 Nov 05 14:54:57.418178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758d844-57ab-4299-943f-076f3d77f163 req-63a85275-6833-448d-a470-c6937d6fe02e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:57.419686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-63a85275-6833-448d-a470-c6937d6fe02e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0410547 Nov 05 14:54:57.514277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-6bc99620-3026-48b7-a2f4-9839872d0755 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874815 Nov 05 14:54:57.615053 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6758d844-57ab-4299-943f-076f3d77f163 req-b4324810-67b5-4ebf-a7ee-758449170627 service neutron] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879431 Nov 05 14:54:57.896155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1099a4a6-dbc7-4c08-85f3-9c1295e38301 req-57329c4f-8828-4d4e-bb71-2ce0de187716 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:57.897733 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1099a4a6-dbc7-4c08-85f3-9c1295e38301 req-57329c4f-8828-4d4e-bb71-2ce0de187716 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 982 time: 0.0642633 Nov 05 14:54:57.953364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1099a4a6-dbc7-4c08-85f3-9c1295e38301 req-36b17e72-cee0-48df-8002-c1eefb236e4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495579 Nov 05 14:54:59.108768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80bc4a02-416f-4ee4-a776-e647334538fa req-cd1b67ee-bc21-450a-b60f-7fe9f25d396e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:54:59.110529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-80bc4a02-416f-4ee4-a776-e647334538fa req-cd1b67ee-bc21-450a-b60f-7fe9f25d396e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 982 time: 0.0659504 Nov 05 14:54:59.117804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:54:59.174757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-80bc4a02-416f-4ee4-a776-e647334538fa req-fcc2cb1b-9c5d-471c-855e-0310d2d31901 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497611 Nov 05 14:54:59.237745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:59.262216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'port_id': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'mac_address': 'fa:16:3e:46:07:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 606, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:54:59.324943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:59.337351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:54:59.362832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:54:59.371486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:54:59.432611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=9']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:54:59.578042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['5c3c9dbf-eb02-4e10-b23d-1333163dfea7'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:55:00.339268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d2fdea-52a8-4625-a79e-01c01c276153 req-1c8cbc91-8927-4a12-a41b-950e5ca79121 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:00.343008 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-90d2fdea-52a8-4625-a79e-01c01c276153 req-1c8cbc91-8927-4a12-a41b-950e5ca79121 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 983 time: 0.0898960 Nov 05 14:55:00.412969 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-90d2fdea-52a8-4625-a79e-01c01c276153 req-ba8b6e2c-a68e-4bad-bf62-2adcca47afc9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628037 Nov 05 14:55:01.132505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:01.199158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:55:01.204393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:01.204826 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:01.297911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:01.326525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8cf68723-fa29-44ed-ac06-3756cd6f5079', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:01.328778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96f56477-15c2-4bbb-b48c-52daaa29bb06" -d '{"events": [{"server_uuid": "8cf68723-fa29-44ed-ac06-3756cd6f5079", "name": "network-vif-plugged", "status": "completed", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:01.342629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:01.347679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:01.384585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-737508d3-d52d-4512-af02-6dd2642a4772 x-openstack-request-id: req-737508d3-d52d-4512-af02-6dd2642a4772 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:01.385052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8cf68723-fa29-44ed-ac06-3756cd6f5079", "name": "network-vif-plugged", "status": "completed", "tag": "5c3c9dbf-eb02-4e10-b23d-1333163dfea7", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:01.385388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-737508d3-d52d-4512-af02-6dd2642a4772 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:01.386054 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8cf68723-fa29-44ed-ac06-3756cd6f5079', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c3c9dbf-eb02-4e10-b23d-1333163dfea7', 'code': 200} Nov 05 14:55:01.411717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=10']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:01.544955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c179d390-0cb8-4827-90de-c029ac024467 req-30262fa2-c848-4aba-b963-dd855e92bf7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:01.552791 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c179d390-0cb8-4827-90de-c029ac024467 req-30262fa2-c848-4aba-b963-dd855e92bf7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0609460 Nov 05 14:55:01.587717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3ab7b7-30cb-4c52-84cc-b29e40e235e2 req-68eb3708-89f9-4ed2-a0a5-acd800631098 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:01.590122 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0e3ab7b7-30cb-4c52-84cc-b29e40e235e2 req-68eb3708-89f9-4ed2-a0a5-acd800631098 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 1138 time: 0.0576127 Nov 05 14:55:01.600557 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c179d390-0cb8-4827-90de-c029ac024467 req-80b8ce54-46e9-4e39-848d-13c382dd093e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468912 Nov 05 14:55:01.642010 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0e3ab7b7-30cb-4c52-84cc-b29e40e235e2 req-bfa6b8ab-5d99-4ff0-92cd-22948f6d1a6e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442541 Nov 05 14:55:02.752658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff8d487-187a-4bda-8595-a0d141e396d3 req-3afb4882-afe2-44ff-800e-e20bc6dae655 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:02.754110 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dff8d487-187a-4bda-8595-a0d141e396d3 req-3afb4882-afe2-44ff-800e-e20bc6dae655 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0799813 Nov 05 14:55:02.817004 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dff8d487-187a-4bda-8595-a0d141e396d3 req-8c418ca4-c1f3-45eb-bf68-bbc5b33645d2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561943 Nov 05 14:55:03.382760 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-4314c739-572e-47cc-996c-18aa3e3d2043 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-343465885&fields=id&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 267 time: 0.0476282 Nov 05 14:55:03.493161 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-0b462561-c7aa-4b35-9615-305a565b0acb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:03.494626 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-0b462561-c7aa-4b35-9615-305a565b0acb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.1051605 Nov 05 14:55:03.509995 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-7bad934c-04ac-4a84-8865-326e2dc3d423 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/quotas/747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 375 time: 0.0096562 Nov 05 14:55:03.567575 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-5183f594-a02b-4319-b692-4e4924f371f5 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0521948 Nov 05 14:55:03.583554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-8978e9d7-686e-4b61-8adb-7f6827a5cce4 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 14:55:03.584522 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-8978e9d7-686e-4b61-8adb-7f6827a5cce4 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050068 Nov 05 14:55:03.673413 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-5e5e7c9a-9324-4ee4-9667-ffea2b819e3e service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833194 Nov 05 14:55:03.761360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-02debd7f-24db-4020-8dd5-27faf0c94552 service neutron] 10.222.0.30 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814328 Nov 05 14:55:03.937832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203723ba-9d1b-483b-b035-01664dc9e8b7 req-fede1ba7-5023-46ea-9792-31c57d02f584 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:03.939339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-203723ba-9d1b-483b-b035-01664dc9e8b7 req-fede1ba7-5023-46ea-9792-31c57d02f584 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0507257 Nov 05 14:55:04.001014 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-203723ba-9d1b-483b-b035-01664dc9e8b7 req-d8da7684-207f-4c68-838b-14720e9ede7c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549438 Nov 05 14:55:04.048479 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-32afec14-2f19-419a-ae1b-ddae68ae56b6 req-d6a9d3ca-e656-4332-a03d-bec8e01d51c4 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0282800 Nov 05 14:55:04.125831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00a2664-6fba-484e-bb23-493f16a5ca44 req-c7314381-7355-442a-af60-6531a1b792ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:04.127476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e00a2664-6fba-484e-bb23-493f16a5ca44 req-c7314381-7355-442a-af60-6531a1b792ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0502288 Nov 05 14:55:04.177661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e00a2664-6fba-484e-bb23-493f16a5ca44 req-6b73b75f-80f0-4cee-94c5-8270cc759a5d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443099 Nov 05 14:55:04.200691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46716) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:04.282839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b490f9b-e507-45cb-b7b6-affa527f77b3 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:04.284382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7b490f9b-e507-45cb-b7b6-affa527f77b3 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079&network_id=a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 200 len: 1133 time: 0.0826859 Nov 05 14:55:04.498153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49060b2c-f200-4d0c-9ec7-95783d96de88 req-572e464b-b983-4a12-94c9-2af062874853 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:04.499670 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49060b2c-f200-4d0c-9ec7-95783d96de88 req-572e464b-b983-4a12-94c9-2af062874853 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0487258 Nov 05 14:55:04.544943 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:55:04.551741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49060b2c-f200-4d0c-9ec7-95783d96de88 req-b9d7e566-a21d-4af1-abbb-93c32982746e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457439 Nov 05 14:55:04.979220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-8e4b6b51-d5f9-493f-8661-e8add9dfe168 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:04.980703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-8e4b6b51-d5f9-493f-8661-e8add9dfe168 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 812 time: 0.1069508 Nov 05 14:55:05.059770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-909687be-4456-47b9-a1e4-6f5c596793b6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=747df015bfd341929de773100c6c68ae HTTP/1.1" status: 200 len: 379 time: 0.0700443 Nov 05 14:55:05.070002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'port': {'device_id': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'admin_state_up': True, 'tenant_id': '747df015bfd341929de773100c6c68ae', 'security_groups': ['04822744-30be-4b89-a4f8-6ca1fd516d0f']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:05.152435 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-22db0154-b668-4ad8-9fce-5dfed6a7bfb0 req-3d148fc8-1223-4445-82fd-92d1e5783b99 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0311027 Nov 05 14:55:05.181943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Made reservation on behalf of 747df015bfd341929de773100c6c68ae for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:55:05.185703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.320753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.20.0.8 (45055355-0dd4-4c48-858a-f131e1d1f8bc/a738c6ea-0bb8-45cf-87bb-1b3689e6e451/c2c61a54-6917-4dd2-8d33-21887a41b601) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:05.460546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.497581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.539646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:05.546791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:05.551267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:05.573374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:05.611018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:05.613486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.638176 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fce883b6-4a3e-42a7-a636-053aa23665e7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5724106 Nov 05 14:55:05.660816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Request body: {'port': {'device_id': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:05.758124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c629594f-32cb-4e66-a236-a9802d8646e5 req-7f81b8e5-f0a0-4165-947b-aa1aacf15b73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:05.759470 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c629594f-32cb-4e66-a236-a9802d8646e5 req-7f81b8e5-f0a0-4165-947b-aa1aacf15b73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.1139727 Nov 05 14:55:05.763628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.850351 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c629594f-32cb-4e66-a236-a9802d8646e5 req-288c94ba-fcbb-4791-ad90-fa5f0fa07e38 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=c875a63f-b449-4c0d-8012-d0bacbd6e9ea&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826845 Nov 05 14:55:05.864205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-535f5ab2-659b-4ad4-9abf-7d1d74313738 None None] Provisioning complete for port c2c61a54-6917-4dd2-8d33-21887a41b601 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:05.865704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-535f5ab2-659b-4ad4-9abf-7d1d74313738 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:05.900597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-535f5ab2-659b-4ad4-9abf-7d1d74313738 None None] Port c2c61a54-6917-4dd2-8d33-21887a41b601 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:55:05.904333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-028b9025-6558-4777-9882-4736e1ae1724 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:05.905987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-028b9025-6558-4777-9882-4736e1ae1724 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 985 time: 0.0872269 Nov 05 14:55:05.953367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-57161c18-b3a2-48c9-b523-540b5d499534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:05.954769 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-57161c18-b3a2-48c9-b523-540b5d499534 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0421948 Nov 05 14:55:06.059648 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-d36dd448-68ee-4081-bb54-30e19e06aa9f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.0988026 Nov 05 14:55:06.070650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:06.100602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2c61a54-6917-4dd2-8d33-21887a41b601 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:55:06.109266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.123748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Transition to ACTIVE for port object c2c61a54-6917-4dd2-8d33-21887a41b601 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:55:06.126878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.130814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.244196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Attempting to bind port c2c61a54-6917-4dd2-8d33-21887a41b601 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:55:06.244595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Attempting to bind port c2c61a54-6917-4dd2-8d33-21887a41b601 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:55:06.244890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Attempting to bind port c2c61a54-6917-4dd2-8d33-21887a41b601 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:06.249473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Pushing event updated for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:06.251858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Port c2c61a54-6917-4dd2-8d33-21887a41b601 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:55:06.252181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Attempting to bind port c2c61a54-6917-4dd2-8d33-21887a41b601 on network 45055355-0dd4-4c48-858a-f131e1d1f8bc {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:06.258584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:55:06.259074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Checking segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:06.259288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Bound using segment: {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:55:06.259697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Bound port: c2c61a54-6917-4dd2-8d33-21887a41b601, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'de99c3ed-af20-4d87-a556-619f37cf0e36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 644, 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:55:06.260050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.297640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:06.328403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:06.331628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c2c61a54-6917-4dd2-8d33-21887a41b601,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:55:06.342212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.352054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] For port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7, host hv-neutron-8168, cleared binding levels {{(pid=113581) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:06.403794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Pushing event updated for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:06.421836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] device_id is not set on port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 yet. {{(pid=113581) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 05 14:55:06.428172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:06.429309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.432236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-a9fcdf2e-b1f8-4eaa-9b1a-d4c6dc560891 service neutron] 10.222.0.32 "PUT /v2.0/ports/c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 200 len: 1093 time: 0.7749002 Nov 05 14:55:06.433384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:06.436059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37edca87-9f1b-49ff-8433-de839277554c" -d '{"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:06.446931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebc996a-a521-486c-b2ca-6de2514cbaff req-6543b557-d170-446d-b6df-09dc32d99121 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:06.449590 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aebc996a-a521-486c-b2ca-6de2514cbaff req-6543b557-d170-446d-b6df-09dc32d99121 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.1147258 Nov 05 14:55:06.460846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.483073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:06.517607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb0570e7-0b9d-40fb-bdd8-3a84d0863287 x-openstack-request-id: req-cb0570e7-0b9d-40fb-bdd8-3a84d0863287 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:06.517899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:06.518152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cb0570e7-0b9d-40fb-bdd8-3a84d0863287 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:06.518555 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'status': 'completed', 'code': 200} Nov 05 14:55:06.534929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-1facf927-f753-4a0d-8e6d-e4549ba1dc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:06.540551 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-1facf927-f753-4a0d-8e6d-e4549ba1dc7a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1096 time: 0.0580494 Nov 05 14:55:06.598285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-c98c2a9e-a9b8-40c8-99cf-5293280786ed service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 200 len: 217 time: 0.0497928 Nov 05 14:55:06.676531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fab85dbc-8117-4c82-a1a3-60da90463faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:06.678185 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-fab85dbc-8117-4c82-a1a3-60da90463faf service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0724740 Nov 05 14:55:06.753710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-5e3fa471-4989-42b7-ac5d-73c6c987907d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:06.755630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-5e3fa471-4989-42b7-ac5d-73c6c987907d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0652974 Nov 05 14:55:06.919213 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-8e2187bf-3d48-4260-b7b5-d2753358df81 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1552601 Nov 05 14:55:07.004839 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8226bf27-c6fe-4b75-aa74-ec4d206b0c3c req-37cad0e8-63fb-444f-81f2-787f660ef339 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=8cf68723-fa29-44ed-ac06-3756cd6f5079 HTTP/1.1" status: 200 len: 210 time: 0.0540304 Nov 05 14:55:07.013991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] No DVR routers for this DVR port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:55:07.022309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aebc996a-a521-486c-b2ca-6de2514cbaff req-223a4ddc-b361-4af7-aedd-539c84ad7663 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.5579925 Nov 05 14:55:07.024489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Pushing event updated for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=11']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:07.029922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-18517295-054f-4721-97c0-c40654d21ed6 None None] Provisioning complete for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:07.030454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18517295-054f-4721-97c0-c40654d21ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:07.060659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-456e2c8e-f855-4f3a-a3d6-64870145cbc3 req-899bb261-ec8f-4508-869d-4cc922ab1154 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1313295 Nov 05 14:55:07.087416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-18517295-054f-4721-97c0-c40654d21ed6 None None] Port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:55:07.159243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37edca87-9f1b-49ff-8433-de839277554c req-2abcea5d-f911-4167-8fd5-a3a35e83b76d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:07.160971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-2abcea5d-f911-4167-8fd5-a3a35e83b76d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1096 time: 0.0470948 Nov 05 14:55:07.202017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] In _notify_port_updated(), no bound segment for port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 on network a5de5a3e-8530-4d22-a002-d8454ed4666a {{(pid=113581) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Nov 05 14:55:07.202881 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:07.203487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:07.204813 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8560f70e-cda3-4179-a7af-38697e6ad1b4 req-8f628a2d-a51d-4782-a225-c55ea1b80fb9 service neutron] 10.222.0.32 "PUT /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 200 len: 1028 time: 1.1388240 Nov 05 14:55:07.258173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37edca87-9f1b-49ff-8433-de839277554c req-5bb5f1de-3e25-440c-85b2-a2eceb7e007b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:07.260514 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-5bb5f1de-3e25-440c-85b2-a2eceb7e007b service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.0918689 Nov 05 14:55:07.303126 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-27aace3e-857f-4c19-a4ad-0a291d3c8750 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 200 len: 217 time: 0.0354540 Nov 05 14:55:07.364490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37edca87-9f1b-49ff-8433-de839277554c req-6b62d334-30d7-4823-bfba-9d1529c8fd45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:07.367135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-6b62d334-30d7-4823-bfba-9d1529c8fd45 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0517337 Nov 05 14:55:07.416351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37edca87-9f1b-49ff-8433-de839277554c req-ba1e3d63-9cf8-4735-88bf-0e52787c4458 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:07.417786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-ba1e3d63-9cf8-4735-88bf-0e52787c4458 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0425460 Nov 05 14:55:07.508601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-58cdcf4c-dd44-4e20-b03a-d4d472c6e016 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825269 Nov 05 14:55:07.611913 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37edca87-9f1b-49ff-8433-de839277554c req-19510338-c345-4126-a25a-b79569d7dac0 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0952282 Nov 05 14:55:08.109369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:08.158662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1b2594-96c3-4518-ba94-3a25bd5e725a req-13c27c50-918c-4435-bb67-96ee203e638e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:08.160185 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ca1b2594-96c3-4518-ba94-3a25bd5e725a req-13c27c50-918c-4435-bb67-96ee203e638e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0509739 Nov 05 14:55:08.170611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.197607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.213092 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ca1b2594-96c3-4518-ba94-3a25bd5e725a req-e1073f6d-18d0-4d8f-bf2c-b4c5a33baf41 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466149 Nov 05 14:55:08.256747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.272483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.272483 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/6cea3aec-e153-4274-9cf6-33b1e4faf8ba HTTP/1.1" status: 204 len: 168 time: 0.1502221 Nov 05 14:55:08.283390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc05b9df-4ba3-431c-a7ce-d28826f57531 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cea3aec-e153-4274-9cf6-33b1e4faf8ba,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:08.346126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46742) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:08.535960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port f9686c29-593f-4aa1-b3ca-749abafa9133 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:55:08.536304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.621054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.621511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.634483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for f9686c29-593f-4aa1-b3ca-749abafa9133 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:55:08.817214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.846184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=f9686c29-593f-4aa1-b3ca-749abafa9133,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:08.913258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:08.913633 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP c27bfc85-1e0e-41a6-8707-f349181224a9 disassociated (deleted). External IP: 172.26.5.3, port: 5c3c9dbf-eb02-4e10-b23d-1333163dfea7. Nov 05 14:55:09.139765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:55:09.145393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:55:09.178967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:55:09.257843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:09.264044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.272378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Sync routers for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:09.288978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:09.289984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:09.317838 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c0c303ec-7cea-46a1-991a-8824500ce7ed tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/c27bfc85-1e0e-41a6-8707-f349181224a9 HTTP/1.1" status: 204 len: 168 time: 0.9704065 Nov 05 14:55:09.380579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98099ed6-6327-4113-9bb6-6f2543b06dd9 req-2cc7a106-d464-4832-b188-f767835b3fea tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:09.384939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-98099ed6-6327-4113-9bb6-6f2543b06dd9 req-2cc7a106-d464-4832-b188-f767835b3fea tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0862186 Nov 05 14:55:09.437161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46750) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:09.445098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-98099ed6-6327-4113-9bb6-6f2543b06dd9 req-636d6fac-2ad0-4cf9-afb8-12cd81a56fb6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0569253 Nov 05 14:55:09.481514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:09.508065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.538015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.607931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.611952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.617129 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/160f3064-995e-4c83-a432-82e261c3a9ee HTTP/1.1" status: 204 len: 168 time: 0.1781280 Nov 05 14:55:09.628150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c1607ed-f9ed-4902-91e1-14103e6dfe24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=160f3064-995e-4c83-a432-82e261c3a9ee,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:09.655851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46754) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:09.733466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:09.755430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:55:09.755925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.761642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Checking router: 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:09.772220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:09.772873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:09.848706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:09.861184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 5c3c9dbf-eb02-4e10-b23d-1333163dfea7 owned by {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:55:09.891208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:09.999584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:10.031079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=5c3c9dbf-eb02-4e10-b23d-1333163dfea7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:10.114873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:10.121717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5faeb5c2-e245-4532-add4-ce82395f7e1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/ports/5c3c9dbf-eb02-4e10-b23d-1333163dfea7 HTTP/1.1" status: 204 len: 168 time: 0.4619250 Nov 05 14:55:10.121996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46756) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:10.125947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:10.160838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d369b4f-5be3-477d-9845-3cc1a56924b6 None None] The sync data for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv is: [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3cbed2a7-0da4-4d8f-a686-cce419a0f8e8', 'name': '', 'network_id': 'a5de5a3e-8530-4d22-a002-d8454ed4666a', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:99:54:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_interface', 'standard_attr_id': 1380, 'fixed_ips': [{'subnet_id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:34Z', 'updated_at': '2021-11-05T14:54:38Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '7a2e0af8-2aa2-490b-b6f8-e472773de905', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:10.488762 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9860ed1-3d9a-4bf3-a7f3-29040515a999 None None] New status for floating IP c27bfc85-1e0e-41a6-8707-f349181224a9: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:55:10.663602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eccbc2a5-c817-49c5-8b26-9ade135871f3 req-9170cc73-24bd-4f80-81b5-2538524eb816 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:10.667127 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eccbc2a5-c817-49c5-8b26-9ade135871f3 req-9170cc73-24bd-4f80-81b5-2538524eb816 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0963192 Nov 05 14:55:10.719143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:10.743021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-eccbc2a5-c817-49c5-8b26-9ade135871f3 req-7340a2f2-7ffd-4ce8-a513-0bfb553c0314 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678251 Nov 05 14:55:11.301391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:55:11.301724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:11.400188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:11.400589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:11.413184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:55:11.614602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:11.646873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=3cbed2a7-0da4-4d8f-a686-cce419a0f8e8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:11.811797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:11.924118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce7ee32-b83c-4cc7-a0f4-d63b8bb8f73c req-6f0fda04-fccf-40bd-ba5a-499cec83c0f7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:11.926229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ce7ee32-b83c-4cc7-a0f4-d63b8bb8f73c req-6f0fda04-fccf-40bd-ba5a-499cec83c0f7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.1085522 Nov 05 14:55:12.029394 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ce7ee32-b83c-4cc7-a0f4-d63b8bb8f73c req-402cd861-20be-412f-a256-7492d44d44f1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0698271 Nov 05 14:55:12.138171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:55:12.250829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:12.256501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cbc61661-dd0a-4cc2-a53d-499e077a1ff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/9ea90ae0-e2d5-4e35-8583-315a1e07eb45/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1333668 Nov 05 14:55:12.259506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:12.262312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Sync routers for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:12.273028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:12.273632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:12.318813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet 7a2e0af8-2aa2-490b-b6f8-e472773de905 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:55:12.321934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.368951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.383450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:12.454011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.511757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.540155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=7a2e0af8-2aa2-490b-b6f8-e472773de905,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:12.542189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.546789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b65e725b-c6c6-40f8-8cba-92afe20307d1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/7a2e0af8-2aa2-490b-b6f8-e472773de905 HTTP/1.1" status: 204 len: 168 time: 0.2858224 Nov 05 14:55:12.549490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46764) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:12.552269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7de882fc-18b4-4f72-b70d-a655793ce330 None None] Network a5de5a3e-8530-4d22-a002-d8454ed4666a requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:55:12.657973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.765464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.788846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107'}], 'enable_snat': True}, 'gw_port_id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:55:11Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'abcfb310-8a7e-48f2-819a-6c63046320c5', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:92:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1378, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:54:32Z', 'updated_at': '2021-11-05T14:54:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:12.817429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Checking router: 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:12.817699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port abcfb310-8a7e-48f2-819a-6c63046320c5 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:55:12.818232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.830498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Routers {'9ea90ae0-e2d5-4e35-8583-315a1e07eb45'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:12.831090 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:12.904792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78f89ed9-3508-4132-8b22-59de78603def None None] DHCP port deletion for a5de5a3e-8530-4d22-a002-d8454ed4666a request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:55:12.909866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port abcfb310-8a7e-48f2-819a-6c63046320c5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=abcfb310-8a7e-48f2-819a-6c63046320c5,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:12.910312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:12.922828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for abcfb310-8a7e-48f2-819a-6c63046320c5 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:55:12.945725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] Set router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:13.008840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:55:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:13.037895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec7f842-fd77-4578-b960-9f635fa0b7af None None] The sync data for ids ['9ea90ae0-e2d5-4e35-8583-315a1e07eb45'] in dv-neutron-816850-1-hyperv is: [{'id': '9ea90ae0-e2d5-4e35-8583-315a1e07eb45', 'name': 'tempest-TestNetworkBasicOps-router-255039042', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:54:31Z', 'updated_at': '2021-11-05T14:55:12Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:13.053907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Deleting port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:55:13.054282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.099890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.126899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=abcfb310-8a7e-48f2-819a-6c63046320c5,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:13.127195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-78f89ed9-3508-4132-8b22-59de78603def None None] For port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,segment=NetworkSegment(4e026e42-23c3-4bb6-aec4-57555ebfb198),segment_id=4e026e42-23c3-4bb6-aec4-57555ebfb198)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:13.127687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.150718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Calling delete_port for 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:55:13.169353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15887686-b61d-42e5-a07b-d3cc837af1f6 req-6781ef48-ee1f-449f-9215-6ec13a92c268 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:13.170915 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-15887686-b61d-42e5-a07b-d3cc837af1f6 req-6781ef48-ee1f-449f-9215-6ec13a92c268 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0513172 Nov 05 14:55:13.199086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.229110 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-15887686-b61d-42e5-a07b-d3cc837af1f6 req-2a9dac1e-16bf-47bb-b609-fdb728be4835 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522375 Nov 05 14:55:13.238655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.268236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f89ed9-3508-4132-8b22-59de78603def None None] Pushing event deleted for resources: {'Port': ['ID=07d8539a-bcc5-45fb-9b0f-0c18e57dbf04,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:13.272061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78f89ed9-3508-4132-8b22-59de78603def None None] No DVR routers for this DVR port 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:55:13.308586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.310643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.351800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.352351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router 9ea90ae0-e2d5-4e35-8583-315a1e07eb45 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:55:13.359123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.360259 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-25aa6909-9553-4c43-b570-3f45fbb6ceea tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/9ea90ae0-e2d5-4e35-8583-315a1e07eb45 HTTP/1.1" status: 204 len: 168 time: 0.8098516 Nov 05 14:55:13.362988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46768) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:13.445178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.540160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.561806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a5de5a3e-8530-4d22-a002-d8454ed4666a']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:13.571246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4e026e42-23c3-4bb6-aec4-57555ebfb198') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:13.571543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4e026e42-23c3-4bb6-aec4-57555ebfb198') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:13.580972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.594713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.601294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:55:13.601678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:55:13.604717 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:55:13.664407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.671086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.674206 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/a5de5a3e-8530-4d22-a002-d8454ed4666a HTTP/1.1" status: 204 len: 168 time: 0.3102953 Nov 05 14:55:13.683725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46770) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:13.686066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b7945a-5186-4e29-8a13-0544fd63db1f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=a5de5a3e-8530-4d22-a002-d8454ed4666a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:13.696983 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7ec4853c-d3aa-4ca4-a433-41f675fb9c40 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/agents?agent_type=L3+agent HTTP/1.1" status: 200 len: 838 time: 0.0120673 Nov 05 14:55:13.699361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46772) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:13.704082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1393385313', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:13.724890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:55:13.728264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.750950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 623} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:55:13.759370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.759706 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment 9ac6169d-c1bf-4e69-8993-6e4cd0088c45 of type vlan for network 1ab38286-de85-4029-9282-575e3809e459 Nov 05 14:55:13.798193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.806122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:55:13.824669 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.827166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:55:13.827514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3cbed2a7-0da4-4d8f-a686-cce419a0f8e8 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:55:13.827933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:55:13.831203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:13.831203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.849895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:55:13.850435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 07d8539a-bcc5-45fb-9b0f-0c18e57dbf04 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:55:13.893522 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1931143 Nov 05 14:55:13.896303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46774) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:13.900874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:13.907153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60f11b3-218c-4796-a823-5b90340e7d05 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=1ab38286-de85-4029-9282-575e3809e459,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:13.919650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 1ab38286-de85-4029-9282-575e3809e459 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:55:13.926107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.927684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:13.981364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.122098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.310483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.353171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.412787 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11959b5-124d-47af-8215-81e1f2509f1c req-50ea77c4-0af3-45e0-ab43-9c1545302449 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:14.414267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a11959b5-124d-47af-8215-81e1f2509f1c req-50ea77c4-0af3-45e0-ab43-9c1545302449 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.1055183 Nov 05 14:55:14.502785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a11959b5-124d-47af-8215-81e1f2509f1c req-507480d4-0a31-4233-9134-8a25ade2485e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0814214 Nov 05 14:55:14.511990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.167 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:14.612655 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.645137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:14.679821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:14.682508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:14.684944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:14.718861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:15.219008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:15.377048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device abcfb310-8a7e-48f2-819a-6c63046320c5 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:55:15.396963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: abcfb310-8a7e-48f2-819a-6c63046320c5 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:55:15.397305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device abcfb310-8a7e-48f2-819a-6c63046320c5 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:55:15.406923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:15.533574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:55:15.623348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f51417d-7386-499a-995e-db966937eb32 req-7cb21031-fc21-4dc4-a66d-f9469312a5de tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:15.624844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f51417d-7386-499a-995e-db966937eb32 req-7cb21031-fc21-4dc4-a66d-f9469312a5de tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0494883 Nov 05 14:55:15.642404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:15.654250 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:15.664221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:15.665473 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-028f415b-c415-4991-9f52-6582ca118428 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.7681351 Nov 05 14:55:15.667934 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:15.668677 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:15.668854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46780) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:15.706509 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f51417d-7386-499a-995e-db966937eb32 req-12e411f9-46b5-48e2-8977-e028db6b3e89 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0756626 Nov 05 14:55:15.708947 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d883c684-142f-46e2-80fc-4fc00ad9ac1c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0392537 Nov 05 14:55:15.711593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46782) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:15.772555 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:15.800577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46e9f3c3-333c-44a3-be7c-3dcc073d2c7e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:15.802072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-46e9f3c3-333c-44a3-be7c-3dcc073d2c7e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0895591 Nov 05 14:55:15.804888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46784) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:15.832494 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c04a5709-0156-4e33-bfc1-6e4fe6c07753 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0265512 Nov 05 14:55:15.835411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46786) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:15.840039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-986910101', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:15.924548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:55:15.928103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:15.949099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:14Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:15.975057 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:15.975546 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Updating router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:55:16.000078 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.110440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.178904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=fb7287cf-07fb-4211-aed5-8a75b33e4ff3,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:16.183269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:16.183632 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 1ab38286-de85-4029-9282-575e3809e459, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:55:16.200964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 1ab38286-de85-4029-9282-575e3809e459 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:55:16.210754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 1ab38286-de85-4029-9282-575e3809e459) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:16.215214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:16.215913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.221898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c59b480-96d1-4717-a2dd-a44ebc392ba0 None None] Network 1ab38286-de85-4029-9282-575e3809e459 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:55:16.233261 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42dce3b1-4883-4c5b-bc08-5834420564c5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.3968534 Nov 05 14:55:16.236397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46788) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:16.249139 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.256197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1c59b480-96d1-4717-a2dd-a44ebc392ba0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:55:16.297247 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:55:16.307483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a778331-b6be-4f2a-aa1a-6e3f54bd246e None None] Network 1ab38286-de85-4029-9282-575e3809e459 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:55:16.310081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Attempting to bind port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:55:16.310644 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Attempting to bind port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:55:16.311189 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Attempting to bind port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:16.316244 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc41dbc6-35ae-475e-b8ab-0429eab24651 None None] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:16.319488 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:55:16.320074 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:16.320699 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.321261 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:55:16.321894 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Bound port: b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:55:16.322533 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.377648 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:16.381190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:55:16.385891 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6a778331-b6be-4f2a-aa1a-6e3f54bd246e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:55:16.388721 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:55:16.397558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c94e8b38-4a82-4a9f-a8e7-127e559ad536 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:55:16.439591 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:16.440203 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:16.483962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c94e8b38-4a82-4a9f-a8e7-127e559ad536 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:55:16.484230 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc41dbc6-35ae-475e-b8ab-0429eab24651 None None] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:16.560256 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:16.711314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.723132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-1ab38286-de85-4029-9282-575e3809e459', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:55:16.724762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:16.767716 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:14Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:16.797077 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521fbd2b-76b6-442a-ac8b-0234a71c77c7 None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:14Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:16.894693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Allocated IP 172.20.0.2 (1ab38286-de85-4029-9282-575e3809e459/fb7287cf-07fb-4211-aed5-8a75b33e4ff3/33e9c054-b1f2-4ef5-b25a-a97ba2dc3306) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:16.912362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0f7749-2bda-4b92-827c-965e9f442c86 req-c52367ed-3d46-440d-bcb5-053cec7ad49e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:16.913914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d0f7749-2bda-4b92-827c-965e9f442c86 req-c52367ed-3d46-440d-bcb5-053cec7ad49e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.1126633 Nov 05 14:55:17.043870 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d0f7749-2bda-4b92-827c-965e9f442c86 req-96762883-0e0d-435b-afbb-ddf599b39f13 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1180475 Nov 05 14:55:17.081077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.090224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.126959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Network 1ab38286-de85-4029-9282-575e3809e459 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:17.129943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:17.133623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:17.147927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (1ab38286-de85-4029-9282-575e3809e459/fb7287cf-07fb-4211-aed5-8a75b33e4ff3/e499f4e1-8f24-460c-bd1f-748ef97593ff) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:17.168289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Pushing event updated for resources: {'Port': ['ID=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:17.209479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Attempting to bind port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:55:17.209851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Attempting to bind port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:55:17.210889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Attempting to bind port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 on network 1ab38286-de85-4029-9282-575e3809e459 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:17.216818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:55:17.217852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Checking segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:17.217852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.218137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Bound using segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:55:17.218473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Bound port: 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:55:17.219100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.275294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.287817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] For port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:17.291492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] For port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:55:17.296218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.312717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.365412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 1ab38286-de85-4029-9282-575e3809e459 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:17.365821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c211a421-a1ea-4017-8224-176a05dc5b86 None None] Pushing event updated for resources: {'Port': ['ID=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:17.374097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:17.386374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:17.418373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:17.453775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.478488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:17.547004 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:17.547623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.650728 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.673446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.696604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:17.703530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.770956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:17.944154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:17.948539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.024321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.026081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:18.126573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 1ab38286-de85-4029-9282-575e3809e459 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:18.128064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:18.169267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4a1230-0d78-44a1-942c-e910b3bec616 req-e771884a-a0f6-4f90-90e8-c0cc862eb6d1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.171920 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a4a1230-0d78-44a1-942c-e910b3bec616 req-e771884a-a0f6-4f90-90e8-c0cc862eb6d1 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0579817 Nov 05 14:55:18.193793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.228869 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a4a1230-0d78-44a1-942c-e910b3bec616 req-6511ced1-9dc4-4da5-95b2-146a84e7e7ee tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491710 Nov 05 14:55:18.251514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:55:18.348198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86ea1362-ffa1-470a-9459-6fbaedb8b130 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:55:18.364883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:18.369947 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b63e0778-39ea-4a38-967c-1e24972c1854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1324003 Nov 05 14:55:18.372337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46794) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:18.405016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] Provisioning complete for port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:18.405393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.479456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86ea1362-ffa1-470a-9459-6fbaedb8b130 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:55:18.552295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.552780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.553233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.553673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.554109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.554547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.556304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1ffbc1ac-6662-4991-a861-ae0cf1fba1f6 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1830444 Nov 05 14:55:18.559031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46796) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:18.570303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.614942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.615395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.615831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.616282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.616737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.617171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:18.621603 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-97b70133-e45f-4486-b9e5-193eb4aeaf0b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4004 time: 0.0590141 Nov 05 14:55:18.621945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46798) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:18.630228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] For port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:18.640038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:18.720756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a95197d-ed11-49d6-81a2-371986eaad92 None None] Pushing event updated for resources: {'Port': ['ID=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:18.765445 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-21193449-67c0-4ca2-9f77-7a24fcd6b3be tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3048 time: 0.1420290 Nov 05 14:55:18.976123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:18.986890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:18.987569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:19.064160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46802) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.070970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1380102622', 'description': 'tempest-secgroup-smoke-1380102622 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.105416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.110233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:19.179224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.183341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.186769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c2c61a54-6917-4dd2-8d33-21887a41b601 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:55:19.217481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.221629 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1533835 Nov 05 14:55:19.222232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.224099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a89232-a4f5-47ae-bc33-84940b75136d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e1384018-98f7-418a-aefe-5ae2529af05e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:19.233028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.266485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.366093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.373097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.412025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36698e10-d0be-41ef-9ffb-9d0515a883a4 req-9e1fe5ad-8225-4bfb-9c48-59b7f62e88cb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:19.413754 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36698e10-d0be-41ef-9ffb-9d0515a883a4 req-9e1fe5ad-8225-4bfb-9c48-59b7f62e88cb tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 943 time: 0.0995102 Nov 05 14:55:19.416487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=090e0c89-6389-4708-a2f0-11fa3ba903ab,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:19.423039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.424513 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-27c0477a-be99-42bc-9f4e-97774c9f15db tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2002256 Nov 05 14:55:19.427593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46808) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.432899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.509447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.530896 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36698e10-d0be-41ef-9ffb-9d0515a883a4 req-b10b2be1-e4b9-4117-a427-ec44c34eff5e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0910687 Nov 05 14:55:19.543225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d2cf2db-da36-463f-bf18-660f11b6f745 None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:19.543846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d2cf2db-da36-463f-bf18-660f11b6f745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.598049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.602519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.608417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:19.625476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fd70be62-dfe6-48db-ae81-e250e8a1896e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:19.630271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.632585 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-384eeea7-7e48-4568-81bd-2930c39deebc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2026126 Nov 05 14:55:19.634489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46810) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.640774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.659280 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-4d2cf2db-da36-463f-bf18-660f11b6f745 None None] Port e499f4e1-8f24-460c-bd1f-748ef97593ff cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:55:19.670832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.704025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c2c61a54-6917-4dd2-8d33-21887a41b601,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:19.717496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4d2cf2db-da36-463f-bf18-660f11b6f745 None None] Provisioning complete for port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:19.718240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d2cf2db-da36-463f-bf18-660f11b6f745 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.736136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.742132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.747885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'port_id': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'mac_address': 'fa:16:3e:bb:33:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 644, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:55:19.763153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d086312d-72b6-44de-89c8-ba16cf1eb7be,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:19.778363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.779802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eb712ea9-faad-481d-87ad-c91b239aaaf5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1435978 Nov 05 14:55:19.782793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46812) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.787928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.793778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:19.817408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.833939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:19.834227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Updating router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 port e499f4e1-8f24-460c-bd1f-748ef97593ff binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:55:19.835955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:19.836318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.874630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.878322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.889513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.893754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ad4bc12c-aff8-4a3d-b3a8-92806cec44b3,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:19.904602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.905804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-989fc07d-5ad8-4440-abdd-5c5f342890cd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1219938 Nov 05 14:55:19.908715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46814) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:19.909573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.913649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:19.935296 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:55:19.940699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:19.941701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2c61a54-6917-4dd2-8d33-21887a41b601 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:55:19.996654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c2c61a54-6917-4dd2-8d33-21887a41b601,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:19.998627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.001720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.003799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.019585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de35d3fe-04a2-494b-b3d5-61f6aa208acc,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:20.027218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.028401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9805be8f-c61e-4c10-bf47-92e03655bf16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1186507 Nov 05 14:55:20.031507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46816) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:20.036897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'e1384018-98f7-418a-aefe-5ae2529af05e', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:20.058582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:55:20.063846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.125184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.135806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.156044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b667c944-27e6-470f-ada7-71ad070ba3a7,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:20.165103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.166316 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5ca9bdcd-a15c-49b6-a2b5-43b8d438b7dc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1337607 Nov 05 14:55:20.175421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b3b19ea-63ef-4f33-a8dd-3cd736ae259e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.185769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:20.191293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:20.222507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['c2c61a54-6917-4dd2-8d33-21887a41b601'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:55:20.228069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-d6e8be5f-2252-40b7-b91d-06944e0d7c77 None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:20.228433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d6e8be5f-2252-40b7-b91d-06944e0d7c77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.315463 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-b0bb9c1d-751e-4ae5-830c-a35f445b8606 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1380102622&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0440295 Nov 05 14:55:20.342634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d6e8be5f-2252-40b7-b91d-06944e0d7c77 None None] Port e499f4e1-8f24-460c-bd1f-748ef97593ff cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:55:20.388343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:20.388655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.422906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-16a00294-dd69-45ce-b63e-bdd84c20a09f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:20.424382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-16a00294-dd69-45ce-b63e-bdd84c20a09f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=1ab38286-de85-4029-9282-575e3809e459 HTTP/1.1" status: 200 len: 797 time: 0.1018257 Nov 05 14:55:20.440049 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-c27aa310-2213-4e4a-91d8-845f4615b2bd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0096145 Nov 05 14:55:20.494751 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-a4d05412-b3d4-4e6a-a326-17f9eaf3a47a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0483141 Nov 05 14:55:20.570394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.592080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.657896 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-66d21a04-d937-482a-93cb-af68de88e80a service neutron] 10.222.0.30 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1502078 Nov 05 14:55:20.662711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c59134-4b1c-420c-846d-0bf39068bd96 req-21bc595d-459b-4d88-a12e-44dfc2578e16 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:20.664402 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c59134-4b1c-420c-846d-0bf39068bd96 req-21bc595d-459b-4d88-a12e-44dfc2578e16 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 944 time: 0.0603311 Nov 05 14:55:20.675033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc3405af-937d-4e71-9f80-3d7f47830605 None None] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:20.734604 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c59134-4b1c-420c-846d-0bf39068bd96 req-ec68c34d-bd34-42b9-962b-f8ee9621d414 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0618682 Nov 05 14:55:20.767163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Attempting to bind port e499f4e1-8f24-460c-bd1f-748ef97593ff on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:55:20.767620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Attempting to bind port e499f4e1-8f24-460c-bd1f-748ef97593ff by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:55:20.768067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Attempting to bind port e499f4e1-8f24-460c-bd1f-748ef97593ff on network 1ab38286-de85-4029-9282-575e3809e459 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:20.771032 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-4f05e31c-eccb-493f-9a21-193e5b1a5c98 service neutron] 10.222.0.30 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1015239 Nov 05 14:55:20.782092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 54, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:55:20.782490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Checking segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:20.782872 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.783271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Bound using segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:55:20.783750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Bound port: e499f4e1-8f24-460c-bd1f-748ef97593ff, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:55:20.784130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.883941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:20.894522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e499f4e1-8f24-460c-bd1f-748ef97593ff,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:55:20.900500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:20.957040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ca407a12-3b35-4c4c-9d6e-dcafb10538d7 req-dd5fe655-3f5c-4073-a2c4-ddf8610b6683 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 210 time: 0.0353854 Nov 05 14:55:20.977469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:20.978096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:54:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:20.982618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc3405af-937d-4e71-9f80-3d7f47830605 None None] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:21.034210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:21.034587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:21.147340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:21.436747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:21.490556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e499f4e1-8f24-460c-bd1f-748ef97593ff,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:21.494969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:21.581927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13444e05-fdd5-4fd8-a62e-8eef78649c76 None None] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:21.606139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:20Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:21.639395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dded203-2b29-40ac-8ee7-8624b5fc30dd None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:20Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:21.649472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f3f465a3-6bab-476f-9a3c-a3ef4cffd6f2 None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:21.649840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f3f465a3-6bab-476f-9a3c-a3ef4cffd6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:21.864946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3737bc60-d67f-4132-a5ee-0a533d2ddb38 req-a7991eab-4449-4e99-b36b-56296bd33bc6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:21.866495 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3737bc60-d67f-4132-a5ee-0a533d2ddb38 req-a7991eab-4449-4e99-b36b-56296bd33bc6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 944 time: 0.0555329 Nov 05 14:55:21.940209 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3737bc60-d67f-4132-a5ee-0a533d2ddb38 req-1adbec58-9096-4643-9baf-71613e98fc97 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0673921 Nov 05 14:55:22.040796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-7f89d038-d25c-42dc-bebc-816840832bcd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:22.042797 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-7f89d038-d25c-42dc-bebc-816840832bcd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=1ab38286-de85-4029-9282-575e3809e459 HTTP/1.1" status: 200 len: 797 time: 0.1223421 Nov 05 14:55:22.097233 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-507f6194-5d72-4861-bb49-5b3d7cbaa0dd req-03b22f42-e181-4b85-81e1-143eeba2c663 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 210 time: 0.0319829 Nov 05 14:55:22.128715 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-732a56e1-36d2-491a-9678-04b943b3a4fc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 380 time: 0.0754883 Nov 05 14:55:22.139405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['e1384018-98f7-418a-aefe-5ae2529af05e']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:22.252704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:55:22.256353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.385121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.12 (1ab38286-de85-4029-9282-575e3809e459/fb7287cf-07fb-4211-aed5-8a75b33e4ff3/3b2fd74a-6630-4902-b53c-aaaed08127bc) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:22.405162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6fff5508-f29f-4744-a7ef-507a3a2362e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.531791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.568737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.612473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 1ab38286-de85-4029-9282-575e3809e459 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:22.617744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:22.620113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:22.653547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:22.680585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:22.681219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.698931 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1559a29d-5ac0-4353-b042-09bc9fdcb6a5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5633698 Nov 05 14:55:22.712246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Request body: {'port': {'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:22.766910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.869740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-53b70fd5-dda7-46d4-b2ec-54b639b25c6d None None] Provisioning complete for port 3b2fd74a-6630-4902-b53c-aaaed08127bc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:22.870320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-53b70fd5-dda7-46d4-b2ec-54b639b25c6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:22.907213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-53b70fd5-dda7-46d4-b2ec-54b639b25c6d None None] Port 3b2fd74a-6630-4902-b53c-aaaed08127bc cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:55:23.189796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c2c61a54-6917-4dd2-8d33-21887a41b601 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:23.222296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3bd87d-8687-4a9f-b206-163a5cb69c3c req-4dfdc7e6-f6a0-425e-9b3e-422d0c09cf76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:23.224729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab3bd87d-8687-4a9f-b206-163a5cb69c3c req-4dfdc7e6-f6a0-425e-9b3e-422d0c09cf76 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 932 time: 0.0527828 Nov 05 14:55:23.240767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port c2c61a54-6917-4dd2-8d33-21887a41b601 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:55:23.245038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port c2c61a54-6917-4dd2-8d33-21887a41b601 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:23.245409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.285364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab3bd87d-8687-4a9f-b206-163a5cb69c3c req-f6b9a807-28ea-4865-958d-0b33ed8f02ae tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537794 Nov 05 14:55:23.287411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae3bc9d-b3ff-4e84-adf4-67133e85c116 req-c38567fa-2818-4416-a747-26172cd3e19f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:23.288948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3ae3bc9d-b3ff-4e84-adf4-67133e85c116 req-c38567fa-2818-4416-a747-26172cd3e19f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 944 time: 0.0985746 Nov 05 14:55:23.335698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.358232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:23.360524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7975757-db53-4294-96a3-7677112cd568" -d '{"events": [{"server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "name": "network-vif-plugged", "status": "completed", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:23.374400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c2c61a54-6917-4dd2-8d33-21887a41b601,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:23.375215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3ae3bc9d-b3ff-4e84-adf4-67133e85c116 req-3baeabd1-6aec-41c6-94b0-07c35f071bad tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0778582 Nov 05 14:55:23.379734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.422815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-851f5398-b817-4687-9ac5-6cc5ec84043e x-openstack-request-id: req-851f5398-b817-4687-9ac5-6cc5ec84043e {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:23.422815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "name": "network-vif-plugged", "status": "completed", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:23.425461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-851f5398-b817-4687-9ac5-6cc5ec84043e {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:23.425461 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'code': 200} Nov 05 14:55:23.442875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.452037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3b2fd74a-6630-4902-b53c-aaaed08127bc {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:55:23.458311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:23.460159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.474105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Transition to ACTIVE for port object 3b2fd74a-6630-4902-b53c-aaaed08127bc will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:55:23.477520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.508636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:23.528083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Pushing event updated for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:23.572118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:23.572762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.636185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Attempting to bind port 3b2fd74a-6630-4902-b53c-aaaed08127bc on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:55:23.636543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Attempting to bind port 3b2fd74a-6630-4902-b53c-aaaed08127bc by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:55:23.636878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Attempting to bind port 3b2fd74a-6630-4902-b53c-aaaed08127bc on network 1ab38286-de85-4029-9282-575e3809e459 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:23.638484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089a1d06-7fc2-4cf6-8bab-eea652b4b7a6 req-aa7a0033-b6db-4b8b-a615-5d740d131d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:23.640003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-089a1d06-7fc2-4cf6-8bab-eea652b4b7a6 req-aa7a0033-b6db-4b8b-a615-5d740d131d64 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1098 time: 0.0426395 Nov 05 14:55:23.641737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Port 3b2fd74a-6630-4902-b53c-aaaed08127bc on network 1ab38286-de85-4029-9282-575e3809e459 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:55:23.642072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Attempting to bind port 3b2fd74a-6630-4902-b53c-aaaed08127bc on network 1ab38286-de85-4029-9282-575e3809e459 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:55:23.647722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 55, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:55:23.648057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Checking segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:55:23.648437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Bound using segment: {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:55:23.648948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Bound port: 3b2fd74a-6630-4902-b53c-aaaed08127bc, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ac6169d-c1bf-4e69-8993-6e4cd0088c45', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '1ab38286-de85-4029-9282-575e3809e459'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:55:23.649306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.694541 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-089a1d06-7fc2-4cf6-8bab-eea652b4b7a6 req-96290743-e1ba-4ca6-9041-c47b5297d53b service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476894 Nov 05 14:55:23.719342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:55:23.722796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:55:23.726979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.760487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:23.761110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:23.762893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] 10.222.0.32 "PUT /v2.0/ports/3b2fd74a-6630-4902-b53c-aaaed08127bc HTTP/1.1" status: 200 len: 1094 time: 1.0549853 Nov 05 14:55:23.763061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:23.765602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3eddadf-e69b-456b-ba5b-175a00682e76" -d '{"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:23.798330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3117b0e5-d7f3-4912-bc6e-6a46635c7188 service neutron] Pushing event updated for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:23.810987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29eccdb8-9866-4957-8152-c0b8aece8323 x-openstack-request-id: req-29eccdb8-9866-4957-8152-c0b8aece8323 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:23.811462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:23.811704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-29eccdb8-9866-4957-8152-c0b8aece8323 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:23.812175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'status': 'completed', 'code': 200} Nov 05 14:55:23.953238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-3cc812a7-d435-4046-9e6f-45b3cb070d62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:23.954757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-3cc812a7-d435-4046-9e6f-45b3cb070d62 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1097 time: 0.0422330 Nov 05 14:55:24.127347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-c82a4fe9-c8b8-45b3-aaaf-2f07716bba08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.128923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-c82a4fe9-c8b8-45b3-aaaf-2f07716bba08 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=2691099d79834234a0e6e846d81eed9c&shared=False HTTP/1.1" status: 200 len: 898 time: 0.1661968 Nov 05 14:55:24.287264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-99119e28-c92d-405a-97af-ab56a553e7d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.288696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a3eddadf-e69b-456b-ba5b-175a00682e76 req-99119e28-c92d-405a-97af-ab56a553e7d6 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1527917 Nov 05 14:55:24.374111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-733b1269-7a46-4369-92d0-3959e4f75930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.375559 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-733b1269-7a46-4369-92d0-3959e4f75930 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1097 time: 0.0491550 Nov 05 14:55:24.413503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349c4334-3eec-4cd2-8d18-b9d87ec14d14 req-4feed2e3-16c2-411a-b8ad-d6d9294cf1e8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.414928 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-349c4334-3eec-4cd2-8d18-b9d87ec14d14 req-4feed2e3-16c2-411a-b8ad-d6d9294cf1e8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 944 time: 0.0551000 Nov 05 14:55:24.480845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-349c4334-3eec-4cd2-8d18-b9d87ec14d14 req-2bbbfbbd-c8d6-4a24-8fd0-db6fb07e0577 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597200 Nov 05 14:55:24.509168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-6783415b-4e09-441c-9e13-ae97920173e2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc HTTP/1.1" status: 200 len: 217 time: 0.0392206 Nov 05 14:55:24.526468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b51ba6-dabe-483a-b052-066bccc8dbf4 req-8ed20735-2732-4431-9bc4-21dfbd7bfd61 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.527933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48b51ba6-dabe-483a-b052-066bccc8dbf4 req-8ed20735-2732-4431-9bc4-21dfbd7bfd61 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0514970 Nov 05 14:55:24.563443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1f0a6c14-0b11-4897-baba-279e994d5026 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.565310 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-1f0a6c14-0b11-4897-baba-279e994d5026 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=fb7287cf-07fb-4211-aed5-8a75b33e4ff3 HTTP/1.1" status: 200 len: 834 time: 0.0480356 Nov 05 14:55:24.580005 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48b51ba6-dabe-483a-b052-066bccc8dbf4 req-b55b7e2b-716a-4e79-ba44-07ec0116a967 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451362 Nov 05 14:55:24.616832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-a223ceab-9caa-40a5-9e7b-ef2274b16c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:24.618372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-a223ceab-9caa-40a5-9e7b-ef2274b16c0d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1ab38286-de85-4029-9282-575e3809e459&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0440385 Nov 05 14:55:24.713342 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-70ca2f76-ec9a-4ffa-939a-c3582ed6c07c service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816960 Nov 05 14:55:24.811342 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-def21e5d-e3a8-49eb-bb89-55eca802ba00 req-5ad709f5-d075-45e7-9acf-e21f370e1d9d service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899596 Nov 05 14:55:24.867536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:25.593960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13eaad16-7696-4092-ab2f-af37b70a8014 req-c7c45f4e-b1a5-4187-b30b-325db62b955b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:25.595411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-13eaad16-7696-4092-ab2f-af37b70a8014 req-c7c45f4e-b1a5-4187-b30b-325db62b955b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 944 time: 0.0483446 Nov 05 14:55:25.645932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-13eaad16-7696-4092-ab2f-af37b70a8014 req-13f59dda-7ab0-4198-a1f7-06d194e91f8e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431657 Nov 05 14:55:25.696265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a986948d-870b-41c8-9b0b-54684c2a4acb req-4a6c6de3-35e6-41d4-81fd-06f457da3435 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:25.697777 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a986948d-870b-41c8-9b0b-54684c2a4acb req-4a6c6de3-35e6-41d4-81fd-06f457da3435 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0529220 Nov 05 14:55:25.745657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a986948d-870b-41c8-9b0b-54684c2a4acb req-d7ba5997-6512-4f92-abbe-3f2235920b0b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421197 Nov 05 14:55:25.855599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cfbf47a-cdaf-4aa9-823d-ff31360cc795 req-6fc12cf2-4ef3-4d1c-9ad5-ab4d962e7d0d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:25.857243 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5cfbf47a-cdaf-4aa9-823d-ff31360cc795 req-6fc12cf2-4ef3-4d1c-9ad5-ab4d962e7d0d tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0485930 Nov 05 14:55:25.900091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:25.913133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5cfbf47a-cdaf-4aa9-823d-ff31360cc795 req-821b3733-a08a-4b7a-bf38-20fb83db8384 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499938 Nov 05 14:55:25.935198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46872) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:25.975049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8bdf293-40da-42af-a869-61a24a15a5d0 tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:25.976566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f8bdf293-40da-42af-a869-61a24a15a5d0 tempest-TestVolumeBootPattern-966811909 tempest-TestVolumeBootPattern-966811909-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1093 time: 0.0403543 Nov 05 14:55:25.979360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46874) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:25.983538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address': '172.20.0.8'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:26.005322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.101259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.209408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Allocated IP 172.26.5.57 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/701239b5-5634-4953-b4f1-dc4981be15c5) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:26.312186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.343846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.377613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:26.380358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:26.382890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:26.414211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=701239b5-5634-4953-b4f1-dc4981be15c5,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:26.783808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.812758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161cef18-49bb-4161-853f-4787639dd04a req-c5203ca5-0ca1-425d-bff9-d16812fbd63a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:26.814221 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-161cef18-49bb-4161-853f-4787639dd04a req-c5203ca5-0ca1-425d-bff9-d16812fbd63a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 944 time: 0.0868733 Nov 05 14:55:26.891582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:26.915700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-161cef18-49bb-4161-853f-4787639dd04a req-5150d661-f6ef-45bc-9e91-795d20363371 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0916507 Nov 05 14:55:27.044451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.049436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.120835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event updated for resources: {'Port': ['ID=701239b5-5634-4953-b4f1-dc4981be15c5,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:27.132668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.208728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 3b2fd74a-6630-4902-b53c-aaaed08127bc details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:55:27.232987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP 3c28b03a-5f29-417d-86c1-139988c4231a associated. External IP: 172.26.5.57, port: c2c61a54-6917-4dd2-8d33-21887a41b601. Nov 05 14:55:27.303032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:27.314428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 623, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:55:27.349966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.362600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3b2fd74a-6630-4902-b53c-aaaed08127bc {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:55:27.382326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:27.386265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.436318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:27.443190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:55:27.550241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:27.560082 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:27.569176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:27.569492 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:27.570089 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:27.610064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['3b2fd74a-6630-4902-b53c-aaaed08127bc'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:55:27.773001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:27.910100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-97f1ff7d-e0cf-4932-9497-265025511b7c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.9297290 Nov 05 14:55:27.910868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:27.913233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f" -d '{"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:28.006842 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3c28b03a-5f29-417d-86c1-139988c4231a', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.57', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:bb:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:26Z', 'updated_at': '2021-11-05T14:55:26Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}, {'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:28.018339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7398a8a-6ec6-4d5b-b590-8ad8b45b968e x-openstack-request-id: req-c7398a8a-6ec6-4d5b-b590-8ad8b45b968e {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:28.018627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:28.018875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c7398a8a-6ec6-4d5b-b590-8ad8b45b968e {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:28.019262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'status': 'completed', 'code': 200} Nov 05 14:55:28.033335 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:28.039105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d26327-a5b2-4ace-a124-a2ea0b0e28db req-75678e72-603a-4b28-a33a-21a27cabeb59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:28.040632 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-89d26327-a5b2-4ace-a124-a2ea0b0e28db req-75678e72-603a-4b28-a33a-21a27cabeb59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 945 time: 0.0533319 Nov 05 14:55:28.041623 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:28.042270 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:28.084030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-4c171269-0799-47d7-9a82-e29664fe1f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:28.085689 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-4c171269-0799-47d7-9a82-e29664fe1f3b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1098 time: 0.0430064 Nov 05 14:55:28.092809 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-89d26327-a5b2-4ace-a124-a2ea0b0e28db req-4e7bf07a-ac27-480b-b310-73ba97941219 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458589 Nov 05 14:55:28.148945 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:28.176869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-f17c12ba-9169-42d7-a986-c63e2a8cca11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:28.178271 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-f17c12ba-9169-42d7-a986-c63e2a8cca11 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.0836511 Nov 05 14:55:28.254317 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-5937b104-8cf2-494e-aab8-4ef6f427b2c5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 200 len: 998 time: 0.0675423 Nov 05 14:55:28.303169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-1e8772b8-7bc5-4e7e-8355-d11fbe7f1708 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:28.304660 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-1e8772b8-7bc5-4e7e-8355-d11fbe7f1708 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0431230 Nov 05 14:55:28.350074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-53ca4a7b-a7ab-429f-aee6-f68268d2b669 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:28.351564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-53ca4a7b-a7ab-429f-aee6-f68268d2b669 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394263 Nov 05 14:55:28.371017 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3c28b03a-5f29-417d-86c1-139988c4231a', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.57', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:bb:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:26Z', 'updated_at': '2021-11-05T14:55:26Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}, {'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:28.398713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4e15bea-14ba-4c00-b73b-ddc54b4dba2e None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3c28b03a-5f29-417d-86c1-139988c4231a', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.57', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:bb:33:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:26Z', 'updated_at': '2021-11-05T14:55:26Z', 'revision_number': 0, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}, {'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:28.452192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-e69ad358-9496-45bb-9871-86488840629c service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926342 Nov 05 14:55:28.544236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ed7d16-f5f8-45ba-b1d1-e1dd40240f3f req-9b995362-dc57-4711-b913-afe15ff97aea service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850992 Nov 05 14:55:28.598861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f2aaaa0-c9c5-4cb0-9602-84d0f71837cc None None] New status for floating IP 3c28b03a-5f29-417d-86c1-139988c4231a: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:55:29.211722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d3fedb-c3ad-4dda-9861-79933e2fae8a req-21c57600-571a-4d64-9ad2-21bd2f2eaa8e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:29.213201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05d3fedb-c3ad-4dda-9861-79933e2fae8a req-21c57600-571a-4d64-9ad2-21bd2f2eaa8e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 945 time: 0.0533376 Nov 05 14:55:29.219743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 3b2fd74a-6630-4902-b53c-aaaed08127bc up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:55:29.262898 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05d3fedb-c3ad-4dda-9861-79933e2fae8a req-75d6d77c-df7f-4cb7-b847-887892486a70 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435033 Nov 05 14:55:29.268271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 3b2fd74a-6630-4902-b53c-aaaed08127bc completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:55:29.272709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 3b2fd74a-6630-4902-b53c-aaaed08127bc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:55:29.273081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:29.351085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:29.373291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:29.375558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d24b23db-c984-420e-96e6-caaf8a7b01d0" -d '{"events": [{"server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "name": "network-vif-plugged", "status": "completed", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:29.388620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:55:29.392575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:29.415860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6eaffb4a-1cae-414e-989c-5878b21ee294 x-openstack-request-id: req-6eaffb4a-1cae-414e-989c-5878b21ee294 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:29.416145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "name": "network-vif-plugged", "status": "completed", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:29.416391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6eaffb4a-1cae-414e-989c-5878b21ee294 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:29.416793 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'code': 200} Nov 05 14:55:29.442818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:29.577897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf1157a-ac14-41de-a409-6cb40b388ca1 req-2fe25b49-31e2-478f-baa1-9523af4219fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:29.579338 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddf1157a-ac14-41de-a409-6cb40b388ca1 req-2fe25b49-31e2-478f-baa1-9523af4219fd service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1099 time: 0.0393488 Nov 05 14:55:29.623730 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddf1157a-ac14-41de-a409-6cb40b388ca1 req-9a222143-304c-4695-8481-3ea26cf39056 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373337 Nov 05 14:55:30.378643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b4f2a1-7070-42c7-8562-63de8a48e782 req-3ec13786-b34f-4f07-ac67-cc8be89d9fa1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:30.380126 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-36b4f2a1-7070-42c7-8562-63de8a48e782 req-3ec13786-b34f-4f07-ac67-cc8be89d9fa1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0484002 Nov 05 14:55:30.432360 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-36b4f2a1-7070-42c7-8562-63de8a48e782 req-1e5c75e0-81c8-4840-acc1-2181b8c1c276 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462766 Nov 05 14:55:31.546103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df2acac-c10f-40f4-b450-86be2095fa17 req-54e3fe0f-1c02-4a1e-b0a9-12ed6a397409 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:31.547531 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df2acac-c10f-40f4-b450-86be2095fa17 req-54e3fe0f-1c02-4a1e-b0a9-12ed6a397409 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0481999 Nov 05 14:55:31.599732 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9df2acac-c10f-40f4-b450-86be2095fa17 req-81c8bfb5-01d9-4408-ad21-5bcd1dd41fca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457220 Nov 05 14:55:31.712724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3555c777-c949-4738-8de8-7b6a2dd262dc req-78e1a1f7-e550-4c46-9358-3bca4bc3bd50 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:31.714193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3555c777-c949-4738-8de8-7b6a2dd262dc req-78e1a1f7-e550-4c46-9358-3bca4bc3bd50 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0506039 Nov 05 14:55:31.763013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3555c777-c949-4738-8de8-7b6a2dd262dc req-2a3b7697-8557-4e8a-b917-cd079600bbb8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429995 Nov 05 14:55:31.783771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46896) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:31.822761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e26add5d-3a5e-4da3-8749-ec28ba3ddb77 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:31.824182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e26add5d-3a5e-4da3-8749-ec28ba3ddb77 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1094 time: 0.0394475 Nov 05 14:55:31.826884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46898) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:31.831149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.12'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:55:31.852305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:31.948879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.047742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.121 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/3b3e8701-3b64-4cdf-a67c-de53bee2c0d1) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:55:32.150013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.184469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.220906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:55:32.227718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:55:32.230133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:55:32.255707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3b3e8701-3b64-4cdf-a67c-de53bee2c0d1,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:32.586760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.649375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.794527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.799109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.864160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3b3e8701-3b64-4cdf-a67c-de53bee2c0d1,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:55:32.877062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:32.974267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP a543a82e-b063-4158-88ba-8b53e908f4f0 associated. External IP: 172.26.5.121, port: 3b2fd74a-6630-4902-b53c-aaaed08127bc. Nov 05 14:55:33.172212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:55:33.277006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:55:33.286635 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:55:33.293830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:33.296232 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:33.296880 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:33.324372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a0bd6e1c-559d-4ae9-ae36-227f3c0b20b9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.4964807 Nov 05 14:55:33.325094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:55:33.326997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46900) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:33.327488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36" -d '{"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:55:33.367148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:55:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-497bb5c4-2428-4b56-93a9-531a502c08a6 x-openstack-request-id: req-497bb5c4-2428-4b56-93a9-531a502c08a6 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:55:33.367446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:55:33.367693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-497bb5c4-2428-4b56-93a9-531a502c08a6 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:55:33.368100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'status': 'completed', 'code': 200} Nov 05 14:55:33.415474 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:33.437060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-ff112f2a-efe2-4adf-9a12-f65e41a30f0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:33.438576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-ff112f2a-efe2-4adf-9a12-f65e41a30f0d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1099 time: 0.0448906 Nov 05 14:55:33.445876 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-25e4e97e-5347-4712-8c96-2d776e0038ab tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9 HTTP/1.1" status: 200 len: 923 time: 0.1174750 Nov 05 14:55:33.448262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:33.512865 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a1783087-6837-44e9-9db5-b1b51427183e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 992 time: 0.0633318 Nov 05 14:55:33.530936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-37e1f538-a341-467c-a1c9-c14462d99d91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:33.532376 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-37e1f538-a341-467c-a1c9-c14462d99d91 service neutron] 10.222.0.32 "GET /v2.0/networks?id=1ab38286-de85-4029-9282-575e3809e459 HTTP/1.1" status: 200 len: 898 time: 0.0868204 Nov 05 14:55:33.600099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-321a3f7a-ee52-47f5-aeee-b0391abd13a1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc HTTP/1.1" status: 200 len: 1000 time: 0.0609884 Nov 05 14:55:33.647773 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:55:32Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:21Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:33.648722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-25f114d7-ecef-45ec-ad88-6704de743fb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:33.650188 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-25f114d7-ecef-45ec-ad88-6704de743fb5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=fb7287cf-07fb-4211-aed5-8a75b33e4ff3 HTTP/1.1" status: 200 len: 834 time: 0.0435514 Nov 05 14:55:33.673065 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:55:33.681705 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:55:33.682294 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:33.695448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-230f8945-81ad-43b4-a55d-8ce5ff5ffb49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:55:33.696959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-230f8945-81ad-43b4-a55d-8ce5ff5ffb49 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1ab38286-de85-4029-9282-575e3809e459&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398173 Nov 05 14:55:33.790305 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:55:34.015770 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:55:32Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:21Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:55:34.098320 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-7d3800d6-440e-44a7-b784-623e818f9647 service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3935304 Nov 05 14:55:34.135886 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8903d115-867b-49b0-9d34-24fecad5c8d8 None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:55:32Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:55:21Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:55:34.199697 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffcf74b9-7c5e-4d5e-be64-417ee9933f36 req-3710b8e4-1034-47e9-a007-0579437a3631 service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946386 Nov 05 14:55:34.339263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-246989e6-b04f-4234-b3b0-64a5f685af8d None None] New status for floating IP a543a82e-b063-4158-88ba-8b53e908f4f0: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:55:34.515945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46908) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:55:34.578673 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71841bed-cdb6-4d5a-8720-3ef1e4938f4c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 994 time: 0.0614786 Nov 05 14:55:41.543653 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:55:48.205389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:50.047878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c3463c87-f32a-49b4-b6e3-16b27cd2f18c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:52.395403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-00dde1f3-9511-414b-8b37-39d66490dd76 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:53.400007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:54.871167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:55:55.901808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:07.794449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46928) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:07.905572 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-399392c5-77a0-495f-a472-fc1d01b61e01 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1099732 Nov 05 14:56:07.908422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46930) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:08.022522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75067f8f-4e1e-4129-ab41-d5fff5634047 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Notify agent at dv-neutron-816850-1-hyperv the message router_removed_from_agent {{(pid=113580) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 05 14:56:08.025680 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-75067f8f-4e1e-4129-ab41-d5fff5634047 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "DELETE /v2.0/agents/720631e7-593a-4825-9d12-ae4f4d318a59/l3-routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9 HTTP/1.1" status: 204 len: 168 time: 0.1163592 Nov 05 14:56:08.028232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46932) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:08.133132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e61b0829-5f00-480c-a851-99255e403b6c tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9/l3-agents HTTP/1.1" status: 200 len: 207 time: 0.1037562 Nov 05 14:56:08.136305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46934) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:08.196581 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1e583bd9-83fa-4796-91d9-8c2d598ce8c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 994 time: 0.0586884 Nov 05 14:56:08.784202 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1fadb3b4-5148-40a7-b11c-cf5f446e0b0f None None] New status for floating IP a543a82e-b063-4158-88ba-8b53e908f4f0: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:56:09.200581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46936) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:09.259610 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2f75e86b-532d-460e-a4f0-11bc4d717dc9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 992 time: 0.0579572 Nov 05 14:56:09.446272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:09.521779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:09.543654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:09.547207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:09.547907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:09.621026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:09.629867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.630212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.630544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.630879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.631201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.631523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.631842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.632174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.632501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.632818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.633156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.633471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:09.671204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:09.701147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e499f4e1-8f24-460c-bd1f-748ef97593ff,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:09.704697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:09.749943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:10.366447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46940) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:10.491671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ead9c3c-ff2f-4b98-b6f5-2866e1257e8e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:56:10.492011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ead9c3c-ff2f-4b98-b6f5-2866e1257e8e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Notify agent at dv-neutron-816850-1-hyperv the message router_added_to_agent {{(pid=113581) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 05 14:56:10.519506 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ead9c3c-ff2f-4b98-b6f5-2866e1257e8e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "POST /v2.0/agents/720631e7-593a-4825-9d12-ae4f4d318a59/l3-routers HTTP/1.1" status: 201 len: 201 time: 0.1519721 Nov 05 14:56:10.522153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46944) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:10.545307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:10.555571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:10.556177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:10.639090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-168785c8-0619-42b7-afa9-875b23171b4a tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1155279 Nov 05 14:56:10.642343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46948) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:10.668504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:10.714515 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7a734180-e50e-496b-b4ea-87378bb72560 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 992 time: 0.0698442 Nov 05 14:56:10.926252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:56:08Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:10.954283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:10.962542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:10.963140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:11.075617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:11.317560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:56:08Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:11.344809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16366c07-859d-4659-9d6f-57d60d6e0e53 None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a543a82e-b063-4158-88ba-8b53e908f4f0', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'port_id': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'mac_address': 'fa:16:3e:f4:c3:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:55:32Z', 'updated_at': '2021-11-05T14:56:08Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:09Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:11.717374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46950) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:11.782740 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0de9e057-9bf0-4096-ad75-0c01e93bc12b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 992 time: 0.0640266 Nov 05 14:56:12.786413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46952) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:12.863030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ea4bec1-7e87-4d08-bb01-9e218da445e5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 992 time: 0.0754855 Nov 05 14:56:12.951984 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-690ad9c0-dfba-45cf-ba65-e9d4bc63bf45 None None] New status for floating IP a543a82e-b063-4158-88ba-8b53e908f4f0: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:56:13.489225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:13.537949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:13.538350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:13.624907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:13.646317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:13.651035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:13.651908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:13.732704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:13.746262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:13.746629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:13.866392 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46954) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:13.932108 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-be8b1d78-e26d-4578-9994-1c5f3c6cb62d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 200 len: 994 time: 0.0631299 Nov 05 14:56:13.972142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.004769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e499f4e1-8f24-460c-bd1f-748ef97593ff,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:14.008312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.059183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:14.163230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46960) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:14.316890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 3b3e8701-3b64-4cdf-a67c-de53bee2c0d1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:56:14.317134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.393662 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.393992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.407420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 3b3e8701-3b64-4cdf-a67c-de53bee2c0d1 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:56:14.563084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.586226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=3b3e8701-3b64-4cdf-a67c-de53bee2c0d1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:14.600789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.601149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.601494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.601831 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.602164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.602501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.603419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.603752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.604084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.604405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.604753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.605075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:14.660031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.660359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP a543a82e-b063-4158-88ba-8b53e908f4f0 disassociated (deleted). External IP: 172.26.5.121, port: 3b2fd74a-6630-4902-b53c-aaaed08127bc. Nov 05 14:56:14.863953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:56:14.970638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:56:14.975442 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:14.985278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:14.994447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:14.995053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:15.002124 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dbc597e7-a616-40a6-ae47-a1e700fa120a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/a543a82e-b063-4158-88ba-8b53e908f4f0 HTTP/1.1" status: 204 len: 168 time: 0.8377964 Nov 05 14:56:15.002706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:56:15.005062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8f5349e-a678-41d1-a030-f6ca2bf83344" -d '{"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:56:15.045575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:56:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec6f6496-4134-4e29-b390-c6d3433450f9 x-openstack-request-id: req-ec6f6496-4134-4e29-b390-c6d3433450f9 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:56:15.046084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:56:15.046514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ec6f6496-4134-4e29-b390-c6d3433450f9 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:56:15.046916 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'status': 'completed', 'code': 200} Nov 05 14:56:15.116028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-1efd556b-8393-497c-bab9-eb79dd49b088 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:15.117504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-1efd556b-8393-497c-bab9-eb79dd49b088 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 1099 time: 0.0462151 Nov 05 14:56:15.119094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:15.259043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-f042d695-663a-429e-90ef-c2b2988005a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:15.260576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-f042d695-663a-429e-90ef-c2b2988005a4 service neutron] 10.222.0.32 "GET /v2.0/networks?id=1ab38286-de85-4029-9282-575e3809e459 HTTP/1.1" status: 200 len: 898 time: 0.1266246 Nov 05 14:56:15.272873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b9b8a0-b0ee-4b12-a59c-37a417a57435 req-151a391d-58ec-4224-946e-e62ff555404c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:15.274264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11b9b8a0-b0ee-4b12-a59c-37a417a57435 req-151a391d-58ec-4224-946e-e62ff555404c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0746429 Nov 05 14:56:15.316256 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-22c1ac66-20c2-488f-be59-f9e9742f1f77 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc HTTP/1.1" status: 200 len: 217 time: 0.0410120 Nov 05 14:56:15.325046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:15.351060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:15.359934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:15.360564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:15.385506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11b9b8a0-b0ee-4b12-a59c-37a417a57435 req-3e01f1dc-6ad8-408b-acf4-530ac5a4da0d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1033182 Nov 05 14:56:15.391109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-d4c501f4-6ac8-4612-889a-07595ac2abea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:15.392627 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-d4c501f4-6ac8-4612-889a-07595ac2abea service neutron] 10.222.0.32 "GET /v2.0/subnets?id=fb7287cf-07fb-4211-aed5-8a75b33e4ff3 HTTP/1.1" status: 200 len: 834 time: 0.0670612 Nov 05 14:56:15.448546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-3b79806d-c00d-41c6-afbb-a1d93892f13d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:15.449950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-3b79806d-c00d-41c6-afbb-a1d93892f13d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1ab38286-de85-4029-9282-575e3809e459&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0482135 Nov 05 14:56:15.470311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:15.500024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:15.544249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-7b486bb2-1648-45d1-bb30-04eb059da36c service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838847 Nov 05 14:56:15.637091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:15.637427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:15.638407 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8f5349e-a678-41d1-a030-f6ca2bf83344 req-f4ae009d-47f7-4b04-8a9c-8a9798be6e03 service neutron] 10.222.0.32 "GET /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863190 Nov 05 14:56:15.772722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:15.803025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:15.833066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df7c6d59-720b-42e4-ad16-0973f98dc789 None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:55:17Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e499f4e1-8f24-460c-bd1f-748ef97593ff', 'name': '', 'network_id': '1ab38286-de85-4029-9282-575e3809e459', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:7e:72:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 1410, 'fixed_ips': [{'subnet_id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:16Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'fb7287cf-07fb-4211-aed5-8a75b33e4ff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:15.850333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e499f4e1-8f24-460c-bd1f-748ef97593ff triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:15.850702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:16.441541 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef44163-32c2-442f-b488-74a77d6cc683 None None] New status for floating IP a543a82e-b063-4158-88ba-8b53e908f4f0: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:56:16.507889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962797e0-ef11-4a65-826b-24faf4ff1471 req-92940b5b-7565-4250-859f-2ce7dffaed59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:16.509626 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-962797e0-ef11-4a65-826b-24faf4ff1471 req-92940b5b-7565-4250-859f-2ce7dffaed59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0505230 Nov 05 14:56:16.562195 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-962797e0-ef11-4a65-826b-24faf4ff1471 req-38e70c6d-a61c-44b6-acb8-299f472fe06e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=e1384018-98f7-418a-aefe-5ae2529af05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465932 Nov 05 14:56:16.605638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0528afed-5e09-4e4d-baea-89421902bb3a req-80c09adb-c565-427f-9543-926b1a89f9e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:16.607127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0528afed-5e09-4e4d-baea-89421902bb3a req-80c09adb-c565-427f-9543-926b1a89f9e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=b524d99a-b9db-4f41-9629-5f82f1ecc974 HTTP/1.1" status: 200 len: 946 time: 0.0494452 Nov 05 14:56:16.697966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 3b2fd74a-6630-4902-b53c-aaaed08127bc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:56:16.698211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:16.788948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 3b2fd74a-6630-4902-b53c-aaaed08127bc, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=3b2fd74a-6630-4902-b53c-aaaed08127bc,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:16.789307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:16.802417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 3b2fd74a-6630-4902-b53c-aaaed08127bc owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:56:16.928339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:16.963452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=3b2fd74a-6630-4902-b53c-aaaed08127bc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:17.001349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.001760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.002110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.002445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.002769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.003153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.003476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.003797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.004115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.004435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.004779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.005097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:17.007852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 3b2fd74a-6630-4902-b53c-aaaed08127bc on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:56:17.009999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:17.013373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0528afed-5e09-4e4d-baea-89421902bb3a req-6262437c-c792-4d88-8f47-682584374321 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/3b2fd74a-6630-4902-b53c-aaaed08127bc HTTP/1.1" status: 204 len: 173 time: 0.3993392 Nov 05 14:56:17.013801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'name': 'network-vif-deleted', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:56:17.016006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7aec7ba4-deff-421d-9c08-7a38f0ba7215" -d '{"events": [{"server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "name": "network-vif-deleted", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:56:17.055849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:56:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2bd34b11-e633-446d-a08d-8394702af334 x-openstack-request-id: req-2bd34b11-e633-446d-a08d-8394702af334 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:56:17.056144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b524d99a-b9db-4f41-9629-5f82f1ecc974", "name": "network-vif-deleted", "tag": "3b2fd74a-6630-4902-b53c-aaaed08127bc", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:56:17.056396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2bd34b11-e633-446d-a08d-8394702af334 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:56:17.056979 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b524d99a-b9db-4f41-9629-5f82f1ecc974', 'name': 'network-vif-deleted', 'tag': '3b2fd74a-6630-4902-b53c-aaaed08127bc', 'status': 'completed', 'code': 200} Nov 05 14:56:17.617467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46978) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:17.677339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:17.704528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:17.762217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:17.764824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:17.766184 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/e1384018-98f7-418a-aefe-5ae2529af05e HTTP/1.1" status: 204 len: 168 time: 0.1477184 Nov 05 14:56:17.776211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e090a0-3496-44bd-ad39-74ec5bc8709b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1384018-98f7-418a-aefe-5ae2529af05e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:17.797701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46982) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:18.160254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:18.205937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:18.411629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port e499f4e1-8f24-460c-bd1f-748ef97593ff {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:56:18.411963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:18.514259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port e499f4e1-8f24-460c-bd1f-748ef97593ff, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e499f4e1-8f24-460c-bd1f-748ef97593ff,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:18.514621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:18.527805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for e499f4e1-8f24-460c-bd1f-748ef97593ff owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:56:18.544318 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:56:18.709267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:18.734596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=e499f4e1-8f24-460c-bd1f-748ef97593ff,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:18.909900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.328748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 3b2fd74a-6630-4902-b53c-aaaed08127bc no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:19.349466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 3b2fd74a-6630-4902-b53c-aaaed08127bc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:56:19.349810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 3b2fd74a-6630-4902-b53c-aaaed08127bc not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:56:19.431885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:56:19.541497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:56:19.547146 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b49dfc46-5ceb-4bef-b9c0-958b7c4d147d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7483323 Nov 05 14:56:19.550164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46984) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:19.552891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Sync routers for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:19.563898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:19.564559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:19.601565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet fb7287cf-07fb-4211-aed5-8a75b33e4ff3 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:56:19.604592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.644979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.669955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:19.731492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.790904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.820436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=fb7287cf-07fb-4211-aed5-8a75b33e4ff3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:19.823090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.827021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2efd9126-7eb8-4dfa-8f7e-bfa84cb8203a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/fb7287cf-07fb-4211-aed5-8a75b33e4ff3 HTTP/1.1" status: 204 len: 168 time: 0.2752402 Nov 05 14:56:19.829000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46986) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:19.832270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dc97134-cb02-4628-ae6e-538a1aea91a1 None None] Network 1ab38286-de85-4029-9282-575e3809e459 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:56:19.933946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:56:18Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:19.942717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:19.971154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Checking router: f3e9e102-8756-49dd-b85c-1db8deb4ddd9 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:19.980312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Routers {'f3e9e102-8756-49dd-b85c-1db8deb4ddd9'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:19.980957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:55:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:20.019594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] DHCP port deletion for 1ab38286-de85-4029-9282-575e3809e459 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:56:20.052809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.107740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:56:20.108015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-110234b5-1269-4d08-b2ed-80caa3139f26 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.108156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.138789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] Set router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:20.187949 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:20.188232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.200188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Deleting port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:56:20.200584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.205626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:56:20.379848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.416099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:20.467605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] For port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,segment=NetworkSegment(9ac6169d-c1bf-4e69-8993-6e4cd0088c45),segment_id=9ac6169d-c1bf-4e69-8993-6e4cd0088c45)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:20.468211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.474456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.488523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Calling delete_port for 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:56:20.571080 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.573334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.608575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:56:18Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:20.611990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.623907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.624970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router f3e9e102-8756-49dd-b85c-1db8deb4ddd9 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:56:20.632591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.636330 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eaae3aa9-2ddb-4ec2-8ed2-77b812e98827 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/f3e9e102-8756-49dd-b85c-1db8deb4ddd9 HTTP/1.1" status: 204 len: 168 time: 0.8034904 Nov 05 14:56:20.636642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46988) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:20.649990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1a2fb44-a622-4b76-990c-3134382dad0c None None] The sync data for ids ['f3e9e102-8756-49dd-b85c-1db8deb4ddd9'] in dv-neutron-816850-1-hyperv is: [{'id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'name': 'tempest-TestNetworkBasicOps-router-2082343729', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167'}], 'enable_snat': True}, 'gw_port_id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:55:13Z', 'updated_at': '2021-11-05T14:56:18Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:bc:5d:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e9e102-8756-49dd-b85c-1db8deb4ddd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1407, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.167', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:55:14Z', 'updated_at': '2021-11-05T14:56:13Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:20.669960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] Pushing event deleted for resources: {'Port': ['ID=33e9c054-b1f2-4ef5-b25a-a97ba2dc3306,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:20.671827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26bad3dd-1340-49ec-8af0-5968838e06a0 None None] No DVR routers for this DVR port 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:56:20.728568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.821056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.841660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1ab38286-de85-4029-9282-575e3809e459']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:20.850941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ac6169d-c1bf-4e69-8993-6e4cd0088c45') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:20.851304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ac6169d-c1bf-4e69-8993-6e4cd0088c45') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:20.861397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.874545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.880638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 623 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:56:20.881012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:56:20.884006 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:56:20.946764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.951785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:20.955256 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/1ab38286-de85-4029-9282-575e3809e459 HTTP/1.1" status: 204 len: 168 time: 0.3176529 Nov 05 14:56:20.973719 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7783761-a0c1-4e85-8602-fb94ca50d02f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=1ab38286-de85-4029-9282-575e3809e459,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:20.976997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46990) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:20.983176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1895374147', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:21.006354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:56:21.010499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.035186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:56:21.045087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.045435 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment e5abe6fa-b526-4b59-8044-a39e44874303 of type vlan for network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 Nov 05 14:56:21.097164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.123584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.132497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:21.134574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.203084 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2242603 Nov 05 14:56:21.205973 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46992) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:21.211099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:21.238083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795a11fb-0a5a-49b8-a154-66cefc236031 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=738ee03b-c9c9-4a04-9e8d-78d2085f4025,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:21.249780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:56:21.251108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.252316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.314759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.466751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.677119 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.699705 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.767720 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:21.794041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:56:21.794386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5a8f21d-43ad-4bd7-aa1b-e435b0cf7c2e not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:56:21.794804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:21.817112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: e499f4e1-8f24-460c-bd1f-748ef97593ff {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:56:21.817447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e499f4e1-8f24-460c-bd1f-748ef97593ff not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:56:21.817971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:56:21.822070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.133 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/ad7341ab-25d6-45d1-8647-cb6043e2c726) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:56:21.838855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:56:21.839207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 33e9c054-b1f2-4ef5-b25a-a97ba2dc3306 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:56:21.929111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:21.962441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:22.004022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:22.006870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:22.012250 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:56:22.038348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=ad7341ab-25d6-45d1-8647-cb6043e2c726,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:22.263615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:22.397879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-558f0279-0598-49aa-a79f-44509564b49e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:22.754064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:22.878221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:56:22.981339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:56:22.990979 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Sync routers for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:23.002061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.002641 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:23.006297 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e9427dc8-c25a-4e0e-a894-720bb50e1303 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.7962770 Nov 05 14:56:23.006466 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:23.006612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 46994) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:23.042664 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8ddec8c-f97e-44e9-a55e-85e162776359 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0349104 Nov 05 14:56:23.043650 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46996) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:23.119191 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:23.130908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-338ac377-8fdc-45d6-9592-7db3465964a1 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:23.132406 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-338ac377-8fdc-45d6-9592-7db3465964a1 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0876462 Nov 05 14:56:23.135791 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 46998) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:23.162770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-63d5f20c-b3bf-4452-ac78-de3af9ff31c5 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0259337 Nov 05 14:56:23.165357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47000) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:23.169982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-792688590', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28', 'dns_nameservers': ['1.2.3.4']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:23.255277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:56:23.258958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.292006 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:22Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:23.321600 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Checking router: 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:23.321953 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Updating router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 port ad7341ab-25d6-45d1-8647-cb6043e2c726 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:56:23.347225 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.404370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.449876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.521727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=d32dc831-0c37-43fc-97ad-31b0b6b81e90,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:23.530494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:56:23.530856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 738ee03b-c9c9-4a04-9e8d-78d2085f4025, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:56:23.549175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:56:23.558554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 738ee03b-c9c9-4a04-9e8d-78d2085f4025) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:23.562904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:23.563488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.569125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37c350ab-54c1-4a44-8b5e-b3937c8e1f69 None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:56:23.585003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2e7b63c2-dfbe-42c4-a4b7-78446c638b01 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.4161627 Nov 05 14:56:23.585245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47002) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:23.607103 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.612678 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-37c350ab-54c1-4a44-8b5e-b3937c8e1f69 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:56:23.650969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:56:23.654606 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Pushing event updated for resources: {'Port': ['ID=ad7341ab-25d6-45d1-8647-cb6043e2c726,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:23.665133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.665942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.666440 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.666612 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.666947 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.667277 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.667513 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f64d684d-adde-4f2d-951a-5d8063fd4cb5 None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:56:23.667660 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.667914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.668237 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.668627 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.668972 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.669293 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:56:23.685803 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Attempting to bind port ad7341ab-25d6-45d1-8647-cb6043e2c726 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:56:23.686457 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Attempting to bind port ad7341ab-25d6-45d1-8647-cb6043e2c726 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:56:23.688503 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Attempting to bind port ad7341ab-25d6-45d1-8647-cb6043e2c726 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:56:23.693615 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:56:23.693992 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:56:23.694389 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.694838 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:56:23.695299 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Bound port: ad7341ab-25d6-45d1-8647-cb6043e2c726, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:56:23.695890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f64d684d-adde-4f2d-951a-5d8063fd4cb5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:56:23.741715 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:56:23.751530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-634c278a-c7ca-4dd9-820e-7c9479f1b059 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:56:23.760280 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] For port ad7341ab-25d6-45d1-8647-cb6043e2c726, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:56:23.763605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] For port ad7341ab-25d6-45d1-8647-cb6043e2c726, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ad7341ab-25d6-45d1-8647-cb6043e2c726,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:56:23.767174 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:23.824537 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:23.825057 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:23.826856 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc65081-79be-44ea-bdd4-fbfbe17668eb None None] Pushing event updated for resources: {'Port': ['ID=ad7341ab-25d6-45d1-8647-cb6043e2c726,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:23.843469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-634c278a-c7ca-4dd9-820e-7c9479f1b059 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:56:24.024188 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:24.058929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.087098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:56:24.087989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.230100 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:22Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:24.242175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Allocated IP 172.20.0.2 (738ee03b-c9c9-4a04-9e8d-78d2085f4025/d32dc831-0c37-43fc-97ad-31b0b6b81e90/d4e5e089-a476-49c5-82dc-4b53c3b4c27e) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:56:24.260589 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e4e7cb-8611-4558-8f55-43b88940f75e None None] The sync data for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv is: [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:22Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:24.391461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.401054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.448380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:24.452193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:24.455455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (738ee03b-c9c9-4a04-9e8d-78d2085f4025/d32dc831-0c37-43fc-97ad-31b0b6b81e90/bdc761df-e1ee-4b2f-bb4c-adf7792a522f) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:56:24.457210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:56:24.459208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Pushing event updated for resources: {'Port': ['ID=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:24.533700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Attempting to bind port d4e5e089-a476-49c5-82dc-4b53c3b4c27e on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:56:24.535006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Attempting to bind port d4e5e089-a476-49c5-82dc-4b53c3b4c27e by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:56:24.536175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Attempting to bind port d4e5e089-a476-49c5-82dc-4b53c3b4c27e on network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:56:24.549992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 55, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:56:24.551239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Checking segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:56:24.551647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.552044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Bound using segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:56:24.552543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Bound port: d4e5e089-a476-49c5-82dc-4b53c3b4c27e, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:56:24.552924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.607798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.627128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] For port d4e5e089-a476-49c5-82dc-4b53c3b4c27e, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:56:24.630643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] For port d4e5e089-a476-49c5-82dc-4b53c3b4c27e, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:56:24.636331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.643909 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.697515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:24.703291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:24.704198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69153f1d-7a14-4d20-bf58-a5c4af5ae40e None None] Pushing event updated for resources: {'Port': ['ID=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:24.710595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:56:24.740535 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:24.766330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.905173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:24.956160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.270386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.275967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.356048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:25.358674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.466179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:25.467658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:25.535815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ad7341ab-25d6-45d1-8647-cb6043e2c726 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:25.597529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ad7341ab-25d6-45d1-8647-cb6043e2c726 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:25.597993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.598513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:56:25.695111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12a3234b-5168-48cf-b448-b34716a63d7b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:56:25.700172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.717637 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:56:25.725224 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a3705193-4144-445a-8e55-f6ced9f33187 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/1e488f3e-ea45-44bb-bd87-c14dbd34cd55/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1363907 Nov 05 14:56:25.725224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47004) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:25.748859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port ad7341ab-25d6-45d1-8647-cb6043e2c726, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ad7341ab-25d6-45d1-8647-cb6043e2c726,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:25.760481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.761258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4e5e089-a476-49c5-82dc-4b53c3b4c27e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:25.827995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.828476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.828936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.829419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.829827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.830293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.832052 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f3d96a4-1771-4d8a-991c-ddac07b2e285 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4285 time: 0.1060057 Nov 05 14:56:25.834833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47008) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:25.851312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] Provisioning complete for port d4e5e089-a476-49c5-82dc-4b53c3b4c27e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:25.851622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.900677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.901134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.901622 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.902055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.902448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.903156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:25.906470 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-edec827e-fb02-449c-8b7d-9c6b567071cf tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4013 time: 0.0706892 Nov 05 14:56:25.909483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47010) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:25.917099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=ad7341ab-25d6-45d1-8647-cb6043e2c726,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:25.955258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a3234b-5168-48cf-b448-b34716a63d7b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:56:25.959061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:25.981904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d4e5e089-a476-49c5-82dc-4b53c3b4c27e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:25.982433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.075803 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-25566a4d-e5c8-4d96-b335-7a65058baaef tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 3048 time: 0.1615782 Nov 05 14:56:26.106246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.195928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] For port d4e5e089-a476-49c5-82dc-4b53c3b4c27e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:26.206465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.256267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.277233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Sync routers for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:26.329066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:26.330060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:26.403472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ccd2cde-df10-4f9b-9027-47b26796b7d7 None None] Pushing event updated for resources: {'Port': ['ID=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:26.593373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47016) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:26.597984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-72539117', 'description': 'tempest-secgroup-smoke-72539117 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:26.620258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.647618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 14:56:26.648270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 14:56:26.693719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.695758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:26.698389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.727617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.729401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1350038 Nov 05 14:56:26.732424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47018) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:26.733424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193acafe-f5d6-47c5-a3f3-d390b3799b99 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fdf2707a-8ec3-498a-bb57-2ddadab7bb47,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:26.737760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:26.771815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.835262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.840242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.859571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b155cb3f-bedb-4794-b8db-75a65b9edd87,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:26.869125 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.870350 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1755604f-8e1b-4815-992f-5c4e16d57b39 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1368585 Nov 05 14:56:26.873246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47020) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:26.877674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:26.906965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.926139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:26.958366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Checking router: 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:26.958736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Updating router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 port bdc761df-e1ee-4b2f-bb4c-adf7792a522f binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:56:26.970679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.975745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.987639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:26.995122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a98b6935-45a9-4fa9-94ee-3b0461191488,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.006971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.008222 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-759942df-f470-4cd6-8d99-242cbca30d7e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1341622 Nov 05 14:56:27.011691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47022) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:27.016821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:27.051836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.115800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.120411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.139023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d70b0b56-5403-4ad6-8231-27ff1078ffb5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.148432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.153498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b843452-f673-4d10-bef0-6f44707297b3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1405532 Nov 05 14:56:27.154100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47024) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:27.159996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:27.190837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.266304 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.272208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.295410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.299441 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1414154 Nov 05 14:56:27.299644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47026) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:27.305357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:27.311823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf3951b-a39e-427c-9524-6b1973ef0bfc tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67ce735b-ff6b-49bd-9325-740acc93033d,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.316171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.330748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.340734 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:56:27.346341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.375663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Provisioning complete for port d4e5e089-a476-49c5-82dc-4b53c3b4c27e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:27.376125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.413901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.421799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.441018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e51e4c4e-42a0-4598-b6cd-24b4a7380f18 None None] Pushing event updated for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.443021 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eaed27c2-c1a8-4a9a-b775-ade81c226c97,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.450630 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.454849 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-84f2634c-ee92-45a5-83a9-e13775c2f205 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1515257 Nov 05 14:56:27.454976 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47028) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:27.459290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fdf2707a-8ec3-498a-bb57-2ddadab7bb47', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:27.488309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Attempting to bind port bdc761df-e1ee-4b2f-bb4c-adf7792a522f on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:56:27.488713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Attempting to bind port bdc761df-e1ee-4b2f-bb4c-adf7792a522f by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:56:27.489097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Attempting to bind port bdc761df-e1ee-4b2f-bb4c-adf7792a522f on network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:56:27.495130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ad7341ab-25d6-45d1-8647-cb6043e2c726 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:27.509601 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:56:27.515852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.526424 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 56, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:56:27.526807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Checking segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:56:27.527218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.527625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Bound using segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:56:27.528114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Bound port: bdc761df-e1ee-4b2f-bb4c-adf7792a522f, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:56:27.528535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.588946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.593169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.612985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=587bc16d-2b5b-4589-be27-ea97002f413f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.622890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.624321 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-71ece582-1b27-4862-89f8-84fdd3f5c75b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1684518 Nov 05 14:56:27.660588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] For port bdc761df-e1ee-4b2f-bb4c-adf7792a522f, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:56:27.664546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ad7341ab-25d6-45d1-8647-cb6043e2c726 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:27.669285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.672371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] For port bdc761df-e1ee-4b2f-bb4c-adf7792a522f, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:56:27.678152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Provisioning complete for port bdc761df-e1ee-4b2f-bb4c-adf7792a522f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:27.678757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.702412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:27.797631 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-3c0cfb51-3ea3-4976-8d9d-81009fcb9342 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-72539117&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0552914 Nov 05 14:56:27.817989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:27.818537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:27.821974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e51e4c4e-42a0-4598-b6cd-24b4a7380f18 None None] Pushing event updated for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:27.926668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-0ada8b5f-5de9-4f05-896d-18d71fc68eb2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:27.928292 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-0ada8b5f-5de9-4f05-896d-18d71fc68eb2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 797 time: 0.1226761 Nov 05 14:56:27.945355 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-de20c988-2966-4eb2-ab23-3cbe01bf31b2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0104153 Nov 05 14:56:27.968227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4e5e089-a476-49c5-82dc-4b53c3b4c27e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:27.996186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:28.010886 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-2bcd38e8-2d66-4ccd-8fc8-0bcea6dbfa30 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0596499 Nov 05 14:56:28.053196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:28.094325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] For port bdc761df-e1ee-4b2f-bb4c-adf7792a522f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:28.104527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:28.127369 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-4ade3da5-50cb-4376-90fd-f329247d62a1 service neutron] 10.222.0.30 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1000493 Nov 05 14:56:28.171682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d4e5e089-a476-49c5-82dc-4b53c3b4c27e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:28.172060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:28.219729 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-25bfdec0-2304-4c74-9ee6-48937824b022 service neutron] 10.222.0.30 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861719 Nov 05 14:56:28.276814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5901d0b-8778-4eaa-9710-466e8b88304f None None] Pushing event updated for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:28.293660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7d5b1e85-0bbf-4235-9539-d3caf7ad8125 None None] Provisioning complete for port bdc761df-e1ee-4b2f-bb4c-adf7792a522f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:28.294034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7d5b1e85-0bbf-4235-9539-d3caf7ad8125 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:28.406353 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-50cc9194-2701-4d22-816c-bb326d99633b req-67c16f23-869b-465c-b06c-24e3381530a2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 210 time: 0.0309939 Nov 05 14:56:28.480619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:27Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:28.510284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-852518cb-e61e-4afe-9de7-f211994965d7 None None] The sync data for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv is: [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:27Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:29.396133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-99245934-1d68-45e1-b46f-7726f6aa6854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:29.397767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-99245934-1d68-45e1-b46f-7726f6aa6854 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 797 time: 0.1181571 Nov 05 14:56:29.498272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bdc761df-e1ee-4b2f-bb4c-adf7792a522f up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:29.506991 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-31c877c7-b753-4c6e-85c5-3d869e6c0136 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 378 time: 0.0994174 Nov 05 14:56:29.523425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': '94f54709-f049-4737-8d52-06efad83b97d', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['fdf2707a-8ec3-498a-bb57-2ddadab7bb47']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:29.552363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bdc761df-e1ee-4b2f-bb4c-adf7792a522f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:29.552783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:29.587515 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2ac7c737-44ad-4977-9d22-bec03eb830d8 req-2df2a7a4-2ac0-4d98-9300-274ef4575a6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 210 time: 0.0787077 Nov 05 14:56:29.667297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:56:29.671292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:29.791186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.3 (738ee03b-c9c9-4a04-9e8d-78d2085f4025/d32dc831-0c37-43fc-97ad-31b0b6b81e90/0708ec80-29ce-416c-8a9a-cb0e5daca53e) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:56:29.929494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:29.961404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.002202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:30.007111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:30.011410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:56:30.035385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:30.067660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:30.068270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.084912 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-fb690906-8686-49cd-90ee-827c963c10cb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5664105 Nov 05 14:56:30.096970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Request body: {'port': {'device_id': '94f54709-f049-4737-8d52-06efad83b97d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:30.159145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.214346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b648b9dd-2e7b-4452-841e-427fd68c4d12 None None] Provisioning complete for port 0708ec80-29ce-416c-8a9a-cb0e5daca53e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:30.214804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b648b9dd-2e7b-4452-841e-427fd68c4d12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.251779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b648b9dd-2e7b-4452-841e-427fd68c4d12 None None] Port 0708ec80-29ce-416c-8a9a-cb0e5daca53e cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:56:30.428042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0708ec80-29ce-416c-8a9a-cb0e5daca53e {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:56:30.436197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.449132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Transition to ACTIVE for port object 0708ec80-29ce-416c-8a9a-cb0e5daca53e will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:56:30.452979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.501572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Pushing event updated for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:30.578864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Attempting to bind port 0708ec80-29ce-416c-8a9a-cb0e5daca53e on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:56:30.579201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Attempting to bind port 0708ec80-29ce-416c-8a9a-cb0e5daca53e by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:56:30.579536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Attempting to bind port 0708ec80-29ce-416c-8a9a-cb0e5daca53e on network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:56:30.584852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Port 0708ec80-29ce-416c-8a9a-cb0e5daca53e on network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:56:30.585329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Attempting to bind port 0708ec80-29ce-416c-8a9a-cb0e5daca53e on network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:56:30.590845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 56, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:56:30.591176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Checking segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:56:30.591551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Bound using segment: {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:56:30.591973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Bound port: 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e5abe6fa-b526-4b59-8044-a39e44874303', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:56:30.592325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.659771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:56:30.663455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:56:30.669033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.705175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:30.705911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:30.707739 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] 10.222.0.32 "PUT /v2.0/ports/0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 1093 time: 0.6145182 Nov 05 14:56:30.707739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:56:30.710051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6" -d '{"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:56:30.736370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b44a42c-0d26-45da-bbd2-01ca5b6dfd34 service neutron] Pushing event updated for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:30.740268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b407fb0-74d4-4eba-a27b-245cc675008a req-2ce395b0-11ee-4968-a901-1369a7eda7c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:30.742045 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6b407fb0-74d4-4eba-a27b-245cc675008a req-2ce395b0-11ee-4968-a901-1369a7eda7c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 943 time: 0.0777371 Nov 05 14:56:30.796778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:56:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10b9b851-d5ed-4b59-8121-6e6444926d25 x-openstack-request-id: req-10b9b851-d5ed-4b59-8121-6e6444926d25 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:56:30.797126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:56:30.798028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-10b9b851-d5ed-4b59-8121-6e6444926d25 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:56:30.798440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'status': 'completed', 'code': 200} Nov 05 14:56:30.817909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6b407fb0-74d4-4eba-a27b-245cc675008a req-f3d92c22-d86b-46af-a19b-c9013d330222 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0663788 Nov 05 14:56:30.857019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-c672cb5d-3285-4620-a1b3-67e7e0b518e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:30.858513 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-c672cb5d-3285-4620-a1b3-67e7e0b518e1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1096 time: 0.0489416 Nov 05 14:56:30.901828 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-217603f1-093d-4477-a536-3df9027ef598 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 217 time: 0.0349917 Nov 05 14:56:30.950521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-ca5eba72-8917-4d96-a1c4-5cfb13ad4894 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:30.951836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-ca5eba72-8917-4d96-a1c4-5cfb13ad4894 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0440278 Nov 05 14:56:31.000888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-8e52e541-5f7e-4157-9798-2bd13fb2cce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.002389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-8e52e541-5f7e-4157-9798-2bd13fb2cce2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0431671 Nov 05 14:56:31.088062 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-7aa629d0-61df-40f8-976a-2a0297ca8991 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788736 Nov 05 14:56:31.179727 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5c89efb-930c-49f0-aa00-af9a80c55d12 req-897b28f8-c013-41ee-b60c-88facec0c86f service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852010 Nov 05 14:56:31.267898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-e24325bc-06f0-4251-aa92-0e0844b4ad72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.269340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-e24325bc-06f0-4251-aa92-0e0844b4ad72 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1096 time: 0.0401945 Nov 05 14:56:31.357569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-b63695af-78f9-45ba-9cff-c4cebbbe5d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.359106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-b63695af-78f9-45ba-9cff-c4cebbbe5d82 service neutron] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 898 time: 0.0824754 Nov 05 14:56:31.403938 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-97720c6b-16c8-4181-b911-5548d24a3246 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 217 time: 0.0366542 Nov 05 14:56:31.452085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-0d64f6d4-f6b9-446f-8c6f-1e097bf383e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.453515 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-0d64f6d4-f6b9-446f-8c6f-1e097bf383e1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0425265 Nov 05 14:56:31.498516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-c56bd749-f853-45d0-9290-f232316950ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.499993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-c56bd749-f853-45d0-9290-f232316950ed service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393095 Nov 05 14:56:31.593621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-3558f498-7f38-4364-8f50-6e6328cf0833 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847242 Nov 05 14:56:31.680234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3abdee1f-d501-4bbc-a8c4-9fda5ba299e6 req-cb2f30ed-2f88-4b78-b7d3-c977e2e301c0 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0785267 Nov 05 14:56:31.932126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00856195-f705-4187-9b61-48c51c534483 req-37dff66d-c963-4982-acd6-4c54448b364c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:31.933628 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-00856195-f705-4187-9b61-48c51c534483 req-37dff66d-c963-4982-acd6-4c54448b364c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 943 time: 0.0478740 Nov 05 14:56:31.984830 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-00856195-f705-4187-9b61-48c51c534483 req-21089c76-0918-40e2-b602-ac867046e2ac tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452049 Nov 05 14:56:33.098642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649c5534-b632-4283-8cf5-5b3720bf983e req-a1b05b65-4f04-4697-a374-e5fa57286754 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:33.100113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-649c5534-b632-4283-8cf5-5b3720bf983e req-a1b05b65-4f04-4697-a374-e5fa57286754 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 943 time: 0.0485883 Nov 05 14:56:33.146819 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-649c5534-b632-4283-8cf5-5b3720bf983e req-d9ccf24a-2ce9-4899-8a0b-6604420c2878 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0409758 Nov 05 14:56:33.381252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0708ec80-29ce-416c-8a9a-cb0e5daca53e details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:56:33.473057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:33.484213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'port_id': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'mac_address': 'fa:16:3e:89:ce:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 618, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:56:33.520824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:33.536427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0708ec80-29ce-416c-8a9a-cb0e5daca53e {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:56:33.554903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:33.559008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:33.603812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:33.784207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['0708ec80-29ce-416c-8a9a-cb0e5daca53e'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:56:34.258679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47c7afe-a384-42eb-8602-d2126e871faa req-e8bdcae8-d03b-4ef3-a4a1-bc99c49ea7ca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:34.260125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b47c7afe-a384-42eb-8602-d2126e871faa req-e8bdcae8-d03b-4ef3-a4a1-bc99c49ea7ca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 944 time: 0.0471869 Nov 05 14:56:34.308561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b47c7afe-a384-42eb-8602-d2126e871faa req-77eee162-8534-416d-8c37-6ad1ce825521 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0425663 Nov 05 14:56:35.395264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0708ec80-29ce-416c-8a9a-cb0e5daca53e up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:56:35.422390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59cb0654-ea02-4c39-bbc5-849092616e05 req-c559e190-7e5d-47c8-99e7-f514ec5bdfa8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:35.423862 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-59cb0654-ea02-4c39-bbc5-849092616e05 req-c559e190-7e5d-47c8-99e7-f514ec5bdfa8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 944 time: 0.0492678 Nov 05 14:56:35.445935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 0708ec80-29ce-416c-8a9a-cb0e5daca53e completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:56:35.450189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 0708ec80-29ce-416c-8a9a-cb0e5daca53e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:56:35.450563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:35.478913 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-59cb0654-ea02-4c39-bbc5-849092616e05 req-bd4983ee-fa04-42e2-890a-69cdacaa8f4c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0490260 Nov 05 14:56:35.531002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:35.554939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:56:35.557791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-610b4f3a-aec0-4e86-bd3e-87b50bbdce66" -d '{"events": [{"server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "name": "network-vif-plugged", "status": "completed", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:56:35.570732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:56:35.574515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:35.621419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:35.647858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:56:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6215197-f0b4-4d97-8a97-e471e3fcc438 x-openstack-request-id: req-d6215197-f0b4-4d97-8a97-e471e3fcc438 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:56:35.648154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "name": "network-vif-plugged", "status": "completed", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:56:35.648406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d6215197-f0b4-4d97-8a97-e471e3fcc438 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:56:35.648844 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'code': 200} Nov 05 14:56:35.805269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ebefb-0903-4643-bf39-81f55cfd283a req-a8f07fae-7af8-4340-9281-ebe3a5f08716 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:35.806717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-333ebefb-0903-4643-bf39-81f55cfd283a req-a8f07fae-7af8-4340-9281-ebe3a5f08716 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1098 time: 0.0385623 Nov 05 14:56:35.851435 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-333ebefb-0903-4643-bf39-81f55cfd283a req-c7f4d0d2-306c-44e0-a8bd-8b4f9bcb1415 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0373771 Nov 05 14:56:36.592440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ef379b-f7d7-4cf3-8c14-05f6355ae2a1 req-ab6488db-41b7-4cfd-9382-bfbd2f7e5502 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:36.593911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-06ef379b-f7d7-4cf3-8c14-05f6355ae2a1 req-ab6488db-41b7-4cfd-9382-bfbd2f7e5502 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0479858 Nov 05 14:56:36.641572 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-06ef379b-f7d7-4cf3-8c14-05f6355ae2a1 req-bd4739bc-d970-407d-8fe1-dd3ece697d5c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417778 Nov 05 14:56:37.760340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fecfd1b8-06ab-4f53-9d6d-9973b5769bf9 req-5ff1b245-f00b-4651-95f5-c8e109829a16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:37.761807 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fecfd1b8-06ab-4f53-9d6d-9973b5769bf9 req-5ff1b245-f00b-4651-95f5-c8e109829a16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0534945 Nov 05 14:56:37.809444 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fecfd1b8-06ab-4f53-9d6d-9973b5769bf9 req-cd3141ae-96ac-4263-bfe1-327d5639dd21 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417533 Nov 05 14:56:37.920224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e6d06c-ee49-4d0b-a63b-1432d5623d1f req-9b5872e1-e842-4e99-99d7-7a01b49800c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:37.921609 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2e6d06c-ee49-4d0b-a63b-1432d5623d1f req-9b5872e1-e842-4e99-99d7-7a01b49800c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0477483 Nov 05 14:56:37.969033 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2e6d06c-ee49-4d0b-a63b-1432d5623d1f req-f5fcae60-ef4b-45df-961c-d822e762adf0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0414872 Nov 05 14:56:37.990595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47084) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:38.035472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5909901-276f-45cb-83cc-b47bbc62d5ab tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:38.037120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e5909901-276f-45cb-83cc-b47bbc62d5ab tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1093 time: 0.0454628 Nov 05 14:56:38.039874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47086) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:38.044619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.3'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:56:38.066126 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.159469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.263039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.151 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/158b5910-55be-49c8-83e7-7fbcf0db2d84) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:56:38.359589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.391751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.431009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:56:38.433764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:56:38.439411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:56:38.464612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=158b5910-55be-49c8-83e7-7fbcf0db2d84,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:38.788966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.855198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:38.999916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:39.004554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:39.068782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=158b5910-55be-49c8-83e7-7fbcf0db2d84,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:56:39.080093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:39.183309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 8686255d-e7fe-4bf4-a538-6e54d74ca42e associated. External IP: 172.26.5.151, port: 0708ec80-29ce-416c-8a9a-cb0e5daca53e. Nov 05 14:56:39.678133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:56:39.781397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:56:39.791461 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Sync routers for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:56:39.798464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:39.800942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:39.801540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:39.825538 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-999d4a52-529a-4ba9-ad75-407137c51e59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7841010 Nov 05 14:56:39.826360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:56:39.828337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47088) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:39.828859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5" -d '{"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:56:39.865465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:56:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7095d20-422b-4fd7-ade5-9b98e9106943 x-openstack-request-id: req-f7095d20-422b-4fd7-ade5-9b98e9106943 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:56:39.865465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:56:39.865465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f7095d20-422b-4fd7-ade5-9b98e9106943 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:56:39.865939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'status': 'completed', 'code': 200} Nov 05 14:56:39.898825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee2b296f-7cb2-4394-8239-e4b93862dd9b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/8686255d-e7fe-4bf4-a538-6e54d74ca42e HTTP/1.1" status: 200 len: 991 time: 0.0691783 Nov 05 14:56:39.910890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:39.932966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-3f41c169-8fc2-4147-8582-d44ec081cc2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:39.934382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-3f41c169-8fc2-4147-8582-d44ec081cc2b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1098 time: 0.0457654 Nov 05 14:56:40.026136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-0bb6c8d3-4ba0-43f9-8b20-0e131de75948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:40.027604 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-0bb6c8d3-4ba0-43f9-8b20-0e131de75948 service neutron] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 898 time: 0.0851016 Nov 05 14:56:40.097426 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-50f7ae0d-bc83-4ac6-a5f0-f3d2c000c8b1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 999 time: 0.0631731 Nov 05 14:56:40.128512 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8686255d-e7fe-4bf4-a538-6e54d74ca42e', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.151', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'port_id': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'mac_address': 'fa:16:3e:89:ce:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94f54709-f049-4737-8d52-06efad83b97d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:56:38Z', 'updated_at': '2021-11-05T14:56:38Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:40.151489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-ea125a89-86f3-4487-890e-1ed7f04c0ec5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:40.152963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-ea125a89-86f3-4487-890e-1ed7f04c0ec5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0493107 Nov 05 14:56:40.157544 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Checking router: 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:56:40.165737 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:56:40.166318 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:40.197966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-f3252ec5-b9b6-4d54-9dd6-573eff904368 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:56:40.199352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-f3252ec5-b9b6-4d54-9dd6-573eff904368 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391929 Nov 05 14:56:40.269426 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:56:40.289999 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-11a6adcd-63d9-4324-adc8-c7f6dac54899 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832286 Nov 05 14:56:40.503722 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8686255d-e7fe-4bf4-a538-6e54d74ca42e', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.151', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'port_id': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'mac_address': 'fa:16:3e:89:ce:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94f54709-f049-4737-8d52-06efad83b97d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:56:38Z', 'updated_at': '2021-11-05T14:56:38Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:56:40.530131 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f52da61-3f9a-424a-85a9-1539aa09de03 None None] The sync data for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv is: [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8686255d-e7fe-4bf4-a538-6e54d74ca42e', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.151', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'port_id': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'mac_address': 'fa:16:3e:89:ce:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94f54709-f049-4737-8d52-06efad83b97d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:56:38Z', 'updated_at': '2021-11-05T14:56:38Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:56:40.717293 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55287ee0-0337-4bc6-95bf-4d73e18d0ed5 req-1cf0199a-cd7e-416c-82d3-76942febd9a9 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4199226 Nov 05 14:56:40.734032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62d2393f-48de-4516-82e9-225524817c4e None None] New status for floating IP 8686255d-e7fe-4bf4-a538-6e54d74ca42e: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:56:40.903357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47092) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:40.969345 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-31dd62bc-c99d-49cd-8736-cdc420e3908e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/8686255d-e7fe-4bf4-a538-6e54d74ca42e HTTP/1.1" status: 200 len: 991 time: 0.0646913 Nov 05 14:56:41.973221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47094) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:56:42.031596 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-16dff3fb-94e1-4235-bd1a-f6b4d95742f9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/8686255d-e7fe-4bf4-a538-6e54d74ca42e HTTP/1.1" status: 200 len: 993 time: 0.0571485 Nov 05 14:56:48.223008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:50.049380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aad04f09-c9c3-4762-bdb0-3f3a4ff4eceb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:52.398628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fe675c7d-82db-4354-a48f-2bb72e3e994d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:53.404271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:54.870631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:56:55.543455 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:56:55.902185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:00.152737 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-62fe2856-6062-4bcd-a50c-2f2330189f82 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0395653 Nov 05 14:57:00.234404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-c4a944ac-3c21-4145-9043-e7803b530871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:00.235836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-c4a944ac-3c21-4145-9043-e7803b530871 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1099 time: 0.0416813 Nov 05 14:57:00.334077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-51c321f6-678f-4253-8138-8928925f0ca7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:00.335482 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-51c321f6-678f-4253-8138-8928925f0ca7 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.0801437 Nov 05 14:57:00.401081 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-22704728-2a89-42fe-bac9-4614f848bebd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 1002 time: 0.0583727 Nov 05 14:57:00.448782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-270812bf-59b1-4e2f-bc8b-ba1c124786c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:00.450118 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-270812bf-59b1-4e2f-bc8b-ba1c124786c2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0426998 Nov 05 14:57:00.495586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-8039f29a-895d-4470-ab7e-9897185cbfdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:00.497094 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-8039f29a-895d-4470-ab7e-9897185cbfdd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400522 Nov 05 14:57:00.589467 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-ae440615-8b75-4a8a-b116-c3b6f5675aec service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837233 Nov 05 14:57:00.677339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17744049-8a7b-4660-804b-fe5edccfccc2 req-fcc9412b-0388-4683-97ba-d075f401ee0c service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801568 Nov 05 14:57:06.552823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47102) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:06.709567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port 701239b5-5634-4953-b4f1-dc4981be15c5 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:06.709904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:06.785970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:06.786219 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:06.797514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for 701239b5-5634-4953-b4f1-dc4981be15c5 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:06.941658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:06.967311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=701239b5-5634-4953-b4f1-dc4981be15c5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:07.026257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:07.026639 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP 3c28b03a-5f29-417d-86c1-139988c4231a disassociated (deleted). External IP: 172.26.5.57, port: c2c61a54-6917-4dd2-8d33-21887a41b601. Nov 05 14:57:07.232406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:57:07.337805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:57:07.342207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:07.348078 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:57:07.358195 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:07.359023 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:07.370144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e3c06b11-aa63-4616-8fdf-49266026733e tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "DELETE /v2.0/floatingips/3c28b03a-5f29-417d-86c1-139988c4231a HTTP/1.1" status: 204 len: 168 time: 0.8162460 Nov 05 14:57:07.370748 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:57:07.374746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-994049df-26b7-49d0-b240-e6bd065774b8" -d '{"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:57:07.412916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:57:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9055bc88-cc35-427b-81b3-68426ee57452 x-openstack-request-id: req-9055bc88-cc35-427b-81b3-68426ee57452 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:57:07.413339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:57:07.413757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9055bc88-cc35-427b-81b3-68426ee57452 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:57:07.414126 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'status': 'completed', 'code': 200} Nov 05 14:57:07.473721 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:07.478512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994049df-26b7-49d0-b240-e6bd065774b8 req-850c3b35-3642-4899-afdf-d363dc72fee8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:07.480283 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-850c3b35-3642-4899-afdf-d363dc72fee8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 1098 time: 0.0419500 Nov 05 14:57:07.596883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994049df-26b7-49d0-b240-e6bd065774b8 req-aba393e6-a56b-4900-add9-e8e4430c770f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:07.598370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-aba393e6-a56b-4900-add9-e8e4430c770f service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.1047568 Nov 05 14:57:07.606084 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9f4e95-110b-4818-a377-67149e13d029 req-69cc0ffc-6364-4776-89d5-9f51d3fe2a20 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:07.607712 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5a9f4e95-110b-4818-a377-67149e13d029 req-69cc0ffc-6364-4776-89d5-9f51d3fe2a20 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0567558 Nov 05 14:57:07.644398 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-ef3bbf62-5b3f-4391-b82b-8a8c3d6462f8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 200 len: 217 time: 0.0385864 Nov 05 14:57:07.663349 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5a9f4e95-110b-4818-a377-67149e13d029 req-73cf529a-993f-42b5-9130-e6485a2db080 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489175 Nov 05 14:57:07.700011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994049df-26b7-49d0-b240-e6bd065774b8 req-d305adae-99eb-4893-9fc5-145fcdf4dd4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:07.701508 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-d305adae-99eb-4893-9fc5-145fcdf4dd4d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0488265 Nov 05 14:57:07.717730 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:07.747926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-994049df-26b7-49d0-b240-e6bd065774b8 req-d2166786-5780-4d2f-b2c3-4e934fb62c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:07.749421 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-d2166786-5780-4d2f-b2c3-4e934fb62c38 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0395937 Nov 05 14:57:07.832960 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:57:07.841182 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:07.841767 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:07.844486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-29e4554a-e632-40fb-aedc-04b1bc7d8a3a service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845582 Nov 05 14:57:07.938387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-994049df-26b7-49d0-b240-e6bd065774b8 req-26a19a73-7461-475a-8c8b-95b0a935bb04 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857944 Nov 05 14:57:07.944586 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:08.161825 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:08.190678 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ee4c391-26de-4d15-bda0-96e93dc78bf0 None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'dc53ad19-0686-4aae-b0e8-341b11ad5bd4', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'floating_ip_address': '172.26.5.101', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87aa76eb-2649-4160-9608-307c31d98562', 'port_id': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 1359, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'mac_address': 'fa:16:3e:f1:9a:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:53:11Z', 'updated_at': '2021-11-05T14:53:14Z', 'revision_number': 1, 'project_id': '747df015bfd341929de773100c6c68ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:57:08.396844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3df96d23-9bff-4081-b127-1943fd915962 None None] New status for floating IP 3c28b03a-5f29-417d-86c1-139988c4231a: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:57:08.781502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2657fa02-adf2-4420-b2d5-65a6ef7d8abc req-27ff09c5-778b-476e-ba35-5106fc180ad9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:08.782928 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2657fa02-adf2-4420-b2d5-65a6ef7d8abc req-27ff09c5-778b-476e-ba35-5106fc180ad9 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0505219 Nov 05 14:57:08.832534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2657fa02-adf2-4420-b2d5-65a6ef7d8abc req-949a600a-e91d-40ed-b2b6-153454d4b44c tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430450 Nov 05 14:57:09.181631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caffc25e-6854-4a0e-8843-97646237f120 req-d503971d-7ee0-4f8d-a930-670e0ff34767 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:09.183137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-caffc25e-6854-4a0e-8843-97646237f120 req-d503971d-7ee0-4f8d-a930-670e0ff34767 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 945 time: 0.0529287 Nov 05 14:57:09.272657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port c2c61a54-6917-4dd2-8d33-21887a41b601 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:09.272989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:09.360044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] For port c2c61a54-6917-4dd2-8d33-21887a41b601, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c2c61a54-6917-4dd2-8d33-21887a41b601,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:09.360393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:09.373910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for c2c61a54-6917-4dd2-8d33-21887a41b601 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:09.495570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:09.526340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=c2c61a54-6917-4dd2-8d33-21887a41b601,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:09.569536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] No DVR routers for this DVR port c2c61a54-6917-4dd2-8d33-21887a41b601 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:57:09.572278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:09.575892 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-caffc25e-6854-4a0e-8843-97646237f120 req-774d695f-b78f-4f4d-b543-6bd97e5a7720 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "DELETE /v2.0/ports/c2c61a54-6917-4dd2-8d33-21887a41b601 HTTP/1.1" status: 204 len: 173 time: 0.3863995 Nov 05 14:57:09.576344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'name': 'network-vif-deleted', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:57:09.579271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b133537-3853-4e30-bdea-e965c41c768a" -d '{"events": [{"server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "name": "network-vif-deleted", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:57:09.679146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:57:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29f0a532-1b07-4359-bbba-3d4072a124e1 x-openstack-request-id: req-29f0a532-1b07-4359-bbba-3d4072a124e1 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:57:09.679445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "960e30f6-aa3f-4a9e-89d9-e8712f8e18a1", "name": "network-vif-deleted", "tag": "c2c61a54-6917-4dd2-8d33-21887a41b601", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:57:09.679696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-29f0a532-1b07-4359-bbba-3d4072a124e1 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:57:09.680087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '960e30f6-aa3f-4a9e-89d9-e8712f8e18a1', 'name': 'network-vif-deleted', 'tag': 'c2c61a54-6917-4dd2-8d33-21887a41b601', 'status': 'completed', 'code': 200} Nov 05 14:57:09.937328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f507f4b9-1b37-4c1e-a87b-211ffda9065c req-949f684d-ebf3-43c3-8e00-b5afdeed0b32 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0308328 Nov 05 14:57:11.032964 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d9ae8577-c2f3-48f2-81c8-12fff994de22 req-7a23e776-9daf-42e8-8887-5124571d6810 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0268726 Nov 05 14:57:12.128927 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92807583-27b6-4def-b19b-5677420dc013 req-53d6b5bd-f387-4264-89fe-9c1c045cc443 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0263557 Nov 05 14:57:13.222822 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18baa267-da1c-4d4b-9874-132abd7bba9d req-760362ab-a62b-4a85-a26c-84593878d4f7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=960e30f6-aa3f-4a9e-89d9-e8712f8e18a1 HTTP/1.1" status: 200 len: 210 time: 0.0275977 Nov 05 14:57:13.586921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c2c61a54-6917-4dd2-8d33-21887a41b601 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:13.606993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: c2c61a54-6917-4dd2-8d33-21887a41b601 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:13.607330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c2c61a54-6917-4dd2-8d33-21887a41b601 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:18.220185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:19.624803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47154) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:19.781395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port 4d63c552-0888-4a13-9ff9-8f64aa581a1f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:19.781636 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:19.857660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:19.857980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:19.870199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for 4d63c552-0888-4a13-9ff9-8f64aa581a1f owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:20.016680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:20.041722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=4d63c552-0888-4a13-9ff9-8f64aa581a1f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:20.051947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e00e09c1-a406-4eb9-a1ef-5af158cc19e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:20.052555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.052836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.053230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.053573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.053908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.054239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.054568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.054898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.055224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.055545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.055867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.056187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:20.112904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:20.113230 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Floating IP dc53ad19-0686-4aae-b0e8-341b11ad5bd4 disassociated (deleted). External IP: 172.26.5.101, port: 07a948f8-d693-4462-8a00-71b63cbd0ee0. Nov 05 14:57:20.320131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:57:20.425562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:57:20.430264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:20.434741 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:57:20.444640 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:20.445133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:20.457740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e7f5d6c3-a799-4464-822a-3ce9415f3d1b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "DELETE /v2.0/floatingips/dc53ad19-0686-4aae-b0e8-341b11ad5bd4 HTTP/1.1" status: 204 len: 168 time: 0.8318756 Nov 05 14:57:20.458347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:57:20.460602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b" -d '{"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:57:20.508813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:57:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cc56d75-6287-4914-9bd6-4dc7cd23043b x-openstack-request-id: req-1cc56d75-6287-4914-9bd6-4dc7cd23043b {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:57:20.509109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:57:20.509368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1cc56d75-6287-4914-9bd6-4dc7cd23043b {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:57:20.509779 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'status': 'completed', 'code': 200} Nov 05 14:57:20.554874 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:20.575085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-aa660c47-cf0d-4b38-be6b-c080881c2dbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:20.576706 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-aa660c47-cf0d-4b38-be6b-c080881c2dbf service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=747df015bfd341929de773100c6c68ae&device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 1099 time: 0.0449898 Nov 05 14:57:20.709512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174ce97e-d85d-4dd1-9d22-f75fdd1017b3 req-dac1e426-aa30-41e2-ba68-49ffe00fe6df tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:20.711006 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-174ce97e-d85d-4dd1-9d22-f75fdd1017b3 req-dac1e426-aa30-41e2-ba68-49ffe00fe6df tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0704823 Nov 05 14:57:20.735299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-0f3cafeb-e432-47a1-8796-7acf634dba78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:20.737297 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-0f3cafeb-e432-47a1-8796-7acf634dba78 service neutron] 10.222.0.32 "GET /v2.0/networks?id=45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 200 len: 913 time: 0.1514862 Nov 05 14:57:20.762406 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:20.790851 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:57:20.791781 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-d07bc2b6-9e7b-4e41-be43-424d6ac315ff service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 200 len: 217 time: 0.0419977 Nov 05 14:57:20.799570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:20.800161 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:56:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:20.814554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-174ce97e-d85d-4dd1-9d22-f75fdd1017b3 req-6aa14710-eb70-4375-b7de-795d007b5aca tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0947597 Nov 05 14:57:20.849676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-0b2a960a-7e9d-40ec-aaf4-b385fc9aff04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:20.851135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-0b2a960a-7e9d-40ec-aaf4-b385fc9aff04 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 200 len: 851 time: 0.0499074 Nov 05 14:57:20.896638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-4dd78132-adca-4b68-9b2d-8eb2bbd1900b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:20.898268 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-4dd78132-adca-4b68-9b2d-8eb2bbd1900b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=45055355-0dd4-4c48-858a-f131e1d1f8bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0401294 Nov 05 14:57:20.900484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:20.992051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-d955de88-5b9f-45e1-9db1-1301ad6268d8 service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854075 Nov 05 14:57:21.080429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7d6a37a0-b7f0-4da7-b6b8-6f5b2703223b req-8d28be5e-6ba4-4249-a0a0-b81d9d8b4e7e service neutron] 10.222.0.32 "GET /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812459 Nov 05 14:57:21.097616 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:21.124725 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2abe7ec1-1f5c-4024-a485-fbd8879a49d7 None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7', 'name': '', 'network_id': '45055355-0dd4-4c48-858a-f131e1d1f8bc', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'mac_address': 'fa:16:3e:c3:08:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_interface', 'standard_attr_id': 971, 'fixed_ips': [{'subnet_id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:24Z', 'updated_at': '2021-11-05T14:49:36Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'subnets': [{'id': 'a738c6ea-0bb8-45cf-87bb-1b3689e6e451', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:57:21.328624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9691831-1b5c-4565-99ac-3b3b098761d2 None None] New status for floating IP dc53ad19-0686-4aae-b0e8-341b11ad5bd4: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:57:21.931019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febae865-b606-4ca3-b7ab-48a92ebd80f1 req-21e27e49-004b-4d59-8224-4ac7a8716cd2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:21.932555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-febae865-b606-4ca3-b7ab-48a92ebd80f1 req-21e27e49-004b-4d59-8224-4ac7a8716cd2 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0499191 Nov 05 14:57:21.984564 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-febae865-b606-4ca3-b7ab-48a92ebd80f1 req-54520b38-6e77-42ad-9627-e2568f6be1a7 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/security-groups?id=04822744-30be-4b89-a4f8-6ca1fd516d0f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458729 Nov 05 14:57:22.125471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-7d30d8cf-76e6-4732-954d-580fca67b520 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:57:22.126813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-7d30d8cf-76e6-4732-954d-580fca67b520 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 946 time: 0.0524123 Nov 05 14:57:22.214697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port 07a948f8-d693-4462-8a00-71b63cbd0ee0 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:22.215036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:22.304184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] For port 07a948f8-d693-4462-8a00-71b63cbd0ee0, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=07a948f8-d693-4462-8a00-71b63cbd0ee0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:22.304565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:22.318006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for 07a948f8-d693-4462-8a00-71b63cbd0ee0 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:22.400161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1de87c5f-feaa-4962-8caf-aa31fead1102 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:22.441250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:22.470638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=07a948f8-d693-4462-8a00-71b63cbd0ee0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:22.482672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.483024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.483368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.483707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.484032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.484361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.484710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.485036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.485359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.485678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.485998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.486352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:22.523188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] No DVR routers for this DVR port 07a948f8-d693-4462-8a00-71b63cbd0ee0 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:57:22.525689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:22.529058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-35fa2a21-05cb-439b-81fd-cb79eccb6e73 req-dc1825a4-591c-4b97-a247-3bf7508e370b tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.32 "DELETE /v2.0/ports/07a948f8-d693-4462-8a00-71b63cbd0ee0 HTTP/1.1" status: 204 len: 173 time: 0.3958092 Nov 05 14:57:22.529500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'name': 'network-vif-deleted', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:57:22.531770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-486fdcbf-da2b-404b-9524-dbfe66b28c60" -d '{"events": [{"server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "name": "network-vif-deleted", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:57:22.571761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:57:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9454377-bebb-4334-8ee3-0254402990af x-openstack-request-id: req-a9454377-bebb-4334-8ee3-0254402990af {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:57:22.572055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8be1afab-3d79-40d8-a5fd-b6e60b8bd584", "name": "network-vif-deleted", "tag": "07a948f8-d693-4462-8a00-71b63cbd0ee0", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:57:22.572310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a9454377-bebb-4334-8ee3-0254402990af {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:57:22.572743 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8be1afab-3d79-40d8-a5fd-b6e60b8bd584', 'name': 'network-vif-deleted', 'tag': '07a948f8-d693-4462-8a00-71b63cbd0ee0', 'status': 'completed', 'code': 200} Nov 05 14:57:23.081042 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f593a6be-511f-4188-bba0-a82149316aac req-92231340-e8ea-4003-b138-73542901449f tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0286338 Nov 05 14:57:23.407992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:24.183312 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-776d4101-e6c2-469d-8116-6877cc043dad req-cc80f40e-6ecb-4732-990d-bc62b6a4d491 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0324223 Nov 05 14:57:24.873351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:25.279092 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-af5d8853-0431-4bcc-a78d-dc7052bbb45a req-a15fd26b-46b6-4e80-acf5-9564a6797318 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0258012 Nov 05 14:57:25.903833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:26.370371 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8e077629-7a09-4e67-aba8-706f783a76cc req-e1048c92-4bc3-46d0-a98c-2998bbf7c2bf tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "GET /v2.0/ports?device_id=8be1afab-3d79-40d8-a5fd-b6e60b8bd584 HTTP/1.1" status: 200 len: 210 time: 0.0267749 Nov 05 14:57:27.425776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47176) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:27.550197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Deleting port fadd8b68-f2c6-4728-a6e4-008fc9f6412a {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:27.550606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.625487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.625803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.637027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Calling delete_port for fadd8b68-f2c6-4728-a6e4-008fc9f6412a owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:27.663846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 07a948f8-d693-4462-8a00-71b63cbd0ee0 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:27.683876 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 07a948f8-d693-4462-8a00-71b63cbd0ee0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:27.684232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 07a948f8-d693-4462-8a00-71b63cbd0ee0 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:27.779479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.807239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'Port': ['ID=fadd8b68-f2c6-4728-a6e4-008fc9f6412a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:27.865884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.868426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:27.869594 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fa634ecf-582d-4191-8460-7baca9813a76 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "DELETE /v2.0/floatingips/baa1f31b-d39c-407b-9a15-cc4161256e47 HTTP/1.1" status: 204 len: 168 time: 0.4428475 Nov 05 14:57:31.150764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47192) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:31.209770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:31.235204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:31.292333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:31.294987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:31.296136 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] 10.222.0.30 "DELETE /v2.0/security-groups/04822744-30be-4b89-a4f8-6ca1fd516d0f HTTP/1.1" status: 204 len: 168 time: 0.1443605 Nov 05 14:57:31.305585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85530b64-5150-4f8c-9bd5-9148195e94e6 tempest-TestVolumeBootPattern-2025711646 tempest-TestVolumeBootPattern-2025711646-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=04822744-30be-4b89-a4f8-6ca1fd516d0f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:31.360347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47196) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:31.893298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:32.138351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Deleting port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:32.138689 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:32.213654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] For port 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:32.214011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:32.226906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Calling delete_port for 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:32.400837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:32.430872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Pushing event deleted for resources: {'Port': ['ID=9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:32.542610 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:57:32.604398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:32.809916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Router 87aa76eb-2649-4160-9608-307c31d98562 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:57:32.911953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:57:32.917287 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-16dd33aa-bbbb-40e8-88ca-cabc8fc0751f admin admin] 10.222.0.30 "PUT /v2.0/routers/87aa76eb-2649-4160-9608-307c31d98562/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5555432 Nov 05 14:57:32.919525 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47200) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:32.920601 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Sync routers for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:57:32.930777 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:32.931375 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:57:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:33.022969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.040727 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:33.316878 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:57:32Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:33.342804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Checking router: 87aa76eb-2649-4160-9608-307c31d98562 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:57:33.351648 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Routers {'87aa76eb-2649-4160-9608-307c31d98562'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:33.352257 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:57:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87aa76eb-2649-4160-9608-307c31d98562'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:33.446334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.454702 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] Set router 87aa76eb-2649-4160-9608-307c31d98562 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:33.506448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Deleting port 2c88dc94-fc32-4605-b14c-15e05ccc5589 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:33.506796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.586053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] For port 2c88dc94-fc32-4605-b14c-15e05ccc5589, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2c88dc94-fc32-4605-b14c-15e05ccc5589,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:33.586498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.599391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Calling delete_port for 2c88dc94-fc32-4605-b14c-15e05ccc5589 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:33.632736 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:57:32Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:33.657821 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-782a5ee3-95f7-4b5f-99ef-5c1fe0eaeaf7 None None] The sync data for ids ['87aa76eb-2649-4160-9608-307c31d98562'] in dv-neutron-816850-1-hyperv is: [{'id': '87aa76eb-2649-4160-9608-307c31d98562', 'name': 'tempest-TestVolumeBootPattern-1069323615-router', 'tenant_id': '747df015bfd341929de773100c6c68ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60'}], 'enable_snat': True}, 'gw_port_id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:14Z', 'updated_at': '2021-11-05T14:57:32Z', 'revision_number': 5, 'project_id': '747df015bfd341929de773100c6c68ae', 'gw_port': {'id': '2c88dc94-fc32-4605-b14c-15e05ccc5589', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:22:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87aa76eb-2649-4160-9608-307c31d98562', 'device_owner': 'network:router_gateway', 'standard_attr_id': 954, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:16Z', 'updated_at': '2021-11-05T14:49:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:57:33.762357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.792025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Pushing event deleted for resources: {'Port': ['ID=2c88dc94-fc32-4605-b14c-15e05ccc5589,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:33.849189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.937616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.939893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.982261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.982696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 87aa76eb-2649-4160-9608-307c31d98562 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:57:33.986909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:33.987944 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1d193c29-16ba-43ab-8255-fb3544468a96 admin admin] 10.222.0.30 "DELETE /v2.0/routers/87aa76eb-2649-4160-9608-307c31d98562 HTTP/1.1" status: 204 len: 168 time: 1.0674560 Nov 05 14:57:33.990720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47202) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:34.043733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Deleting subnet a738c6ea-0bb8-45cf-87bb-1b3689e6e451 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:57:34.048003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.083929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.164942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.221925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.245706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a738c6ea-0bb8-45cf-87bb-1b3689e6e451,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:34.251512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.255295 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d04081d1-c432-41e8-9101-82123875b931 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/a738c6ea-0bb8-45cf-87bb-1b3689e6e451 HTTP/1.1" status: 204 len: 168 time: 0.2635584 Nov 05 14:57:34.258145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47204) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:34.262009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af290c5b-b05b-43bd-9c63-d973c48b37c6 None None] Network 45055355-0dd4-4c48-858a-f131e1d1f8bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:57:34.335832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.396251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Deleting port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:34.396645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.455908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] For port b5219506-82cf-4af9-bed1-f22b9d3e4cb0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,segment=NetworkSegment(de99c3ed-af20-4d87-a556-619f37cf0e36),segment_id=de99c3ed-af20-4d87-a556-619f37cf0e36)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:34.456605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.472772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Calling delete_port for b5219506-82cf-4af9-bed1-f22b9d3e4cb0 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:34.547551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.574050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Pushing event deleted for resources: {'Port': ['ID=b5219506-82cf-4af9-bed1-f22b9d3e4cb0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:34.575860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] No DVR routers for this DVR port b5219506-82cf-4af9-bed1-f22b9d3e4cb0 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:57:34.649612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.671135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45055355-0dd4-4c48-858a-f131e1d1f8bc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:34.682559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de99c3ed-af20-4d87-a556-619f37cf0e36') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:34.683253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5475d971-e458-4656-b48f-93379a65872f None None] DHCP port deletion for 45055355-0dd4-4c48-858a-f131e1d1f8bc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:57:34.683447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de99c3ed-af20-4d87-a556-619f37cf0e36') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:34.693730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.708981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.715144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Releasing vlan 644 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:57:34.715716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:57:34.717414 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:57:34.770113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.775626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:34.778757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] 10.222.0.30 "DELETE /v2.0/networks/45055355-0dd4-4c48-858a-f131e1d1f8bc HTTP/1.1" status: 204 len: 168 time: 0.5196011 Nov 05 14:57:34.781901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47206) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:34.790326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e502cb-e4f7-4fc2-af92-e64f98948adc admin admin] Pushing event deleted for resources: {'Network': ['ID=45055355-0dd4-4c48-858a-f131e1d1f8bc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:35.113096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:35.350427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Deleting port 1e2801d3-ca3e-4985-a965-861f5c8326b0 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:35.350964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:35.430767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] For port 1e2801d3-ca3e-4985-a965-861f5c8326b0, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1e2801d3-ca3e-4985-a965-861f5c8326b0,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:35.431008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:35.444532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Calling delete_port for 1e2801d3-ca3e-4985-a965-861f5c8326b0 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:35.490871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2c88dc94-fc32-4605-b14c-15e05ccc5589 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:35.510945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 2c88dc94-fc32-4605-b14c-15e05ccc5589 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:35.511283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2c88dc94-fc32-4605-b14c-15e05ccc5589 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:35.511698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5219506-82cf-4af9-bed1-f22b9d3e4cb0 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:35.529770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b5219506-82cf-4af9-bed1-f22b9d3e4cb0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:35.530106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b5219506-82cf-4af9-bed1-f22b9d3e4cb0 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:35.530504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:35.549216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:35.549453 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 9d55bb3b-ae2e-4619-ab1b-e80cbacbaed7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:35.913480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:35.939491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Pushing event deleted for resources: {'Port': ['ID=1e2801d3-ca3e-4985-a965-861f5c8326b0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:36.094374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.304321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Router affa76f7-e71b-4e66-bc82-992ceed4fa91 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:57:36.417326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:57:36.424893 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e3876448-c95c-4cc4-8121-3cc33f87ac85 admin admin] 10.222.0.30 "PUT /v2.0/routers/affa76f7-e71b-4e66-bc82-992ceed4fa91/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6393268 Nov 05 14:57:36.425491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47208) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:36.429074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Sync routers for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:57:36.438479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:36.439083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:57:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:36.530781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.540199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:36.635576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.686742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Deleting port 23c75c34-c49e-48dd-99c4-e2f41cb6108a {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:36.687087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.715277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156'}], 'enable_snat': True}, 'gw_port_id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:57:35Z', 'revision_number': 5, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port': {'id': '23c75c34-c49e-48dd-99c4-e2f41cb6108a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:57:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1002, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.156', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:49:34Z', 'updated_at': '2021-11-05T14:49:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:36.742548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Checking router: affa76f7-e71b-4e66-bc82-992ceed4fa91 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:57:36.750669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Routers {'affa76f7-e71b-4e66-bc82-992ceed4fa91'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:57:36.751269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:57:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['affa76f7-e71b-4e66-bc82-992ceed4fa91'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:36.770013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] For port 23c75c34-c49e-48dd-99c4-e2f41cb6108a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23c75c34-c49e-48dd-99c4-e2f41cb6108a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:36.770378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.783550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Calling delete_port for 23c75c34-c49e-48dd-99c4-e2f41cb6108a owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:36.835401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] Set router affa76f7-e71b-4e66-bc82-992ceed4fa91 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:57:36.887976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:57:36Z', 'revision_number': 6, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:36.913655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b429d77b-7d9d-4faa-b9f8-d36b2688376a None None] The sync data for ids ['affa76f7-e71b-4e66-bc82-992ceed4fa91'] in dv-neutron-816850-1-hyperv is: [{'id': 'affa76f7-e71b-4e66-bc82-992ceed4fa91', 'name': 'tempest-TestVolumeBootPattern-738994026-router', 'tenant_id': '2db7c5f71a2f486a87a72e6ff069379a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:49:33Z', 'updated_at': '2021-11-05T14:57:36Z', 'revision_number': 6, 'project_id': '2db7c5f71a2f486a87a72e6ff069379a', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:57:36.952997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:36.978819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Pushing event deleted for resources: {'Port': ['ID=23c75c34-c49e-48dd-99c4-e2f41cb6108a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:37.040439 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.133048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.135201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.176834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.177432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Fanout notify agent at l3_agent the message router_deleted on router affa76f7-e71b-4e66-bc82-992ceed4fa91 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:57:37.181646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.182753 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28bd8951-c335-4043-8b8c-6e55118fbe3d admin admin] 10.222.0.30 "DELETE /v2.0/routers/affa76f7-e71b-4e66-bc82-992ceed4fa91 HTTP/1.1" status: 204 len: 168 time: 0.7563210 Nov 05 14:57:37.185410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47210) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:37.228910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Deleting subnet 2e71e7a1-f932-4523-a8ac-7f5facc8c11b {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:57:37.231734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.266682 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.350381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.402291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.428383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2e71e7a1-f932-4523-a8ac-7f5facc8c11b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:37.434017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.438350 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1308445b-5c34-47d7-bdcb-53416b3ad6d9 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/2e71e7a1-f932-4523-a8ac-7f5facc8c11b HTTP/1.1" status: 204 len: 168 time: 0.2520144 Nov 05 14:57:37.438828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0683f48e-725f-45fc-8c37-d29997861d32 None None] Network bde16d5a-a42f-4260-868f-719b54772c0d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:57:37.440918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47212) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:37.514497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.568078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Deleting port 7597b659-dde2-40d5-944e-6c7302e11125 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:37.568410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.629467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] For port 7597b659-dde2-40d5-944e-6c7302e11125, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=7597b659-dde2-40d5-944e-6c7302e11125,segment=NetworkSegment(ba199014-4316-4a72-be9f-2e9a347a8e16),segment_id=ba199014-4316-4a72-be9f-2e9a347a8e16)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:37.629821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.643412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Calling delete_port for 7597b659-dde2-40d5-944e-6c7302e11125 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:37.662178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] DHCP port deletion for bde16d5a-a42f-4260-868f-719b54772c0d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:57:37.716773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23c75c34-c49e-48dd-99c4-e2f41cb6108a no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:37.736840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.739864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 23c75c34-c49e-48dd-99c4-e2f41cb6108a {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:37.740209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23c75c34-c49e-48dd-99c4-e2f41cb6108a not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:37.740648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1e2801d3-ca3e-4985-a965-861f5c8326b0 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:37.764048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=7597b659-dde2-40d5-944e-6c7302e11125,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:37.764264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 1e2801d3-ca3e-4985-a965-861f5c8326b0 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:37.764394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1e2801d3-ca3e-4985-a965-861f5c8326b0 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:37.764744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7597b659-dde2-40d5-944e-6c7302e11125 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:57:37.765840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] No DVR routers for this DVR port 7597b659-dde2-40d5-944e-6c7302e11125 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:57:37.786413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 7597b659-dde2-40d5-944e-6c7302e11125 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:57:37.786755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 7597b659-dde2-40d5-944e-6c7302e11125 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:57:37.788842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Deleting port 7597b659-dde2-40d5-944e-6c7302e11125 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:57:37.789218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.844824 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.855842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] For port 7597b659-dde2-40d5-944e-6c7302e11125, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:57:37.856229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.866207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bde16d5a-a42f-4260-868f-719b54772c0d']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:37.869291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Calling delete_port for 7597b659-dde2-40d5-944e-6c7302e11125 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:57:37.872052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.ipam_backend_mixin [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Port 7597b659-dde2-40d5-944e-6c7302e11125 was not found and therefore no delete operation was performed {{(pid=113582) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 14:57:37.875105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.878214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ba199014-4316-4a72-be9f-2e9a347a8e16') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:37.878517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ba199014-4316-4a72-be9f-2e9a347a8e16') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:57:37.891162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.900885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Pushing event deleted for resources: {'Port': ['ID=7597b659-dde2-40d5-944e-6c7302e11125,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:37.905810 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.912155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.912543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.912891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.913227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.913560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.913954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.914295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.914980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.915140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.915434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.915883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.916229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:57:37.917577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Releasing vlan 615 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:57:37.918183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.919348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7903d7f0-8e21-40f4-aeb5-9154d85de563 None None] No DVR routers for this DVR port 7597b659-dde2-40d5-944e-6c7302e11125 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:57:37.922566 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:57:37.989252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.995862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:37.999507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] 10.222.0.30 "DELETE /v2.0/networks/bde16d5a-a42f-4260-868f-719b54772c0d HTTP/1.1" status: 204 len: 168 time: 0.5575497 Nov 05 14:57:38.025345 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88d323f-efea-4800-8900-752b09e884c3 admin admin] Pushing event deleted for resources: {'Network': ['ID=bde16d5a-a42f-4260-868f-719b54772c0d,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:38.151760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47216) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:38.196205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-de5bcb87-3259-49cb-b347-f72b954cbe35 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=747df015bfd341929de773100c6c68ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0431225 Nov 05 14:57:38.198610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47218) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:38.245401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.266214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.313398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.315926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.317096 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2fd95c45-4104-46e4-9dba-a0f1d40c3da6 HTTP/1.1" status: 204 len: 168 time: 0.1176028 Nov 05 14:57:38.324553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb5dfb8a-250a-48ec-8025-123db69b03d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fd95c45-4104-46e4-9dba-a0f1d40c3da6,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:38.625016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47224) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:38.664516 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54663323-fd22-45a6-a0be-eea8fd568da3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2db7c5f71a2f486a87a72e6ff069379a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383358 Nov 05 14:57:38.667031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47226) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:57:38.716202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.736945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.784203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.786701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:38.787808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/50eac81d-9a30-44aa-a3c7-8baa685b8c92 HTTP/1.1" status: 204 len: 168 time: 0.1198997 Nov 05 14:57:38.795217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea562d2-0d83-4c5c-8578-4393ca6f335b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50eac81d-9a30-44aa-a3c7-8baa685b8c92,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:57:48.250575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:50.053394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12a8e5a6-3860-4ec4-8c98-3dc1a397ff7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:52.400688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-32cd596b-333e-494a-ad90-8089a45520c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:53.409616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:54.876331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:57:55.906173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:02.426404 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-83d78b13-a7ff-401b-9222-30b861ec73d2 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0440302 Nov 05 14:58:02.484594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-f8d039eb-e65a-440f-8cbb-91662622e694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:58:02.486051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-f8d039eb-e65a-440f-8cbb-91662622e694 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1098 time: 0.0392303 Nov 05 14:58:02.588209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-1684a2b9-31b0-448e-b1b8-4be62958e451 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:58:02.589684 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-1684a2b9-31b0-448e-b1b8-4be62958e451 service neutron] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 898 time: 0.0838935 Nov 05 14:58:02.656414 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-208b4778-ceb2-4550-ad70-6da4fa77649e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 1001 time: 0.0600901 Nov 05 14:58:02.704761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-68ee3ea5-5824-4630-a582-7ba6ec87ea4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:58:02.706061 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-68ee3ea5-5824-4630-a582-7ba6ec87ea4e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0419252 Nov 05 14:58:02.749388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-96023091-ff7f-49f4-a8c4-784a3a5684c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:58:02.750825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-96023091-ff7f-49f4-a8c4-784a3a5684c2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0372844 Nov 05 14:58:02.840100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-a1a59766-3cee-42e0-9cc7-2fec1652c340 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824213 Nov 05 14:58:02.926007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-89f74bb1-fa47-481b-90fb-c3d3d6acd0a7 req-5ff1907b-891c-47a5-8a3a-7f1b1a674bb8 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787220 Nov 05 14:58:09.541968 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:58:18.272629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:20.054249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-84bfc3f1-d43f-452a-b63c-5de9d8c75e57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:22.400684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f004b95-76ac-49f6-9e8d-02e27e5d3e82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:23.412809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:24.878948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:25.906666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:32.290660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47244) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:58:32.296706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'dns_nameservers': ['9.8.7.6']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:58:32.389667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-9931214'] for subnet, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:32.530116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785316530261', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-9638471'] for subnet, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:32.570001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:58:32.570506 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:32.571815 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/subnets/d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 835 time: 0.2801156 Nov 05 14:58:32.577596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-189454ab-ef81-434b-b0b2-634e4b245d43 None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:58:32.590326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=d32dc831-0c37-43fc-97ad-31b0b6b81e90,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:58:32.597487 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.597839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.598177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.598512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.598846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.599176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.599511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.599838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.600158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.600494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.600823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.601144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d984ffa-092a-4a5f-bf06-736281a6853c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-189454ab-ef81-434b-b0b2-634e4b245d43 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:58:32.650078 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:58:32.659830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a62f2e2-680c-410c-99da-52100ab5cf19 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:58:32.731046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a62f2e2-680c-410c-99da-52100ab5cf19 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:58:33.526208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Provisioning complete for port 0708ec80-29ce-416c-8a9a-cb0e5daca53e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:58:33.526576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:33.612523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Provisioning complete for port d4e5e089-a476-49c5-82dc-4b53c3b4c27e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:58:33.613194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:33.698851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Provisioning complete for port bdc761df-e1ee-4b2f-bb4c-adf7792a522f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:58:33.699220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-72e90b46-c212-4b03-a050-872ad5666331 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:46.541514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:58:48.272724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:50.057010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eb29bb58-6cb1-4294-b2db-a56183b42119 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:52.402430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c0741918-e4f8-4619-a07a-6bc016d6729b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:53.414620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:54.880034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:58:55.908375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:04.102233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-e4d69671-651c-498e-bc51-64c6f8aeaeaa service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0440683 Nov 05 14:59:04.181482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31b5476-243e-4040-9f7d-56da837756c7 req-72400578-74d5-452c-b9e0-7dcebe54607a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:04.182960 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-72400578-74d5-452c-b9e0-7dcebe54607a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1098 time: 0.0387552 Nov 05 14:59:04.284445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31b5476-243e-4040-9f7d-56da837756c7 req-16665986-ea23-4a32-b868-a27e5001e588 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:04.285909 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-16665986-ea23-4a32-b868-a27e5001e588 service neutron] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 898 time: 0.0832818 Nov 05 14:59:04.354125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-952edfdd-5f5e-4dd9-96bf-0ac71bce5a4e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 1001 time: 0.0610983 Nov 05 14:59:04.401218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31b5476-243e-4040-9f7d-56da837756c7 req-aea0a276-6226-454d-9396-ca56ff25ce92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:04.402604 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-aea0a276-6226-454d-9396-ca56ff25ce92 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0420394 Nov 05 14:59:04.445476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31b5476-243e-4040-9f7d-56da837756c7 req-b33579ed-3613-469c-a387-7f5cd8301832 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:04.446886 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-b33579ed-3613-469c-a387-7f5cd8301832 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0372415 Nov 05 14:59:04.538627 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-1b1503a0-9f45-4ea7-80b9-3e085ea7f7ed service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845735 Nov 05 14:59:04.624737 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e31b5476-243e-4040-9f7d-56da837756c7 req-dc04ca28-8144-4de5-b371-3ac6e4a01e54 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794630 Nov 05 14:59:15.402969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47252) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:15.734810 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 158b5910-55be-49c8-83e7-7fbcf0db2d84 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:59:15.735053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:15.809827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:15.810147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:15.822059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 158b5910-55be-49c8-83e7-7fbcf0db2d84 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:59:15.962510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:15.992221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=158b5910-55be-49c8-83e7-7fbcf0db2d84,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:16.047105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:16.047426 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 8686255d-e7fe-4bf4-a538-6e54d74ca42e disassociated (deleted). External IP: 172.26.5.151, port: 0708ec80-29ce-416c-8a9a-cb0e5daca53e. Nov 05 14:59:16.247771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:59:16.357153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:16.362062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:16.366499 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Sync routers for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:16.377380 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:16.377978 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:58:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:16.387770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b80fea56-642d-408c-8f17-e7c6762862e6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/8686255d-e7fe-4bf4-a538-6e54d74ca42e HTTP/1.1" status: 204 len: 168 time: 0.9837105 Nov 05 14:59:16.388359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:16.390647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138" -d '{"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:16.433884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e103d9c-98aa-4f22-9570-c28a6188788c x-openstack-request-id: req-7e103d9c-98aa-4f22-9570-c28a6188788c {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:16.434500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:16.434855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7e103d9c-98aa-4f22-9570-c28a6188788c {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:16.435396 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'status': 'completed', 'code': 200} Nov 05 14:59:16.483514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:16.500581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-ded4649e-43c6-45a8-8d94-4985622205e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:16.505133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-ded4649e-43c6-45a8-8d94-4985622205e6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 1098 time: 0.0479572 Nov 05 14:59:16.660019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a0debd-8741-4327-b33d-360ebf105429 req-8c5394c0-b841-440b-8143-49fcdd909630 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:16.661585 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77a0debd-8741-4327-b33d-360ebf105429 req-8c5394c0-b841-440b-8143-49fcdd909630 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0778139 Nov 05 14:59:16.666591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-cc5aa4ad-9002-4b84-9c1d-f17890dac173 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:16.667973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-cc5aa4ad-9002-4b84-9c1d-f17890dac173 service neutron] 10.222.0.32 "GET /v2.0/networks?id=738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 200 len: 898 time: 0.1535385 Nov 05 14:59:16.695720 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:16.720708 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-b6855e98-ccd3-419b-b75d-9eae91e9b153 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 200 len: 217 time: 0.0444465 Nov 05 14:59:16.721479 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Checking router: 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:16.730037 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:16.730634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:58:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:16.776165 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77a0debd-8741-4327-b33d-360ebf105429 req-7c1c4c3d-eec9-4005-b5a8-8a92d1c1c283 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1071482 Nov 05 14:59:16.789501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-ef8659f9-4e98-4c25-8e74-1698713a00af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:16.791170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-ef8659f9-4e98-4c25-8e74-1698713a00af service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 200 len: 843 time: 0.0598612 Nov 05 14:59:16.835202 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:16.838104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-f7527190-b32a-4830-a779-52ef354050f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:16.839626 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-f7527190-b32a-4830-a779-52ef354050f6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=738ee03b-c9c9-4a04-9e8d-78d2085f4025&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403092 Nov 05 14:59:16.937611 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-96cb315c-2314-4954-a773-e60eef619852 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898390 Nov 05 14:59:17.027875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b7a5ca-89d9-4db9-9b8e-686a8e65e138 req-f1ce2cb1-4292-409a-b9b5-af75d55af165 service neutron] 10.222.0.32 "GET /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812688 Nov 05 14:59:17.127458 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:17.153282 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10468bc8-5b31-40d8-ae17-5b5d97992a4b None None] The sync data for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv is: [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:24Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'bdc761df-e1ee-4b2f-bb4c-adf7792a522f', 'name': '', 'network_id': '738ee03b-c9c9-4a04-9e8d-78d2085f4025', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:20:7c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_interface', 'standard_attr_id': 1431, 'fixed_ips': [{'subnet_id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:24Z', 'updated_at': '2021-11-05T14:56:28Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'd32dc831-0c37-43fc-97ad-31b0b6b81e90', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:17.366524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51e04c1d-4393-4c9c-b2ac-a59e87172c63 None None] New status for floating IP 8686255d-e7fe-4bf4-a538-6e54d74ca42e: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:59:17.892560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cc3ce1-59aa-471c-8559-f9f3769584e8 req-badffed4-4f4f-437e-b0fc-3ed197b993d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:17.894025 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-10cc3ce1-59aa-471c-8559-f9f3769584e8 req-badffed4-4f4f-437e-b0fc-3ed197b993d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0489635 Nov 05 14:59:17.942331 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-10cc3ce1-59aa-471c-8559-f9f3769584e8 req-b30c3014-a386-4354-a11d-69cd05ed0f2f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fdf2707a-8ec3-498a-bb57-2ddadab7bb47&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0424969 Nov 05 14:59:18.047118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-207a1fc1-74f2-4ec6-80f0-d03da103d31b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:18.048570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-207a1fc1-74f2-4ec6-80f0-d03da103d31b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=94f54709-f049-4737-8d52-06efad83b97d HTTP/1.1" status: 200 len: 945 time: 0.0516329 Nov 05 14:59:18.133654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 0708ec80-29ce-416c-8a9a-cb0e5daca53e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:59:18.133892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:18.222391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 0708ec80-29ce-416c-8a9a-cb0e5daca53e, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0708ec80-29ce-416c-8a9a-cb0e5daca53e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:18.222748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:18.234982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 0708ec80-29ce-416c-8a9a-cb0e5daca53e owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:59:18.279498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:18.358820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:18.391188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=0708ec80-29ce-416c-8a9a-cb0e5daca53e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:18.400592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.400947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.401288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.401622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.401949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.402279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.402605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.402929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.403253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.404075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.404075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.404282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:18.444007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 0708ec80-29ce-416c-8a9a-cb0e5daca53e on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:59:18.446431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:18.449679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b591e54-917c-4dd8-8435-56fec56574b4 req-37e9cea2-d08d-401c-ba21-dc999bb7b2a1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/0708ec80-29ce-416c-8a9a-cb0e5daca53e HTTP/1.1" status: 204 len: 173 time: 0.3948679 Nov 05 14:59:18.450129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'name': 'network-vif-deleted', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:18.452367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-558a198f-c3c4-4e3e-bf3c-447141a5375a" -d '{"events": [{"server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "name": "network-vif-deleted", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:18.490617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c951daf5-9577-4815-8e3b-e59243e482cb x-openstack-request-id: req-c951daf5-9577-4815-8e3b-e59243e482cb {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:18.490934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94f54709-f049-4737-8d52-06efad83b97d", "name": "network-vif-deleted", "tag": "0708ec80-29ce-416c-8a9a-cb0e5daca53e", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:18.491184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c951daf5-9577-4815-8e3b-e59243e482cb {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:18.491602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94f54709-f049-4737-8d52-06efad83b97d', 'name': 'network-vif-deleted', 'tag': '0708ec80-29ce-416c-8a9a-cb0e5daca53e', 'status': 'completed', 'code': 200} Nov 05 14:59:18.995275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47274) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:19.054800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:19.079821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:19.136893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:19.139627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:19.140803 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/fdf2707a-8ec3-498a-bb57-2ddadab7bb47 HTTP/1.1" status: 204 len: 168 time: 0.1445146 Nov 05 14:59:19.150854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d1f905-6f4d-43de-8dfc-436c6d95f82a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdf2707a-8ec3-498a-bb57-2ddadab7bb47,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:19.170512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47278) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:19.811585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.056340 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port bdc761df-e1ee-4b2f-bb4c-adf7792a522f {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:59:20.057151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.057924 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4523ca99-3596-4da5-a4dc-feaa5c3f3e4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.146507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port bdc761df-e1ee-4b2f-bb4c-adf7792a522f, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:20.146864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.159402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for bdc761df-e1ee-4b2f-bb4c-adf7792a522f owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:59:20.336620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.362186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=bdc761df-e1ee-4b2f-bb4c-adf7792a522f,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:20.528680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.737864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:59:20.847082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:20.852129 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cf5bdb9a-8152-4d19-94ff-aca6c1ba9f11 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/1e488f3e-ea45-44bb-bd87-c14dbd34cd55/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6805959 Nov 05 14:59:20.854932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47280) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:20.857731 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Sync routers for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:20.868495 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:20.869377 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:58:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:20.910311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet d32dc831-0c37-43fc-97ad-31b0b6b81e90 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 14:59:20.913569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.954323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:20.969727 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:21.035329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.099639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.128954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=d32dc831-0c37-43fc-97ad-31b0b6b81e90,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:21.130917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.136738 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eab51b6a-d84b-40b1-aa56-a1a6415eabb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/d32dc831-0c37-43fc-97ad-31b0b6b81e90 HTTP/1.1" status: 204 len: 168 time: 0.2782795 Nov 05 14:59:21.137258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47282) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:21.145330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68af0737-4085-45eb-81cf-085659622c32 None None] Network 738ee03b-c9c9-4a04-9e8d-78d2085f4025 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:59:21.149032 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:59:20Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:21.175543 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Checking router: 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:21.184933 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Routers {'1e488f3e-ea45-44bb-bd87-c14dbd34cd55'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:21.185574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:58:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:21.252960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.290749 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] Set router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:21.305904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] DHCP port deletion for 738ee03b-c9c9-4a04-9e8d-78d2085f4025 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 14:59:21.354783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Deleting port d4e5e089-a476-49c5-82dc-4b53c3b4c27e {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:59:21.356183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.366852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.421099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port ad7341ab-25d6-45d1-8647-cb6043e2c726 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 14:59:21.421425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.423558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] For port d4e5e089-a476-49c5-82dc-4b53c3b4c27e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,segment=NetworkSegment(e5abe6fa-b526-4b59-8044-a39e44874303),segment_id=e5abe6fa-b526-4b59-8044-a39e44874303)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:21.423735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.437380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Calling delete_port for d4e5e089-a476-49c5-82dc-4b53c3b4c27e owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:59:21.474732 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:59:20Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:21.507364 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8bbaf6f-855c-45d5-b491-0479e8862808 None None] The sync data for ids ['1e488f3e-ea45-44bb-bd87-c14dbd34cd55'] in dv-neutron-816850-1-hyperv is: [{'id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'name': 'tempest-TestNetworkBasicOps-router-1254904102', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133'}], 'enable_snat': True}, 'gw_port_id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:59:20Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'ad7341ab-25d6-45d1-8647-cb6043e2c726', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:7f:89:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1e488f3e-ea45-44bb-bd87-c14dbd34cd55', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1428, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:56:21Z', 'updated_at': '2021-11-05T14:56:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:21.516235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port ad7341ab-25d6-45d1-8647-cb6043e2c726, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ad7341ab-25d6-45d1-8647-cb6043e2c726,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:21.516641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.531277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for ad7341ab-25d6-45d1-8647-cb6043e2c726 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 14:59:21.544558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.561042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] No DVR routers for this DVR port d4e5e089-a476-49c5-82dc-4b53c3b4c27e on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 14:59:21.582615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Pushing event deleted for resources: {'Port': ['ID=d4e5e089-a476-49c5-82dc-4b53c3b4c27e,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:21.590229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.590587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.590935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.591292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.591613 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.591949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.592288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.592649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.592982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.593312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.593637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.593965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a5f6f0-2074-474e-b3cc-f72e3ab5a7c4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:21.702777 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.731391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=ad7341ab-25d6-45d1-8647-cb6043e2c726,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:21.788815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.885559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.888498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.937021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4e5e089-a476-49c5-82dc-4b53c3b4c27e no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:59:21.938793 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.939338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router 1e488f3e-ea45-44bb-bd87-c14dbd34cd55 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 14:59:21.946533 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:21.948512 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3d5824e8-ed76-472c-9f66-ffe6fb41fb66 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/1e488f3e-ea45-44bb-bd87-c14dbd34cd55 HTTP/1.1" status: 204 len: 168 time: 0.8094850 Nov 05 14:59:21.950446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47284) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:21.965618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d4e5e089-a476-49c5-82dc-4b53c3b4c27e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:59:21.965961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d4e5e089-a476-49c5-82dc-4b53c3b4c27e not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:59:22.039757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.125743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.151542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['738ee03b-c9c9-4a04-9e8d-78d2085f4025']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:22.156851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0708ec80-29ce-416c-8a9a-cb0e5daca53e no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:59:22.162390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5abe6fa-b526-4b59-8044-a39e44874303') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:22.162679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5abe6fa-b526-4b59-8044-a39e44874303') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:22.173093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.181709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 0708ec80-29ce-416c-8a9a-cb0e5daca53e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:59:22.182335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0708ec80-29ce-416c-8a9a-cb0e5daca53e not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:59:22.188238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.194847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 618 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 14:59:22.195280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 14:59:22.198896 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 14:59:22.258311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.265282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.268546 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/738ee03b-c9c9-4a04-9e8d-78d2085f4025 HTTP/1.1" status: 204 len: 168 time: 0.3171120 Nov 05 14:59:22.280320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81e3dd8-d9be-4776-aaa4-9fe066ab9238 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=738ee03b-c9c9-4a04-9e8d-78d2085f4025,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:22.280678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47286) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:22.287422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--1580155234', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:22.314345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:59:22.317799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.342015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 615} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 14:59:22.352618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.352890 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment b88121b7-935e-466f-87d4-cf53fd74de68 of type vlan for network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 Nov 05 14:59:22.402611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.405495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5c950b27-715a-47db-9662-c7a461f7bd0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.439190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.444940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:22.445522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.526182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2444096 Nov 05 14:59:22.528927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47288) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:22.534906 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-908492748', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:22.551434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c751d0b1-f874-46d9-999f-7a677ee719b5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=47ec29fc-5fd0-445a-8aa9-e92573ff36d7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:22.561012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.562876 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.563402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 14:59:22.620752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.756913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.945625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:22.963638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:23.066416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.199 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/1c077461-7fe9-4831-bca3-c0e7de2c3420) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:23.164955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:23.196718 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:23.233414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:23.238127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:23.241644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:23.247460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=1c077461-7fe9-4831-bca3-c0e7de2c3420,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:23.417537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:23.490028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:23.541746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ad7341ab-25d6-45d1-8647-cb6043e2c726 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:59:23.542217 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 14:59:23.565546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: ad7341ab-25d6-45d1-8647-cb6043e2c726 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:59:23.565886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ad7341ab-25d6-45d1-8647-cb6043e2c726 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:59:23.566300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bdc761df-e1ee-4b2f-bb4c-adf7792a522f no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 14:59:23.585308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: bdc761df-e1ee-4b2f-bb4c-adf7792a522f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 14:59:23.585635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bdc761df-e1ee-4b2f-bb4c-adf7792a522f not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 14:59:23.980920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.104483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 14:59:24.206826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:24.220673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:24.228771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.233408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:24.233584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47290) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:24.234068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:24.234208 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ad4fef06-3859-4d57-9962-7ace8369059f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.7030263 Nov 05 14:59:24.266554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-868affd7-f5f7-4160-b397-75434a18bf6b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0318689 Nov 05 14:59:24.269131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47292) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:24.338647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:24.351530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-292754fa-aea0-4060-8153-1a1928d19ab9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:24.353089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-292754fa-aea0-4060-8153-1a1928d19ab9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0829542 Nov 05 14:59:24.355840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47294) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:24.383329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9b80f89b-eb98-43f6-8e9f-11072a4e0b7b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0264344 Nov 05 14:59:24.385740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47296) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:24.390262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-927293398', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:24.481252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:59:24.484777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.515088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:23Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:24.545617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:24.546095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Updating router e6710dd8-3c34-44ce-b64c-ab4d925438df port 1c077461-7fe9-4831-bca3-c0e7de2c3420 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:59:24.573498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.663408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.728747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=6ce87ce3-5449-4321-aa64-f461c37973ea,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:24.736934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:24.737392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: 47ec29fc-5fd0-445a-8aa9-e92573ff36d7, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 14:59:24.754463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 14:59:24.762883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 47ec29fc-5fd0-445a-8aa9-e92573ff36d7) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:24.767129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:24.768252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.774194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5c9df84-3ef6-4f10-a15f-0e6d7171447c None None] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:59:24.786050 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f77dd093-587f-40d7-9eae-4195c93d8271 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.3991592 Nov 05 14:59:24.788599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47298) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:24.911482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.913085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d5c9df84-3ef6-4f10-a15f-0e6d7171447c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:59:24.915819 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:59:24.919018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:24.927009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faa9ddec-9893-4209-a08e-1ed57695b852 None None] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 14:59:25.018188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Attempting to bind port 1c077461-7fe9-4831-bca3-c0e7de2c3420 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:59:25.018434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Attempting to bind port 1c077461-7fe9-4831-bca3-c0e7de2c3420 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:59:25.018786 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Attempting to bind port 1c077461-7fe9-4831-bca3-c0e7de2c3420 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:25.023240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea6e307-6c42-4fac-b2b7-da6a80962b54 None None] Pushing event updated for resources: {'Port': ['ID=1c077461-7fe9-4831-bca3-c0e7de2c3420,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:25.034873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 58, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:59:25.035240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:25.035635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.036017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:59:25.036519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Bound port: 1c077461-7fe9-4831-bca3-c0e7de2c3420, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:59:25.036874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-faa9ddec-9893-4209-a08e-1ed57695b852 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 14:59:25.080079 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 14:59:25.090247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f3ed215-a72b-4aac-9968-692d329a72c7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:59:25.133634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] For port 1c077461-7fe9-4831-bca3-c0e7de2c3420, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:59:25.155488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] For port 1c077461-7fe9-4831-bca3-c0e7de2c3420, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1c077461-7fe9-4831-bca3-c0e7de2c3420,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:59:25.161733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.208236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.211099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f3ed215-a72b-4aac-9968-692d329a72c7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:59:25.391079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea6e307-6c42-4fac-b2b7-da6a80962b54 None None] Pushing event updated for resources: {'Port': ['ID=1c077461-7fe9-4831-bca3-c0e7de2c3420,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:25.394228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:25.394831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:25.483544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (47ec29fc-5fd0-445a-8aa9-e92573ff36d7/6ce87ce3-5449-4321-aa64-f461c37973ea/87d720c1-4ba3-4c90-97f9-566591dbfca1) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:25.564314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:25.602664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.635420 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.674910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:25.680445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:25.682879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:25.712493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:25.736392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.790467 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 14:59:25.791317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.862995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.872859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:23Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:25.920549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2faa821d-10e7-4ae7-99e9-302ed283150d None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:23Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:25.959902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:25.979439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Allocated IP 172.20.0.2 (47ec29fc-5fd0-445a-8aa9-e92573ff36d7/6ce87ce3-5449-4321-aa64-f461c37973ea/60b12a92-a585-4e34-b105-4361f134c897) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:26.152795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.154135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.160036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.166023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.222916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:26.227192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:26.229153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Pushing event updated for resources: {'Port': ['ID=60b12a92-a585-4e34-b105-4361f134c897,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:26.231376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:26.291609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Attempting to bind port 60b12a92-a585-4e34-b105-4361f134c897 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:59:26.291978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Attempting to bind port 60b12a92-a585-4e34-b105-4361f134c897 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:59:26.292342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Attempting to bind port 60b12a92-a585-4e34-b105-4361f134c897 on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:26.298206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:59:26.298580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Checking segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:26.299021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.299416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Bound using segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:59:26.299898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Bound port: 60b12a92-a585-4e34-b105-4361f134c897, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:59:26.300276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.369877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] For port 60b12a92-a585-4e34-b105-4361f134c897, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:59:26.373343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] For port 60b12a92-a585-4e34-b105-4361f134c897, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=60b12a92-a585-4e34-b105-4361f134c897,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:59:26.378776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.440638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe1034e-6676-44a8-835a-ce901e5ff174 None None] Pushing event updated for resources: {'Port': ['ID=60b12a92-a585-4e34-b105-4361f134c897,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:26.589079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:26.594724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:26.703762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:26.705894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:26.829952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:59:26.940197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:26.946299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2f332714-c20a-455c-a6ac-49053a7ccca7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/e6710dd8-3c34-44ce-b64c-ab4d925438df/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1560104 Nov 05 14:59:26.948223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47302) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.041034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bde73582-da1e-4f1f-a6f9-a5ef1544965b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.041498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bde73582-da1e-4f1f-a6f9-a5ef1544965b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.041950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bde73582-da1e-4f1f-a6f9-a5ef1544965b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.042389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bde73582-da1e-4f1f-a6f9-a5ef1544965b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.046557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bde73582-da1e-4f1f-a6f9-a5ef1544965b tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2886 time: 0.0946736 Nov 05 14:59:27.046755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47304) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.100772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfbff0b2-12f6-40f4-a7a8-d303e18781d8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.101228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfbff0b2-12f6-40f4-a7a8-d303e18781d8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.101668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfbff0b2-12f6-40f4-a7a8-d303e18781d8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.102112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfbff0b2-12f6-40f4-a7a8-d303e18781d8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:27.106378 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cfbff0b2-12f6-40f4-a7a8-d303e18781d8 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2727 time: 0.0559757 Nov 05 14:59:27.106528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47306) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.238430 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c9fed70d-2a85-423c-949f-5e13cb6169db tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1607 time: 0.1308203 Nov 05 14:59:27.368189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bbc34b5-4f24-4e25-8b49-1fa75b1a4784 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 14:59:27.418518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] Provisioning complete for port 60b12a92-a585-4e34-b105-4361f134c897 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:27.419076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.448990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47310) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.454418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1738231904', 'description': 'tempest-secgroup-smoke-1738231904 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:27.481172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.486189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bbc34b5-4f24-4e25-8b49-1fa75b1a4784 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 14:59:27.570937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.575151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.600648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.605008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.608566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47312) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.609139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1584654 Nov 05 14:59:27.613434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22b52e35-36df-4f58-a7f5-2e27c8b9ac5f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=781d06c7-a365-4b90-9dcd-5b6332569875,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:27.614291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:27.650463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 60b12a92-a585-4e34-b105-4361f134c897 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:27.656664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.706956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.711404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.720579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] For port 60b12a92-a585-4e34-b105-4361f134c897, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=60b12a92-a585-4e34-b105-4361f134c897,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:27.730895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.733396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aaa53f36-dee1-4b0f-9558-c82994cffe0e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:27.741840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.743093 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aa69c4c0-6efc-4531-ba7b-c3dfa2ec7a63 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1335995 Nov 05 14:59:27.745825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47314) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.750489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:27.779884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.822722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 60b12a92-a585-4e34-b105-4361f134c897 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:27.823083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.826688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff40dddb-fefa-4e06-a805-17eb495a4d5b None None] Pushing event updated for resources: {'Port': ['ID=60b12a92-a585-4e34-b105-4361f134c897,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:27.841879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.845591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.868523 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b185ab07-f2c5-4e08-8b7e-8a6de8334a25,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:27.877765 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.880267 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1ecd4470-3bac-48f6-94f5-9dde59900579 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1334484 Nov 05 14:59:27.883031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47316) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:27.887785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:27.915048 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:27.916890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.925574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:27.926075 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:27.979713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1c077461-7fe9-4831-bca3-c0e7de2c3420 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:27.984850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:27.990796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.009013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03b5bdfb-36eb-4062-977d-0385594e2d90,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.020805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.022753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d512f8f3-f816-4359-bf5f-038c6151741c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1381850 Nov 05 14:59:28.025254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:28.030191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:28.035920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1c077461-7fe9-4831-bca3-c0e7de2c3420 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:28.036617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.043888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:28.070019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.125060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.138520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.144538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.149185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 1c077461-7fe9-4831-bca3-c0e7de2c3420, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1c077461-7fe9-4831-bca3-c0e7de2c3420,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:28.156231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.172852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a021d365-9910-49ff-938a-c9c97da17693,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.180702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.183064 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b2e24321-a0e9-4a73-a6c9-534c11ed7a7f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1561859 Nov 05 14:59:28.185133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47320) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:28.191616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:28.215642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=1c077461-7fe9-4831-bca3-c0e7de2c3420,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.227519 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:59:28.233521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.289237 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:26Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:28.304063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.309048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.323594 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:28.323917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Updating router e6710dd8-3c34-44ce-b64c-ab4d925438df port 87d720c1-4ba3-4c90-97f9-566591dbfca1 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 14:59:28.328658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0003ad8-d530-4835-82f0-a21335aa162f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.338119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.339315 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b940af61-86c0-4717-9137-fbb7347ba941 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1531842 Nov 05 14:59:28.342143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47322) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:28.347757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '781d06c7-a365-4b90-9dcd-5b6332569875', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:28.355255 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.370708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:59:28.376059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.443751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.447841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.466380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9c087553-ad82-47cc-9221-9f46c7d0be33,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.480042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.481555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3868f1ab-4ae1-4a48-a9d7-f1adc2ff95c4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1383686 Nov 05 14:59:28.646235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.653613 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.657475 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-9c3d68f6-076d-4311-a32b-b7870e9a4197 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1738231904&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0510864 Nov 05 14:59:28.665583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-51f8e5d3-99d3-4ca0-8594-26227526b1d9 None None] Provisioning complete for port 60b12a92-a585-4e34-b105-4361f134c897 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:28.666715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-51f8e5d3-99d3-4ca0-8594-26227526b1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.710946 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Pushing event updated for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:28.723260 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.723994 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.724582 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.725135 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.725682 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.726197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.726691 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.727194 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.727748 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.728267 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.728617 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.728942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:28.785994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-51f8e5d3-99d3-4ca0-8594-26227526b1d9 None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:28.786522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-51f8e5d3-99d3-4ca0-8594-26227526b1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.793643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-b5a65416-9a71-4980-acf8-0d73f6028bb8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:28.795559 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-b5a65416-9a71-4980-acf8-0d73f6028bb8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 797 time: 0.1299794 Nov 05 14:59:28.812284 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-f929035f-0c29-47bf-8d53-8069b419acd1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0106604 Nov 05 14:59:28.825495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-51f8e5d3-99d3-4ca0-8594-26227526b1d9 None None] Port 87d720c1-4ba3-4c90-97f9-566591dbfca1 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:59:28.883695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-b795e4f1-f555-42d5-b39b-91474a19a2f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0584428 Nov 05 14:59:28.892140 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Attempting to bind port 87d720c1-4ba3-4c90-97f9-566591dbfca1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:59:28.893192 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Attempting to bind port 87d720c1-4ba3-4c90-97f9-566591dbfca1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:59:28.893622 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Attempting to bind port 87d720c1-4ba3-4c90-97f9-566591dbfca1 on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:28.899055 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:59:28.899507 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Checking segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:28.899970 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.900424 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Bound using segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:59:28.900987 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Bound port: 87d720c1-4ba3-4c90-97f9-566591dbfca1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:59:28.901429 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.945602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-afb7adf5-0a9d-4b7c-bad0-eebe93972600 None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:28.945967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afb7adf5-0a9d-4b7c-bad0-eebe93972600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.969464 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] For port 87d720c1-4ba3-4c90-97f9-566591dbfca1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:59:28.978571 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] For port 87d720c1-4ba3-4c90-97f9-566591dbfca1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=87d720c1-4ba3-4c90-97f9-566591dbfca1,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:59:28.986762 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:28.989812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-afb7adf5-0a9d-4b7c-bad0-eebe93972600 None None] Port 87d720c1-4ba3-4c90-97f9-566591dbfca1 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:59:29.006974 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-744a28b6-194b-4c51-bc4a-2091fb714af1 service neutron] 10.222.0.30 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1094987 Nov 05 14:59:29.047886 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:29.048513 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:29.090515 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858a9f85-c56d-4b77-a857-b4a14fe5f146 None None] Pushing event updated for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:29.111040 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-e2669e33-7a11-4fc0-84df-1c679ee87e39 service neutron] 10.222.0.30 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928166 Nov 05 14:59:29.122698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:29.123309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.169664 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:29.220575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.259135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] For port 87d720c1-4ba3-4c90-97f9-566591dbfca1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=87d720c1-4ba3-4c90-97f9-566591dbfca1,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:29.263663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.316054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb19fd09-2293-48c8-bc3f-cb0c7bdb9e81 None None] Pushing event updated for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:29.388296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:29.390914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-645f5a30-8dee-4408-a778-5ae6a3309a63 None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:29.391514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-645f5a30-8dee-4408-a778-5ae6a3309a63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.415246 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3aa08b35-615c-4f5f-b885-125fcc7b49ab None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:29.617940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4a7737a0-a130-45ca-a07f-f6a59d0ee4e2 None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:29.618555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a7737a0-a130-45ca-a07f-f6a59d0ee4e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.644914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 87d720c1-4ba3-4c90-97f9-566591dbfca1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:29.737472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 87d720c1-4ba3-4c90-97f9-566591dbfca1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:29.738104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.828046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 60b12a92-a585-4e34-b105-4361f134c897 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:29.877763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 60b12a92-a585-4e34-b105-4361f134c897 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:29.878124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:29.956491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1c077461-7fe9-4831-bca3-c0e7de2c3420 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:30.006649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1c077461-7fe9-4831-bca3-c0e7de2c3420 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:30.007070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:30.315391 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8090b01c-24cc-4d60-909f-0607feb96ce0 req-3443d837-fc38-4ec8-9ae8-bb3452e6adb7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 210 time: 0.0291817 Nov 05 14:59:31.208856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-44f237cc-8e60-4701-86be-da4c175f39d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:31.210312 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-44f237cc-8e60-4701-86be-da4c175f39d9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 797 time: 0.1028800 Nov 05 14:59:31.276959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-fa460aa3-147c-4ec4-b494-ad1c75994673 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 380 time: 0.0572889 Nov 05 14:59:31.288264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['781d06c7-a365-4b90-9dcd-5b6332569875']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:31.412592 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f0931eb3-082f-4ea9-b9ee-217f6350fa7d req-586d5ae8-45e5-4317-bc49-c326ce0f4de8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 210 time: 0.0309465 Nov 05 14:59:31.444399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:59:31.447913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:31.573326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.4 (47ec29fc-5fd0-445a-8aa9-e92573ff36d7/6ce87ce3-5449-4321-aa64-f461c37973ea/8b758032-30ff-4f44-923f-59b4917dec2f) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:31.717641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:31.749558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:31.788549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:31.791448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:31.797352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:31.824247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:31.850443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:31.851059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:31.868417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-dd67b6f5-517a-468a-9181-5e4175a20f02 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5838733 Nov 05 14:59:31.882116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Request body: {'port': {'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:31.936938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:31.997566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c14ceba4-4c8c-4454-b958-8ec5f5deb79c None None] Provisioning complete for port 8b758032-30ff-4f44-923f-59b4917dec2f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:31.998189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c14ceba4-4c8c-4454-b958-8ec5f5deb79c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.034873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c14ceba4-4c8c-4454-b958-8ec5f5deb79c None None] Port 8b758032-30ff-4f44-923f-59b4917dec2f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:59:32.201523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8b758032-30ff-4f44-923f-59b4917dec2f {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:59:32.208833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.221684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Transition to ACTIVE for port object 8b758032-30ff-4f44-923f-59b4917dec2f will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:59:32.225367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.291600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:32.363435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Attempting to bind port 8b758032-30ff-4f44-923f-59b4917dec2f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:59:32.363769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Attempting to bind port 8b758032-30ff-4f44-923f-59b4917dec2f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:59:32.364104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Attempting to bind port 8b758032-30ff-4f44-923f-59b4917dec2f on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:32.368791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Port 8b758032-30ff-4f44-923f-59b4917dec2f on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:59:32.369114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Attempting to bind port 8b758032-30ff-4f44-923f-59b4917dec2f on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:32.374238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 59, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:59:32.374571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Checking segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:32.375021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Bound using segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:59:32.375373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Bound port: 8b758032-30ff-4f44-923f-59b4917dec2f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:59:32.375737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.443633 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:59:32.447238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:59:32.451836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.489515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:32.490109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:32.491487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] 10.222.0.32 "PUT /v2.0/ports/8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 1093 time: 0.6142731 Nov 05 14:59:32.491927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:32.494194 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e59e10b1-2fa2-44d8-a021-d58990ca97ac" -d '{"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:32.530316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3eda32-49cb-430d-9f60-79f0b16b891f service neutron] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:32.557282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2f422d-ae03-45c4-a727-d766626d290d req-3daa9a54-3f37-4610-aebf-2b366d40dd78 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:32.558885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e2f422d-ae03-45c4-a727-d766626d290d req-3daa9a54-3f37-4610-aebf-2b366d40dd78 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 943 time: 0.0701578 Nov 05 14:59:32.560793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6de19c22-1b39-4199-981d-e6fe22a29a5f x-openstack-request-id: req-6de19c22-1b39-4199-981d-e6fe22a29a5f {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:32.561335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:32.561596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6de19c22-1b39-4199-981d-e6fe22a29a5f {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:32.561989 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 14:59:32.594977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-05f474ec-7c81-420a-861f-4f8a36a2e8d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:32.599513 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-05f474ec-7c81-420a-861f-4f8a36a2e8d9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1096 time: 0.0495362 Nov 05 14:59:32.616194 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e2f422d-ae03-45c4-a727-d766626d290d req-82d5fcca-5beb-4bd0-8db8-b127388b26ab tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479894 Nov 05 14:59:32.651627 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-a68866e0-6b43-4444-8a14-d47e84845d01 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 217 time: 0.0436244 Nov 05 14:59:32.715919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-6645a24c-2b09-4613-8939-3313e6fc20f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:32.717426 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-6645a24c-2b09-4613-8939-3313e6fc20f7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0583069 Nov 05 14:59:32.762844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-3faaa399-530f-4870-82f2-9a366849b491 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:32.764277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-3faaa399-530f-4870-82f2-9a366849b491 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385299 Nov 05 14:59:32.860874 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-39e049a0-dbbc-4e65-99f5-4f5bc945f7df service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866785 Nov 05 14:59:32.949836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-84e11320-ee5f-425c-85f5-fea2a2526962 req-407103c1-a282-4503-8b0f-2d176e7230ca service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812287 Nov 05 14:59:33.037816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-5380cc0e-bc6d-46dd-840f-5e532c17fef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:33.039343 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-5380cc0e-bc6d-46dd-840f-5e532c17fef2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1096 time: 0.0419257 Nov 05 14:59:33.140414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-6096fda2-e4f2-46e4-accf-1f00b6dcf6e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:33.141854 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-6096fda2-e4f2-46e4-accf-1f00b6dcf6e1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0953338 Nov 05 14:59:33.186471 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-599de779-8d79-45a6-aeb2-99cf29e4d2bf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 217 time: 0.0349941 Nov 05 14:59:33.241429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-cf8e6626-58d7-4c1a-8cf7-1d9c453ad294 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:33.242922 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-cf8e6626-58d7-4c1a-8cf7-1d9c453ad294 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0469365 Nov 05 14:59:33.288407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-e6239e43-c32b-456e-94cf-138f62a246b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:33.290107 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-e6239e43-c32b-456e-94cf-138f62a246b9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393202 Nov 05 14:59:33.381461 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-50738447-875a-4549-b40b-e28f2de19e28 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830612 Nov 05 14:59:33.476278 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e59e10b1-2fa2-44d8-a021-d58990ca97ac req-bebe9047-f813-41a2-8979-f62df3d74353 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876071 Nov 05 14:59:33.731642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86be17e6-af44-4187-88af-64e9cc3b38d9 req-c18d35d4-7ff3-4310-922c-d2c248ebb305 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:33.733130 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86be17e6-af44-4187-88af-64e9cc3b38d9 req-c18d35d4-7ff3-4310-922c-d2c248ebb305 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 943 time: 0.0517836 Nov 05 14:59:33.784950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86be17e6-af44-4187-88af-64e9cc3b38d9 req-0ff91def-6095-409c-833d-e33fe32be2bd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455341 Nov 05 14:59:34.902794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab144861-ce62-41cb-8556-a71f0c547ce4 req-35e19a14-fa31-46d9-a192-0140f31893e2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:34.904251 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab144861-ce62-41cb-8556-a71f0c547ce4 req-35e19a14-fa31-46d9-a192-0140f31893e2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 943 time: 0.0519619 Nov 05 14:59:34.953307 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab144861-ce62-41cb-8556-a71f0c547ce4 req-9f287167-574d-46fd-91ab-d78249aa6a9d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432007 Nov 05 14:59:36.074108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988b8c59-84b6-4f32-8045-bcb03bb346ee req-b92ba16f-7243-4700-881d-f29b8b939991 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:36.075574 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-988b8c59-84b6-4f32-8045-bcb03bb346ee req-b92ba16f-7243-4700-881d-f29b8b939991 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 943 time: 0.0571506 Nov 05 14:59:36.123690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-988b8c59-84b6-4f32-8045-bcb03bb346ee req-ce627d9e-fd39-4a97-b767-5428934c5552 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417025 Nov 05 14:59:36.218788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b758032-30ff-4f44-923f-59b4917dec2f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:59:36.308960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:36.320700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8b758032-30ff-4f44-923f-59b4917dec2f', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 615, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:59:36.498942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:36.512022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b758032-30ff-4f44-923f-59b4917dec2f {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:59:36.530929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:36.535127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:36.580746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:36.759426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8b758032-30ff-4f44-923f-59b4917dec2f'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:59:37.235928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9289c988-906b-461d-b739-901532a8c00f req-5b70b6ea-b444-4cfe-8de3-d02d4d705b3c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:37.238031 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9289c988-906b-461d-b739-901532a8c00f req-5b70b6ea-b444-4cfe-8de3-d02d4d705b3c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 944 time: 0.0487676 Nov 05 14:59:37.286780 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9289c988-906b-461d-b739-901532a8c00f req-acb150a4-2871-467c-be47-4b64c31d507c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430093 Nov 05 14:59:38.234823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b758032-30ff-4f44-923f-59b4917dec2f up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:38.282470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 8b758032-30ff-4f44-923f-59b4917dec2f completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:59:38.286350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8b758032-30ff-4f44-923f-59b4917dec2f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:38.286722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:38.366624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:38.389940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:38.392274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4cc19618-58fb-42df-b969-2ce18feadfc9" -d '{"events": [{"server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "name": "network-vif-plugged", "status": "completed", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:38.401233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b511c8-57b8-4f37-94c3-e9ca595fb937 req-82a827b8-70f6-47c5-bb6d-db79a9bcfb3e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:38.402777 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-90b511c8-57b8-4f37-94c3-e9ca595fb937 req-82a827b8-70f6-47c5-bb6d-db79a9bcfb3e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 944 time: 0.0483100 Nov 05 14:59:38.407677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:38.412856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:38.441003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b64a4eeb-6956-4d8f-aba4-7a017bf5fda7 x-openstack-request-id: req-b64a4eeb-6956-4d8f-aba4-7a017bf5fda7 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:38.441296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "name": "network-vif-plugged", "status": "completed", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:38.441545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b64a4eeb-6956-4d8f-aba4-7a017bf5fda7 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:38.441937 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'code': 200} Nov 05 14:59:38.456863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-90b511c8-57b8-4f37-94c3-e9ca595fb937 req-0f8cf9e5-fc0c-4c0e-8ba2-b454cdc03347 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470269 Nov 05 14:59:38.481109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:38.597616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa2f0e8-4573-43f4-92e7-3d3431fd15ef req-7e968e88-66b0-41c2-a4c2-4d37584a7f83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:38.599058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7fa2f0e8-4573-43f4-92e7-3d3431fd15ef req-7e968e88-66b0-41c2-a4c2-4d37584a7f83 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1098 time: 0.0395322 Nov 05 14:59:38.647348 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7fa2f0e8-4573-43f4-92e7-3d3431fd15ef req-34bdd9d3-9090-48a3-9d0b-184b4cc7c109 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418563 Nov 05 14:59:39.715143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b485ded-75fc-4138-8322-60827a73db36 req-9ef5995e-bef7-4259-b6b3-e871ef28c1a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:39.716535 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b485ded-75fc-4138-8322-60827a73db36 req-9ef5995e-bef7-4259-b6b3-e871ef28c1a0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.1851988 Nov 05 14:59:39.769413 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b485ded-75fc-4138-8322-60827a73db36 req-ac9b6bba-ee6f-4e45-8da4-7aa763c46fe4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469356 Nov 05 14:59:40.880581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8451e9aa-d561-4e49-aed1-b7b8b9ad32bb req-af46312c-a2d5-4f84-b6ce-162bc2eaeab3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:40.882012 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8451e9aa-d561-4e49-aed1-b7b8b9ad32bb req-af46312c-a2d5-4f84-b6ce-162bc2eaeab3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.0476913 Nov 05 14:59:40.929598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8451e9aa-d561-4e49-aed1-b7b8b9ad32bb req-c7e643f6-b358-4614-89f1-c6a18aa8fd98 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418158 Nov 05 14:59:41.041128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f9731f-26ae-43d6-8ece-435a2618fcc0 req-881359a8-7eed-4768-bbd4-c6b5525df239 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:41.042596 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-80f9731f-26ae-43d6-8ece-435a2618fcc0 req-881359a8-7eed-4768-bbd4-c6b5525df239 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.0483179 Nov 05 14:59:41.090914 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-80f9731f-26ae-43d6-8ece-435a2618fcc0 req-e6c61cf7-7311-4a6a-8ec2-82a2482c96c8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423827 Nov 05 14:59:41.112729 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47384) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:41.275246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a48127bc-c9c7-47b1-b8d8-d195c9bc246d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:41.276767 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a48127bc-c9c7-47b1-b8d8-d195c9bc246d tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1093 time: 0.1630449 Nov 05 14:59:41.279619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47388) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:41.283903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.4'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:41.305244 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:41.402283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:41.504615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.140 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/721e7c9f-7c76-4986-b887-2a63031bd1e2) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:41.606854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:41.638806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:41.675524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:41.680713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:41.684240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:41.689894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=721e7c9f-7c76-4986-b887-2a63031bd1e2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:41.716938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.717280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.717613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.717943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.718268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.718596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.718922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.719241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.719559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.719877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.720191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:41.721055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 14:59:42.041648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.106560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.251530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.256143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.325121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=721e7c9f-7c76-4986-b887-2a63031bd1e2,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:42.336797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.435207 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 3b6381ea-dc4f-48f7-90d0-26ff81b043d5 associated. External IP: 172.26.5.140, port: 8b758032-30ff-4f44-923f-59b4917dec2f. Nov 05 14:59:42.642058 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:59:42.742278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:42.751615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:42.759771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:42.765526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:42.766136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:42.795901 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a0929fb-95f4-4257-89e4-312fcefe4eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5125532 Nov 05 14:59:42.795901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:42.797063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47392) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:42.797568 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9daf886a-717f-469f-916d-09b0dd4a7ffe" -d '{"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:42.845607 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8b0c7fd-8ee6-4905-b7fe-6050bcb852ba x-openstack-request-id: req-c8b0c7fd-8ee6-4905-b7fe-6050bcb852ba {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:42.845904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:42.846159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c8b0c7fd-8ee6-4905-b7fe-6050bcb852ba {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:42.846581 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 14:59:42.848777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83256a6f-81d6-46b8-9d54-634c8aa2b4c0 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:42.850539 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-83256a6f-81d6-46b8-9d54-634c8aa2b4c0 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1093 time: 0.0524137 Nov 05 14:59:42.882071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:42.911386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-a1e6dd15-1ee4-4a83-a2bd-dfa572059745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:42.912993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-a1e6dd15-1ee4-4a83-a2bd-dfa572059745 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1098 time: 0.0434396 Nov 05 14:59:42.999554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47400) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.006107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1922066212', 'description': 'tempest-secgroup-smoke-1922066212 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.014162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-631e36b3-7b38-4139-ae3a-e9cc66f6ad48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:43.018556 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-631e36b3-7b38-4139-ae3a-e9cc66f6ad48 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0951459 Nov 05 14:59:43.039932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.101858 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-de124f40-cb94-49b0-859d-28a5a29376dc service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 999 time: 0.0755229 Nov 05 14:59:43.113303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.113879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:41Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:43.118617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.140755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:43.150534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.150799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:43.151187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:43.155146 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1512728 Nov 05 14:59:43.156240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47402) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.161709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a2734c-6133-4e0d-802b-1c58446f6baf tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.164597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.187802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-64302021-d3e2-4529-9bc3-0172fd8fae5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:43.189346 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-64302021-d3e2-4529-9bc3-0172fd8fae5e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0813236 Nov 05 14:59:43.226499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.258280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-25175022-828f-4642-852c-a5acd8a90f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:43.259808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-25175022-828f-4642-852c-a5acd8a90f91 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0620871 Nov 05 14:59:43.263140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:43.328009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.334997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.364717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=93cb4c7e-c9d6-43ad-a888-b4105c61b5f5,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.378394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.379586 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b16f6a5a-eb72-4ba0-a80e-d626c057fa4e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2223222 Nov 05 14:59:43.382540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47404) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.387130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.389974 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-6bdc930c-aaf4-468c-b3bb-4f13943c73ae service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1210277 Nov 05 14:59:43.417955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.480790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.486053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.500650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9daf886a-717f-469f-916d-09b0dd4a7ffe req-4a354ddf-00b7-4d8b-917a-ecd6b942dd5c service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1032615 Nov 05 14:59:43.509483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b6aba0c-a93e-4f45-bb19-16da0022b4d1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.518308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.519220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:41Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:43.519704 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8a578afb-4803-4f31-8457-b3346ff13976 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1360765 Nov 05 14:59:43.522639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47406) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.527536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.553729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2df262a7-04d3-48be-b9dc-0bf267dce78b None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:41Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:43.554276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.618601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.623074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.640986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6a0fbd07-0dc5-4d18-83fe-2683c4f45d72,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.648505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.649671 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1726056a-62de-4081-af4f-d195e4d9b15d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1257393 Nov 05 14:59:43.652481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47408) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.656688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.683555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.743447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.749753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.762871 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9cd342f-4b01-4f67-8b24-c8168e6b8121 None None] New status for floating IP 3b6381ea-dc4f-48f7-90d0-26ff81b043d5: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 14:59:43.775157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcc3ebef-9a11-475c-9d47-4d92464af681,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.784147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.787932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3a9d114b-5b5f-451e-a468-ac631240731c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1320124 Nov 05 14:59:43.788219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47410) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.792527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.814613 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:59:43.819499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.877575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.881276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.899441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b4eda6da-edfb-4f76-b811-69c732994a6e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:43.907835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:43.912084 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e8abf390-d41e-43da-b116-1dec6ddc1a35 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1198916 Nov 05 14:59:43.912084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47412) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:43.916156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': '7c41f45e-0fa8-4b6e-a52f-80bb1bea9487', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:43.937994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 14:59:43.943649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:44.002677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:44.005810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:44.022899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=29abd2c7-4dd5-429b-842d-734c6a7ab0da,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:44.031020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:44.032187 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-51999b5b-0000-4b36-9918-5d7ab5cba9f6 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1194265 Nov 05 14:59:44.291630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-42d61e39-5ccd-4cb3-8480-c4ca4f2193c1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1922066212&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0427787 Nov 05 14:59:44.393894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-5fdc9a24-de79-4fdf-af04-f0e317f12b15 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:44.395345 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-5fdc9a24-de79-4fdf-af04-f0e317f12b15 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 797 time: 0.0970964 Nov 05 14:59:44.410119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-109d60d8-c27e-4a38-9c03-b7d137548918 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0092137 Nov 05 14:59:44.466547 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-21f7af63-e9d7-40d9-9181-1f1e19b52795 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0513914 Nov 05 14:59:44.559261 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-d06e1b24-6bed-4bdb-9e8f-dcc513385eaf service neutron] 10.222.0.30 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810542 Nov 05 14:59:44.649328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-10ed64e6-9d82-4c59-afeb-6ce86d094c73 service neutron] 10.222.0.30 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836172 Nov 05 14:59:44.801933 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fd68aea8-baa0-4187-bd74-6e5ed4201721 req-7d2340cc-58b2-4774-8e9c-e44eada36493 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 210 time: 0.0271597 Nov 05 14:59:45.882199 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f59b1fb6-5c96-40f8-ae99-787df4bb2336 req-61ce9a8c-1052-46f2-a9e0-9698575d5164 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 210 time: 0.0303416 Nov 05 14:59:46.720675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-51efb8a5-5900-4812-b5a4-44f7a48827d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:46.722160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-51efb8a5-5900-4812-b5a4-44f7a48827d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 797 time: 0.1009083 Nov 05 14:59:46.806277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-02b6fb79-d11a-488a-b80c-601e92b534ba tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 473 time: 0.0745404 Nov 05 14:59:46.816223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['7c41f45e-0fa8-4b6e-a52f-80bb1bea9487']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:46.918192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 14:59:46.921897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:46.974590 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-26cd207a-c2f8-4d45-8515-e0bcc75507e8 req-e0c97235-d4dd-4560-9189-738a89684638 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 210 time: 0.0269179 Nov 05 14:59:47.047963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.7 (47ec29fc-5fd0-445a-8aa9-e92573ff36d7/6ce87ce3-5449-4321-aa64-f461c37973ea/0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:47.184783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.218789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.263654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:47.268515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:47.272200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:47.297074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:47.324012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:47.324654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.340053 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-ab78e81a-5da3-4734-9e91-18db56c69a73 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5278580 Nov 05 14:59:47.353298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Request body: {'port': {'device_id': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:47.407866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.500832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8e3e4e66-7249-46c9-867a-76e23b394532 None None] Provisioning complete for port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:47.502337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8e3e4e66-7249-46c9-867a-76e23b394532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.540802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-8e3e4e66-7249-46c9-867a-76e23b394532 None None] Port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 14:59:47.673638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:59:47.681386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.693098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Transition to ACTIVE for port object 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 14:59:47.696941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.743880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Pushing event updated for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:47.818738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Attempting to bind port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 14:59:47.819066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Attempting to bind port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 14:59:47.819392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Attempting to bind port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:47.824004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 14:59:47.824486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Attempting to bind port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 on network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 14:59:47.831768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 14, 59, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 14:59:47.832096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Checking segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 14:59:47.832499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Bound using segment: {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 14:59:47.833067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Bound port: 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b88121b7-935e-466f-87d4-cf53fd74de68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 14:59:47.833584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.901558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 14:59:47.904710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 14:59:47.909938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.942278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:47.942872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:47.944233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] 10.222.0.32 "PUT /v2.0/ports/0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 200 len: 1093 time: 0.5951824 Nov 05 14:59:47.944692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:47.946994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5c14dd5-a162-4d68-b92f-5349bc873029" -d '{"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:47.971264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-623f10b4-0958-4f7d-a328-24dd41a1fbcc service neutron] Pushing event updated for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:48.021604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60f9fc4c-9169-4f52-a7b8-4c7024964a49 x-openstack-request-id: req-60f9fc4c-9169-4f52-a7b8-4c7024964a49 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:48.021892 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:48.022152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-60f9fc4c-9169-4f52-a7b8-4c7024964a49 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:48.022533 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'status': 'completed', 'code': 200} Nov 05 14:59:48.030847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-2997c668-0351-462a-b782-b0780370d41d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.032486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-2997c668-0351-462a-b782-b0780370d41d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1096 time: 0.0474846 Nov 05 14:59:48.080140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-d15af838-dec3-4842-84d1-3a2ab604434b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 200 len: 217 time: 0.0389106 Nov 05 14:59:48.101563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5df71b6-ab38-40d4-af91-b736c3c843bd req-5b937483-acc9-473d-b93b-e1ee7573b964 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.103359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5df71b6-ab38-40d4-af91-b736c3c843bd req-5b937483-acc9-473d-b93b-e1ee7573b964 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 943 time: 0.0564370 Nov 05 14:59:48.148977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-b381266d-60c3-472a-9a6c-c014539298f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.150514 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-b381266d-60c3-472a-9a6c-c014539298f5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0636256 Nov 05 14:59:48.164252 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5df71b6-ab38-40d4-af91-b736c3c843bd req-b99bcc9d-9c7e-406b-ae63-beceedea6fb0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543013 Nov 05 14:59:48.196532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-3ba11d04-f020-44cd-bafd-874e0ed8a7a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.197975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-3ba11d04-f020-44cd-bafd-874e0ed8a7a0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398626 Nov 05 14:59:48.283249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:48.288625 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-0cffa837-d842-4f06-9b19-a3e8c1a118ad service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836363 Nov 05 14:59:48.375373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4f41abb4-ef1f-4327-881b-590ee313d8fa req-9b2e46ff-a3ff-4989-8b39-4673f228ff1e service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802028 Nov 05 14:59:48.463989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-faf2c7cc-31da-4b60-9101-89ee23270aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.465425 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-faf2c7cc-31da-4b60-9101-89ee23270aa4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1096 time: 0.0433156 Nov 05 14:59:48.559213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-221932ec-04f3-47c2-bb9f-1d389a46806c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.560980 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-221932ec-04f3-47c2-bb9f-1d389a46806c service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0887465 Nov 05 14:59:48.603494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-33b40f33-bf1b-4b75-8f7a-8fdb62d646f3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 200 len: 217 time: 0.0336804 Nov 05 14:59:48.657174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-4c34ed67-c7ea-4c0f-a5e3-3495349f069b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.658595 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-4c34ed67-c7ea-4c0f-a5e3-3495349f069b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0479262 Nov 05 14:59:48.705774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-9307d09a-8453-4a73-98b0-8bf08d6e5b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:48.707271 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-9307d09a-8453-4a73-98b0-8bf08d6e5b59 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408120 Nov 05 14:59:48.793204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-fd0268db-330e-4017-b529-f48ef544162e service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784576 Nov 05 14:59:48.885340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5c14dd5-a162-4d68-b92f-5349bc873029 req-daf669d7-f636-417a-a098-99e63b37e990 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841694 Nov 05 14:59:49.278595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298ef99a-493c-42d4-9a48-8891491cf4d8 req-0ef70e84-1dff-46b5-a22c-5e81210f3cf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:49.280025 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-298ef99a-493c-42d4-9a48-8891491cf4d8 req-0ef70e84-1dff-46b5-a22c-5e81210f3cf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 943 time: 0.0483322 Nov 05 14:59:49.327116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-298ef99a-493c-42d4-9a48-8891491cf4d8 req-12f49674-c982-4add-b8d7-d98550b71158 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406249 Nov 05 14:59:50.059097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2c6669d5-eae8-42c8-9a89-7198fe9de853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:50.443135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b03467-1d18-4d6a-8f56-ca212e8c9db3 req-4b78048c-d85a-4e2a-bebd-eac3e5cb4074 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:50.444556 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-31b03467-1d18-4d6a-8f56-ca212e8c9db3 req-4b78048c-d85a-4e2a-bebd-eac3e5cb4074 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 943 time: 0.0498383 Nov 05 14:59:50.493965 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-31b03467-1d18-4d6a-8f56-ca212e8c9db3 req-bdf5a761-2ed9-4f12-8624-46616e2c8f46 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433862 Nov 05 14:59:51.615850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b6fdcd-1c64-4402-8426-9ac593aa6e40 req-df6473ce-d367-4e26-9914-4b797341c4ca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:51.617344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-68b6fdcd-1c64-4402-8426-9ac593aa6e40 req-df6473ce-d367-4e26-9914-4b797341c4ca tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 943 time: 0.0510700 Nov 05 14:59:51.665047 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-68b6fdcd-1c64-4402-8426-9ac593aa6e40 req-619cb165-ce12-4c51-a826-b84068a20cbe tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418763 Nov 05 14:59:52.313456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 14:59:52.419134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:52.421497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7462483c-53ef-4d3e-937a-669fa5fb3a7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:52.434491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'port_id': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'mac_address': 'fa:16:3e:14:4a:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 615, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 14:59:52.471293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:52.483710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 14:59:52.504378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:52.508077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:52.552853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:52.726205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 14:59:52.779931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a81017-418d-489a-a0de-45d5c0939d2e req-8fcd082b-9432-447e-8bbd-38ac6f71b991 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:52.781436 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7a81017-418d-489a-a0de-45d5c0939d2e req-8fcd082b-9432-447e-8bbd-38ac6f71b991 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 944 time: 0.0516858 Nov 05 14:59:52.836780 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7a81017-418d-489a-a0de-45d5c0939d2e req-b8f3a006-78f5-4398-a1b1-aa8107522a1b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486333 Nov 05 14:59:53.418834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:53.950896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a1d045-9204-4c8b-9e69-9bc7fd30c8b2 req-7fcc9f24-fa02-431a-a012-3d1f6c53e8e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:53.952339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d6a1d045-9204-4c8b-9e69-9bc7fd30c8b2 req-7fcc9f24-fa02-431a-a012-3d1f6c53e8e1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 944 time: 0.0482337 Nov 05 14:59:53.998987 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d6a1d045-9204-4c8b-9e69-9bc7fd30c8b2 req-a81e72c1-1dcc-45f9-b875-ffceb4a8e1ec tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408807 Nov 05 14:59:54.320289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 14:59:54.374270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 14:59:54.378656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 14:59:54.379031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:54.455250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:54.480849 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:54.483362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a62089c-556f-4136-a15a-5f934597900f" -d '{"events": [{"server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "name": "network-vif-plugged", "status": "completed", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:54.497201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 14:59:54.507102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:54.532434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1d96f8e-ca8c-4996-8cd9-a99ad3a52c9d x-openstack-request-id: req-e1d96f8e-ca8c-4996-8cd9-a99ad3a52c9d {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:54.532888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "name": "network-vif-plugged", "status": "completed", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:54.533250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e1d96f8e-ca8c-4996-8cd9-a99ad3a52c9d {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:54.533548 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'code': 200} Nov 05 14:59:54.562560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:54.688867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a3b232-3943-4bae-82df-e2679296234c req-be8e8a22-1ecd-487b-a750-c44fe3579e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:54.690299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58a3b232-3943-4bae-82df-e2679296234c req-be8e8a22-1ecd-487b-a750-c44fe3579e56 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1098 time: 0.0392547 Nov 05 14:59:54.739182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58a3b232-3943-4bae-82df-e2679296234c req-42cbe072-3143-407d-b4c1-f412a864345d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409465 Nov 05 14:59:54.887390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:55.111472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c25e38-c327-48a5-ad05-d08155b40c1a req-d5a04fbe-37b2-4071-8e16-34f748d4f423 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:55.112934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f9c25e38-c327-48a5-ad05-d08155b40c1a req-d5a04fbe-37b2-4071-8e16-34f748d4f423 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0482905 Nov 05 14:59:55.161244 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f9c25e38-c327-48a5-ad05-d08155b40c1a req-4ba83c52-a537-47d4-aafe-ccf3723a8412 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425346 Nov 05 14:59:55.912051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:56.274115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce978b1f-6c75-48ff-9786-cb9590a65483 req-34043801-9920-480f-9b53-422811b4d220 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:56.275601 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce978b1f-6c75-48ff-9786-cb9590a65483 req-34043801-9920-480f-9b53-422811b4d220 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0479636 Nov 05 14:59:56.324190 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce978b1f-6c75-48ff-9786-cb9590a65483 req-2672e513-8805-4ba1-a481-e22051b9858b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426664 Nov 05 14:59:56.434318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c348b95c-23ef-48f7-bd8d-57e2aef62687 req-02e9b8fc-15ff-4678-8c31-4461aa1dc786 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:56.435747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c348b95c-23ef-48f7-bd8d-57e2aef62687 req-02e9b8fc-15ff-4678-8c31-4461aa1dc786 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0467060 Nov 05 14:59:56.483436 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c348b95c-23ef-48f7-bd8d-57e2aef62687 req-371f947d-e770-408a-a72e-97aaf7f9d5f9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409839 Nov 05 14:59:56.504738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47470) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:56.544973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8954b3df-b171-48d0-9565-14b8bd7548c5 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:56.546413 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8954b3df-b171-48d0-9565-14b8bd7548c5 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1093 time: 0.0407381 Nov 05 14:59:56.549109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47472) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 14:59:56.553206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.7'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 14:59:56.574121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:56.671085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.092757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.127 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/188bb0e0-d977-41b9-8a26-4e8a2dd77fb4) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 14:59:57.187926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.217958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.258115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 14:59:57.262861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 14:59:57.266731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 14:59:57.288127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=188bb0e0-d977-41b9-8a26-4e8a2dd77fb4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:57.608953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.671819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.816386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.820756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.884257 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=188bb0e0-d977-41b9-8a26-4e8a2dd77fb4,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 14:59:57.897907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:57.994535 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 40f1ec83-30bf-45e1-b355-7a73181ca055 associated. External IP: 172.26.5.127, port: 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6. Nov 05 14:59:58.194844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 14:59:58.325347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 14:59:58.335182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 14:59:58.342903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 14:59:58.345188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:58.345803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:58.370425 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-93bf0330-9640-4946-a13a-cac18fa6bdb9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8203049 Nov 05 14:59:58.371000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 14:59:58.373281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f" -d '{"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 14:59:58.407546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 14:59:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01174550-4988-4355-9bef-96206045e944 x-openstack-request-id: req-01174550-4988-4355-9bef-96206045e944 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 14:59:58.407837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 14:59:58.408083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-01174550-4988-4355-9bef-96206045e944 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 14:59:58.408503 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'status': 'completed', 'code': 200} Nov 05 14:59:58.455606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:58.518848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-3dfc0c9d-70a6-4732-b462-f21c32892275 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:58.520347 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-3dfc0c9d-70a6-4732-b462-f21c32892275 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1098 time: 0.0892880 Nov 05 14:59:58.619641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-91ac769d-d50d-4847-bf33-af922336a8a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:58.621127 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-91ac769d-d50d-4847-bf33-af922336a8a1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0920744 Nov 05 14:59:58.688788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-94764a6a-e000-40c4-9fbe-2dfdcbf2fa93 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 200 len: 999 time: 0.0593801 Nov 05 14:59:58.696535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}, {'id': '40f1ec83-30bf-45e1-b355-7a73181ca055', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.127', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:14:4a:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:57Z', 'updated_at': '2021-11-05T14:59:57Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:58.723091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 14:59:58.731071 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 14:59:58.731663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T14:59:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:58.738872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-cfd2a8be-e72e-4f80-b5e0-6ac0edba77d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:58.740336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-cfd2a8be-e72e-4f80-b5e0-6ac0edba77d7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0439465 Nov 05 14:59:58.788531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-5af1c8ac-56c4-4d5a-8315-77f4cf81073f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 14:59:58.790037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-5af1c8ac-56c4-4d5a-8315-77f4cf81073f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0427694 Nov 05 14:59:58.834844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 14:59:58.884059 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-5dbe0fd7-0f14-437b-abca-ebb2063725bb service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845156 Nov 05 14:59:58.979952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-770dcb6e-9a8c-4905-b7bb-6dbd20dc4c8f req-5ec6acb5-185b-47f8-ab62-51cac69726f6 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898042 Nov 05 14:59:59.203235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}, {'id': '40f1ec83-30bf-45e1-b355-7a73181ca055', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.127', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:14:4a:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:57Z', 'updated_at': '2021-11-05T14:59:57Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 14:59:59.229051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35ea900-9e00-4858-bac7-940a7e6b9486 None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}, {'id': '40f1ec83-30bf-45e1-b355-7a73181ca055', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.127', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:14:4a:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:57Z', 'updated_at': '2021-11-05T14:59:57Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 14:59:59.412833 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c768cf89-d2c6-48af-95cc-4805090c6e6b None None] New status for floating IP 40f1ec83-30bf-45e1-b355-7a73181ca055: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:00:00.541336 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:00:04.548577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-5d241854-e5b3-4c5d-9232-8d44ef2ec5c0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396578 Nov 05 15:00:04.629527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-492a8f9a-63cb-415a-a512-e8630871b555 req-cefc3ce3-2ee6-4d1e-b918-aa1a750a9461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:04.630985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-cefc3ce3-2ee6-4d1e-b918-aa1a750a9461 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1098 time: 0.0393877 Nov 05 15:00:04.735485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-492a8f9a-63cb-415a-a512-e8630871b555 req-4656a060-0313-4832-b02f-4b186454ff11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:04.736962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-4656a060-0313-4832-b02f-4b186454ff11 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0866222 Nov 05 15:00:04.802833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-c412d72f-34d8-4e31-941e-8f041bb58564 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 1001 time: 0.0583925 Nov 05 15:00:04.851043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-492a8f9a-63cb-415a-a512-e8630871b555 req-ae29c8a1-6c16-4747-aaf6-582dd2992846 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:04.852445 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-ae29c8a1-6c16-4747-aaf6-582dd2992846 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0423913 Nov 05 15:00:04.899645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-492a8f9a-63cb-415a-a512-e8630871b555 req-5cdcba60-7b5b-45ed-b19c-f6c92cf6ffe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:04.901138 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-5cdcba60-7b5b-45ed-b19c-f6c92cf6ffe9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0414970 Nov 05 15:00:04.988379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-d99067b7-c05b-4842-a70b-dede67f70582 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796497 Nov 05 15:00:05.077385 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-492a8f9a-63cb-415a-a512-e8630871b555 req-8e83ff64-2f53-453b-981f-56832686b8cd service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824699 Nov 05 15:00:06.398911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-479422e0-5d8c-4eea-9296-823db70f6ac0 req-02283cd6-cf2c-48f2-97fa-f74285c44c99 service neutron] (113581) timed out ('10.222.0.32', 61036) {{(pid=113581) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 05 15:00:18.309671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:20.059300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a1652e8e-b78a-4e50-b146-c0adff7630e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:22.402288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9b0b20db-831b-49ce-813a-f10715a4c93b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:23.421519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:24.889097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:25.914680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:28.058374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47488) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:28.118030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a21c7c75-5795-40b2-8084-ac26a3934da5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/3b6381ea-dc4f-48f7-90d0-26ff81b043d5 HTTP/1.1" status: 200 len: 993 time: 0.0584853 Nov 05 15:00:30.211774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47496) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:30.217330 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:30.279998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:30.425198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:30.454059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:30.458483 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:30.499840 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:30.500486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:30.501911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/ports/8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 938 time: 0.2890770 Nov 05 15:00:30.502462 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:30.504764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44951d6f-c1db-4ab1-904d-6e402971d5cd" -d '{"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:30.531096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3ee447-bf2c-4e55-b210-097a15c86b91 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=6']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:30.606844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e77b6e58-7efc-423f-82f9-30abb779db9d x-openstack-request-id: req-e77b6e58-7efc-423f-82f9-30abb779db9d {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:30.607145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:30.607402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e77b6e58-7efc-423f-82f9-30abb779db9d {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:30.607816 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 15:00:30.671108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-fb930a12-b94e-4d2c-86e3-f046ca6ffe44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:30.672744 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-fb930a12-b94e-4d2c-86e3-f046ca6ffe44 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1099 time: 0.0420523 Nov 05 15:00:30.765270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-7bb517db-89ae-4efa-a13e-c0381cc30454 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:30.766572 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-7bb517db-89ae-4efa-a13e-c0381cc30454 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0847843 Nov 05 15:00:30.781717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f7d38ea2-804e-453d-8d5a-aaa07bc6b48c None None] Provisioning complete for port 8b758032-30ff-4f44-923f-59b4917dec2f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:30.782320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f7d38ea2-804e-453d-8d5a-aaa07bc6b48c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:30.821800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f7d38ea2-804e-453d-8d5a-aaa07bc6b48c None None] Port 8b758032-30ff-4f44-923f-59b4917dec2f is administratively disabled so it will not transition to active. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:356}} Nov 05 15:00:30.833315 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-c0198e51-d659-4494-8334-b1353ba60e64 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 1002 time: 0.0584013 Nov 05 15:00:30.885143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-226985e4-7aa6-4233-ba0b-160b91c24ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:30.886558 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-226985e4-7aa6-4233-ba0b-160b91c24ac7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0460556 Nov 05 15:00:30.930444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-647e7ac9-ef9c-43b2-a18a-ece55310e1c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:30.931858 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-647e7ac9-ef9c-43b2-a18a-ece55310e1c3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382235 Nov 05 15:00:31.018598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-2f7a03cb-4d41-47e3-a0db-37782cc56601 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0783894 Nov 05 15:00:31.108082 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44951d6f-c1db-4ab1-904d-6e402971d5cd req-53f4c444-8e00-4c39-ab66-4702178e27fa service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822961 Nov 05 15:00:33.940627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47506) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:33.946472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'admin_state_up': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:34.005503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:34.154291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:34.183750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:34.188894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:34.230997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:34.231619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:34.233043 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/ports/8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 937 time: 0.2913971 Nov 05 15:00:34.233608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:34.235968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a" -d '{"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:34.236148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47508) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:34.275217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=7']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:34.283441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd88bf0d-9a6a-4954-b955-7d2512ec1646 x-openstack-request-id: req-bd88bf0d-9a6a-4954-b955-7d2512ec1646 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:34.283724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:34.283973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bd88bf0d-9a6a-4954-b955-7d2512ec1646 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:34.284519 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 15:00:34.285723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.286244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.286594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.286925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.287253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.287581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.288040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.288371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.289017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.289355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.289675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.289998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eab9bdfa-9ddc-40ec-bba7-71a7ce5f9d6f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:34.317169 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a4ec67f1-b267-4b48-a79b-80105ed74292 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/3b6381ea-dc4f-48f7-90d0-26ff81b043d5 HTTP/1.1" status: 200 len: 993 time: 0.0797758 Nov 05 15:00:34.350770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-4f886942-5cfb-414c-9c84-6076f8ca8c2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:34.352381 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-4f886942-5cfb-414c-9c84-6076f8ca8c2e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1098 time: 0.0456207 Nov 05 15:00:34.446524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-cd9b8d39-c698-4f54-8c01-11030fef966d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:34.448015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-cd9b8d39-c698-4f54-8c01-11030fef966d service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0887289 Nov 05 15:00:34.451043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8b758032-30ff-4f44-923f-59b4917dec2f'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:00:34.506141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8ed9b788-c577-4fba-8e5f-5b0a2dff6c95 None None] Provisioning complete for port 8b758032-30ff-4f44-923f-59b4917dec2f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:34.506521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8ed9b788-c577-4fba-8e5f-5b0a2dff6c95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:34.517881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-851480c5-fbe1-445e-bf60-22fb3bdcbdde service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 1001 time: 0.0626428 Nov 05 15:00:34.567813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-1f244c00-7790-45cf-8d42-52316255e140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:34.569702 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-1f244c00-7790-45cf-8d42-52316255e140 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0444105 Nov 05 15:00:34.614548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-d7dcce41-1c54-454d-86bf-eaf8dd719272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:34.616139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-d7dcce41-1c54-454d-86bf-eaf8dd719272 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396743 Nov 05 15:00:34.708071 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-4a3e66cb-072c-49b9-b917-3ff17d0e8abf service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848494 Nov 05 15:00:34.796615 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2dc5cba7-4b5b-4901-ba14-1315b5e25c4a req-68f224b1-bc3e-4509-aa26-d296ce521588 service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805721 Nov 05 15:00:36.842648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47518) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:36.999594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 188bb0e0-d977-41b9-8a26-4e8a2dd77fb4 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:36.999936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.076031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.076356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.088114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 188bb0e0-d977-41b9-8a26-4e8a2dd77fb4 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:37.258161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.282145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=188bb0e0-d977-41b9-8a26-4e8a2dd77fb4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:37.343126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.343448 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 40f1ec83-30bf-45e1-b355-7a73181ca055 disassociated (deleted). External IP: 172.26.5.127, port: 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6. Nov 05 15:00:37.540809 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:00:37.547252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:00:37.650275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:00:37.655173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:37.659759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:00:37.670511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:37.671145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:37.781994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:38.006485 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-315c9e58-fa3a-4c4c-a064-5ff453257f1a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/40f1ec83-30bf-45e1-b355-7a73181ca055 HTTP/1.1" status: 204 len: 168 time: 1.1627078 Nov 05 15:00:38.007267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:38.009553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8448d060-285c-423a-968b-0748a2f51135" -d '{"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:38.016896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:38.044943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:00:38.047427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6b1a10f-12de-48cf-98fb-31ca3f897216 x-openstack-request-id: req-c6b1a10f-12de-48cf-98fb-31ca3f897216 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:38.047845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:38.047984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c6b1a10f-12de-48cf-98fb-31ca3f897216 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:38.048371 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'status': 'completed', 'code': 200} Nov 05 15:00:38.054320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:38.055146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:38.109091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8448d060-285c-423a-968b-0748a2f51135 req-8a540a55-5f73-4f76-9d3c-60373cca81f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:38.110755 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-8a540a55-5f73-4f76-9d3c-60373cca81f9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 1098 time: 0.0410464 Nov 05 15:00:38.169886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:38.238512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8448d060-285c-423a-968b-0748a2f51135 req-3160b1cf-5404-4235-a1a2-42d52727237f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:38.240041 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-3160b1cf-5404-4235-a1a2-42d52727237f service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.1214550 Nov 05 15:00:38.263081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c1c4658-2601-487e-a503-82734aea92bd req-6bfbd3c3-0fa5-4ba5-89f7-179c9a21fb0d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:38.264562 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8c1c4658-2601-487e-a503-82734aea92bd req-6bfbd3c3-0fa5-4ba5-89f7-179c9a21fb0d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0678637 Nov 05 15:00:38.293734 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-9c853444-0de2-40bc-8e99-fcdcb476cf18 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 200 len: 217 time: 0.0454142 Nov 05 15:00:38.372584 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8c1c4658-2601-487e-a503-82734aea92bd req-9f0dbf97-901d-4674-adf3-62ddfe3c7603 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0814965 Nov 05 15:00:38.375867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8448d060-285c-423a-968b-0748a2f51135 req-de4b5208-dba0-4243-8561-00d194f3d3d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:38.377313 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-de4b5208-dba0-4243-8561-00d194f3d3d2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0717430 Nov 05 15:00:38.393248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:38.424370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8448d060-285c-423a-968b-0748a2f51135 req-105b6d66-a6dc-4413-afc2-55f2dd9f0c64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:38.424677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa476a95-c730-484a-9bbd-c27d69dd0269 None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '3b6381ea-dc4f-48f7-90d0-26ff81b043d5', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.140', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'port_id': '8b758032-30ff-4f44-923f-59b4917dec2f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 1462, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'mac_address': 'fa:16:3e:db:ed:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T14:59:41Z', 'updated_at': '2021-11-05T14:59:43Z', 'revision_number': 1, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:00:38.425964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-105b6d66-a6dc-4413-afc2-55f2dd9f0c64 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0400097 Nov 05 15:00:38.521571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-cdf98cf5-79e5-4575-8272-58e455cacb5f service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854712 Nov 05 15:00:38.620577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8448d060-285c-423a-968b-0748a2f51135 req-98718c95-7bff-4cc8-abba-60271968fd2a service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906928 Nov 05 15:00:38.657724 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e6bba65-da58-4da9-86f7-408f5657fcf6 None None] New status for floating IP 40f1ec83-30bf-45e1-b355-7a73181ca055: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:00:39.490238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa8b61f-2230-40c3-9310-fcb712e55a9a req-c951b655-5de2-42c0-857c-5bce6d210eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:39.491821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9fa8b61f-2230-40c3-9310-fcb712e55a9a req-c951b655-5de2-42c0-857c-5bce6d210eb4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0488448 Nov 05 15:00:39.541904 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9fa8b61f-2230-40c3-9310-fcb712e55a9a req-a547ef3f-8e18-40ea-a7cf-422b7eaa7f79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443079 Nov 05 15:00:39.546698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-7bc0866f-d1de-4dc3-9392-5c89c3e77ea0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:39.548294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-7bc0866f-d1de-4dc3-9392-5c89c3e77ea0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=fbbcdd7c-b6c8-4d96-87bc-f9edc6592410 HTTP/1.1" status: 200 len: 945 time: 0.0532606 Nov 05 15:00:39.639415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:39.639749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:39.724864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:39.725142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:39.738152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:39.864498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:39.893259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:39.939850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:00:39.942481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:39.946757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-364a0d47-cc08-4dfa-888a-ce7d11b32732 req-c06a6624-9f08-400f-89c4-1ce338d89712 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 HTTP/1.1" status: 204 len: 173 time: 0.3921440 Nov 05 15:00:40.049935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'name': 'network-vif-deleted', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:40.052230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f177cc4d-7dcf-4dcb-89fe-fe7a62ca187c" -d '{"events": [{"server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "name": "network-vif-deleted", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:40.087343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdc70cd9-9efe-490b-8d74-a7dfaf814cfb x-openstack-request-id: req-cdc70cd9-9efe-490b-8d74-a7dfaf814cfb {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:40.087641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fbbcdd7c-b6c8-4d96-87bc-f9edc6592410", "name": "network-vif-deleted", "tag": "0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:40.087900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cdc70cd9-9efe-490b-8d74-a7dfaf814cfb {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:40.088336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fbbcdd7c-b6c8-4d96-87bc-f9edc6592410', 'name': 'network-vif-deleted', 'tag': '0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6', 'status': 'completed', 'code': 200} Nov 05 15:00:40.596931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47532) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:40.652423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:40.677032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:40.733698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:40.736280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:40.737451 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/7c41f45e-0fa8-4b6e-a52f-80bb1bea9487 HTTP/1.1" status: 204 len: 168 time: 0.1395490 Nov 05 15:00:40.751125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42f5f03-6ed0-4e65-9e5a-e825aeffd270 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c41f45e-0fa8-4b6e-a52f-80bb1bea9487,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:40.768312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:40.924108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 721e7c9f-7c76-4986-b887-2a63031bd1e2 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:40.924448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.001624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.001950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.015259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 721e7c9f-7c76-4986-b887-2a63031bd1e2 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:41.156415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.184163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=721e7c9f-7c76-4986-b887-2a63031bd1e2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:41.244045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.244373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 3b6381ea-dc4f-48f7-90d0-26ff81b043d5 disassociated (deleted). External IP: 172.26.5.140, port: 8b758032-30ff-4f44-923f-59b4917dec2f. Nov 05 15:00:41.449419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:00:41.553828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:00:41.558563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:41.563266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:00:41.572873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:41.573471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:41.586166 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ac635e12-23ee-466f-a5b4-35a003baef24 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/3b6381ea-dc4f-48f7-90d0-26ff81b043d5 HTTP/1.1" status: 204 len: 168 time: 0.8167489 Nov 05 15:00:41.680106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:41.797608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6feaafe9-d3c0-4f3b-b327-422d21a7f0e5 req-103e9487-8ffa-4135-a587-09b70892112b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:41.799193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6feaafe9-d3c0-4f3b-b327-422d21a7f0e5 req-103e9487-8ffa-4135-a587-09b70892112b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.0485401 Nov 05 15:00:41.849263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6feaafe9-d3c0-4f3b-b327-422d21a7f0e5 req-c8eb1982-93b9-424c-a702-9fd24ea19cc4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434062 Nov 05 15:00:41.879884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:41.908541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:00:41.917174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:41.917756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:42.089632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:42.092107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b44c771c-0f21-4b3e-b201-4698da0014fa" -d '{"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:42.128508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c56c05d5-c10e-4a64-9fa0-53f594756652 x-openstack-request-id: req-c56c05d5-c10e-4a64-9fa0-53f594756652 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:42.128800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:42.129048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c56c05d5-c10e-4a64-9fa0-53f594756652 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:42.129447 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 15:00:42.163837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:42.199068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-ceac2595-364d-4dc5-b417-033856da7277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:42.200615 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-ceac2595-364d-4dc5-b417-033856da7277 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 1098 time: 0.0445998 Nov 05 15:00:42.290889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-814139d5-ea44-42c4-8c8c-23f332412db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:42.292493 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-814139d5-ea44-42c4-8c8c-23f332412db3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 200 len: 898 time: 0.0848680 Nov 05 15:00:42.339033 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-a0178aa5-697e-46c6-8583-2913aa9b36ea service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 200 len: 217 time: 0.0386751 Nov 05 15:00:42.357250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:42.383146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e55ae6-105e-4fc3-b977-8f10bc8bd598 None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:25Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '87d720c1-4ba3-4c90-97f9-566591dbfca1', 'name': '', 'network_id': '47ec29fc-5fd0-445a-8aa9-e92573ff36d7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:4b:d8:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_interface', 'standard_attr_id': 1449, 'fixed_ips': [{'subnet_id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:25Z', 'updated_at': '2021-11-05T14:59:29Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': '6ce87ce3-5449-4321-aa64-f461c37973ea', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:00:42.388578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-5427f286-ead7-4a5c-ad00-b461663760fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:42.390045 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-5427f286-ead7-4a5c-ad00-b461663760fd service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 200 len: 834 time: 0.0437179 Nov 05 15:00:42.439472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-76c19be0-b786-4e50-a943-fb150dea3039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:42.441079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-76c19be0-b786-4e50-a943-fb150dea3039 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=47ec29fc-5fd0-445a-8aa9-e92573ff36d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0426123 Nov 05 15:00:42.538856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-d3a57c6f-5429-410c-a5a3-a26255cee16f service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891054 Nov 05 15:00:42.605574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96ee819b-0323-44c8-bcb1-7193933b02cb None None] New status for floating IP 3b6381ea-dc4f-48f7-90d0-26ff81b043d5: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:00:42.631258 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44c771c-0f21-4b3e-b201-4698da0014fa req-803c8aa0-76ff-477c-a795-a2e0dffa2b0e service neutron] 10.222.0.32 "GET /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851235 Nov 05 15:00:42.966998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-376a33d0-51ff-45fc-9040-c65766f485fe req-c55a724c-31da-4062-978c-68d7144c8234 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:42.968517 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-376a33d0-51ff-45fc-9040-c65766f485fe req-c55a724c-31da-4062-978c-68d7144c8234 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.0504181 Nov 05 15:00:43.018882 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-376a33d0-51ff-45fc-9040-c65766f485fe req-7a4b2337-8683-4edb-924e-7ad0414bf4f1 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=781d06c7-a365-4b90-9dcd-5b6332569875&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442142 Nov 05 15:00:43.216896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-5105f3a5-2700-4754-b90c-0bc26634110c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:43.218303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-5105f3a5-2700-4754-b90c-0bc26634110c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=f74db702-cbaa-457b-92a6-3778be2c26d2 HTTP/1.1" status: 200 len: 945 time: 0.0508103 Nov 05 15:00:43.303974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 8b758032-30ff-4f44-923f-59b4917dec2f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:43.304308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:43.391178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 8b758032-30ff-4f44-923f-59b4917dec2f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b758032-30ff-4f44-923f-59b4917dec2f,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:43.391566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:43.404610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 8b758032-30ff-4f44-923f-59b4917dec2f owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:43.534180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:43.561674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=8b758032-30ff-4f44-923f-59b4917dec2f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:43.601595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 8b758032-30ff-4f44-923f-59b4917dec2f on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:00:43.604201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:43.607585 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b44778a0-e5b4-496b-ab23-49bf1eaecbed req-1d1a67b5-2b42-4439-8aae-1ed50a2d2b6e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/8b758032-30ff-4f44-923f-59b4917dec2f HTTP/1.1" status: 204 len: 173 time: 0.3826997 Nov 05 15:00:44.081936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47548) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:44.131048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'name': 'network-vif-deleted', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:44.133852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9226f68-0e95-4ccd-a318-06f6c8c1530f" -d '{"events": [{"server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "name": "network-vif-deleted", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:44.149861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.170694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd47948d-0815-44a2-8a2c-a988a48e6a74 x-openstack-request-id: req-cd47948d-0815-44a2-8a2c-a988a48e6a74 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:44.171130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f74db702-cbaa-457b-92a6-3778be2c26d2", "name": "network-vif-deleted", "tag": "8b758032-30ff-4f44-923f-59b4917dec2f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:44.171463 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cd47948d-0815-44a2-8a2c-a988a48e6a74 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:44.171975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f74db702-cbaa-457b-92a6-3778be2c26d2', 'name': 'network-vif-deleted', 'tag': '8b758032-30ff-4f44-923f-59b4917dec2f', 'status': 'completed', 'code': 200} Nov 05 15:00:44.178797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.240678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.243846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.245009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/781d06c7-a365-4b90-9dcd-5b6332569875 HTTP/1.1" status: 204 len: 168 time: 0.1620820 Nov 05 15:00:44.253856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fdd138-952b-460e-abfb-1a2c432727a7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=781d06c7-a365-4b90-9dcd-5b6332569875,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:44.274556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47554) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:44.576335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:00:44.598691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:00:44.599036 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 0c404a5d-c073-4d8c-ad4d-0fff2d27b6a6 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:00:44.628909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.873925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 87d720c1-4ba3-4c90-97f9-566591dbfca1 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:44.874175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.961657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 87d720c1-4ba3-4c90-97f9-566591dbfca1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=87d720c1-4ba3-4c90-97f9-566591dbfca1,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:44.962025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:44.974179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 87d720c1-4ba3-4c90-97f9-566591dbfca1 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:45.151810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:45.176774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=87d720c1-4ba3-4c90-97f9-566591dbfca1,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:45.339003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:45.872103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router e6710dd8-3c34-44ce-b64c-ab4d925438df has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:00:45.973473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:00:45.978966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-70b0f5b5-b719-4097-81d8-561ae84b1733 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/e6710dd8-3c34-44ce-b64c-ab4d925438df/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7033157 Nov 05 15:00:45.982034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47556) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:45.983011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Sync routers for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:00:45.994198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:45.994797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:46.032866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet 6ce87ce3-5449-4321-aa64-f461c37973ea {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:00:46.035888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.080610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.099737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:46.161537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.218504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.249242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=6ce87ce3-5449-4321-aa64-f461c37973ea,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:46.259593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.262967 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/6ce87ce3-5449-4321-aa64-f461c37973ea HTTP/1.1" status: 204 len: 168 time: 0.2799253 Nov 05 15:00:46.264591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.264947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.265382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.265731 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.266170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47558) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:46.266760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.267109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.267445 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.267782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.268117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.268486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.268805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.269347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e83847c-67be-49d9-bf92-7fec6538e677 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.274222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87c78338-28e4-4ab3-b6e0-f0cbf3ba7de2 None None] Network 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:00:46.321901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T15:00:45Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:46.351292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Checking router: e6710dd8-3c34-44ce-b64c-ab4d925438df for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:00:46.376368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.381077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Routers {'e6710dd8-3c34-44ce-b64c-ab4d925438df'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:46.381731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e6710dd8-3c34-44ce-b64c-ab4d925438df'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:46.476439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.502828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] Set router e6710dd8-3c34-44ce-b64c-ab4d925438df gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:46.529642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] DHCP port deletion for 47ec29fc-5fd0-445a-8aa9-e92573ff36d7 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:00:46.538824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 1c077461-7fe9-4831-bca3-c0e7de2c3420 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:46.539172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.617060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 1c077461-7fe9-4831-bca3-c0e7de2c3420, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1c077461-7fe9-4831-bca3-c0e7de2c3420,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:46.617422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.630146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 1c077461-7fe9-4831-bca3-c0e7de2c3420 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:46.674817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Deleting port 60b12a92-a585-4e34-b105-4361f134c897 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:00:46.675191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.760536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] For port 60b12a92-a585-4e34-b105-4361f134c897, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=60b12a92-a585-4e34-b105-4361f134c897,segment=NetworkSegment(b88121b7-935e-466f-87d4-cf53fd74de68),segment_id=b88121b7-935e-466f-87d4-cf53fd74de68)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:46.760858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.776768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Calling delete_port for 60b12a92-a585-4e34-b105-4361f134c897 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:00:46.792288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.819473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=1c077461-7fe9-4831-bca3-c0e7de2c3420,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:46.826614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T15:00:45Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:46.860336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c130ba6-4b34-4b42-a0ab-2700388e07d7 None None] The sync data for ids ['e6710dd8-3c34-44ce-b64c-ab4d925438df'] in dv-neutron-816850-1-hyperv is: [{'id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'name': 'tempest-TestNetworkBasicOps-router-908492748', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199'}], 'enable_snat': True}, 'gw_port_id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T15:00:45Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': '1c077461-7fe9-4831-bca3-c0e7de2c3420', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:17:82', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e6710dd8-3c34-44ce-b64c-ab4d925438df', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1447, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.199', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T14:59:22Z', 'updated_at': '2021-11-05T14:59:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:00:46.880331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.891162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.917297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Pushing event deleted for resources: {'Port': ['ID=60b12a92-a585-4e34-b105-4361f134c897,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:46.921599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] No DVR routers for this DVR port 60b12a92-a585-4e34-b105-4361f134c897 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:00:46.927817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.928115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.928986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.929317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.929638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.929962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.930283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.930601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.930921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.931241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.931558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.931875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55ad8292-b0be-4c3c-9337-86d6dfc937e0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:46.974234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:46.976360 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.017640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.018155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router e6710dd8-3c34-44ce-b64c-ab4d925438df {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:00:47.024847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.025941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ef338bcd-ee32-4adc-9f3a-364be9cbd97c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/e6710dd8-3c34-44ce-b64c-ab4d925438df HTTP/1.1" status: 204 len: 168 time: 0.7569666 Nov 05 15:00:47.029470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47560) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:47.111367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.193701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.215040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['47ec29fc-5fd0-445a-8aa9-e92573ff36d7']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:47.224628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b88121b7-935e-466f-87d4-cf53fd74de68') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:47.224927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b88121b7-935e-466f-87d4-cf53fd74de68') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:47.234547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.248079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.254041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 615 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:00:47.254444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:00:47.258003 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:00:47.321665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.329206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.331762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/47ec29fc-5fd0-445a-8aa9-e92573ff36d7 HTTP/1.1" status: 204 len: 168 time: 0.3013647 Nov 05 15:00:47.344833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c601e2f2-79bf-42f9-87b9-09ff139547a8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=47ec29fc-5fd0-445a-8aa9-e92573ff36d7,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:47.357699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47562) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:47.362710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'network': {'name': 'tempest-network-smoke--99683297', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:47.383974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:00:47.387696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.416846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 601} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:00:47.426896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.427252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Added segment 183903ea-b3d2-4801-b0fd-054505f6ecb4 of type vlan for network f6c647b9-a042-41ec-b272-6b1be5a566b2 Nov 05 15:00:47.472312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.499414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.505354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:47.505951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.567684 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.2087641 Nov 05 15:00:47.570608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47564) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:47.575351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'admin_state_up': True, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:47.579222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9b8310-97b8-4ed7-9218-10d81cffca44 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Network': ['ID=f6c647b9-a042-41ec-b272-6b1be5a566b2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:47.589548 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:00:47.600603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.601618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.652203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:47.900641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 87d720c1-4ba3-4c90-97f9-566591dbfca1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:00:47.922097 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 87d720c1-4ba3-4c90-97f9-566591dbfca1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:00:47.922435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 87d720c1-4ba3-4c90-97f9-566591dbfca1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:00:47.922855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 60b12a92-a585-4e34-b105-4361f134c897 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:00:47.943096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 60b12a92-a585-4e34-b105-4361f134c897 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:00:47.943434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 60b12a92-a585-4e34-b105-4361f134c897 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:00:47.943887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1c077461-7fe9-4831-bca3-c0e7de2c3420 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:00:47.966964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 1c077461-7fe9-4831-bca3-c0e7de2c3420 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:00:47.967300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1c077461-7fe9-4831-bca3-c0e7de2c3420 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:00:48.093916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.282160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.300553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.323966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.403307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.3 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b6e5b79f-14e9-4c02-aae2-277cf1c7baf2) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:00:48.509188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.542734 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:48.583471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:00:48.587661 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:48.590807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:00:48.591972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b758032-30ff-4f44-923f-59b4917dec2f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:00:48.613455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 8b758032-30ff-4f44-923f-59b4917dec2f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:00:48.613793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b758032-30ff-4f44-923f-59b4917dec2f not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:00:48.623470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:48.848391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.041619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.173869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:00:49.278262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:00:49.287303 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:00:49.297920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.299144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-41390f8e-c11f-40ed-b518-118dafad7bf4 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.7274637 Nov 05 15:00:49.302090 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:49.302667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47566) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:49.303325 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:49.330428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2750b45b-d18e-4505-9b7a-3dd5de8f158f tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=2691099d79834234a0e6e846d81eed9c&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0264227 Nov 05 15:00:49.333027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47568) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:49.404540 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:49.426468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34fab162-25d4-460b-90b6-ac7c66c5e75e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:49.427891 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-34fab162-25d4-460b-90b6-ac7c66c5e75e tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0939751 Nov 05 15:00:49.431158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47570) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:49.460746 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-15add4c4-a748-4566-846f-30ea69d4f2f9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0280883 Nov 05 15:00:49.463232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47572) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:49.467897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2028332762', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:49.553591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:00:49.557159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.584550 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:48Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:49.610535 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:00:49.610887 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Updating router 292293fb-bf6c-461b-817c-c7b24fc17b6c port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:00:49.635734 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.740015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.805436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Subnet': ['ID=cb2c37c3-6354-4283-a067-26bf566a5b44,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:49.814429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Checking segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:00:49.814792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network hostable DHCP agents. Network: f6c647b9-a042-41ec-b272-6b1be5a566b2, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:00:49.832402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:00:49.842482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, f6c647b9-a042-41ec-b272-6b1be5a566b2) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:49.847240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:49.848451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.852170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f337f4d-f048-4c50-b347-c3ce1386cbc3 None None] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:00:49.864635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7e8662df-320c-4ff5-8a81-ffc951e91eb3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4003854 Nov 05 15:00:49.867447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47574) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-7f337f4d-f048-4c50-b347-c3ce1386cbc3 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:00:49.926887 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:00:49.938336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1ea2fba-24fb-48ff-b39b-4f1f3770c5e4 None None] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:00:49.985006 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:49.990461 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-a1ea2fba-24fb-48ff-b39b-4f1f3770c5e4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:00:50.012858 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:00:50.029942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37395e42-541e-4c70-9714-a2010d5a90fc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:00:50.042435 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:50.050570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.050918 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.051252 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.051577 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.051900 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.052224 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.052574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.052902 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.053735 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.054053 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.054367 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.054675 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:00:50.058228 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Attempting to bind port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:00:50.058705 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Attempting to bind port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:00:50.059081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Attempting to bind port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:00:50.065013 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:00:50.065234 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:00:50.065655 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.066001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:00:50.066461 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Bound port: b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:00:50.066836 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.083469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c3e27b76-3b73-4257-a1a9-043b16fbf274 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.117587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37395e42-541e-4c70-9714-a2010d5a90fc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:00:50.119948 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:00:50.123526 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:00:50.127288 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.183197 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f9c12d-6ab9-4e13-beaf-0f33659da144 None None] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:50.198526 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:50.199173 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:50.302835 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:50.348757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-f6c647b9-a042-41ec-b272-6b1be5a566b2', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:00:50.349624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.393011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.483119 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:48Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:50.511866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Allocated IP 172.20.0.2 (f6c647b9-a042-41ec-b272-6b1be5a566b2/cb2c37c3-6354-4283-a067-26bf566a5b44/901d91d2-f136-4b0b-bd4d-33f01de9a63b) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:00:50.513881 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31bdcbac-95e9-4857-8818-1b8d5b42232a None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:48Z', 'revision_number': 3, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:00:50.695186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.700823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.743659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:00:50.746572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:50.749759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:00:50.762911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.1 (f6c647b9-a042-41ec-b272-6b1be5a566b2/cb2c37c3-6354-4283-a067-26bf566a5b44/3f061e06-dbc9-4be0-a976-c15173876c2b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:00:50.766662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Pushing event updated for resources: {'Port': ['ID=901d91d2-f136-4b0b-bd4d-33f01de9a63b,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:50.946588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.982629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:50.997051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Attempting to bind port 901d91d2-f136-4b0b-bd4d-33f01de9a63b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:00:50.997581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Attempting to bind port 901d91d2-f136-4b0b-bd4d-33f01de9a63b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:00:50.998277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Attempting to bind port 901d91d2-f136-4b0b-bd4d-33f01de9a63b on network f6c647b9-a042-41ec-b272-6b1be5a566b2 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:00:51.004835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:00:51.005215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Checking segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:00:51.005673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.006072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Bound using segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:00:51.007155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Bound port: 901d91d2-f136-4b0b-bd4d-33f01de9a63b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:00:51.007540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.032749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:00:51.038777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:51.044271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:00:51.051763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:51.098441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.104450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] For port 901d91d2-f136-4b0b-bd4d-33f01de9a63b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:00:51.107961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] For port 901d91d2-f136-4b0b-bd4d-33f01de9a63b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=901d91d2-f136-4b0b-bd4d-33f01de9a63b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:00:51.113145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.194983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbb577b-2acb-4efb-8cd8-b8f7b925b241 None None] Pushing event updated for resources: {'Port': ['ID=901d91d2-f136-4b0b-bd4d-33f01de9a63b,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:51.287418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.669663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.675480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.676181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 901d91d2-f136-4b0b-bd4d-33f01de9a63b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:00:51.727225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 901d91d2-f136-4b0b-bd4d-33f01de9a63b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:51.727597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.748692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.750421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:51.804127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.841451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 901d91d2-f136-4b0b-bd4d-33f01de9a63b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=901d91d2-f136-4b0b-bd4d-33f01de9a63b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:51.842772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:00:51.844354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:51.845536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.847176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:00:51.922700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=901d91d2-f136-4b0b-bd4d-33f01de9a63b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:51.936992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:51.937818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:51.966374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:00:52.026673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:52.047759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:52.056631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:52.086820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:00:52.094592 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-07ea4fb2-680f-41ac-a8ef-133ab99ff19e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/292293fb-bf6c-461b-817c-c7b24fc17b6c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2236331 Nov 05 15:00:52.094833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47576) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:52.112975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:52.228958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb9c5e92-aefb-4e3c-aea8-de8b95513741 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:00:52.309761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-2b4653fd-4714-4f5c-b76d-4ee2edb915e1 None None] Provisioning complete for port 901d91d2-f136-4b0b-bd4d-33f01de9a63b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:52.310139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2b4653fd-4714-4f5c-b76d-4ee2edb915e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:52.313374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb9c5e92-aefb-4e3c-aea8-de8b95513741 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:00:52.460770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d24bef80-d953-47c6-9d57-7761469b3f1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:52.545244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b519fff2-7830-4d89-8857-9ca27c7c8fda tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.545706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b519fff2-7830-4d89-8857-9ca27c7c8fda tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.546159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b519fff2-7830-4d89-8857-9ca27c7c8fda tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.546632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b519fff2-7830-4d89-8857-9ca27c7c8fda tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.548329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b519fff2-7830-4d89-8857-9ca27c7c8fda tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2884 time: 0.4524500 Nov 05 15:00:52.551047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47578) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:52.608838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca42146-b9e1-4312-91a9-f25a858138c9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.609299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca42146-b9e1-4312-91a9-f25a858138c9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.609752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca42146-b9e1-4312-91a9-f25a858138c9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.610202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca42146-b9e1-4312-91a9-f25a858138c9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:52.611916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7ca42146-b9e1-4312-91a9-f25a858138c9 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2728 time: 0.0599551 Nov 05 15:00:52.614931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47580) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:52.661832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:00:52.674349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:52.675062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:52.767237 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4314f5a3-ff5b-4fff-b548-062634f4f46a tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1606 time: 0.1510129 Nov 05 15:00:52.792391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:53.007193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:53.041459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:00:53.042138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Updating router 292293fb-bf6c-461b-817c-c7b24fc17b6c port 3f061e06-dbc9-4be0-a976-c15173876c2b binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:00:53.068018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.097992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47584) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.103530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-319823985', 'description': 'tempest-secgroup-smoke-319823985 description', 'project_id': '2691099d79834234a0e6e846d81eed9c'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.131243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.191676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0bc7afce-6ba7-406e-9e40-f6a53b155e66 None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:53.191964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bc7afce-6ba7-406e-9e40-f6a53b155e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.207665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.212025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.243573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.245100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1459980 Nov 05 15:00:53.246302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0bc7afce-6ba7-406e-9e40-f6a53b155e66 None None] Port 3f061e06-dbc9-4be0-a976-c15173876c2b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:00:53.248027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47586) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.251646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0def446-61c6-4a65-a0f5-695106cea12d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fb607689-24e3-4ce8-8326-4d14fe4fca61,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.252589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.286867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.310536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0bc7afce-6ba7-406e-9e40-f6a53b155e66 None None] Provisioning complete for port 901d91d2-f136-4b0b-bd4d-33f01de9a63b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:53.311161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0bc7afce-6ba7-406e-9e40-f6a53b155e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.351177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.356531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.376040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d682963b-6518-4c7a-be2d-10ed4863232d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.388492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.389795 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f7d932b2-9437-40f8-8e6a-7a1b04616406 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1406925 Nov 05 15:00:53.392565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47588) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.398025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.426781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.479444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.501186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.504744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.509736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.509953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.531174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b71491e-7732-45f2-92ae-e5aa09584091,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.537674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.539013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ef8e4da-51fa-49b8-a756-7e757d137d72 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1452796 Nov 05 15:00:53.541858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.547903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.599144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.632295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 901d91d2-f136-4b0b-bd4d-33f01de9a63b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:00:53.669888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.674896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.676346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2578564-3ed7-4e75-be1a-676372b3b74d None None] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.683388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Attempting to bind port 3f061e06-dbc9-4be0-a976-c15173876c2b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:00:53.683753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Attempting to bind port 3f061e06-dbc9-4be0-a976-c15173876c2b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:00:53.684321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Attempting to bind port 3f061e06-dbc9-4be0-a976-c15173876c2b on network f6c647b9-a042-41ec-b272-6b1be5a566b2 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:00:53.691318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:00:53.691681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Checking segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:00:53.692083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.692506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Bound using segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:00:53.692968 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Bound port: 3f061e06-dbc9-4be0-a976-c15173876c2b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:00:53.693342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.699536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5025ee9d-c710-4768-a674-f071c4dbf395,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.706184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.707774 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53af7952-bc74-47bd-b59e-c69e57c4a4d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1645119 Nov 05 15:00:53.710456 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47592) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.715199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-769382a4-3ee7-4e39-b293-9ea9fddf36e3 None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:53.715564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-769382a4-3ee7-4e39-b293-9ea9fddf36e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.716177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.749187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.798947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-769382a4-3ee7-4e39-b293-9ea9fddf36e3 None None] Port 3f061e06-dbc9-4be0-a976-c15173876c2b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:00:53.804159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 901d91d2-f136-4b0b-bd4d-33f01de9a63b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:53.804550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.808400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.813703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.831515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ef968d2-05da-4129-9f4f-c54b35d92768,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.834084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:00:53.840018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.841279 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dba0df17-d6c4-47cc-8963-4aec3937bf5e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1296172 Nov 05 15:00:53.844010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.848327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:53.855950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3f061e06-dbc9-4be0-a976-c15173876c2b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:00:53.861504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.870582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:00:53.875411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.938437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.941863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2578564-3ed7-4e75-be1a-676372b3b74d None None] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.943474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.946541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:00:53.947155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:53.964531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44f87701-dbf0-4587-9553-42b38a686a6a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:53.970653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:53.974806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47596) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:00:53.975004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-21525f14-557a-4725-b918-cd85e068519f tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1298063 Nov 05 15:00:53.979597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'security_group_rule': {'security_group_id': 'fb607689-24e3-4ce8-8326-4d14fe4fca61', 'project_id': '2691099d79834234a0e6e846d81eed9c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:54.009612 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Project 2691099d79834234a0e6e846d81eed9c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:00:54.015212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.018691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:54.018691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.086656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.091993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.112096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1784a9b8-a6b0-436b-94f6-2a406b9e1077,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:54.123208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.124748 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d14fc1f9-ff2c-40e2-927d-7ee4a45db2c7 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1486554 Nov 05 15:00:54.210369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:00:54.288540 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-ff0b79e2-7e96-48be-a13b-8c5171305711 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-319823985&fields=id&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 267 time: 0.0503969 Nov 05 15:00:54.307426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:00:54.397836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-8d266686-9224-4505-a352-0f20eeb69c16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:54.399524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-8d266686-9224-4505-a352-0f20eeb69c16 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/networks?id=f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 200 len: 795 time: 0.1042700 Nov 05 15:00:54.407002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:54.407370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.415137 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-fb82a052-2758-4744-999d-d14f5e2c978c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/quotas/2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 375 time: 0.0096211 Nov 05 15:00:54.469953 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-2ad87e9a-3f88-4975-803d-dbcb02347ed0 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0488048 Nov 05 15:00:54.475079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.561696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3f061e06-dbc9-4be0-a976-c15173876c2b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:00:54.591086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.627092 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-d3cd4af8-4dbf-42b6-802f-35eee691a153 service neutron] 10.222.0.30 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449394 Nov 05 15:00:54.673418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6a67a5-c675-4057-b270-138a04acb1c6 None None] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:54.694996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:53Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:00:54.732167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f1c9687-01e8-45d6-9d40-393bcf4aff89 None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:53Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:00:54.745651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-826ab664-0a0d-48f9-a00a-cba5b1920455 None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:54.746084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-826ab664-0a0d-48f9-a00a-cba5b1920455 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.746829 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-7a2f7ff2-7cb0-4454-b41a-a9a1bca51eb6 service neutron] 10.222.0.30 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1093864 Nov 05 15:00:54.927001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:54.974627 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c56e8613-7665-4925-b77d-d383fb381946 req-f18ccb54-548e-4a52-9002-9e4b2d5e9dc2 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 210 time: 0.0300534 Nov 05 15:00:55.616569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:00:55.668637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:55.669013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:55.917084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:55.932567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-7b783666-d852-4421-b884-b181f29e610a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:55.934023 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-7b783666-d852-4421-b884-b181f29e610a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/networks?id=f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 200 len: 795 time: 0.1059844 Nov 05 15:00:55.997866 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-cf5c26ce-6a6e-4b1c-87b1-d8cdb22c3cdb tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2691099d79834234a0e6e846d81eed9c HTTP/1.1" status: 200 len: 379 time: 0.0546584 Nov 05 15:00:56.007324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'port': {'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'admin_state_up': True, 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'security_groups': ['fb607689-24e3-4ce8-8326-4d14fe4fca61']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:56.077633 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-168d6e8d-5161-4e21-8c08-67d46853198d req-d6b5aad4-e40e-4c90-8f3e-bfe6f01a9507 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 210 time: 0.0263965 Nov 05 15:00:56.115581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Made reservation on behalf of 2691099d79834234a0e6e846d81eed9c for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:00:56.119222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.242261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.20.0.12 (f6c647b9-a042-41ec-b272-6b1be5a566b2/cb2c37c3-6354-4283-a067-26bf566a5b44/7828a340-2e7e-4136-8d2b-10ff20366fd4) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:00:56.373642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.406403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.450902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:00:56.455846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:00:56.460205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:00:56.466496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:56.513402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:56.514018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.531141 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-74dcc608-b44c-4f50-96d9-2569f8ed6a97 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5275731 Nov 05 15:00:56.543546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Request body: {'port': {'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:00:56.599035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.692339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-622358ce-4dc4-4792-ac20-0cb941c9e4ea None None] Provisioning complete for port 7828a340-2e7e-4136-8d2b-10ff20366fd4 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:00:56.692993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-622358ce-4dc4-4792-ac20-0cb941c9e4ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.725939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-622358ce-4dc4-4792-ac20-0cb941c9e4ea None None] Port 7828a340-2e7e-4136-8d2b-10ff20366fd4 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:00:56.863186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7828a340-2e7e-4136-8d2b-10ff20366fd4 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:00:56.870330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.882151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Transition to ACTIVE for port object 7828a340-2e7e-4136-8d2b-10ff20366fd4 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:00:56.885732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:56.933243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Pushing event updated for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:57.002330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Attempting to bind port 7828a340-2e7e-4136-8d2b-10ff20366fd4 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:00:57.002955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Attempting to bind port 7828a340-2e7e-4136-8d2b-10ff20366fd4 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:00:57.003110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Attempting to bind port 7828a340-2e7e-4136-8d2b-10ff20366fd4 on network f6c647b9-a042-41ec-b272-6b1be5a566b2 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:00:57.008402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Port 7828a340-2e7e-4136-8d2b-10ff20366fd4 on network f6c647b9-a042-41ec-b272-6b1be5a566b2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:00:57.008758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Attempting to bind port 7828a340-2e7e-4136-8d2b-10ff20366fd4 on network f6c647b9-a042-41ec-b272-6b1be5a566b2 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:00:57.014731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 0, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:00:57.015073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Checking segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:00:57.015455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Bound using segment: {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:00:57.015888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Bound port: 7828a340-2e7e-4136-8d2b-10ff20366fd4, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '183903ea-b3d2-4801-b0fd-054505f6ecb4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:00:57.016306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:57.085668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:00:57.088991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:00:57.093731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:57.127301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.127915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:00:57.129303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] 10.222.0.32 "PUT /v2.0/ports/7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 200 len: 1094 time: 0.5900645 Nov 05 15:00:57.129743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:00:57.132778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f710843-c911-4194-9da3-39cdd77e81f6" -d '{"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:00:57.202331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:00:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cab44aca-fbce-4af7-9214-e55855aafd2e x-openstack-request-id: req-cab44aca-fbce-4af7-9214-e55855aafd2e {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:00:57.202614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:00:57.202860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cab44aca-fbce-4af7-9214-e55855aafd2e {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:00:57.203253 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'status': 'completed', 'code': 200} Nov 05 15:00:57.205070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876046a9-c39a-4244-bfda-48af582c9615 service neutron] Pushing event updated for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:00:57.253610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67050888-58a0-4e26-a999-1dc5dda6b5b7 req-d6d3b00a-422e-4423-93e7-be472ce0b830 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.255138 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-67050888-58a0-4e26-a999-1dc5dda6b5b7 req-d6d3b00a-422e-4423-93e7-be472ce0b830 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 944 time: 0.0885534 Nov 05 15:00:57.262731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-a34ee011-411e-4d1b-92d4-fe995bcc1b5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.264206 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-a34ee011-411e-4d1b-92d4-fe995bcc1b5a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1097 time: 0.0843368 Nov 05 15:00:57.313953 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-d34db1e2-dd6a-4f89-a95e-c8516932e892 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 200 len: 217 time: 0.0418305 Nov 05 15:00:57.368736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-67050888-58a0-4e26-a999-1dc5dda6b5b7 req-1ce95aad-5043-4f90-bb55-aa67a9e8ca77 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1034477 Nov 05 15:00:57.384591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-0363e877-1834-4976-8788-dd5b0abbee91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.384591 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-0363e877-1834-4976-8788-dd5b0abbee91 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=cb2c37c3-6354-4283-a067-26bf566a5b44 HTTP/1.1" status: 200 len: 835 time: 0.0595345 Nov 05 15:00:57.433789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-fe1968b7-f91a-450e-af4b-3969939abc36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.435328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-fe1968b7-f91a-450e-af4b-3969939abc36 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f6c647b9-a042-41ec-b272-6b1be5a566b2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0446830 Nov 05 15:00:57.526037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-7e396ccc-9f02-44b9-a681-3603775e5f57 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838213 Nov 05 15:00:57.617408 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48c4ab96-6d0b-4717-b5b2-270d522fba1a req-e012d61d-d123-48b3-ab89-0c837e7dad02 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848098 Nov 05 15:00:57.698885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-20587f0b-157b-4eac-8b27-da13c99262b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.700379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-20587f0b-157b-4eac-8b27-da13c99262b6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1097 time: 0.0408731 Nov 05 15:00:57.787913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-8725be99-8b76-43c0-b983-984c8856e50b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.789435 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-8725be99-8b76-43c0-b983-984c8856e50b service neutron] 10.222.0.32 "GET /v2.0/networks?id=f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 200 len: 896 time: 0.0819385 Nov 05 15:00:57.836979 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-4d04ae22-b3fe-4ebd-8ad1-3d5329273973 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 200 len: 217 time: 0.0370531 Nov 05 15:00:57.884658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-3031b6b2-bf5a-442b-ad46-a6b02deb4be4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.886025 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-3031b6b2-bf5a-442b-ad46-a6b02deb4be4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=cb2c37c3-6354-4283-a067-26bf566a5b44 HTTP/1.1" status: 200 len: 835 time: 0.0426226 Nov 05 15:00:57.930017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-1839d465-4b94-4711-8ef5-defad4b5180d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:57.931495 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-1839d465-4b94-4711-8ef5-defad4b5180d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f6c647b9-a042-41ec-b272-6b1be5a566b2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0383437 Nov 05 15:00:58.023821 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-1bb0a099-8c64-410e-9408-412c1efe1fa2 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841885 Nov 05 15:00:58.113448 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f710843-c911-4194-9da3-39cdd77e81f6 req-36e016e6-aeb0-4f7a-8eba-ce2e5eab98bd service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818663 Nov 05 15:00:58.483825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34998e5c-315e-4151-bd85-38f42582bc5d req-09e0e33d-4535-4a05-9790-f2cf16fc7105 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:58.485387 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-34998e5c-315e-4151-bd85-38f42582bc5d req-09e0e33d-4535-4a05-9790-f2cf16fc7105 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 944 time: 0.0491972 Nov 05 15:00:58.534039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-34998e5c-315e-4151-bd85-38f42582bc5d req-f63c6231-0b01-4d4c-93c3-0ae477cb9091 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426807 Nov 05 15:00:59.652634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e9daa6-848c-4af5-b805-75910516130a req-54f307e1-b851-45c7-acbd-a6185a6d2ca5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:00:59.654300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-72e9daa6-848c-4af5-b805-75910516130a req-54f307e1-b851-45c7-acbd-a6185a6d2ca5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 944 time: 0.0530314 Nov 05 15:00:59.701879 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-72e9daa6-848c-4af5-b805-75910516130a req-48c518b7-bbbd-49db-b3ee-24e7938ffda3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418220 Nov 05 15:01:00.628344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 7828a340-2e7e-4136-8d2b-10ff20366fd4 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:01:00.722009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:00.735001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 601, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:01:00.776931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:00.790463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7828a340-2e7e-4136-8d2b-10ff20366fd4 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:01:00.813372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:00.818188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:00.833655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84b08d0-cb9e-4a19-869a-523cc5be3fef req-9ed2770c-ecbf-42bb-b763-64c51c5c2156 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:00.835189 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e84b08d0-cb9e-4a19-869a-523cc5be3fef req-9ed2770c-ecbf-42bb-b763-64c51c5c2156 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 944 time: 0.0593948 Nov 05 15:01:00.866538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:00.885381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e84b08d0-cb9e-4a19-869a-523cc5be3fef req-558043f2-3cb9-45be-91a2-723210c93c8d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438235 Nov 05 15:01:01.031346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['7828a340-2e7e-4136-8d2b-10ff20366fd4'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:01:01.997801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443b6328-f5cc-4a19-8a2a-d7c7ac1a1a03 req-12d2484e-6432-4cad-9b2c-7a043d848091 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:01.999254 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-443b6328-f5cc-4a19-8a2a-d7c7ac1a1a03 req-12d2484e-6432-4cad-9b2c-7a043d848091 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 945 time: 0.0476246 Nov 05 15:01:02.046784 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-443b6328-f5cc-4a19-8a2a-d7c7ac1a1a03 req-20844cfe-d08c-474a-b646-06749f2d1f1c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417118 Nov 05 15:01:02.623538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 7828a340-2e7e-4136-8d2b-10ff20366fd4 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:01:02.671648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 7828a340-2e7e-4136-8d2b-10ff20366fd4 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:01:02.675430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 7828a340-2e7e-4136-8d2b-10ff20366fd4 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:02.675784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:02.752501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:02.773942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:01:02.776122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ca457bf-50c5-4144-a74a-fed53e7e5758" -d '{"events": [{"server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "name": "network-vif-plugged", "status": "completed", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:01:02.788741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:02.793636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:02.816999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:01:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fbd990c8-5f6b-4db1-8f5e-ab649c63240a x-openstack-request-id: req-fbd990c8-5f6b-4db1-8f5e-ab649c63240a {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:01:02.817293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "name": "network-vif-plugged", "status": "completed", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:01:02.817549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fbd990c8-5f6b-4db1-8f5e-ab649c63240a {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:01:02.817937 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'code': 200} Nov 05 15:01:02.845642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:02.977127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503a325a-6180-4d41-80cf-79f2c5a4f7a4 req-74c09206-6ca6-4c17-8142-a40ff89322d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:02.978601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503a325a-6180-4d41-80cf-79f2c5a4f7a4 req-74c09206-6ca6-4c17-8142-a40ff89322d4 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1099 time: 0.0386736 Nov 05 15:01:03.027917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503a325a-6180-4d41-80cf-79f2c5a4f7a4 req-9f8bbaf0-84ac-4aa4-b2b9-cf74341373d6 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421715 Nov 05 15:01:03.161386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0cd7c2-5401-490d-b762-45005534b85f req-4784eb89-fc33-4f18-8a60-a38e42bdcd03 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:03.163371 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc0cd7c2-5401-490d-b762-45005534b85f req-4784eb89-fc33-4f18-8a60-a38e42bdcd03 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0498376 Nov 05 15:01:03.218825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc0cd7c2-5401-490d-b762-45005534b85f req-b216fc62-b7fb-4f30-8c7e-9ba1322881ba tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492537 Nov 05 15:01:04.336265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fbe9cb-de6c-4d4d-adf3-f4750e1dcae3 req-1b4254c7-3cc3-4772-9a7d-87a02a87200b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:04.337769 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42fbe9cb-de6c-4d4d-adf3-f4750e1dcae3 req-1b4254c7-3cc3-4772-9a7d-87a02a87200b tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0490687 Nov 05 15:01:04.385395 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42fbe9cb-de6c-4d4d-adf3-f4750e1dcae3 req-2122cbcb-e2a3-443c-bfd4-f5f558706b93 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418344 Nov 05 15:01:04.497040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da22e501-7f36-402f-b32b-19c93d5f4880 req-103ca9d2-cf45-4ab3-8ba9-dfbc2c66c930 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:04.498587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da22e501-7f36-402f-b32b-19c93d5f4880 req-103ca9d2-cf45-4ab3-8ba9-dfbc2c66c930 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0478044 Nov 05 15:01:04.559938 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da22e501-7f36-402f-b32b-19c93d5f4880 req-29228170-c738-446c-bbfb-0e6d03cad893 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0552959 Nov 05 15:01:04.581956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47654) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:04.624034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca94e80b-56c9-4ce1-bffc-61e9ba3b8dc3 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:04.625543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ca94e80b-56c9-4ce1-bffc-61e9ba3b8dc3 tempest-TestNetworkBasicOps-447717997 tempest-TestNetworkBasicOps-447717997-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1094 time: 0.0426066 Nov 05 15:01:04.628230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47656) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:04.632385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address': '172.20.0.12'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:01:04.653306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:04.747202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:04.851167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Allocated IP 172.26.5.139 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:01:04.951654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:04.985322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.027102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:01:05.031920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:01:05.034546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:01:05.059174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:05.391806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.457522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.605573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.609882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.673197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event updated for resources: {'Port': ['ID=c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:05.686304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:05.781955 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 associated. External IP: 172.26.5.139, port: 7828a340-2e7e-4136-8d2b-10ff20366fd4. Nov 05 15:01:05.982151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:01:06.085701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:01:06.095124 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:01:06.103151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:06.105325 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:06.105986 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:06.129871 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8a050377-acf1-4bac-bc73-50eeb33a669d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5006316 Nov 05 15:01:06.130532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:01:06.132798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47658) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:06.133285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22d808e9-bb09-4392-aa8b-95e051f5208b" -d '{"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:01:06.173680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:01:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6fc7796-040a-443c-a7fd-a5edaac78a6d x-openstack-request-id: req-a6fc7796-040a-443c-a7fd-a5edaac78a6d {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:01:06.174058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:01:06.174322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a6fc7796-040a-443c-a7fd-a5edaac78a6d {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:01:06.174736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'status': 'completed', 'code': 200} Nov 05 15:01:06.201068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b8829de7-602a-42a9-86a8-4d6e942b0fa9 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 992 time: 0.0668125 Nov 05 15:01:06.213901 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:06.234423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-3bddb51e-faab-47c3-a0df-d883e2040510 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:06.235934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-3bddb51e-faab-47c3-a0df-d883e2040510 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1099 time: 0.0400059 Nov 05 15:01:06.329524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-c2a5a2ac-2ecd-4c5a-a40c-a8209ad5c6fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:06.331155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-c2a5a2ac-2ecd-4c5a-a40c-a8209ad5c6fc service neutron] 10.222.0.32 "GET /v2.0/networks?id=f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 200 len: 896 time: 0.0872977 Nov 05 15:01:06.399110 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-aa0d56fe-ff6c-47d0-b457-149e76e4093f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 200 len: 1000 time: 0.0592167 Nov 05 15:01:06.430864 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:05Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:54Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:06.446490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-aa0001b0-179c-4ef5-876f-0d1fd0dd7e6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:06.447921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-aa0001b0-179c-4ef5-876f-0d1fd0dd7e6c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=cb2c37c3-6354-4283-a067-26bf566a5b44 HTTP/1.1" status: 200 len: 835 time: 0.0425076 Nov 05 15:01:06.459980 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:01:06.467997 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:06.468610 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:00:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:06.495874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-fbdea736-3a09-4638-89bf-362201e7c39f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:06.497395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-fbdea736-3a09-4638-89bf-362201e7c39f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f6c647b9-a042-41ec-b272-6b1be5a566b2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0430150 Nov 05 15:01:06.570778 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:06.587351 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-d48f1122-b4a5-43a5-829d-7a16a72c67b7 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827019 Nov 05 15:01:06.680308 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22d808e9-bb09-4392-aa8b-95e051f5208b req-4648896f-c3bc-491b-9263-96451101d12a service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856938 Nov 05 15:01:06.788874 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:05Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:54Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:06.813826 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-383e5078-39d2-4e4f-9bd7-8946b61c349d None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:00:51Z', 'revision_number': 4, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:00:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:05Z', 'revision_number': 0, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:00:54Z', 'revision_number': 5, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:01:06.994463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4813b52-ec95-416a-a9a3-9fe23bd594b7 None None] New status for floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:01:07.204912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47662) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:07.265577 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8fce15f7-20dc-4f9f-882a-169dfbffde33 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 994 time: 0.0595360 Nov 05 15:01:14.540124 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:01:18.338992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:20.068592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ee54b9b6-ee6d-4ed7-a0b7-5df6862620ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:22.408064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-23162035-efb3-4fab-b44e-237a4339ade3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:23.429101 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:24.896312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:25.918351 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:35.825033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47672) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:35.829631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'admin_state_up': False}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:01:36.437043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:36.448316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:36.551084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:01:36.654419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:01:36.662471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:36.664983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-42178676-719c-4def-8139-f2efa9a561f3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/292293fb-bf6c-461b-817c-c7b24fc17b6c HTTP/1.1" status: 200 len: 887 time: 0.8378398 Nov 05 15:01:36.665121 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:01:36.675109 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:36.675705 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:36.707655 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:36.715755 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:36.716327 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:36.749398 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:36.750001 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64257277-d27d-422f-a38a-4b7c84f615a9 None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:01:37.488233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad4ebb79-ab35-4692-a667-c90b32dc8b0f None None] New status for floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:01:37.622789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:37.699245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:37.733313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3f061e06-dbc9-4be0-a976-c15173876c2b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:37.737157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:37.737986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:37.809483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:37.850418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:37.870446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:37.874123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:37.924292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:38.779828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47676) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:38.784445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Request body: {'router': {'admin_state_up': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:01:39.081035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1032801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1040372', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13848'] for router, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:39.091472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1032728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1032727', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1040355'] for router, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:39.197064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:01:39.305835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:01:39.313381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:39.314529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ddeb3ed6-1ecc-4ca6-963f-380cd7bf1b7d tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/292293fb-bf6c-461b-817c-c7b24fc17b6c HTTP/1.1" status: 200 len: 886 time: 0.5336452 Nov 05 15:01:39.315877 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:01:39.317414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47678) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:39.327179 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:39.327782 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:39.376596 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-10c68b0d-5bcd-447c-b451-99d4a6c762d5 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 992 time: 0.0580115 Nov 05 15:01:39.429412 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:39.649292 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:39.679934 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:01:39.691997 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:39.692654 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:39.794283 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:40.007781 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:40.036530 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7ce7e9f-6c1c-41fc-9194-cbcfc7496b37 None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'floating_ip_address': '172.26.5.139', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'port_id': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'mac_address': 'fa:16:3e:59:17:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84bc22f6-f491-4e12-899a-208997347760', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:01:05Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 2, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:37Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:01:40.380385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47680) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:40.445501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dd4756b6-383c-4046-a0d4-5a5276921498 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 992 time: 0.0639293 Nov 05 15:01:41.449734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47682) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:41.512246 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cfb7978e-65aa-4162-9dd1-6bbe15302829 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 992 time: 0.0612891 Nov 05 15:01:41.533931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7eee6b75-60b1-43de-9c4d-38bfa081ab84 None None] New status for floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:01:41.678234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:01:41.731132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:41.731497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:41.813466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:41.845845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3f061e06-dbc9-4be0-a976-c15173876c2b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:41.849392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:41.850158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:01:41.925807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:41.938971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:41.939411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:42.015989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:42.034907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:42.039438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:42.086154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:42.516095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47684) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:42.581079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4a63aec9-6505-48b5-a5d9-619db4f1c0d3 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 200 len: 994 time: 0.0634592 Nov 05 15:01:42.847879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47690) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:43.002793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:01:43.003131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.081314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.081624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.092882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:01:43.232715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.261573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=c1c1f5e4-3b69-43ee-bb98-6a2efc6682fc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:43.284621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.284971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.285307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.285642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.285974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.286299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.286626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.286949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.287282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.287595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.287918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.288234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:43.329462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.329783 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 disassociated (deleted). External IP: 172.26.5.139, port: 7828a340-2e7e-4136-8d2b-10ff20366fd4. Nov 05 15:01:43.531258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:01:43.631180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:01:43.639319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:01:43.643619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.648527 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:01:43.658570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:43.659394 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:43.670963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-10a6dfde-159a-4606-a9ca-70ae5600af5a tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/floatingips/0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7 HTTP/1.1" status: 204 len: 168 time: 0.8220842 Nov 05 15:01:43.671542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:01:43.673804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75278a5e-23d7-4776-b99f-a7cfc5308b55" -d '{"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:01:43.706889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3f061e06-dbc9-4be0-a976-c15173876c2b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:43.707258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.718993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:01:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-459e302f-b387-475c-ae41-2329d95253f1 x-openstack-request-id: req-459e302f-b387-475c-ae41-2329d95253f1 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:01:43.719279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:01:43.719533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-459e302f-b387-475c-ae41-2329d95253f1 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:01:43.719959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'status': 'completed', 'code': 200} Nov 05 15:01:43.786627 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:43.797237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-43855fda-dae2-49ae-aa81-2315c210b321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:43.799632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-43855fda-dae2-49ae-aa81-2315c210b321 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2691099d79834234a0e6e846d81eed9c&device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 1099 time: 0.0557277 Nov 05 15:01:43.800104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:01:43.856754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:43.857130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:43.939832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-7855d6fd-130f-4cd7-bc7d-2e40d43bbc6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:43.941356 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-7855d6fd-130f-4cd7-bc7d-2e40d43bbc6e service neutron] 10.222.0.32 "GET /v2.0/networks?id=f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 200 len: 896 time: 0.1350594 Nov 05 15:01:43.954354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67a7211-7d89-4aa4-91fe-c248fe8e6b0d req-6a1c8027-aeb3-41b2-99f2-eebf8c28af9e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:43.955826 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e67a7211-7d89-4aa4-91fe-c248fe8e6b0d req-6a1c8027-aeb3-41b2-99f2-eebf8c28af9e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0664048 Nov 05 15:01:44.005063 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-bbbd263e-f516-4d80-abf7-70bc44f9f61a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 200 len: 217 time: 0.0482757 Nov 05 15:01:44.013824 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:41Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:44.039157 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:01:44.047802 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:44.048383 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:44.063054 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e67a7211-7d89-4aa4-91fe-c248fe8e6b0d req-af5f0ae9-5fa1-443e-ab0f-7c1e8586ce62 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1003146 Nov 05 15:01:44.078157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-439f0d4d-fd68-4359-96ec-1fdceae29150 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:44.079653 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-439f0d4d-fd68-4359-96ec-1fdceae29150 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=cb2c37c3-6354-4283-a067-26bf566a5b44 HTTP/1.1" status: 200 len: 835 time: 0.0670846 Nov 05 15:01:44.129785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-b467fbe8-3027-4a83-884d-27e1801c7a66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:44.131319 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-b467fbe8-3027-4a83-884d-27e1801c7a66 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f6c647b9-a042-41ec-b272-6b1be5a566b2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423541 Nov 05 15:01:44.228340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-6421908e-ea06-4b30-9e6e-e576a31458e6 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890381 Nov 05 15:01:44.238814 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:44.318519 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75278a5e-23d7-4776-b99f-a7cfc5308b55 req-a11c93fe-bda2-4922-adeb-b4a6327e00f3 service neutron] 10.222.0.32 "GET /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818429 Nov 05 15:01:44.433108 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:41Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:44.458478 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-447f3b8e-c52a-4f6e-9e48-53ebacc957c7 None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:39Z', 'revision_number': 6, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '3f061e06-dbc9-4be0-a976-c15173876c2b', 'name': '', 'network_id': 'f6c647b9-a042-41ec-b272-6b1be5a566b2', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'mac_address': 'fa:16:3e:11:28:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1481, 'fixed_ips': [{'subnet_id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:50Z', 'updated_at': '2021-11-05T15:01:41Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'subnets': [{'id': 'cb2c37c3-6354-4283-a067-26bf566a5b44', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:01:45.083167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29221689-5a61-4e3b-9007-1b603a3d1c98 None None] New status for floating IP 0ea2a7e2-32d2-42e9-bf80-ee69f06c9bf7: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:01:45.183608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ee6453-7030-45f1-8508-f25723076b02 req-5561ef29-b234-453c-bd21-59aa1a3f7622 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:45.184302 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a659ff3-bbee-427f-a08c-3e7b85c940d8 req-4f69760d-efec-4375-b22f-ff6df5248cbd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:45.185136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-06ee6453-7030-45f1-8508-f25723076b02 req-5561ef29-b234-453c-bd21-59aa1a3f7622 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0489578 Nov 05 15:01:45.186255 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8a659ff3-bbee-427f-a08c-3e7b85c940d8 req-4f69760d-efec-4375-b22f-ff6df5248cbd tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/ports?device_id=84bc22f6-f491-4e12-899a-208997347760 HTTP/1.1" status: 200 len: 946 time: 0.0540252 Nov 05 15:01:45.235293 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8a659ff3-bbee-427f-a08c-3e7b85c940d8 req-ae2dca6b-476f-491f-ae9d-1e16e52cff79 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "GET /v2.0/security-groups?id=fb607689-24e3-4ce8-8326-4d14fe4fca61&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432036 Nov 05 15:01:45.278937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 7828a340-2e7e-4136-8d2b-10ff20366fd4 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:01:45.279272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:45.365995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 7828a340-2e7e-4136-8d2b-10ff20366fd4, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=7828a340-2e7e-4136-8d2b-10ff20366fd4,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:45.366267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:45.378479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 7828a340-2e7e-4136-8d2b-10ff20366fd4 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:01:45.504309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:45.532881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=7828a340-2e7e-4136-8d2b-10ff20366fd4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:45.577278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] No DVR routers for this DVR port 7828a340-2e7e-4136-8d2b-10ff20366fd4 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:01:45.580191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:45.583674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-06ee6453-7030-45f1-8508-f25723076b02 req-02f2d997-00ae-49a5-a43b-b69d56e2f85e tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.32 "DELETE /v2.0/ports/7828a340-2e7e-4136-8d2b-10ff20366fd4 HTTP/1.1" status: 204 len: 173 time: 0.3919272 Nov 05 15:01:45.720756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'name': 'network-vif-deleted', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:01:45.723086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c11f3231-d4b6-4801-9dff-28979de4441a" -d '{"events": [{"server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "name": "network-vif-deleted", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:01:45.760934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:01:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8657a4d-1f96-4a5c-9adb-13cd3cd99941 x-openstack-request-id: req-c8657a4d-1f96-4a5c-9adb-13cd3cd99941 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:01:45.761229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84bc22f6-f491-4e12-899a-208997347760", "name": "network-vif-deleted", "tag": "7828a340-2e7e-4136-8d2b-10ff20366fd4", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:01:45.761479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c8657a4d-1f96-4a5c-9adb-13cd3cd99941 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:01:45.761883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84bc22f6-f491-4e12-899a-208997347760', 'name': 'network-vif-deleted', 'tag': '7828a340-2e7e-4136-8d2b-10ff20366fd4', 'status': 'completed', 'code': 200} Nov 05 15:01:46.293708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47704) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:46.348965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:46.373576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:46.430386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:46.433052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:46.434191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/security-groups/fb607689-24e3-4ce8-8326-4d14fe4fca61 HTTP/1.1" status: 204 len: 168 time: 0.1395082 Nov 05 15:01:46.443475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e27a41-8874-4cd5-b3c1-a999b0265bf8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb607689-24e3-4ce8-8326-4d14fe4fca61,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:46.467279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47708) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:46.813346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:47.055695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port 3f061e06-dbc9-4be0-a976-c15173876c2b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:01:47.056051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:47.141110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port 3f061e06-dbc9-4be0-a976-c15173876c2b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3f061e06-dbc9-4be0-a976-c15173876c2b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:47.141468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:47.153852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for 3f061e06-dbc9-4be0-a976-c15173876c2b owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:01:47.656911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:47.687483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=3f061e06-dbc9-4be0-a976-c15173876c2b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:47.850107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.064435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Router 292293fb-bf6c-461b-817c-c7b24fc17b6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:01:48.174099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:01:48.180289 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-72addd71-514a-4f8c-b7d2-0266be69fb9c tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "PUT /v2.0/routers/292293fb-bf6c-461b-817c-c7b24fc17b6c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7108054 Nov 05 15:01:48.182568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47710) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:48.186074 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Sync routers for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:01:48.195538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:48.196130 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:48.232958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting subnet cb2c37c3-6354-4283-a067-26bf566a5b44 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:01:48.236047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.275313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.298881 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:48.341942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.363621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.425754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.452540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Subnet': ['ID=cb2c37c3-6354-4283-a067-26bf566a5b44,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:48.456186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.459845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-57316260-2d56-4e95-8d94-fb8966437709 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/subnets/cb2c37c3-6354-4283-a067-26bf566a5b44 HTTP/1.1" status: 204 len: 168 time: 0.2763398 Nov 05 15:01:48.463885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:48.467106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfc22919-171f-44e3-a1ca-55ed2a4fbac5 None None] Network f6c647b9-a042-41ec-b272-6b1be5a566b2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:01:48.492292 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:47Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:48.524102 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Checking router: 292293fb-bf6c-461b-817c-c7b24fc17b6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:01:48.533604 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Routers {'292293fb-bf6c-461b-817c-c7b24fc17b6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:01:48.534002 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:01:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['292293fb-bf6c-461b-817c-c7b24fc17b6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:48.572370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.658242 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] Set router 292293fb-bf6c-461b-817c-c7b24fc17b6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:01:48.663218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] DHCP port deletion for f6c647b9-a042-41ec-b272-6b1be5a566b2 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:01:48.710615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Deleting port 901d91d2-f136-4b0b-bd4d-33f01de9a63b {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:01:48.711130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.716112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.771075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Deleting port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:01:48.771618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.785229 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] For port 901d91d2-f136-4b0b-bd4d-33f01de9a63b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=901d91d2-f136-4b0b-bd4d-33f01de9a63b,segment=NetworkSegment(183903ea-b3d2-4801-b0fd-054505f6ecb4),segment_id=183903ea-b3d2-4801-b0fd-054505f6ecb4)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:48.785632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.797901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Calling delete_port for 901d91d2-f136-4b0b-bd4d-33f01de9a63b owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:01:48.839879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 7828a340-2e7e-4136-8d2b-10ff20366fd4 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:48.847285 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:47Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:48.858077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] For port b6e5b79f-14e9-4c02-aae2-277cf1c7baf2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:01:48.858495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.861147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 7828a340-2e7e-4136-8d2b-10ff20366fd4 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:01:48.861495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 7828a340-2e7e-4136-8d2b-10ff20366fd4 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:01:48.871726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Calling delete_port for b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:01:48.878725 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ab200d-401e-42ee-9320-8b8bf68509ee None None] The sync data for ids ['292293fb-bf6c-461b-817c-c7b24fc17b6c'] in dv-neutron-816850-1-hyperv is: [{'id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'name': 'tempest-TestNetworkBasicOps-router-1274795247', 'tenant_id': '2691099d79834234a0e6e846d81eed9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3'}], 'enable_snat': True}, 'gw_port_id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:00:47Z', 'updated_at': '2021-11-05T15:01:47Z', 'revision_number': 7, 'project_id': '2691099d79834234a0e6e846d81eed9c', 'gw_port': {'id': 'b6e5b79f-14e9-4c02-aae2-277cf1c7baf2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:5e:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '292293fb-bf6c-461b-817c-c7b24fc17b6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1478, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.3', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:00:48Z', 'updated_at': '2021-11-05T15:01:42Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:01:48.900226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:48.930316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Pushing event deleted for resources: {'Port': ['ID=901d91d2-f136-4b0b-bd4d-33f01de9a63b,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:48.934688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] No DVR routers for this DVR port 901d91d2-f136-4b0b-bd4d-33f01de9a63b on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:01:48.941466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.941822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.942166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.942496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.942829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.943160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.943491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.943841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.944152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.944534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.945775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:48.945775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f076c57-7074-4c63-a4b5-a0b43f688c80 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.051467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.075991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Port': ['ID=b6e5b79f-14e9-4c02-aae2-277cf1c7baf2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:49.136585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.229946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.232113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.277006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.277598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Fanout notify agent at l3_agent the message router_deleted on router 292293fb-bf6c-461b-817c-c7b24fc17b6c {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:01:49.284577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.285799 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ebcead43-7c93-4926-8d1e-457ef4bf1c59 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/routers/292293fb-bf6c-461b-817c-c7b24fc17b6c HTTP/1.1" status: 204 len: 168 time: 0.8208342 Nov 05 15:01:49.288626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47714) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:49.370893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.460314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.482027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6c647b9-a042-41ec-b272-6b1be5a566b2']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:49.491951 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '183903ea-b3d2-4801-b0fd-054505f6ecb4') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:49.492245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '183903ea-b3d2-4801-b0fd-054505f6ecb4') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:01:49.502702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.516115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.522179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Releasing vlan 601 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:01:49.522560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:01:49.525611 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:01:49.587913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.594994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:49.598149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] 10.222.0.30 "DELETE /v2.0/networks/f6c647b9-a042-41ec-b272-6b1be5a566b2 HTTP/1.1" status: 204 len: 168 time: 0.3083816 Nov 05 15:01:49.610169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Pushing event deleted for resources: {'Network': ['ID=f6c647b9-a042-41ec-b272-6b1be5a566b2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:49.621193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.626078 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5873d5f1-bf25-4f98-8327-be7a4a58dff8 tempest-TestNetworkBasicOps-722737895 tempest-TestNetworkBasicOps-722737895-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:01:49.873428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47720) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:49.919655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:49.942356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 3f061e06-dbc9-4be0-a976-c15173876c2b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:01:49.942692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3f061e06-dbc9-4be0-a976-c15173876c2b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:01:49.943158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 901d91d2-f136-4b0b-bd4d-33f01de9a63b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:49.961511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 901d91d2-f136-4b0b-bd4d-33f01de9a63b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:01:49.961845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 901d91d2-f136-4b0b-bd4d-33f01de9a63b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:01:49.962253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:01:49.982788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:01:49.983129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b6e5b79f-14e9-4c02-aae2-277cf1c7baf2 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:01:50.014675 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c11912c7-a63f-4a98-807f-4d209436d27e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2691099d79834234a0e6e846d81eed9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1400025 Nov 05 15:01:50.017546 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47724) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:50.064444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.072788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c8c01dec-7e45-4942-9adc-80a71cc37651 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.085880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.130665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.133394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.134536 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c875a63f-b449-4c0d-8012-d0bacbd6e9ea HTTP/1.1" status: 204 len: 168 time: 0.1161096 Nov 05 15:01:50.142654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9618adbe-6cda-4579-994a-8ff836fd79bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c875a63f-b449-4c0d-8012-d0bacbd6e9ea,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:50.407201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47730) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:50.420115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1e860d3-c2b8-49fc-9dd2-d2d3dbd6dfd9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.496417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1e860d3-c2b8-49fc-9dd2-d2d3dbd6dfd9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.505337 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b1e860d3-c2b8-49fc-9dd2-d2d3dbd6dfd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.544619 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b1e860d3-c2b8-49fc-9dd2-d2d3dbd6dfd9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fa7bb0d22ef648679b9ac31002b85dab&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1363292 Nov 05 15:01:50.545769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e860d3-c2b8-49fc-9dd2-d2d3dbd6dfd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86adb412-41a6-42df-bd7a-06f31e12d4cf,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:50.547331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47732) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:01:50.597179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.617169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.671124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.673640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:50.674845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/86adb412-41a6-42df-bd7a-06f31e12d4cf HTTP/1.1" status: 204 len: 168 time: 0.1259434 Nov 05 15:01:50.683761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e11390-3ab0-4415-a330-684dae94d65e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86adb412-41a6-42df-bd7a-06f31e12d4cf,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:51.539050 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:01:52.409683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f5fb9f83-c1b9-45b3-b188-3ed006a9b735 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:53.432930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:54.900162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:55.921604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:57.172355 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-dcb4693d-fa92-436b-9ec0-3b45c0b4ceae tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/networks?tenant_id=2056ce98263d4810bc2c78986a1f5002&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0295248 Nov 05 15:01:57.349587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-206211ed-9065-42cd-9931-8c56a0c02775 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:57.350988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-206211ed-9065-42cd-9931-8c56a0c02775 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1734092 Nov 05 15:01:57.366417 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-c7e25c76-5aca-4066-abe7-bb420a91c79b tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/quotas/2056ce98263d4810bc2c78986a1f5002 HTTP/1.1" status: 200 len: 375 time: 0.0088449 Nov 05 15:01:57.700716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-9f3e71b2-d885-4d26-808d-b4a0061873f6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2056ce98263d4810bc2c78986a1f5002&fields=id HTTP/1.1" status: 200 len: 210 time: 0.3290870 Nov 05 15:01:57.856792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fe36e863-5a76-49f8-8ace-14095cfae622 req-4a88b062-0684-43ad-98c9-26a60852ee4f tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 210 time: 0.0300066 Nov 05 15:01:58.647390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-69239c05-081e-4da7-b2c7-7657c3ae681d tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.32 "GET /v2.0/networks?tenant_id=2056ce98263d4810bc2c78986a1f5002&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0280800 Nov 05 15:01:58.830321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-851170aa-ce68-4a58-9425-3b8ca52951e8 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:58.831760 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-851170aa-ce68-4a58-9425-3b8ca52951e8 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1777213 Nov 05 15:01:58.845473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Request body: {'port': {'device_id': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843', 'admin_state_up': True, 'tenant_id': '2056ce98263d4810bc2c78986a1f5002'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:01:58.949315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a20f5fdb-2f0f-4aa4-862d-b481f63a11aa req-04272ffa-03f3-4543-a43c-679847fcfe5a tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 210 time: 0.0266709 Nov 05 15:01:58.955230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Made reservation on behalf of 2056ce98263d4810bc2c78986a1f5002 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:01:58.958868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:58.967939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.039093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.042650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.099500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4a9ee92-d388-4973-965d-f53b5656ea21,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:59.173430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Allocated IP 192.168.233.157 (a7ba848b-6b37-4af7-8857-f74b4bca9843/4a2bd17f-d985-49b9-ad2c-a812da33c55e/8b7e2a8b-760c-449b-b251-998655d06c16) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:01:59.315875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.347177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.391688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Network a7ba848b-6b37-4af7-8857-f74b4bca9843 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:01:59.396574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:01:59.400262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:01:59.423387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Pushing event updated for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:59.452824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:01:59.453444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.470104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-16367cff-ab01-4479-8c2a-2f2f59c87076 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6280496 Nov 05 15:01:59.486722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Request body: {'port': {'device_id': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:01:59.545664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.584413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5f192ed3-dff3-4c3d-9ae0-586a07bcff55 None None] Provisioning complete for port 8b7e2a8b-760c-449b-b251-998655d06c16 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:01:59.584905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f192ed3-dff3-4c3d-9ae0-586a07bcff55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.618460 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5f192ed3-dff3-4c3d-9ae0-586a07bcff55 None None] Port 8b7e2a8b-760c-449b-b251-998655d06c16 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:01:59.798783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8b7e2a8b-760c-449b-b251-998655d06c16 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:01:59.806649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.818313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Transition to ACTIVE for port object 8b7e2a8b-760c-449b-b251-998655d06c16 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:01:59.822272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:01:59.887634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Pushing event updated for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:01:59.943499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Attempting to bind port 8b7e2a8b-760c-449b-b251-998655d06c16 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:01:59.943831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Attempting to bind port 8b7e2a8b-760c-449b-b251-998655d06c16 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:01:59.944159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Attempting to bind port 8b7e2a8b-760c-449b-b251-998655d06c16 on network a7ba848b-6b37-4af7-8857-f74b4bca9843 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:01:59.949406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Port 8b7e2a8b-760c-449b-b251-998655d06c16 on network a7ba848b-6b37-4af7-8857-f74b4bca9843 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:01:59.949727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Attempting to bind port 8b7e2a8b-760c-449b-b251-998655d06c16 on network a7ba848b-6b37-4af7-8857-f74b4bca9843 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:01:59.954775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 1, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:01:59.955121 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Checking segment: {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:01:59.955503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Bound using segment: {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:01:59.956077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Bound port: 8b7e2a8b-760c-449b-b251-998655d06c16, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '89c45c70-abda-41a2-a005-38b20dc5309a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:01:59.956278 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:00.025081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:02:00.059287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b7e2a8b-760c-449b-b251-998655d06c16,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:02:00.064500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:00.104469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.105081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:00.106446 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] 10.222.0.32 "PUT /v2.0/ports/8b7e2a8b-760c-449b-b251-998655d06c16 HTTP/1.1" status: 200 len: 1098 time: 0.6241529 Nov 05 15:02:00.108546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:00.110757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-711b11eb-d9f7-47ae-89f7-0bd7180a8758" -d '{"events": [{"name": "network-changed", "server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:00.123608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88ff278-23c9-489d-8da0-054cf2c2780d req-2084989d-4bb5-4d67-ade4-cfdc7c900b20 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.125368 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b88ff278-23c9-489d-8da0-054cf2c2780d req-2084989d-4bb5-4d67-ade4-cfdc7c900b20 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 948 time: 0.1032350 Nov 05 15:02:00.155494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7b5ebfd-a65f-4f81-b984-83a2ce5fd4fc x-openstack-request-id: req-f7b5ebfd-a65f-4f81-b984-83a2ce5fd4fc {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:00.155839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:00.156089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f7b5ebfd-a65f-4f81-b984-83a2ce5fd4fc {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:00.156504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16', 'status': 'completed', 'code': 200} Nov 05 15:02:00.190396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fc8133-b6d7-4bea-b6e0-a7add5dfcf58 service neutron] Pushing event updated for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:00.225883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b88ff278-23c9-489d-8da0-054cf2c2780d req-374b2130-8879-4cb2-989e-e397be89b067 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927641 Nov 05 15:02:00.231859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-4e877bc7-2f4c-4c24-95dc-341bc4949eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.233411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-4e877bc7-2f4c-4c24-95dc-341bc4949eb0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2056ce98263d4810bc2c78986a1f5002&device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 1101 time: 0.0716121 Nov 05 15:02:00.277196 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-95d552e1-5213-4447-bfcc-5b64b3134732 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.157&port_id=8b7e2a8b-760c-449b-b251-998655d06c16 HTTP/1.1" status: 200 len: 217 time: 0.0359342 Nov 05 15:02:00.329719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-2e4f7baa-beff-4e2c-8a15-b87a77ab544c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.331153 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-2e4f7baa-beff-4e2c-8a15-b87a77ab544c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4a2bd17f-d985-49b9-ad2c-a812da33c55e HTTP/1.1" status: 200 len: 843 time: 0.0476930 Nov 05 15:02:00.375717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-0e3d8722-39ac-497e-a1f5-b0d96f9368bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.377238 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-0e3d8722-39ac-497e-a1f5-b0d96f9368bb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a7ba848b-6b37-4af7-8857-f74b4bca9843&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1180 time: 0.0386615 Nov 05 15:02:00.463685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-41cf4dec-52d2-40ac-8c87-677fa837440c service neutron] 10.222.0.32 "GET /v2.0/networks/a7ba848b-6b37-4af7-8857-f74b4bca9843?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0777102 Nov 05 15:02:00.553393 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-65eafc1c-7a47-4c71-b602-dc6135513bfd req-2d8a3152-4b89-40cc-85f7-0242a7b3d01c service neutron] 10.222.0.32 "GET /v2.0/networks/a7ba848b-6b37-4af7-8857-f74b4bca9843?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823679 Nov 05 15:02:00.640306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-62663aff-a657-46fb-b238-b4f0ab24e24f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.641713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-62663aff-a657-46fb-b238-b4f0ab24e24f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2056ce98263d4810bc2c78986a1f5002&device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 1101 time: 0.0398543 Nov 05 15:02:00.732660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-e393c803-c6f4-472c-9f46-9f0c0f2aec94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.734079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-e393c803-c6f4-472c-9f46-9f0c0f2aec94 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a7ba848b-6b37-4af7-8857-f74b4bca9843 HTTP/1.1" status: 200 len: 870 time: 0.0844874 Nov 05 15:02:00.774358 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-af30d9a1-8986-4bc7-bc63-e67e786df768 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.157&port_id=8b7e2a8b-760c-449b-b251-998655d06c16 HTTP/1.1" status: 200 len: 217 time: 0.0327063 Nov 05 15:02:00.820804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-ac66f612-0c34-49f9-af15-6adee9dc1c43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.822174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-ac66f612-0c34-49f9-af15-6adee9dc1c43 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4a2bd17f-d985-49b9-ad2c-a812da33c55e HTTP/1.1" status: 200 len: 843 time: 0.0409513 Nov 05 15:02:00.868247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-9968567a-4b34-4a58-b5d8-7121a8290cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:00.870300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-9968567a-4b34-4a58-b5d8-7121a8290cb6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a7ba848b-6b37-4af7-8857-f74b4bca9843&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1180 time: 0.0407534 Nov 05 15:02:00.955299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-5b7314a0-47c1-4929-a76b-0677ed51b5ca service neutron] 10.222.0.32 "GET /v2.0/networks/a7ba848b-6b37-4af7-8857-f74b4bca9843?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0773337 Nov 05 15:02:01.046935 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-711b11eb-d9f7-47ae-89f7-0bd7180a8758 req-dbc0a1fd-a81e-4451-99a0-ca9c91d8371e service neutron] 10.222.0.32 "GET /v2.0/networks/a7ba848b-6b37-4af7-8857-f74b4bca9843?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828874 Nov 05 15:02:01.346631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11cd3115-5664-44e7-952e-b736f16870a4 req-25d5db6b-a2f1-4ed6-b5dd-7bdb0f640ef8 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:01.348187 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11cd3115-5664-44e7-952e-b736f16870a4 req-25d5db6b-a2f1-4ed6-b5dd-7bdb0f640ef8 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 948 time: 0.0533020 Nov 05 15:02:01.398419 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-11cd3115-5664-44e7-952e-b736f16870a4 req-65bea8fb-750b-4025-9b24-437b82ec6f17 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432825 Nov 05 15:02:02.512206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55416ccd-adf8-488e-bd49-1a622e00857a req-4dc95209-0794-4474-b0c1-06e25a8bd1a7 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:02.513713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55416ccd-adf8-488e-bd49-1a622e00857a req-4dc95209-0794-4474-b0c1-06e25a8bd1a7 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 948 time: 0.0497417 Nov 05 15:02:02.559561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55416ccd-adf8-488e-bd49-1a622e00857a req-da2213f2-418a-4168-b6e8-9983ce0db811 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399041 Nov 05 15:02:02.888703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b7e2a8b-760c-449b-b251-998655d06c16 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:02:02.980244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b7e2a8b-760c-449b-b251-998655d06c16,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:02.991905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8b7e2a8b-760c-449b-b251-998655d06c16', 'network_id': 'a7ba848b-6b37-4af7-8857-f74b4bca9843', 'port_id': '8b7e2a8b-760c-449b-b251-998655d06c16', 'mac_address': 'fa:16:3e:c4:e8:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 622, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4a2bd17f-d985-49b9-ad2c-a812da33c55e', 'ip_address': '192.168.233.157'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:02:03.032877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:03.045393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8b7e2a8b-760c-449b-b251-998655d06c16 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:02:03.064129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b7e2a8b-760c-449b-b251-998655d06c16,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:03.067638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:03.112434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:03.278318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8b7e2a8b-760c-449b-b251-998655d06c16'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:02:03.674496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2fb4594-a334-4d07-87ab-875425743f74 req-fe9e66c3-89bc-43c8-aa19-43b5e19b0319 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:03.675938 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2fb4594-a334-4d07-87ab-875425743f74 req-fe9e66c3-89bc-43c8-aa19-43b5e19b0319 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 949 time: 0.0507979 Nov 05 15:02:03.724434 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2fb4594-a334-4d07-87ab-875425743f74 req-ce04cb85-ab7b-4901-85dd-29e407fc95b8 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420282 Nov 05 15:02:04.835456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98a03fa-7873-4cbe-8948-378ea3bce9b5 req-77634f6d-f4fc-4c37-914d-c5fe9a1f35e2 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:04.836906 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c98a03fa-7873-4cbe-8948-378ea3bce9b5 req-77634f6d-f4fc-4c37-914d-c5fe9a1f35e2 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 949 time: 0.0473819 Nov 05 15:02:04.881972 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c98a03fa-7873-4cbe-8948-378ea3bce9b5 req-c80f7275-d02b-4daf-a54f-cc81f575ec41 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391939 Nov 05 15:02:04.891141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b7e2a8b-760c-449b-b251-998655d06c16 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:02:04.938263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 8b7e2a8b-760c-449b-b251-998655d06c16 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:02:04.947821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8b7e2a8b-760c-449b-b251-998655d06c16 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:02:04.948187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:05.030384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:05.054283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:05.057040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87d12b15-c715-4ae5-8880-764f83f916d1" -d '{"events": [{"server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "name": "network-vif-plugged", "status": "completed", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:05.069942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b7e2a8b-760c-449b-b251-998655d06c16,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:05.074605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:05.120109 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:05.148275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac0802ef-a88e-47d8-9f81-d4946a65dfee x-openstack-request-id: req-ac0802ef-a88e-47d8-9f81-d4946a65dfee {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:05.148671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "name": "network-vif-plugged", "status": "completed", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:05.148992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ac0802ef-a88e-47d8-9f81-d4946a65dfee {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:05.149396 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16', 'code': 200} Nov 05 15:02:05.308149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ca167e-d3ee-4cf5-8a49-f6d7ea649aae req-be9cc3aa-3800-494d-b3e9-75e3db0a0f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:05.309533 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75ca167e-d3ee-4cf5-8a49-f6d7ea649aae req-be9cc3aa-3800-494d-b3e9-75e3db0a0f05 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 1103 time: 0.0429566 Nov 05 15:02:05.354440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-75ca167e-d3ee-4cf5-8a49-f6d7ea649aae req-d22e67fa-9a5e-477d-8552-1bcbd78d1063 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378821 Nov 05 15:02:05.996595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e585a61-fb2a-4391-9a64-f2097deb1c8e req-c8424805-7d21-4419-a0d9-8974ad671018 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:05.998070 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e585a61-fb2a-4391-9a64-f2097deb1c8e req-c8424805-7d21-4419-a0d9-8974ad671018 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 950 time: 0.0498002 Nov 05 15:02:06.044033 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e585a61-fb2a-4391-9a64-f2097deb1c8e req-347089e2-9e3f-4075-b8ed-5c0b1cec469b tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400865 Nov 05 15:02:07.157853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff955a9-f082-45d3-9b70-72c25847134e req-445d01db-0af9-4c3e-9b8a-1e131e1264c0 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:07.159311 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9ff955a9-f082-45d3-9b70-72c25847134e req-445d01db-0af9-4c3e-9b8a-1e131e1264c0 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 950 time: 0.0476551 Nov 05 15:02:07.205079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9ff955a9-f082-45d3-9b70-72c25847134e req-860e1963-e026-4249-9932-00151b04dba5 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399106 Nov 05 15:02:07.574496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-28c32ba6-5e68-4d97-98e3-02418ce9aa54 req-bdc81029-ed6d-406b-a704-ab8f9defebea service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:02:07.575462 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28c32ba6-5e68-4d97-98e3-02418ce9aa54 req-bdc81029-ed6d-406b-a704-ab8f9defebea service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0950832 Nov 05 15:02:07.926448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-9beac138-ffff-4fb1-9f72-c8f17bc1ee28 req-bdad85c8-c4e1-4d8a-b4ba-0e6e7ed4bdc8 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:02:07.927471 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9beac138-ffff-4fb1-9f72-c8f17bc1ee28 req-bdad85c8-c4e1-4d8a-b4ba-0e6e7ed4bdc8 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055077 Nov 05 15:02:08.273842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-264ed3a4-3f52-472c-a515-8df67a1ae235 req-cae69f7f-898e-4ac2-91fb-7995157cdba7 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:08.275290 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-264ed3a4-3f52-472c-a515-8df67a1ae235 req-cae69f7f-898e-4ac2-91fb-7995157cdba7 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 950 time: 0.0481496 Nov 05 15:02:08.326240 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-264ed3a4-3f52-472c-a515-8df67a1ae235 req-96ea8cb2-ff6c-4e52-b185-1b10de34907c tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449147 Nov 05 15:02:09.443796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b087639-e1cf-4a33-bf5f-3f6b5d74338c req-472e3d00-5a83-48e7-8849-de39f984e4ee tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:09.445298 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4b087639-e1cf-4a33-bf5f-3f6b5d74338c req-472e3d00-5a83-48e7-8849-de39f984e4ee tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 950 time: 0.0514808 Nov 05 15:02:09.847444 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4b087639-e1cf-4a33-bf5f-3f6b5d74338c req-a0fe57ce-1173-44c1-a5e6-93b55ffefc31 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.30 "GET /v2.0/security-groups?id=b4a9ee92-d388-4973-965d-f53b5656ea21&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3954852 Nov 05 15:02:09.859924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-f3fc266c-daf2-4069-a720-0c08cd3859b5 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:09.861432 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-f3fc266c-daf2-4069-a720-0c08cd3859b5 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.32 "GET /v2.0/ports?device_id=16f6cd53-b179-4103-8c3c-cd1d0736e51a HTTP/1.1" status: 200 len: 950 time: 0.0675173 Nov 05 15:02:09.952170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Deleting port 8b7e2a8b-760c-449b-b251-998655d06c16 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:02:09.952527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:10.036228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] For port 8b7e2a8b-760c-449b-b251-998655d06c16, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8b7e2a8b-760c-449b-b251-998655d06c16,segment=NetworkSegment(89c45c70-abda-41a2-a005-38b20dc5309a),segment_id=89c45c70-abda-41a2-a005-38b20dc5309a)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:10.036637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:10.049364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Calling delete_port for 8b7e2a8b-760c-449b-b251-998655d06c16 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:02:10.173478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:10.186486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8b7e2a8b-760c-449b-b251-998655d06c16'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:02:10.201154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Pushing event deleted for resources: {'Port': ['ID=8b7e2a8b-760c-449b-b251-998655d06c16,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:10.240327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] No DVR routers for this DVR port 8b7e2a8b-760c-449b-b251-998655d06c16 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:02:10.242990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:10.246380 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8280999e-ad65-48b0-93d0-2d79e0001e7a req-92590389-7a61-4378-9312-5b4dac304ec6 tempest-ServersAdminNegativeTestJSON-849653568 tempest-ServersAdminNegativeTestJSON-849653568-project] 10.222.0.32 "DELETE /v2.0/ports/8b7e2a8b-760c-449b-b251-998655d06c16 HTTP/1.1" status: 204 len: 173 time: 0.3783684 Nov 05 15:02:10.246837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'name': 'network-vif-deleted', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:10.249127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd81861a-3bc9-4373-8445-f56c979c95ac" -d '{"events": [{"server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "name": "network-vif-deleted", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:10.361419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04422e3b-7d29-4efc-8152-d3ac03514dbb x-openstack-request-id: req-04422e3b-7d29-4efc-8152-d3ac03514dbb {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:10.361654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16f6cd53-b179-4103-8c3c-cd1d0736e51a", "name": "network-vif-deleted", "tag": "8b7e2a8b-760c-449b-b251-998655d06c16", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:10.361905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-04422e3b-7d29-4efc-8152-d3ac03514dbb {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:10.362308 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16f6cd53-b179-4103-8c3c-cd1d0736e51a', 'name': 'network-vif-deleted', 'tag': '8b7e2a8b-760c-449b-b251-998655d06c16', 'status': 'completed', 'code': 200} Nov 05 15:02:11.128843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47870) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:11.261993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2da25f42-8726-453e-a298-af1ef4d73ed7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2056ce98263d4810bc2c78986a1f5002&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1320608 Nov 05 15:02:11.264516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47874) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:11.309491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.329570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.376000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.378580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.379984 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b4a9ee92-d388-4973-965d-f53b5656ea21 HTTP/1.1" status: 204 len: 168 time: 0.1143022 Nov 05 15:02:11.387726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92668b6d-06c4-4518-8a76-94223daad555 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4a9ee92-d388-4973-965d-f53b5656ea21,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:11.634933 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47880) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:11.647789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dbbad17a-e86e-4b38-a391-cac790536c28 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.721319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dbbad17a-e86e-4b38-a391-cac790536c28 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.725160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dbbad17a-e86e-4b38-a391-cac790536c28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.761400 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dbbad17a-e86e-4b38-a391-cac790536c28 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7c55da59bfe544e381b6615d9466ccaa&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1253693 Nov 05 15:02:11.763295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbbad17a-e86e-4b38-a391-cac790536c28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8623670c-689b-409e-9722-2aa41009fb9b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:11.764142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47882) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:11.811856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.831704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.876835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.879307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:11.880435 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8623670c-689b-409e-9722-2aa41009fb9b HTTP/1.1" status: 204 len: 168 time: 0.1152589 Nov 05 15:02:11.888870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df86bb21-f683-4335-b482-6868f8e78633 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8623670c-689b-409e-9722-2aa41009fb9b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:12.564987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47904) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:12.657649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1683671608-network', 'tenant_id': '2747823920414ced8a6f8f596cd13b94'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:02:12.677622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Made reservation on behalf of 2747823920414ced8a6f8f596cd13b94 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:02:12.679859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.691945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.763860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.767630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.792015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:02:12.800700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81bc40d6-b39f-4846-b0fc-9fa468844d56,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:12.808133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.809059 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Added segment 419a9e44-e30c-41a0-a576-7632b6397016 of type vlan for network ace970c4-7b84-4fb8-8b58-e06587bd2b59 Nov 05 15:02:12.846023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.870017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.870932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:12.871492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:12.935870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b7e2a8b-760c-449b-b251-998655d06c16 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:02:12.954497 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3856273 Nov 05 15:02:12.954980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 47908) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:12.956443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 8b7e2a8b-760c-449b-b251-998655d06c16 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:02:12.956927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8b7e2a8b-760c-449b-b251-998655d06c16 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:02:12.959615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2492c7fa-c870-4bbb-916e-a6d813056496 admin admin] Pushing event updated for resources: {'Network': ['ID=ace970c4-7b84-4fb8-8b58-e06587bd2b59,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:12.962022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Request body: {'subnet': {'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1683671608-subnet', 'tenant_id': '2747823920414ced8a6f8f596cd13b94', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:02:12.969448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ace970c4-7b84-4fb8-8b58-e06587bd2b59 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:02:12.984037 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Made reservation on behalf of 2747823920414ced8a6f8f596cd13b94 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:02:12.986357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:13.149128 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:13.202846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3d89c6f-5e31-4ed9-8345-af0e0ea40173,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:13.211282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Checking segment: {'id': '419a9e44-e30c-41a0-a576-7632b6397016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:02:13.211639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Network hostable DHCP agents. Network: ace970c4-7b84-4fb8-8b58-e06587bd2b59, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:02:13.228658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Network ace970c4-7b84-4fb8-8b58-e06587bd2b59 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:02:13.237183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, ace970c4-7b84-4fb8-8b58-e06587bd2b59) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:02:13.241145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:13.241766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:13.246346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c70e2e6-f2a7-4c6e-b51b-08ce6fa59499 None None] Network ace970c4-7b84-4fb8-8b58-e06587bd2b59 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:02:13.260950 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-25dabd05-47d3-4279-826d-f105a18cd8f1 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.3047354 Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3c70e2e6-f2a7-4c6e-b51b-08ce6fa59499 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:02:13.319440 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:02:13.329060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-923bc58f-18c9-4adf-97ce-e758109fe91f None None] Network ace970c4-7b84-4fb8-8b58-e06587bd2b59 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-923bc58f-18c9-4adf-97ce-e758109fe91f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:02:13.397961 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:02:13.407452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10e0add8-6469-4280-8f91-2fada90c3364 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:02:13.471385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10e0add8-6469-4280-8f91-2fada90c3364 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:02:13.675498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe03f168-fd96-4bc1-932f-73458d0ddc28 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:02:13.693994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-61ac2b90-69a7-4b0e-80c4-6974ddae3b08 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:13.695477 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-61ac2b90-69a7-4b0e-80c4-6974ddae3b08 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 812 time: 0.1103332 Nov 05 15:02:13.710206 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-8464160a-a028-4de9-aac7-402b32d68b4e tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/quotas/2747823920414ced8a6f8f596cd13b94 HTTP/1.1" status: 200 len: 375 time: 0.0090294 Nov 05 15:02:13.737560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe03f168-fd96-4bc1-932f-73458d0ddc28 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:02:13.742002 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-ffe67be9-efce-4b4b-9a2a-adc2c5ed9645 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0264988 Nov 05 15:02:13.834128 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-8253ec89-dda9-4059-bfa5-fc846e37efda service neutron] 10.222.0.30 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845237 Nov 05 15:02:13.923257 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-ad7a487c-c6bc-4384-9d03-e1cc6efd1484 service neutron] 10.222.0.30 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823481 Nov 05 15:02:14.074969 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c4aad0ba-5f7b-479e-b8a3-514d3509cf92 req-bf75ebab-ebf7-4ac0-9af6-bc9d549f0a7c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 210 time: 0.0270505 Nov 05 15:02:14.962150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-420b5421-8662-41ad-8fc1-5dab78076352 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:14.964157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-420b5421-8662-41ad-8fc1-5dab78076352 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.32 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 812 time: 0.1039586 Nov 05 15:02:14.978112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Request body: {'port': {'device_id': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59', 'admin_state_up': True, 'tenant_id': '2747823920414ced8a6f8f596cd13b94'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:02:15.085176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Made reservation on behalf of 2747823920414ced8a6f8f596cd13b94 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:02:15.089397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.167106 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-093860cb-97b9-4414-a6c8-caa79748824f req-7ce0e2d6-775f-465e-bdeb-286f1f56d970 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 210 time: 0.0272763 Nov 05 15:02:15.217646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Allocated IP 172.20.0.10 (ace970c4-7b84-4fb8-8b58-e06587bd2b59/a3d89c6f-5e31-4ed9-8345-af0e0ea40173/11282d0a-72ea-4153-81f2-f025c0764e5d) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:02:15.358488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.390906 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.432109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Network ace970c4-7b84-4fb8-8b58-e06587bd2b59 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:02:15.441741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:02:15.446151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:02:15.450713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Pushing event updated for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:15.495022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:15.495548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.511877 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-9660fdf7-b400-471a-a4da-a4cd467ffcf2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5380971 Nov 05 15:02:15.523640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Request body: {'port': {'device_id': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:02:15.578159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.827836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 11282d0a-72ea-4153-81f2-f025c0764e5d {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:02:15.834855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.846253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Transition to ACTIVE for port object 11282d0a-72ea-4153-81f2-f025c0764e5d will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:02:15.849947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:15.903091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Pushing event updated for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:15.967103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Attempting to bind port 11282d0a-72ea-4153-81f2-f025c0764e5d on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:02:15.967431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Attempting to bind port 11282d0a-72ea-4153-81f2-f025c0764e5d by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '419a9e44-e30c-41a0-a576-7632b6397016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:02:15.967759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Attempting to bind port 11282d0a-72ea-4153-81f2-f025c0764e5d on network ace970c4-7b84-4fb8-8b58-e06587bd2b59 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:02:15.971969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Port 11282d0a-72ea-4153-81f2-f025c0764e5d on network ace970c4-7b84-4fb8-8b58-e06587bd2b59 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:02:15.972271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Attempting to bind port 11282d0a-72ea-4153-81f2-f025c0764e5d on network ace970c4-7b84-4fb8-8b58-e06587bd2b59 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:02:15.977044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 1, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:02:15.977377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Checking segment: {'id': '419a9e44-e30c-41a0-a576-7632b6397016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:02:15.977756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Bound using segment: {'id': '419a9e44-e30c-41a0-a576-7632b6397016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:02:15.978702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Bound port: 11282d0a-72ea-4153-81f2-f025c0764e5d, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '419a9e44-e30c-41a0-a576-7632b6397016', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:02:15.979050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:16.038921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:02:16.042419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=11282d0a-72ea-4153-81f2-f025c0764e5d,segment=NetworkSegment(419a9e44-e30c-41a0-a576-7632b6397016),segment_id=419a9e44-e30c-41a0-a576-7632b6397016)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:02:16.048038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:16.079776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.080394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:16.081777 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] 10.222.0.32 "PUT /v2.0/ports/11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 1094 time: 0.5620823 Nov 05 15:02:16.082208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:16.084421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60" -d '{"events": [{"name": "network-changed", "server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:16.112595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b439a9-f51c-4a10-a01f-5cbd027d7148 service neutron] Pushing event updated for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:16.126288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b76bf44a-975a-4215-bc35-218df72e4ad2 x-openstack-request-id: req-b76bf44a-975a-4215-bc35-218df72e4ad2 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:16.126579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:16.126943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b76bf44a-975a-4215-bc35-218df72e4ad2 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:16.127349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d', 'status': 'completed', 'code': 200} Nov 05 15:02:16.166954 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-8f4fc917-3559-420e-b42b-c7f4182ccacd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.168399 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-8f4fc917-3559-420e-b42b-c7f4182ccacd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1097 time: 0.0402820 Nov 05 15:02:16.212849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-cf0ba98b-2952-4319-ae11-76ae77abfeb6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 217 time: 0.0364909 Nov 05 15:02:16.262763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-2c114384-f9d7-4bc0-aebb-0ab0573ad4ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.264489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-2c114384-f9d7-4bc0-aebb-0ab0573ad4ea service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 200 len: 852 time: 0.0442648 Nov 05 15:02:16.285585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd4a9d3b-07b6-40d0-9bb3-c9e160372cf7 req-c3741670-f165-40f9-9625-101d79d5c91c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.287080 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dd4a9d3b-07b6-40d0-9bb3-c9e160372cf7 req-c3741670-f165-40f9-9625-101d79d5c91c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 944 time: 0.0528040 Nov 05 15:02:16.295861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-acbc4b71-acad-4786-97c4-84b242b07f4a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ace970c4-7b84-4fb8-8b58-e06587bd2b59&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246255 Nov 05 15:02:16.341100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dd4a9d3b-07b6-40d0-9bb3-c9e160372cf7 req-0632b919-4b8a-48e5-8ffe-fff00b5df8ba tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471427 Nov 05 15:02:16.391860 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-031e3e01-62d9-46dd-b636-70b659d1d46c service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891862 Nov 05 15:02:16.478805 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5ecf1164-b710-4e92-bc38-19069e6ba575 req-e3d58920-f28d-4e5a-9e1a-a15f03d5708e service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804391 Nov 05 15:02:16.563465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-62aec436-21ec-471e-a40f-f2ae15e6b6e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.564941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-62aec436-21ec-471e-a40f-f2ae15e6b6e3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1097 time: 0.0399497 Nov 05 15:02:16.659818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-53970941-f8fe-40da-9a32-174373468c79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.661399 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-53970941-f8fe-40da-9a32-174373468c79 service neutron] 10.222.0.32 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 913 time: 0.0876896 Nov 05 15:02:16.708212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-c0b210b9-a36e-4a5b-938e-a309b4868379 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 217 time: 0.0387661 Nov 05 15:02:16.762119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-07a7145e-e8a1-4d45-b10d-73ae0bd21231 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:16.763534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-07a7145e-e8a1-4d45-b10d-73ae0bd21231 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 200 len: 852 time: 0.0463326 Nov 05 15:02:16.795048 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-c706463a-e2cb-4e64-952b-a8b8033bac81 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ace970c4-7b84-4fb8-8b58-e06587bd2b59&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233328 Nov 05 15:02:16.880763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-602bef12-1064-4684-8c1e-85d4e526cdf4 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787284 Nov 05 15:02:16.978259 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64ae2aff-f2cf-4e8f-9e6c-47a0179cef60 req-427b9890-1abe-40ea-9160-f71337f63ecb service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898571 Nov 05 15:02:17.458830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb6c7cf-1b66-4b17-aab9-1d2baba55498 req-857112da-b50c-4d03-b55a-1a25131b0d6e tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:17.460294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffb6c7cf-1b66-4b17-aab9-1d2baba55498 req-857112da-b50c-4d03-b55a-1a25131b0d6e tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 944 time: 0.0503135 Nov 05 15:02:17.506936 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ffb6c7cf-1b66-4b17-aab9-1d2baba55498 req-437e8375-4edc-45d3-9bb1-173243b7d3f6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407069 Nov 05 15:02:18.351576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:18.623820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1396ec45-37d1-4fbb-b745-d8d1439b1261 req-f4be4411-1bf9-4b27-8739-76f1771826e4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:18.625222 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1396ec45-37d1-4fbb-b745-d8d1439b1261 req-f4be4411-1bf9-4b27-8739-76f1771826e4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 944 time: 0.0499883 Nov 05 15:02:18.671744 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1396ec45-37d1-4fbb-b745-d8d1439b1261 req-1ae1e06a-8eed-4dfe-bc5c-e9c87ae4025b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406587 Nov 05 15:02:18.951705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 11282d0a-72ea-4153-81f2-f025c0764e5d details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:02:19.045532 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=11282d0a-72ea-4153-81f2-f025c0764e5d,segment=NetworkSegment(419a9e44-e30c-41a0-a576-7632b6397016),segment_id=419a9e44-e30c-41a0-a576-7632b6397016)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:19.056386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '11282d0a-72ea-4153-81f2-f025c0764e5d', 'network_id': 'ace970c4-7b84-4fb8-8b58-e06587bd2b59', 'port_id': '11282d0a-72ea-4153-81f2-f025c0764e5d', 'mac_address': 'fa:16:3e:24:25:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 618, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a3d89c6f-5e31-4ed9-8345-af0e0ea40173', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:02:19.091980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:19.105050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 11282d0a-72ea-4153-81f2-f025c0764e5d {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:02:19.123528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=11282d0a-72ea-4153-81f2-f025c0764e5d,segment=NetworkSegment(419a9e44-e30c-41a0-a576-7632b6397016),segment_id=419a9e44-e30c-41a0-a576-7632b6397016)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:19.127580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:19.175952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:19.318373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['11282d0a-72ea-4153-81f2-f025c0764e5d'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:02:19.783960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71172e26-7f0e-4ec4-9609-91e29a664bb6 req-c7c23e3b-6486-4046-811f-889b72066dad tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:19.785433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-71172e26-7f0e-4ec4-9609-91e29a664bb6 req-c7c23e3b-6486-4046-811f-889b72066dad tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 945 time: 0.0475535 Nov 05 15:02:19.835337 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-71172e26-7f0e-4ec4-9609-91e29a664bb6 req-75e927bf-f59c-4a62-95e2-f70d7ce7329c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440574 Nov 05 15:02:20.076173 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-74cbceaa-dd31-44e1-b31e-1ba994744338 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:20.951613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41908521-ec6d-404b-98ae-3017852bd737 req-a708489e-06f4-40ee-82a1-8ea0a7580372 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:20.953152 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-41908521-ec6d-404b-98ae-3017852bd737 req-a708489e-06f4-40ee-82a1-8ea0a7580372 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 945 time: 0.0524774 Nov 05 15:02:20.964862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 11282d0a-72ea-4153-81f2-f025c0764e5d up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:02:21.003885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-41908521-ec6d-404b-98ae-3017852bd737 req-06ce4350-b83f-4795-a244-3fda6e144454 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443389 Nov 05 15:02:21.021150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 11282d0a-72ea-4153-81f2-f025c0764e5d completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:02:21.026143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 11282d0a-72ea-4153-81f2-f025c0764e5d triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:02:21.026512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:21.100911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:21.122994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:21.125149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13ec6fb7-e22c-4d60-8052-e9fd6a72ea16" -d '{"events": [{"server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "name": "network-vif-plugged", "status": "completed", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:21.137929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=11282d0a-72ea-4153-81f2-f025c0764e5d,segment=NetworkSegment(419a9e44-e30c-41a0-a576-7632b6397016),segment_id=419a9e44-e30c-41a0-a576-7632b6397016)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:21.142075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:21.172680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6172e792-8921-41ed-821d-3e829eaea4df x-openstack-request-id: req-6172e792-8921-41ed-821d-3e829eaea4df {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:21.172970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "name": "network-vif-plugged", "status": "completed", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:21.173477 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6172e792-8921-41ed-821d-3e829eaea4df {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:21.173867 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d', 'code': 200} Nov 05 15:02:21.200841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:21.333053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de36571-3f9e-49e0-9bf7-11a601570f35 req-407819b5-18fb-4ac5-9ac3-9b8473f52a4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:21.334696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7de36571-3f9e-49e0-9bf7-11a601570f35 req-407819b5-18fb-4ac5-9ac3-9b8473f52a4f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1099 time: 0.0472524 Nov 05 15:02:21.378644 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7de36571-3f9e-49e0-9bf7-11a601570f35 req-67516f85-b441-44f9-8dce-4e8fa1c1524c service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357764 Nov 05 15:02:22.118129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a445b56-2018-4f3f-856d-2b22a6ce9190 req-6a1a34e9-8e43-4dda-a257-130bd8d71bb1 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:22.119579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4a445b56-2018-4f3f-856d-2b22a6ce9190 req-6a1a34e9-8e43-4dda-a257-130bd8d71bb1 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0485024 Nov 05 15:02:22.165885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4a445b56-2018-4f3f-856d-2b22a6ce9190 req-da05f697-0cdb-4e0a-b508-6e4b43561e51 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399773 Nov 05 15:02:22.411476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2880e30d-98e0-4d04-9718-fabc3ee905a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:23.278605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3c7748-0277-4d35-87f4-55a108c12438 req-0921346a-9fdc-41ae-ae84-f1b5b2c26a6c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:23.280052 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c3c7748-0277-4d35-87f4-55a108c12438 req-0921346a-9fdc-41ae-ae84-f1b5b2c26a6c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0479133 Nov 05 15:02:23.326111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5c3c7748-0277-4d35-87f4-55a108c12438 req-b003e222-2494-46cc-894c-b06e6eceb307 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402439 Nov 05 15:02:23.435286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:23.652429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1166c9d6-46b5-46f7-986d-b5be322f0e6d req-57bfd1e3-bbb6-42b8-9a8a-2c1df25b7cbb tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:23.654113 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1166c9d6-46b5-46f7-986d-b5be322f0e6d req-57bfd1e3-bbb6-42b8-9a8a-2c1df25b7cbb tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0530992 Nov 05 15:02:23.658891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 47968) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:02:23.715412 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1166c9d6-46b5-46f7-986d-b5be322f0e6d req-e2108d3b-e235-4dc5-a329-5cb54e8ae221 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543978 Nov 05 15:02:23.745357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-0af19a9c-a374-4eeb-9df8-ecc315918065 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0854223 Nov 05 15:02:23.754052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-775ea9bf-2568-4df1-bbcf-2414bb203dd9 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:02:23.754979 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-775ea9bf-2568-4df1-bbcf-2414bb203dd9 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048232 Nov 05 15:02:24.831051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5876a2d6-4416-4af2-b639-55dc51ac2af7 req-142ccdfc-e23b-497c-8a4f-f3998b50ed17 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:24.832513 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5876a2d6-4416-4af2-b639-55dc51ac2af7 req-142ccdfc-e23b-497c-8a4f-f3998b50ed17 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0502121 Nov 05 15:02:24.885069 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5876a2d6-4416-4af2-b639-55dc51ac2af7 req-2fd5b95b-4dca-4fa8-af91-9d04290f9881 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459239 Nov 05 15:02:24.893987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-42513bb3-3551-41b9-96e5-5895d7ac8321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:24.896100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-42513bb3-3551-41b9-96e5-5895d7ac8321 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1099 time: 0.0473382 Nov 05 15:02:24.905165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:24.993222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-202e81d9-2406-421b-a811-473a6481447e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:24.994703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-202e81d9-2406-421b-a811-473a6481447e service neutron] 10.222.0.32 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 913 time: 0.0914695 Nov 05 15:02:25.035417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-da92514b-e392-4230-8352-ffbfe350bd7e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 217 time: 0.0341821 Nov 05 15:02:25.087013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-b90dcf12-626e-4ca9-980f-c7332f05c03f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:25.088369 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-b90dcf12-626e-4ca9-980f-c7332f05c03f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 200 len: 852 time: 0.0462437 Nov 05 15:02:25.118706 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-1478eae6-d257-4c7a-807a-0baa2b8a7afe service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ace970c4-7b84-4fb8-8b58-e06587bd2b59&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234764 Nov 05 15:02:25.205160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-70e5d37e-29b5-4aca-ac59-57e74a677bd0 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795414 Nov 05 15:02:25.298149 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-d0ae4936-1251-4c12-b6b4-078513bbca74 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860329 Nov 05 15:02:25.924017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:26.003553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11795bce-20d8-4301-9626-a121ee7c3dbf req-80510407-044f-43b7-9cb4-e0cf0be855ac tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:26.005051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11795bce-20d8-4301-9626-a121ee7c3dbf req-80510407-044f-43b7-9cb4-e0cf0be855ac tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0490844 Nov 05 15:02:26.051496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11795bce-20d8-4301-9626-a121ee7c3dbf req-5c54739e-41d6-42f6-b646-ee3770e57806 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403404 Nov 05 15:02:27.167720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f814858-ab65-43fc-97a9-63b9867dd77c req-b231769f-4783-4bfc-a18a-31da8fbc644b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:27.169218 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f814858-ab65-43fc-97a9-63b9867dd77c req-b231769f-4783-4bfc-a18a-31da8fbc644b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0488560 Nov 05 15:02:27.216357 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f814858-ab65-43fc-97a9-63b9867dd77c req-66e10d3a-634d-4182-8899-af59de1ea903 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413315 Nov 05 15:02:28.327712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff92bf55-80a6-4c9e-97cf-950a634cd5de req-89316803-f891-4ce6-87bb-53419ce787c2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:28.329201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff92bf55-80a6-4c9e-97cf-950a634cd5de req-89316803-f891-4ce6-87bb-53419ce787c2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0473645 Nov 05 15:02:28.378666 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff92bf55-80a6-4c9e-97cf-950a634cd5de req-bcc5698b-f404-4abc-96ca-a2b22dc394be tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436697 Nov 05 15:02:28.538258 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:02:29.491726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75658fa6-f294-4552-80b0-36c2b20dc5b4 req-cd9fc305-a513-4f01-b2b2-fcf299e066e9 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:29.493911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-75658fa6-f294-4552-80b0-36c2b20dc5b4 req-cd9fc305-a513-4f01-b2b2-fcf299e066e9 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0483301 Nov 05 15:02:29.543957 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-75658fa6-f294-4552-80b0-36c2b20dc5b4 req-97d4063a-fbcf-4e78-ae49-341fd671e6ec tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442770 Nov 05 15:02:30.656838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91bf99c6-6142-451e-a03d-d8ab8b8ff6d3 req-9e1a63c7-51b5-492c-9b82-c7db37462991 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:30.658328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91bf99c6-6142-451e-a03d-d8ab8b8ff6d3 req-9e1a63c7-51b5-492c-9b82-c7db37462991 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0480478 Nov 05 15:02:30.704466 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91bf99c6-6142-451e-a03d-d8ab8b8ff6d3 req-dedb8db5-9e7d-458f-929d-f278408cceef tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402675 Nov 05 15:02:31.822339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c771575a-114c-4622-8937-25f4ce1b6fba req-b6f783b5-432c-4dc9-abba-88c6bf51370c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:31.823709 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c771575a-114c-4622-8937-25f4ce1b6fba req-b6f783b5-432c-4dc9-abba-88c6bf51370c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0533736 Nov 05 15:02:31.870096 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c771575a-114c-4622-8937-25f4ce1b6fba req-a44cdd30-3bfd-46a7-b5be-ddfc6cf93f45 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406005 Nov 05 15:02:32.983350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d77ac0-2bac-4005-8e54-649d92acfdd7 req-2152674d-12d4-4afc-ae3c-64213b3574c4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:32.984836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6d77ac0-2bac-4005-8e54-649d92acfdd7 req-2152674d-12d4-4afc-ae3c-64213b3574c4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0480030 Nov 05 15:02:33.030455 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6d77ac0-2bac-4005-8e54-649d92acfdd7 req-392c2506-f568-49c7-829e-6be179e0b9b2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398865 Nov 05 15:02:34.144288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03c6e61-c1d7-414d-a4a0-3e67f0fec6d6 req-34b7d5ee-6b9a-4170-a216-d8f7437eb03c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:34.145770 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c03c6e61-c1d7-414d-a4a0-3e67f0fec6d6 req-34b7d5ee-6b9a-4170-a216-d8f7437eb03c tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0485220 Nov 05 15:02:34.193330 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c03c6e61-c1d7-414d-a4a0-3e67f0fec6d6 req-70469a9a-8249-4ef0-9139-cca7bc15f47e tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417345 Nov 05 15:02:35.312731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfabebd8-e047-41ba-8f8f-89851a630a1a req-4b9eb8fd-7087-4a85-a63b-fbf98c30ff25 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:35.314199 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dfabebd8-e047-41ba-8f8f-89851a630a1a req-4b9eb8fd-7087-4a85-a63b-fbf98c30ff25 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0517561 Nov 05 15:02:35.371564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dfabebd8-e047-41ba-8f8f-89851a630a1a req-32096c09-51a1-439e-9591-7be64a7225b1 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501239 Nov 05 15:02:36.486518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e45c444-feb8-4156-8134-372e46192314 req-f8190d23-b976-4a06-81fc-4454f38866d6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:36.488004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e45c444-feb8-4156-8134-372e46192314 req-f8190d23-b976-4a06-81fc-4454f38866d6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0482197 Nov 05 15:02:36.543006 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e45c444-feb8-4156-8134-372e46192314 req-b8a802f0-b9e2-4e06-9664-ed878f2507d5 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490515 Nov 05 15:02:37.667096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fe1f6a-ba8e-4347-b24a-1bdd7fd8d85e req-2fde7ffe-8373-4a43-af9c-232e400eee9d tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:37.668574 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f6fe1f6a-ba8e-4347-b24a-1bdd7fd8d85e req-2fde7ffe-8373-4a43-af9c-232e400eee9d tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0572438 Nov 05 15:02:37.713922 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f6fe1f6a-ba8e-4347-b24a-1bdd7fd8d85e req-b1db9c87-27ba-457d-9950-f64072b75bfb tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394385 Nov 05 15:02:38.826856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfdda899-bb32-4ec6-a174-b064fb7da43b req-b4bc316b-888f-465b-8d43-b26c389fa87d tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:38.828262 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfdda899-bb32-4ec6-a174-b064fb7da43b req-b4bc316b-888f-465b-8d43-b26c389fa87d tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0483725 Nov 05 15:02:38.874698 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dfdda899-bb32-4ec6-a174-b064fb7da43b req-006d7114-df7e-400e-979e-39e571788fc9 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406969 Nov 05 15:02:39.986688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d87595-0346-4b10-8d7e-f32e2a07c953 req-3000b5f2-4b29-4222-8a45-31a6f911dd9b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:39.988139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c7d87595-0346-4b10-8d7e-f32e2a07c953 req-3000b5f2-4b29-4222-8a45-31a6f911dd9b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0470827 Nov 05 15:02:40.040031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c7d87595-0346-4b10-8d7e-f32e2a07c953 req-05709527-ace5-4e88-a5d9-7ffc9a8a400e tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460227 Nov 05 15:02:41.154520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-759f0415-9946-4fb4-9414-c2447f883003 req-db3e5117-10c0-4798-b5ef-e1a43c9bd0ec tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:41.156003 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-759f0415-9946-4fb4-9414-c2447f883003 req-db3e5117-10c0-4798-b5ef-e1a43c9bd0ec tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0488837 Nov 05 15:02:41.202017 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-759f0415-9946-4fb4-9414-c2447f883003 req-b9d86fd2-96d0-47dd-80b3-a944742bc3ea tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401618 Nov 05 15:02:42.314478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29d13749-fe4d-42dd-b97e-e44b9e9c82ea req-a6e8470e-b35e-40a5-b7ae-494a91443fbd tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:42.316069 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29d13749-fe4d-42dd-b97e-e44b9e9c82ea req-a6e8470e-b35e-40a5-b7ae-494a91443fbd tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0478854 Nov 05 15:02:42.361833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29d13749-fe4d-42dd-b97e-e44b9e9c82ea req-7e043eb8-47ad-4978-9357-ccec4dd24f94 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399120 Nov 05 15:02:43.480008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cc6921-6b53-45db-99db-49a8ca35e611 req-b26f6ed2-fbf8-4664-b921-de5c2ba122a2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:43.481542 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f3cc6921-6b53-45db-99db-49a8ca35e611 req-b26f6ed2-fbf8-4664-b921-de5c2ba122a2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0528593 Nov 05 15:02:43.529730 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f3cc6921-6b53-45db-99db-49a8ca35e611 req-15bcbf7e-5deb-42b7-9788-4a5068b1ead0 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421357 Nov 05 15:02:44.641826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e0dfbab-9d9b-4a96-9123-c313b5966631 req-1f664769-5970-45b4-a5dc-438dc9825bce tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:44.643263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e0dfbab-9d9b-4a96-9123-c313b5966631 req-1f664769-5970-45b4-a5dc-438dc9825bce tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0469270 Nov 05 15:02:44.688703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e0dfbab-9d9b-4a96-9123-c313b5966631 req-763988dc-7b46-4d0b-87c2-7cb56707c44b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397198 Nov 05 15:02:45.800376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01f5a75-0ddf-4db9-9219-e787b275fdda req-1ed47662-1550-4159-ab5f-6feeb310ad68 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:45.801774 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f01f5a75-0ddf-4db9-9219-e787b275fdda req-1ed47662-1550-4159-ab5f-6feeb310ad68 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0482192 Nov 05 15:02:45.848090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f01f5a75-0ddf-4db9-9219-e787b275fdda req-6d2947f0-5d59-4312-8aad-f0cf586b6d32 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406020 Nov 05 15:02:46.967941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f95e545-38ce-4f34-b557-b3c53cad5b9d req-95c72073-6532-4cb7-b803-218413b40ea1 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:46.969471 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f95e545-38ce-4f34-b557-b3c53cad5b9d req-95c72073-6532-4cb7-b803-218413b40ea1 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0538633 Nov 05 15:02:47.014681 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f95e545-38ce-4f34-b557-b3c53cad5b9d req-59221e56-2850-4c72-be66-a8341ec51b2f tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394590 Nov 05 15:02:48.133645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102accfa-14de-4bb9-9688-46e0f64fffcc req-c7f2a888-e196-4bfb-a3ad-34bd69c3b6e6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:48.135176 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-102accfa-14de-4bb9-9688-46e0f64fffcc req-c7f2a888-e196-4bfb-a3ad-34bd69c3b6e6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0523069 Nov 05 15:02:48.181957 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-102accfa-14de-4bb9-9688-46e0f64fffcc req-275176fb-1b34-45fb-8d57-56fb19beba0d tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403824 Nov 05 15:02:48.354746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:49.293068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b21061d-a946-4080-9727-dc85f134a8f5 req-9d3f5842-1ca7-4e65-a627-6f7a32c5e83f tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:49.295144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b21061d-a946-4080-9727-dc85f134a8f5 req-9d3f5842-1ca7-4e65-a627-6f7a32c5e83f tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0483572 Nov 05 15:02:49.341518 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b21061d-a946-4080-9727-dc85f134a8f5 req-a0f6e6f4-56c8-4bed-8b7e-e4d893eb0e2b tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404797 Nov 05 15:02:50.080434 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1dea7ab8-a5f3-435e-b22e-ccbf9d520aab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:50.455396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3464abe8-e896-465f-a178-478159d579c7 req-85b8beab-e354-4182-ae4b-10959a12ad12 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:50.456844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3464abe8-e896-465f-a178-478159d579c7 req-85b8beab-e354-4182-ae4b-10959a12ad12 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0491118 Nov 05 15:02:50.505301 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3464abe8-e896-465f-a178-478159d579c7 req-ef1b1fde-ba40-425c-bf5c-ad60764f8122 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425372 Nov 05 15:02:51.625372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc6313e-019e-4cf6-8973-24b90f061238 req-65a3a3fe-4517-48c7-934f-1cbbc1c80dc7 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:51.626951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-efc6313e-019e-4cf6-8973-24b90f061238 req-65a3a3fe-4517-48c7-934f-1cbbc1c80dc7 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0548446 Nov 05 15:02:51.674809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-efc6313e-019e-4cf6-8973-24b90f061238 req-2c53e763-1fd5-4802-a2b9-932414e94b21 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417759 Nov 05 15:02:52.010068 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-7ac9f725-56a1-4ef9-a2ee-5ecd52f996b1 service neutron] 10.222.0.32 "GET /v2.0/ports/11282d0a-72ea-4153-81f2-f025c0764e5d/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0689998 Nov 05 15:02:52.258441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-e3f4d896-100f-4637-b6bb-fd6c6bb4ca1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:52.260429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-e3f4d896-100f-4637-b6bb-fd6c6bb4ca1a service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c&tenant_id=2747823920414ced8a6f8f596cd13b94 HTTP/1.1" status: 200 len: 1099 time: 0.0884852 Nov 05 15:02:52.328173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-047d5e3d-17a8-4c37-84cd-e6a002a3a1ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:52.329920 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-047d5e3d-17a8-4c37-84cd-e6a002a3a1ae service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1099 time: 0.0474877 Nov 05 15:02:52.415334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4b040fe1-246b-448e-ade9-1e37ea35c1da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:52.421626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-f197f073-a4c9-467f-9b79-91573c9306c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:52.423088 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-f197f073-a4c9-467f-9b79-91573c9306c3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 913 time: 0.0859904 Nov 05 15:02:52.464785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-a784bc3e-38ab-4bd9-b03b-88ae413de105 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 217 time: 0.0344090 Nov 05 15:02:52.518829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-2f5373c2-bd90-4956-adc6-232dbe237318 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:52.520226 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-2f5373c2-bd90-4956-adc6-232dbe237318 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 200 len: 852 time: 0.0491567 Nov 05 15:02:52.552207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-3af51364-3da4-4c03-bf88-ce861814ddf0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ace970c4-7b84-4fb8-8b58-e06587bd2b59&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244670 Nov 05 15:02:52.651870 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-bc116967-7535-40dd-afdd-db9514738f78 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929227 Nov 05 15:02:52.751906 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86bbb1e8-0e8c-4ba4-8e98-ec88a0fdc821 req-760ab9c7-f82d-436e-bf60-0406885a8c8b service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931592 Nov 05 15:02:52.788424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc671cd-485d-440a-9f55-6464b3b23b1e req-cc746224-be9e-49fa-94f0-cadde093b2fc tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:52.790019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bbc671cd-485d-440a-9f55-6464b3b23b1e req-cc746224-be9e-49fa-94f0-cadde093b2fc tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0492260 Nov 05 15:02:52.842463 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bbc671cd-485d-440a-9f55-6464b3b23b1e req-a367faf1-d342-4d8a-9064-d93c1cdca5e6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460250 Nov 05 15:02:53.437440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:53.957387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef4ab7b-e842-4afc-9de3-1bcf6bae325d req-2658a708-870f-4f95-9302-5daf68404bca tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:53.958862 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ef4ab7b-e842-4afc-9de3-1bcf6bae325d req-2658a708-870f-4f95-9302-5daf68404bca tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0492883 Nov 05 15:02:54.004363 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ef4ab7b-e842-4afc-9de3-1bcf6bae325d req-507ee96d-abc7-4ecb-be38-7df73ee0c6f0 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397484 Nov 05 15:02:54.903648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:55.116649 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb91472-5402-4c81-bd83-03e64b343a1e req-a3a32455-86a0-4c0c-b9f6-9932a915dd55 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:55.118087 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7eb91472-5402-4c81-bd83-03e64b343a1e req-a3a32455-86a0-4c0c-b9f6-9932a915dd55 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0474944 Nov 05 15:02:55.163927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7eb91472-5402-4c81-bd83-03e64b343a1e req-ac3f0bb2-43ab-4aae-84ed-c135a0395437 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393269 Nov 05 15:02:55.484280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-029eff9d-8336-4541-b41c-9c049523d3d4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:55.485725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-029eff9d-8336-4541-b41c-9c049523d3d4 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.32 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c&tenant_id=2747823920414ced8a6f8f596cd13b94&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 946 time: 0.0935769 Nov 05 15:02:55.593176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-32409e30-988c-4ff5-bc30-07a8cf091c04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:55.594670 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-32409e30-988c-4ff5-bc30-07a8cf091c04 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=2747823920414ced8a6f8f596cd13b94&device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 1099 time: 0.0416954 Nov 05 15:02:55.688262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-ca68512a-ed81-42a4-b5ee-54219e8eef4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:55.689803 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-ca68512a-ed81-42a4-b5ee-54219e8eef4a service neutron] 10.222.0.32 "GET /v2.0/networks?id=ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 200 len: 913 time: 0.0885394 Nov 05 15:02:55.736917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-32d584c7-33eb-484f-9ae8-b259d1124e71 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 200 len: 217 time: 0.0393507 Nov 05 15:02:55.784142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-00802b76-5dcc-478d-a1b4-319fe4f8fa2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:55.785631 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-00802b76-5dcc-478d-a1b4-319fe4f8fa2c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 200 len: 852 time: 0.0422378 Nov 05 15:02:55.816878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-bef681c3-dd82-48dc-9219-c27f1fd0988e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ace970c4-7b84-4fb8-8b58-e06587bd2b59&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235801 Nov 05 15:02:55.906831 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-9df8cfad-7572-4e22-960d-be6567c6dbc6 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832696 Nov 05 15:02:55.926678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:55.996917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-ecdd0f22-6b7b-4216-ba3d-99d0e1a46a96 service neutron] 10.222.0.32 "GET /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833089 Nov 05 15:02:56.690470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a7f33c-845f-4014-9060-25ba4310e1f6 req-d3e09496-9ed5-4292-a2e5-0e1b232685e7 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:56.691839 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-10a7f33c-845f-4014-9060-25ba4310e1f6 req-d3e09496-9ed5-4292-a2e5-0e1b232685e7 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0486860 Nov 05 15:02:56.737962 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-10a7f33c-845f-4014-9060-25ba4310e1f6 req-071afed4-62eb-4d90-81fb-883c2687692f tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402620 Nov 05 15:02:57.854071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c76434-c269-4ee6-a990-4ac5b0455fe7 req-edfe47f1-7536-4b59-b746-b8313b038c32 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:57.855549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e0c76434-c269-4ee6-a990-4ac5b0455fe7 req-edfe47f1-7536-4b59-b746-b8313b038c32 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0495334 Nov 05 15:02:57.906851 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e0c76434-c269-4ee6-a990-4ac5b0455fe7 req-99db9424-472a-4dff-b49d-5b3bd9fc14e6 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/security-groups?id=81bc40d6-b39f-4846-b0fc-9fa468844d56&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454550 Nov 05 15:02:58.309374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-e065508d-6a0c-476e-b7e4-f73e449d3ca2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:02:58.311081 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-e065508d-6a0c-476e-b7e4-f73e449d3ca2 tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.32 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 946 time: 0.0487919 Nov 05 15:02:58.396111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Deleting port 11282d0a-72ea-4153-81f2-f025c0764e5d {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:02:58.396443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:58.488759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] For port 11282d0a-72ea-4153-81f2-f025c0764e5d, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=11282d0a-72ea-4153-81f2-f025c0764e5d,segment=NetworkSegment(419a9e44-e30c-41a0-a576-7632b6397016),segment_id=419a9e44-e30c-41a0-a576-7632b6397016)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:02:58.489118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:58.502087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Calling delete_port for 11282d0a-72ea-4153-81f2-f025c0764e5d owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:02:58.639937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:58.653667 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['11282d0a-72ea-4153-81f2-f025c0764e5d'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:02:58.672498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Pushing event deleted for resources: {'Port': ['ID=11282d0a-72ea-4153-81f2-f025c0764e5d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:02:58.701430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.701775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.702110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.702446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.702775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.703530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.703530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.703736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.704030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.704347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.704686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.705002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:02:58.729818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] No DVR routers for this DVR port 11282d0a-72ea-4153-81f2-f025c0764e5d on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:02:58.732374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:02:58.736198 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9663cda-53cb-4c48-b315-727f08039eb4 req-43fc3803-1b74-40da-9058-c6096c41f6ff tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.32 "DELETE /v2.0/ports/11282d0a-72ea-4153-81f2-f025c0764e5d HTTP/1.1" status: 204 len: 173 time: 0.4193745 Nov 05 15:02:58.736665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'name': 'network-vif-deleted', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:02:58.739712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-774b283d-02cd-4958-99b3-4f9703c29a9a" -d '{"events": [{"server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "name": "network-vif-deleted", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:02:58.777347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:02:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71f3b40e-0fc7-4c99-af51-c9d3abf6f64c x-openstack-request-id: req-71f3b40e-0fc7-4c99-af51-c9d3abf6f64c {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:02:58.777643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c0048452-5948-44d2-9af4-3948e5e0dd6c", "name": "network-vif-deleted", "tag": "11282d0a-72ea-4153-81f2-f025c0764e5d", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:02:58.777899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-71f3b40e-0fc7-4c99-af51-c9d3abf6f64c {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:02:58.778309 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0048452-5948-44d2-9af4-3948e5e0dd6c', 'name': 'network-vif-deleted', 'tag': '11282d0a-72ea-4153-81f2-f025c0764e5d', 'status': 'completed', 'code': 200} Nov 05 15:02:59.008769 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aad856f1-ea83-439c-9717-5208a42a869e req-93b7c4f2-8b8e-4fd5-8ff1-7679ab8c966a tempest-DeleteServersTestJSON-1875738059 tempest-DeleteServersTestJSON-1875738059-project] 10.222.0.30 "GET /v2.0/ports?device_id=c0048452-5948-44d2-9af4-3948e5e0dd6c HTTP/1.1" status: 200 len: 210 time: 0.0256445 Nov 05 15:03:00.133751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48074) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:00.183271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Deleting subnet a3d89c6f-5e31-4ed9-8345-af0e0ea40173 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:03:00.186589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.219581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.256798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.306588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.331939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a3d89c6f-5e31-4ed9-8345-af0e0ea40173,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:00.336849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.340921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6c887456-02b2-4a3c-98e9-6005aa864a4c admin admin] 10.222.0.30 "DELETE /v2.0/subnets/a3d89c6f-5e31-4ed9-8345-af0e0ea40173 HTTP/1.1" status: 204 len: 168 time: 0.2061493 Nov 05 15:03:00.343383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48076) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:00.413568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.498553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.523489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ace970c4-7b84-4fb8-8b58-e06587bd2b59']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:03:00.540062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '419a9e44-e30c-41a0-a576-7632b6397016') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:03:00.540449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '419a9e44-e30c-41a0-a576-7632b6397016') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:03:00.555567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.575519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.581970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Releasing vlan 618 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:03:00.582371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:03:00.583974 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:03:00.636580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.641802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.644920 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] 10.222.0.30 "DELETE /v2.0/networks/ace970c4-7b84-4fb8-8b58-e06587bd2b59 HTTP/1.1" status: 204 len: 168 time: 0.3006303 Nov 05 15:03:00.656005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42786ba5-5895-4884-854c-fcfb50cff990 admin admin] Pushing event deleted for resources: {'Network': ['ID=ace970c4-7b84-4fb8-8b58-e06587bd2b59,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:00.750228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48080) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:00.793719 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-90321e54-c68c-4aae-b67f-6316a7608b34 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2747823920414ced8a6f8f596cd13b94&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0423384 Nov 05 15:03:00.796173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48082) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:00.842015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.862120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.906082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.908836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:00.909942 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/81bc40d6-b39f-4846-b0fc-9fa468844d56 HTTP/1.1" status: 204 len: 168 time: 0.1128531 Nov 05 15:03:00.917247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43bf49b6-dda7-4f35-bf09-218d316bc2e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81bc40d6-b39f-4846-b0fc-9fa468844d56,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:01.542855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48104) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:01.638667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-167304918-network', 'tenant_id': '76f7bbafc2d84fd5bffe13625b3e0ab0'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:01.661082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Made reservation on behalf of 76f7bbafc2d84fd5bffe13625b3e0ab0 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:03:01.663312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.671510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.745917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.749657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.770752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:03:01.783722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c0dc4e2-4017-4d31-ae82-26859e23426b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:01.789770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.790126 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Added segment 6f11f15a-725e-4a95-9453-824af715b913 of type vlan for network 78ee7829-f79d-422a-9d77-83226dafd6af Nov 05 15:03:01.832019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.856008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.857123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:01.857692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:01.912966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3687167 Nov 05 15:03:01.916137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48108) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:03:01.922550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Request body: {'subnet': {'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-167304918-subnet', 'tenant_id': '76f7bbafc2d84fd5bffe13625b3e0ab0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:01.926572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec252faf-195f-4c88-88d8-e6b3d5b55fb1 admin admin] Pushing event updated for resources: {'Network': ['ID=78ee7829-f79d-422a-9d77-83226dafd6af,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:01.937310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 78ee7829-f79d-422a-9d77-83226dafd6af details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:03:01.949202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Made reservation on behalf of 76f7bbafc2d84fd5bffe13625b3e0ab0 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:03:01.951520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:02.467003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:02.528937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4e8859b-6984-4cb0-97e5-254a052beeeb,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:02.539115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Checking segment: {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:03:02.539464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Network hostable DHCP agents. Network: 78ee7829-f79d-422a-9d77-83226dafd6af, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:03:02.560645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Network 78ee7829-f79d-422a-9d77-83226dafd6af is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:03:02.570042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 78ee7829-f79d-422a-9d77-83226dafd6af) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:03:02.575065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:02.576179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:02.579794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-731b24f6-82ca-4c51-943a-900057b94587 None None] Network 78ee7829-f79d-422a-9d77-83226dafd6af requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:03:02.593362 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-04b5efc2-f097-45b7-930b-fc01f347720d admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6762140 Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-731b24f6-82ca-4c51-943a-900057b94587 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:03:02.668739 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:03:02.677792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1ce30ee-30a8-4d0e-8860-f534bcaa9c27 None None] Network 78ee7829-f79d-422a-9d77-83226dafd6af requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d1ce30ee-30a8-4d0e-8860-f534bcaa9c27 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:03:02.746867 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:03:02.756420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae07ced5-2da0-42dc-a2df-925938d00256 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:03:02.820699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae07ced5-2da0-42dc-a2df-925938d00256 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:03:03.035219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b95a8801-c4fd-4196-8d73-65fe00c56bec None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:03:03.035809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-6242692b-9455-44ce-b4b7-ffb5450e0014 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:03.037243 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-6242692b-9455-44ce-b4b7-ffb5450e0014 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 814 time: 0.1052468 Nov 05 15:03:03.053105 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-02680dbe-4b49-403f-8132-673ea2d4871f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/quotas/76f7bbafc2d84fd5bffe13625b3e0ab0 HTTP/1.1" status: 200 len: 375 time: 0.0091844 Nov 05 15:03:03.096675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95a8801-c4fd-4196-8d73-65fe00c56bec None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:03:03.108808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-838f6680-032d-4074-a942-2e5c58df8d0f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0501711 Nov 05 15:03:03.147655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 11282d0a-72ea-4153-81f2-f025c0764e5d no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:03:03.175558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 11282d0a-72ea-4153-81f2-f025c0764e5d {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:03:03.175896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 11282d0a-72ea-4153-81f2-f025c0764e5d not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:03:03.201304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-af3862f6-065f-48a7-add4-32c44a185f4b service neutron] 10.222.0.30 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807629 Nov 05 15:03:03.292267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-47c1dcf7-6efe-47dd-bc58-c836944c7b7f service neutron] 10.222.0.30 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846121 Nov 05 15:03:03.449381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8b5684e1-93e8-44a3-ada3-72e4a18aed66 req-b2ed2497-a50f-45df-8dfb-55c53b25beb2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 210 time: 0.0307260 Nov 05 15:03:04.327309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-67fd1151-bb8c-4b7b-accf-21300c481f1e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:04.328789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-67fd1151-bb8c-4b7b-accf-21300c481f1e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 814 time: 0.1018941 Nov 05 15:03:04.342290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Request body: {'port': {'device_id': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'admin_state_up': True, 'tenant_id': '76f7bbafc2d84fd5bffe13625b3e0ab0'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:04.452652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Made reservation on behalf of 76f7bbafc2d84fd5bffe13625b3e0ab0 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:03:04.456142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:04.552574 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9c2f04ab-bfeb-44e4-807a-09ed2a429a16 req-69faa2c2-f09f-49a2-88aa-1426539c2189 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 210 time: 0.0328202 Nov 05 15:03:04.605672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Allocated IP 172.20.0.8 (78ee7829-f79d-422a-9d77-83226dafd6af/e4e8859b-6984-4cb0-97e5-254a052beeeb/1f7e1e63-64bd-4405-812a-f66d9122a2fd) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:03:04.742711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:04.774741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:04.818771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Network 78ee7829-f79d-422a-9d77-83226dafd6af is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:03:04.823632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:03:04.827299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:03:04.849789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:04.877394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:04.877989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:04.892986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-bacf89ed-b5ce-4dc0-a95d-668f07990484 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5548713 Nov 05 15:03:04.906082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Request body: {'port': {'device_id': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:04.956024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.211872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:05.219235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.231370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Transition to ACTIVE for port object 1f7e1e63-64bd-4405-812a-f66d9122a2fd will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:03:05.234936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.288327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:05.350830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Attempting to bind port 1f7e1e63-64bd-4405-812a-f66d9122a2fd on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:03:05.351506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Attempting to bind port 1f7e1e63-64bd-4405-812a-f66d9122a2fd by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:03:05.351506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Attempting to bind port 1f7e1e63-64bd-4405-812a-f66d9122a2fd on network 78ee7829-f79d-422a-9d77-83226dafd6af {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:03:05.355760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Port 1f7e1e63-64bd-4405-812a-f66d9122a2fd on network 78ee7829-f79d-422a-9d77-83226dafd6af not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:03:05.356082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Attempting to bind port 1f7e1e63-64bd-4405-812a-f66d9122a2fd on network 78ee7829-f79d-422a-9d77-83226dafd6af {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:03:05.360900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 2, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:03:05.361235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Checking segment: {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:03:05.361614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Bound using segment: {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:03:05.362032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Bound port: 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:03:05.362384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.426266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:03:05.429214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:03:05.434213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.466374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:05.467064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:05.468443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] 10.222.0.32 "PUT /v2.0/ports/1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 1093 time: 0.5662739 Nov 05 15:03:05.468912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:05.471157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8" -d '{"events": [{"name": "network-changed", "server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:05.505948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d20c5e-6bc8-45b0-8d0c-ce9b616b97a3 service neutron] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:05.510440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25da972a-0c57-41a4-8f81-3447ce0c63e2 x-openstack-request-id: req-25da972a-0c57-41a4-8f81-3447ce0c63e2 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:05.510734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:05.510988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-25da972a-0c57-41a4-8f81-3447ce0c63e2 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:05.511390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'status': 'completed', 'code': 200} Nov 05 15:03:05.537022 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:03:05.552395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-5117f37b-402d-463f-a4bf-b1a4250d3116 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:05.553922 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-5117f37b-402d-463f-a4bf-b1a4250d3116 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1096 time: 0.0411074 Nov 05 15:03:05.600121 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-9df6df41-238b-44f1-b153-bc48091e0900 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 217 time: 0.0373237 Nov 05 15:03:05.683832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-92884ffa-105d-4c40-a71d-6d911a6642b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:05.685602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-92884ffa-105d-4c40-a71d-6d911a6642b0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0772252 Nov 05 15:03:05.709248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a66300f0-dedb-4662-aff0-1e70d46b194f req-9e8c3711-4f31-46ec-9f54-ecda77e00910 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:05.710695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a66300f0-dedb-4662-aff0-1e70d46b194f req-9e8c3711-4f31-46ec-9f54-ecda77e00910 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0752676 Nov 05 15:03:05.727161 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-dee42455-2061-4dd5-8c19-f6fb9e986cbb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0340054 Nov 05 15:03:05.818249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a66300f0-dedb-4662-aff0-1e70d46b194f req-ff0c37a5-a99b-4652-930b-7783899a1033 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0939653 Nov 05 15:03:05.845522 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-6d248bec-1f1b-4eab-bee3-6cca1e4a9137 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1062913 Nov 05 15:03:05.933257 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d795493d-9c97-4c94-9adb-0e5c0625bd8a req-b9b11789-b79f-415e-8380-04faca6f21cd service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803969 Nov 05 15:03:06.019916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-d8fafea7-34d8-4286-9438-1bf73e33be86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:06.021346 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-d8fafea7-34d8-4286-9438-1bf73e33be86 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1096 time: 0.0454464 Nov 05 15:03:06.112597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-d667c120-ad5a-4a2b-b68c-1b0bbdb61160 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:06.114051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-d667c120-ad5a-4a2b-b68c-1b0bbdb61160 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0861118 Nov 05 15:03:06.160094 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-21329bfa-98d9-418b-a8f3-ea190cf564cf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 217 time: 0.0382531 Nov 05 15:03:06.209744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-95c65b26-9ef5-4106-ace1-b99b9191d5a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:06.211185 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-95c65b26-9ef5-4106-ace1-b99b9191d5a0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0422237 Nov 05 15:03:06.242811 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-6a6f2169-9ac7-4416-a71a-b45836ed5dba service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241857 Nov 05 15:03:06.331037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-0ac761dc-01c7-4b08-9330-3978d8c222da service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795829 Nov 05 15:03:06.422048 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e27c3605-da8a-4bf9-a7f9-d2c2e91f16c8 req-436fd629-c750-4f48-b323-5d976fbd0b93 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835907 Nov 05 15:03:06.931223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4664a6-9621-4fe0-a524-7753a26e26a5 req-b2e95425-b568-42ab-bedd-e7cc48751801 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:06.933204 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1b4664a6-9621-4fe0-a524-7753a26e26a5 req-b2e95425-b568-42ab-bedd-e7cc48751801 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0487127 Nov 05 15:03:06.979668 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1b4664a6-9621-4fe0-a524-7753a26e26a5 req-566cd11b-ebbb-4987-b5c4-1dc848c3feac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404406 Nov 05 15:03:08.093939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da564432-734f-4c2f-a7c9-bb185ed79b21 req-df363c00-ea5e-4146-b721-fd7778c9ac10 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:08.095437 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da564432-734f-4c2f-a7c9-bb185ed79b21 req-df363c00-ea5e-4146-b721-fd7778c9ac10 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0496106 Nov 05 15:03:08.143335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da564432-734f-4c2f-a7c9-bb185ed79b21 req-abc92b64-2ee0-45d4-b6be-64619e0ec9f4 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418086 Nov 05 15:03:09.140976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:03:09.236739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:09.248149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'port_id': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'mac_address': 'fa:16:3e:30:3d:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4e8859b-6984-4cb0-97e5-254a052beeeb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:03:09.257421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86b969a-3a24-4ad6-8e09-3adf03032c09 req-8236358b-6210-49d4-9f04-6dc5e2348c27 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:09.258908 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d86b969a-3a24-4ad6-8e09-3adf03032c09 req-8236358b-6210-49d4-9f04-6dc5e2348c27 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0498281 Nov 05 15:03:09.284166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:09.297455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:09.305645 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d86b969a-3a24-4ad6-8e09-3adf03032c09 req-7b63007e-5778-46b0-be72-64142981ef53 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408993 Nov 05 15:03:09.317111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:09.321507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:09.370263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:09.376940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.377284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.377619 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.377945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.378268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.378582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.378906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.379224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.379538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.379853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.380166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.380502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:09.535462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['1f7e1e63-64bd-4405-812a-f66d9122a2fd'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:03:10.430375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e172aa0-698d-4dc4-81fc-cd0e22c96a79 req-64a50f92-e811-43bb-b830-eb97f433cc10 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:10.431845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5e172aa0-698d-4dc4-81fc-cd0e22c96a79 req-64a50f92-e811-43bb-b830-eb97f433cc10 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 944 time: 0.0528791 Nov 05 15:03:10.478290 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5e172aa0-698d-4dc4-81fc-cd0e22c96a79 req-3a92fea1-bad4-4ee8-9132-afd068a47c0a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402904 Nov 05 15:03:11.139813 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:03:11.190274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 1f7e1e63-64bd-4405-812a-f66d9122a2fd completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:03:11.193857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 1f7e1e63-64bd-4405-812a-f66d9122a2fd triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:03:11.194215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:11.272772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:11.294857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:11.297099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fe07c05-225d-41d4-a579-d8d245eecf02" -d '{"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-plugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:11.309779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:11.313577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:11.339105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bceafd6c-879b-4f14-8202-ce94ccbb7c0f x-openstack-request-id: req-bceafd6c-879b-4f14-8202-ce94ccbb7c0f {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:11.339452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-plugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:11.339743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bceafd6c-879b-4f14-8202-ce94ccbb7c0f {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:11.340164 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'code': 200} Nov 05 15:03:11.365364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:11.498182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f067ca65-608a-4114-83f9-dc083a4e08c2 req-666e796f-7709-4cf8-befb-4b6b210b75f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:11.499704 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f067ca65-608a-4114-83f9-dc083a4e08c2 req-666e796f-7709-4cf8-befb-4b6b210b75f6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1098 time: 0.0403719 Nov 05 15:03:11.544527 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f067ca65-608a-4114-83f9-dc083a4e08c2 req-d53fe8d9-42e6-45a2-a7e9-127991f53d45 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377326 Nov 05 15:03:11.593365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5bdd44e-87b5-47fe-81cc-bcee3531d5ed req-e96332a5-7a9f-4533-b6e9-c782fdeef1fd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:11.594761 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c5bdd44e-87b5-47fe-81cc-bcee3531d5ed req-e96332a5-7a9f-4533-b6e9-c782fdeef1fd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0486035 Nov 05 15:03:11.644694 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c5bdd44e-87b5-47fe-81cc-bcee3531d5ed req-1ceff94f-1445-4c54-a12d-4489e674844c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440233 Nov 05 15:03:12.762583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cbb33d-1abb-4139-a559-d92cc8ba2ebc req-c4f53a09-0842-4553-a257-60e76b96876f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:12.763982 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74cbb33d-1abb-4139-a559-d92cc8ba2ebc req-c4f53a09-0842-4553-a257-60e76b96876f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0527482 Nov 05 15:03:12.810555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74cbb33d-1abb-4139-a559-d92cc8ba2ebc req-5f3f5da0-e6e9-439a-8fc9-ee15b536d28b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407212 Nov 05 15:03:12.921777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b24ab9-159d-4e61-b991-c818500fe320 req-2bdf18ed-cfc6-4921-9471-47951124fc6b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:12.923259 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4b24ab9-159d-4e61-b991-c818500fe320 req-2bdf18ed-cfc6-4921-9471-47951124fc6b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0484533 Nov 05 15:03:12.969210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4b24ab9-159d-4e61-b991-c818500fe320 req-716d8f0b-9841-4ce1-8a7e-82de8efc6597 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400887 Nov 05 15:03:13.167085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d81aae9-5653-4250-bb10-ab381aa95971 req-ec379b4a-0a73-4a9a-b2b5-695783480774 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:13.168579 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2d81aae9-5653-4250-bb10-ab381aa95971 req-ec379b4a-0a73-4a9a-b2b5-695783480774 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0481107 Nov 05 15:03:13.214087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2d81aae9-5653-4250-bb10-ab381aa95971 req-93df6a9e-bc2c-4db6-b327-d1402cd5fbfa tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397098 Nov 05 15:03:13.324041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9285499-7588-4268-ab06-2f1f496b788f req-2bea4204-dc3d-450e-9355-0d923ee848fa tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:13.325944 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9285499-7588-4268-ab06-2f1f496b788f req-2bea4204-dc3d-450e-9355-0d923ee848fa tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0487564 Nov 05 15:03:13.371612 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9285499-7588-4268-ab06-2f1f496b788f req-e7a81503-1fab-4dad-ae85-0c864df42364 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398960 Nov 05 15:03:13.682406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-1214bfe5-6317-4e21-89b0-2dad399a2041 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0436804 Nov 05 15:03:13.696767 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f49d6a4-e094-498e-95df-2a896bef8317 req-0c2763f2-ca08-46e2-ac36-7cbbe2997b67 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:13.698304 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8f49d6a4-e094-498e-95df-2a896bef8317 req-0c2763f2-ca08-46e2-ac36-7cbbe2997b67 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0523131 Nov 05 15:03:13.746006 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8f49d6a4-e094-498e-95df-2a896bef8317 req-e731fe67-d8b5-4f9a-89db-badf3745c506 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406723 Nov 05 15:03:14.776123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-0a37374d-7462-4e0a-9bc0-9557548390d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:14.777433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-0a37374d-7462-4e0a-9bc0-9557548390d6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1098 time: 0.0399270 Nov 05 15:03:14.900802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7bc30a-7b24-4a30-8a38-8870f28ac931 req-1509d488-1235-4b63-bdd0-20f6aaccc9fd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:14.902241 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7f7bc30a-7b24-4a30-8a38-8870f28ac931 req-1509d488-1235-4b63-bdd0-20f6aaccc9fd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0778470 Nov 05 15:03:14.907183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-168c6e12-a637-4440-90c5-3c83f7c4b7e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:14.908621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-168c6e12-a637-4440-90c5-3c83f7c4b7e0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.1242516 Nov 05 15:03:14.954988 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-18388eb7-67b7-4a06-b37b-281db0bf9fc3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 217 time: 0.0397062 Nov 05 15:03:15.009945 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7f7bc30a-7b24-4a30-8a38-8870f28ac931 req-6842f4a9-6bf6-4563-8c0e-0c3dbb16d573 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004081 Nov 05 15:03:15.022362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-2edbfaf6-dc04-4321-8312-86b1e321db32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:15.023851 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-2edbfaf6-dc04-4321-8312-86b1e321db32 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0586307 Nov 05 15:03:15.055652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-0d5b58db-b7b1-4985-9194-462ef67fdfc7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239570 Nov 05 15:03:15.144889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-cd0074dc-e4a3-42c5-9eda-a7733c4a99f3 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816560 Nov 05 15:03:15.233434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-fbdf6b7a-0941-43d4-abf4-17392fb1510e service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822017 Nov 05 15:03:16.122720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b830bbe2-8fcd-4962-9653-87d0bcbf9490 req-e2301094-e289-4930-8958-d412c6b5a773 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:16.124161 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b830bbe2-8fcd-4962-9653-87d0bcbf9490 req-e2301094-e289-4930-8958-d412c6b5a773 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0478940 Nov 05 15:03:16.171469 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b830bbe2-8fcd-4962-9653-87d0bcbf9490 req-60636d03-44fe-45c7-93c2-d5bac5bbc94c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412395 Nov 05 15:03:17.284868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab2ff78-1e5c-4e0c-9792-5e6935af6759 req-eb1ff024-d9c7-421d-a27a-bc04e8a08145 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:17.286345 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cab2ff78-1e5c-4e0c-9792-5e6935af6759 req-eb1ff024-d9c7-421d-a27a-bc04e8a08145 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0484984 Nov 05 15:03:17.332764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cab2ff78-1e5c-4e0c-9792-5e6935af6759 req-64076db8-ec17-4163-b7bb-7a3697d25fb1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406458 Nov 05 15:03:18.362944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:18.444888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e8a331-c91a-403d-b4e4-bbf09bd6ccaa req-572960b7-cb9d-4726-9246-9cb77c188f8a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:18.446333 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d4e8a331-c91a-403d-b4e4-bbf09bd6ccaa req-572960b7-cb9d-4726-9246-9cb77c188f8a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0479524 Nov 05 15:03:18.498507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d4e8a331-c91a-403d-b4e4-bbf09bd6ccaa req-23741945-08d1-4854-886e-3849e42eb952 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458186 Nov 05 15:03:19.616552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb1db0e-0db1-4913-a6c5-c736157fdb4d req-3a3132d5-38ca-4845-a177-6e4daab5b1f7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:19.617991 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bb1db0e-0db1-4913-a6c5-c736157fdb4d req-3a3132d5-38ca-4845-a177-6e4daab5b1f7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0521960 Nov 05 15:03:19.662773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bb1db0e-0db1-4913-a6c5-c736157fdb4d req-6575f069-0af4-477a-bf6c-02dce47119b2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390313 Nov 05 15:03:20.081768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3dcc3490-9e91-44d4-8790-d62571bb9dcb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:20.774932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe68cc3-9927-4ad6-955a-92ea278190fc req-20819548-d9e5-4494-8b1b-53767a78a149 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:20.776286 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2fe68cc3-9927-4ad6-955a-92ea278190fc req-20819548-d9e5-4494-8b1b-53767a78a149 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0481832 Nov 05 15:03:20.822582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2fe68cc3-9927-4ad6-955a-92ea278190fc req-501f86ab-1bee-475f-b914-0172d9339c04 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404453 Nov 05 15:03:21.933761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee5860e-bd1e-447a-a301-e1d77ee26300 req-881fc9f9-e805-4d1c-9307-b1df35b96c61 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:21.936017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bee5860e-bd1e-447a-a301-e1d77ee26300 req-881fc9f9-e805-4d1c-9307-b1df35b96c61 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0477521 Nov 05 15:03:21.981757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bee5860e-bd1e-447a-a301-e1d77ee26300 req-6eda12b9-fee3-44b3-b4cd-90b7629109a8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398843 Nov 05 15:03:22.417557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d3452540-02f9-4b33-930f-6304088c0cc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:23.097366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564f413b-329a-4517-96d1-6ce6e4a66747 req-6172f79c-cf24-4f63-b764-62f9fae0b2e9 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:23.098840 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-564f413b-329a-4517-96d1-6ce6e4a66747 req-6172f79c-cf24-4f63-b764-62f9fae0b2e9 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0494308 Nov 05 15:03:23.145364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-564f413b-329a-4517-96d1-6ce6e4a66747 req-73d30522-3360-4c77-965c-ea51af85c3bd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406699 Nov 05 15:03:23.439777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:24.259552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39732c7d-78bf-4c21-8401-a5b3764a26a0 req-e03f233b-0c94-4e5f-8c13-547ea9b3a90b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:24.261247 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39732c7d-78bf-4c21-8401-a5b3764a26a0 req-e03f233b-0c94-4e5f-8c13-547ea9b3a90b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0487957 Nov 05 15:03:24.317773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39732c7d-78bf-4c21-8401-a5b3764a26a0 req-19976693-d637-4202-b919-878882fdc146 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498466 Nov 05 15:03:24.907672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:25.436148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777f9fb9-5ae0-4e73-9de8-1bb4b3c48536 req-845d04be-1475-42a0-82e5-4535e7b387e7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:25.437619 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-777f9fb9-5ae0-4e73-9de8-1bb4b3c48536 req-845d04be-1475-42a0-82e5-4535e7b387e7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0533302 Nov 05 15:03:25.483301 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-777f9fb9-5ae0-4e73-9de8-1bb4b3c48536 req-c1532fa4-bb66-48f5-867c-fc0c6e8f5344 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398772 Nov 05 15:03:25.928820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:26.602491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096e1172-f157-417d-b086-ea677e3f85af req-deadb292-6b2b-4741-b0ec-44b7fb942d3c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:26.603953 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-096e1172-f157-417d-b086-ea677e3f85af req-deadb292-6b2b-4741-b0ec-44b7fb942d3c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0495603 Nov 05 15:03:26.649354 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-096e1172-f157-417d-b086-ea677e3f85af req-c35ff9a7-2389-4d52-86e9-366ba13649ee tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396338 Nov 05 15:03:27.761055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ee23f5-95d8-481d-94b0-ccc102107b02 req-f4080bb7-feb5-4a8c-ae04-57c7232bd336 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:27.762419 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d4ee23f5-95d8-481d-94b0-ccc102107b02 req-f4080bb7-feb5-4a8c-ae04-57c7232bd336 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0481641 Nov 05 15:03:27.808136 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d4ee23f5-95d8-481d-94b0-ccc102107b02 req-f652f79a-6c26-42ec-b48a-b322c7e5336c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399630 Nov 05 15:03:28.920605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5012cbaf-b46c-4bfa-b3ed-688c7ff4689a req-4283c45e-3176-4fd2-9e85-2e88f69c5be3 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:28.922063 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5012cbaf-b46c-4bfa-b3ed-688c7ff4689a req-4283c45e-3176-4fd2-9e85-2e88f69c5be3 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0475852 Nov 05 15:03:28.967836 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5012cbaf-b46c-4bfa-b3ed-688c7ff4689a req-d99c9a38-8a54-4aea-b765-ca798298073c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399928 Nov 05 15:03:30.080438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1886a251-b873-4d26-964e-d8f8f15fd1d1 req-5adb18a5-da3d-481b-97f5-c55f2ddc416a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:30.081899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1886a251-b873-4d26-964e-d8f8f15fd1d1 req-5adb18a5-da3d-481b-97f5-c55f2ddc416a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0475578 Nov 05 15:03:30.131138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1886a251-b873-4d26-964e-d8f8f15fd1d1 req-90790584-6053-4f9b-869f-bddb4e71cd96 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434337 Nov 05 15:03:31.247111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3e8de5-2124-44bb-bd75-4ab1970d4121 req-8be4925b-bbae-447d-838b-da297ee091a7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:31.248635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a3e8de5-2124-44bb-bd75-4ab1970d4121 req-8be4925b-bbae-447d-838b-da297ee091a7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0518537 Nov 05 15:03:31.294380 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a3e8de5-2124-44bb-bd75-4ab1970d4121 req-b4110b32-aa3e-4039-ac91-14d8e118c129 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399330 Nov 05 15:03:32.407264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a477907d-719d-437f-a6d6-ef60b3c09ffc req-11f1cac1-e4cd-4ef2-a6e4-e54d47de69c1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:32.408729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a477907d-719d-437f-a6d6-ef60b3c09ffc req-11f1cac1-e4cd-4ef2-a6e4-e54d47de69c1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0477474 Nov 05 15:03:32.455027 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a477907d-719d-437f-a6d6-ef60b3c09ffc req-78a0cc7b-3108-432a-9dc9-d5302e705797 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403407 Nov 05 15:03:33.576032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a9c58f-d51b-4707-a6d8-585af9a3406b req-b49092f2-cdf5-458e-991c-18f601abf63e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:33.577635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25a9c58f-d51b-4707-a6d8-585af9a3406b req-b49092f2-cdf5-458e-991c-18f601abf63e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0560703 Nov 05 15:03:33.623741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-25a9c58f-d51b-4707-a6d8-585af9a3406b req-46b4fa1b-5475-43cd-b821-048702a7f0e8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402803 Nov 05 15:03:34.735892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be9800cd-3fb8-44ac-bfef-5e9d7e3277da req-c2073393-001a-4b63-abec-efa711bbd402 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:34.737375 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-be9800cd-3fb8-44ac-bfef-5e9d7e3277da req-c2073393-001a-4b63-abec-efa711bbd402 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0474780 Nov 05 15:03:34.783223 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-be9800cd-3fb8-44ac-bfef-5e9d7e3277da req-c15f25d7-68c7-4754-8bd0-a926b3ddbf3d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401192 Nov 05 15:03:35.900495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64b7de5-411b-4f2c-9bd0-6b0aa018603a req-b5c258c3-2040-4b1b-aaa6-cf772b27f198 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:35.902007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a64b7de5-411b-4f2c-9bd0-6b0aa018603a req-b5c258c3-2040-4b1b-aaa6-cf772b27f198 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0524714 Nov 05 15:03:35.957397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a64b7de5-411b-4f2c-9bd0-6b0aa018603a req-bc10b92c-91d0-4114-ad87-76c9310c3d43 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457358 Nov 05 15:03:37.086907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2324486-2990-467b-9be2-e50a37ce8dce req-50e1b14a-6789-4f60-832b-2721ec1f8275 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:37.088387 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e2324486-2990-467b-9be2-e50a37ce8dce req-50e1b14a-6789-4f60-832b-2721ec1f8275 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0527189 Nov 05 15:03:37.136939 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e2324486-2990-467b-9be2-e50a37ce8dce req-d1bc60e4-e904-4999-b345-f2e49a669db4 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426254 Nov 05 15:03:38.248801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6802b9d9-c0b7-4edc-af3a-f355b98e80df req-d20d96bb-ec53-4dca-8b9b-00e7fcc4717f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:38.250255 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6802b9d9-c0b7-4edc-af3a-f355b98e80df req-d20d96bb-ec53-4dca-8b9b-00e7fcc4717f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0483582 Nov 05 15:03:38.301832 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6802b9d9-c0b7-4edc-af3a-f355b98e80df req-0923a9db-de5c-4a6e-9b5f-7c5b602c0b18 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456746 Nov 05 15:03:39.415696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4dc1fd3-6877-492e-be7c-74350fc4da9a req-cd314390-ede3-4744-9d2f-58aa50595c43 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:39.417203 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c4dc1fd3-6877-492e-be7c-74350fc4da9a req-cd314390-ede3-4744-9d2f-58aa50595c43 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0478933 Nov 05 15:03:39.463299 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c4dc1fd3-6877-492e-be7c-74350fc4da9a req-41c98208-3eb8-4f39-ae0e-8eaa7d885204 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397236 Nov 05 15:03:40.586629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6d8771-4c31-4179-8e6f-41236feb5e4e req-feb04453-7113-4ca0-8699-e41e8a80751f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:40.588141 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec6d8771-4c31-4179-8e6f-41236feb5e4e req-feb04453-7113-4ca0-8699-e41e8a80751f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0503232 Nov 05 15:03:40.634757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec6d8771-4c31-4179-8e6f-41236feb5e4e req-4bc72549-e029-4ea6-bee8-6a21439f7891 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406654 Nov 05 15:03:41.750978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736d22df-a3c2-4782-876f-c766960a3719 req-d91e0604-db08-471f-9881-8df99f45d59b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:41.753512 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-736d22df-a3c2-4782-876f-c766960a3719 req-d91e0604-db08-471f-9881-8df99f45d59b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0521898 Nov 05 15:03:41.799911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-736d22df-a3c2-4782-876f-c766960a3719 req-520bd489-8265-4af5-b2f8-36b9ba67fca0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415542 Nov 05 15:03:41.804744 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-8c065c56-6299-4dcc-8b8a-477a3dd4e936 service neutron] 10.222.0.32 "GET /v2.0/ports/1f7e1e63-64bd-4405-812a-f66d9122a2fd/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0595396 Nov 05 15:03:42.003442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-9073d387-e7fd-4344-9025-70fe0e91c902 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:42.004977 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-9073d387-e7fd-4344-9025-70fe0e91c902 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88&tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0 HTTP/1.1" status: 200 len: 1098 time: 0.0410488 Nov 05 15:03:42.063380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-cc86051c-a301-4fcd-b54a-537532843556 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:42.064828 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-cc86051c-a301-4fcd-b54a-537532843556 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1098 time: 0.0392358 Nov 05 15:03:42.154997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-aeb9d711-1c63-472a-8f08-bdcb7a98693a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:42.156487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-aeb9d711-1c63-472a-8f08-bdcb7a98693a service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0853426 Nov 05 15:03:42.196701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-c1cbecf0-9427-4a70-871f-5df826658d6a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 217 time: 0.0334246 Nov 05 15:03:42.243805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-a7bc8536-cfbd-4b5d-86ca-dd4c69a8a2d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:42.245253 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-a7bc8536-cfbd-4b5d-86ca-dd4c69a8a2d2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0414164 Nov 05 15:03:42.280429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-010dc24f-a2ba-4541-a13a-eede37d99bd7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0281348 Nov 05 15:03:42.367079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-cdae52d9-257a-4f96-b2a3-5a04ac73df5d service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797851 Nov 05 15:03:42.457192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ecbc0a0e-51fa-4144-aec4-43d7c8870ebc req-5d528e7b-15a1-4e2c-ab23-2b8767a88ec5 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828369 Nov 05 15:03:42.539339 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:03:42.914288 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a60d9604-219b-441f-be6f-03fff1afc91b req-1c98730d-f383-49e7-8c18-2b1f924ff353 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:42.915747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a60d9604-219b-441f-be6f-03fff1afc91b req-1c98730d-f383-49e7-8c18-2b1f924ff353 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0479307 Nov 05 15:03:42.967366 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a60d9604-219b-441f-be6f-03fff1afc91b req-a1038c77-ad8c-4def-9213-6c4276a6b860 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447321 Nov 05 15:03:44.085377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d63dd0-f9fc-4005-887f-93a89c820188 req-1e49bea6-911b-42db-bf21-3aeb65f777dd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.086848 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-20d63dd0-f9fc-4005-887f-93a89c820188 req-1e49bea6-911b-42db-bf21-3aeb65f777dd tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0491483 Nov 05 15:03:44.133080 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-20d63dd0-f9fc-4005-887f-93a89c820188 req-975cf3a5-9807-43b8-b296-43962f8ff19c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403485 Nov 05 15:03:44.323588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373a9b88-2b28-4da4-a9ac-08b69a08c4b8 req-e9848199-e95e-49b7-ba48-4490032dfca2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.325142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-373a9b88-2b28-4da4-a9ac-08b69a08c4b8 req-e9848199-e95e-49b7-ba48-4490032dfca2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0501297 Nov 05 15:03:44.377400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-bb655f7c-4380-48e3-b5df-a4c91f1e3323 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.379028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-bb655f7c-4380-48e3-b5df-a4c91f1e3323 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88&tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0543964 Nov 05 15:03:44.379688 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-373a9b88-2b28-4da4-a9ac-08b69a08c4b8 req-90599423-feb3-444f-ad53-801c8a5879f1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484099 Nov 05 15:03:44.457725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-433025e2-5973-406d-8ad7-f113024a53d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.459231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-433025e2-5973-406d-8ad7-f113024a53d9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 1098 time: 0.0398543 Nov 05 15:03:44.550952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-173b0bad-8ed3-40e0-9a1e-b142098835d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.552417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-173b0bad-8ed3-40e0-9a1e-b142098835d5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0868850 Nov 05 15:03:44.594806 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-5d1d1f43-a7a3-492b-b23d-a003b9001414 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 200 len: 217 time: 0.0349576 Nov 05 15:03:44.645524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-5cde0013-83e7-4279-b79f-146c8e6b60bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:44.646934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-5cde0013-83e7-4279-b79f-146c8e6b60bb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0456967 Nov 05 15:03:44.677573 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-1352909c-71b5-43d4-90fe-37815a863bca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239871 Nov 05 15:03:44.763323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-12d474fa-6798-45aa-8418-e77743354412 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786338 Nov 05 15:03:44.854950 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17de49ae-1fe8-45cc-825e-0c341bd074dc req-4a3c7ef5-3be4-4b25-9aa2-3b2d0d0b4427 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838184 Nov 05 15:03:45.317452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:03:45.320604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:03:45.475423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:45.482332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:45.499260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c7782f-d4e1-4f52-8ed2-288cf2ef8f93 req-e69918ec-834f-4862-86a2-c422fe332cfe tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:45.500718 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41c7782f-d4e1-4f52-8ed2-288cf2ef8f93 req-e69918ec-834f-4862-86a2-c422fe332cfe tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0522516 Nov 05 15:03:45.501094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'port_id': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'mac_address': 'fa:16:3e:30:3d:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4e8859b-6984-4cb0-97e5-254a052beeeb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:03:45.533147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:45.535384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e420ba93-d8ab-45ee-8d1a-3a589d11b273" -d '{"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-unplugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:45.548870 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41c7782f-d4e1-4f52-8ed2-288cf2ef8f93 req-32ae140a-bf59-4934-83ae-d52f846cf0db tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411751 Nov 05 15:03:45.550954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:45.558121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:45.566470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:45.594081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61085094-4d0e-4fea-a9f4-4273e595112d x-openstack-request-id: req-61085094-4d0e-4fea-a9f4-4273e595112d {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:45.594381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-unplugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:45.594621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-61085094-4d0e-4fea-a9f4-4273e595112d {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:45.595008 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'code': 200} Nov 05 15:03:45.604722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:45.649919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:45.664663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 15:03:45.665023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 15:03:45.677719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc1478e-a977-4254-a6ab-5cf4bbc211a2 req-beabb9e9-e768-4ce4-9cff-d277ab8f6bee tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:45.679179 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7fc1478e-a977-4254-a6ab-5cf4bbc211a2 req-beabb9e9-e768-4ce4-9cff-d277ab8f6bee tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0494442 Nov 05 15:03:45.972263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7fc1478e-a977-4254-a6ab-5cf4bbc211a2 req-007b0afc-6650-474e-b351-ac50ac147611 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2863083 Nov 05 15:03:46.084073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7b3744-9834-4c0c-bb59-d024c3dd0da0 req-db257b5b-ac83-4d2d-9129-377e43232c51 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:46.085531 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de7b3744-9834-4c0c-bb59-d024c3dd0da0 req-db257b5b-ac83-4d2d-9129-377e43232c51 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 943 time: 0.0481231 Nov 05 15:03:46.131446 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de7b3744-9834-4c0c-bb59-d024c3dd0da0 req-c339b976-2052-4973-9fcc-5ce39d5fa1b6 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396247 Nov 05 15:03:46.199757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:46.212157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:46.232726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:46.236310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:46.288344 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:46.293253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['1f7e1e63-64bd-4405-812a-f66d9122a2fd'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:03:46.483440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-ae525234-ad3d-4284-a03a-6b02b22178d6 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:46.484848 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-ae525234-ad3d-4284-a03a-6b02b22178d6 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 814 time: 0.1024354 Nov 05 15:03:46.499322 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-08fab5ae-81f0-40f2-adc2-49641637396f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/quotas/76f7bbafc2d84fd5bffe13625b3e0ab0 HTTP/1.1" status: 200 len: 375 time: 0.0089152 Nov 05 15:03:46.548322 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-46af8055-6597-4f1d-a9c5-2ef5be593c75 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0438175 Nov 05 15:03:46.635175 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-d2f3ee7d-3aa6-4f5a-b79e-b195f3497b0f service neutron] 10.222.0.30 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794885 Nov 05 15:03:46.726747 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-90fe936b-fe95-4043-9f82-1081e4da88af service neutron] 10.222.0.30 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850446 Nov 05 15:03:46.882640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-018cfbd4-12f6-45bf-bb7f-a8c6347df2a9 req-8d07f11f-426f-41d3-9c1b-be2273f6966d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 210 time: 0.0265079 Nov 05 15:03:47.352198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:03:47.398457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 1f7e1e63-64bd-4405-812a-f66d9122a2fd triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:03:47.398822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:47.477053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:47.507581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:47.510598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:47.556010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:47.595669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:47.597981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd6df68a-8d69-46bb-8258-20a75a16a8dc" -d '{"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-plugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:47.638251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdbe2eab-5469-43f1-a114-57c59817e95b x-openstack-request-id: req-cdbe2eab-5469-43f1-a114-57c59817e95b {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:47.638653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-plugged", "status": "completed", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:47.638976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cdbe2eab-5469-43f1-a114-57c59817e95b {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:47.639458 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'code': 200} Nov 05 15:03:47.758638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-01f84e02-8c3c-4673-aa36-f4c8af1b483f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:47.760065 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-01f84e02-8c3c-4673-aa36-f4c8af1b483f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 814 time: 0.1005166 Nov 05 15:03:47.775720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Request body: {'port': {'device_id': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'admin_state_up': True, 'tenant_id': '76f7bbafc2d84fd5bffe13625b3e0ab0'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:47.885697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Made reservation on behalf of 76f7bbafc2d84fd5bffe13625b3e0ab0 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:03:47.889737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:47.987954 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0eb82b94-0403-4ad7-aa13-d6f09883b07b req-06aaefa6-f6e7-4f5f-836f-c302acf6c1e0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 210 time: 0.0371029 Nov 05 15:03:48.036521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Allocated IP 172.20.0.6 (78ee7829-f79d-422a-9d77-83226dafd6af/e4e8859b-6984-4cb0-97e5-254a052beeeb/e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:03:48.081171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-6fc23c1e-9243-4fbc-a0a2-273ebb355f86 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:48.082608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-6fc23c1e-9243-4fbc-a0a2-273ebb355f86 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/ports?device_id=e032cc78-36b6-4a40-ba8d-be9fb62a2c88 HTTP/1.1" status: 200 len: 945 time: 0.0497561 Nov 05 15:03:48.175839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Deleting port 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:03:48.176173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.185668 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.217940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.231211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['1f7e1e63-64bd-4405-812a-f66d9122a2fd'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:03:48.260448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Network 78ee7829-f79d-422a-9d77-83226dafd6af is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:03:48.267684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:03:48.272238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:03:48.276242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:48.279018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] For port 1f7e1e63-64bd-4405-812a-f66d9122a2fd, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=1f7e1e63-64bd-4405-812a-f66d9122a2fd,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:48.279942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.297003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Calling delete_port for 1f7e1e63-64bd-4405-812a-f66d9122a2fd owned by compute:nova {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:03:48.329230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:48.329593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.348019 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5e304bc2-366c-4a2e-b77e-14366f91698f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5759463 Nov 05 15:03:48.363676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Request body: {'port': {'device_id': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:03:48.377602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.426718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.439861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.469863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Pushing event deleted for resources: {'Port': ['ID=1f7e1e63-64bd-4405-812a-f66d9122a2fd,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:48.481665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.482026 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.482477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.482871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.483238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.483580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.483921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.484328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.484702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.485033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.485362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.485779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:03:48.525175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] No DVR routers for this DVR port 1f7e1e63-64bd-4405-812a-f66d9122a2fd on host hv-neutron-8168 {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:03:48.528260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.531681 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9f247070-d5f6-4548-bbe6-77c919318be3 req-00492bee-ef50-47cb-81e2-8734297776ac tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "DELETE /v2.0/ports/1f7e1e63-64bd-4405-812a-f66d9122a2fd HTTP/1.1" status: 204 len: 173 time: 0.4427757 Nov 05 15:03:48.532123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-deleted', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:48.534411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c467395b-f646-4ee5-8e86-253debc3e509" -d '{"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-deleted", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:48.573492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ad4718d-b807-49d6-bd26-28c02f95871f x-openstack-request-id: req-0ad4718d-b807-49d6-bd26-28c02f95871f {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:48.573820 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e032cc78-36b6-4a40-ba8d-be9fb62a2c88", "name": "network-vif-deleted", "tag": "1f7e1e63-64bd-4405-812a-f66d9122a2fd", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:48.574075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0ad4718d-b807-49d6-bd26-28c02f95871f {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:48.574477 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e032cc78-36b6-4a40-ba8d-be9fb62a2c88', 'name': 'network-vif-deleted', 'tag': '1f7e1e63-64bd-4405-812a-f66d9122a2fd', 'status': 'completed', 'code': 200} Nov 05 15:03:48.710423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:48.718213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.731026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Transition to ACTIVE for port object e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:03:48.734659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.799870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:48.850815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Attempting to bind port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:03:48.851140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Attempting to bind port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:03:48.851465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Attempting to bind port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 on network 78ee7829-f79d-422a-9d77-83226dafd6af {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:03:48.855719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 on network 78ee7829-f79d-422a-9d77-83226dafd6af not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:03:48.856040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Attempting to bind port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 on network 78ee7829-f79d-422a-9d77-83226dafd6af {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:03:48.860937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 3, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:03:48.861270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Checking segment: {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:03:48.861645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Bound using segment: {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:03:48.862085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Bound port: e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f11f15a-725e-4a95-9453-824af715b913', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:03:48.862430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.923884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:03:48.926798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:03:48.931491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.966878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:48.967499 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:48.968997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] 10.222.0.32 "PUT /v2.0/ports/e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 1093 time: 0.6110625 Nov 05 15:03:48.969444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:48.971894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42612b68-5db5-4c28-9b7c-9424ff73c26b" -d '{"events": [{"name": "network-changed", "server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:49.000053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b12d3f4-a6e8-4cf6-96fb-6e8b017c1d8e service neutron] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:49.029750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0725427-cabe-4166-8e90-93ff525a03c6 x-openstack-request-id: req-c0725427-cabe-4166-8e90-93ff525a03c6 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:49.030047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:49.030303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c0725427-cabe-4166-8e90-93ff525a03c6 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:49.030715 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'status': 'completed', 'code': 200} Nov 05 15:03:49.080832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-e20fdfc7-bae1-402e-824b-118370615b57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.082576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-e20fdfc7-bae1-402e-824b-118370615b57 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1096 time: 0.0446901 Nov 05 15:03:49.126315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42a6206-2365-4bfb-9190-44fff671f800 req-74415700-eae3-47d6-9b8b-dcea3a40b7a6 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.127835 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b42a6206-2365-4bfb-9190-44fff671f800 req-74415700-eae3-47d6-9b8b-dcea3a40b7a6 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 943 time: 0.0575783 Nov 05 15:03:49.131281 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-c87362f0-e82d-46f2-8e5c-b8182ec4c79e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0396316 Nov 05 15:03:49.175352 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b42a6206-2365-4bfb-9190-44fff671f800 req-2801086c-514c-445c-8c77-e9d1fc7ad71c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413566 Nov 05 15:03:49.178937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1755f042-66e1-481d-abd0-8abb235fe626 req-8e84fbc1-27b6-47c3-ae7d-f8695ddb3eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.180397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-8e84fbc1-27b6-47c3-ae7d-f8695ddb3eb4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0426776 Nov 05 15:03:49.212494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-3ef47977-e8e0-4caf-86b3-d084e3dcad2d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253196 Nov 05 15:03:49.302178 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-41962b12-9eb9-4089-a59d-c2be6d00d1b0 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829432 Nov 05 15:03:49.389993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1755f042-66e1-481d-abd0-8abb235fe626 req-c9de8463-46a5-4fbe-923f-70b44b941cf5 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806382 Nov 05 15:03:49.475480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-16ab5e61-7a5a-48fb-bf92-f38b97410b30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.477038 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-16ab5e61-7a5a-48fb-bf92-f38b97410b30 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1096 time: 0.0404186 Nov 05 15:03:49.571460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-8d984825-fbb5-45d3-bc5e-d7d1a3b95f8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.572949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-8d984825-fbb5-45d3-bc5e-d7d1a3b95f8a service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0876484 Nov 05 15:03:49.614850 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-c65cf266-3d6b-40c1-b850-3c21be6d209c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0344405 Nov 05 15:03:49.666037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-5fc3f637-ec6b-49c7-a6c3-519b670bcecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:49.667967 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-5fc3f637-ec6b-49c7-a6c3-519b670bcecb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0454929 Nov 05 15:03:49.700799 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-d4e5e21d-b5af-4367-9448-b5a1da59b3e8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242736 Nov 05 15:03:49.787260 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-26bbed71-615d-4a88-b4cf-8e5512fe3e66 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784473 Nov 05 15:03:49.879063 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42612b68-5db5-4c28-9b7c-9424ff73c26b req-8618a877-b5fb-4996-8d2d-aad313eb21fe service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840330 Nov 05 15:03:50.082215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb26bada-af04-46ad-8d9c-4628a937ad14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:50.292946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60097e6-3510-4be1-989b-c7908c7a14df req-7ccdf106-e76c-4b4f-a3f5-02bdfb1514fe tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:50.294515 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b60097e6-3510-4be1-989b-c7908c7a14df req-7ccdf106-e76c-4b4f-a3f5-02bdfb1514fe tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 943 time: 0.0496192 Nov 05 15:03:50.346787 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b60097e6-3510-4be1-989b-c7908c7a14df req-20d3bf9a-88a5-447a-9052-7f729a3bc0fc tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462883 Nov 05 15:03:51.367070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:03:51.370268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:03:51.397289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 1f7e1e63-64bd-4405-812a-f66d9122a2fd {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:03:51.397626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 1f7e1e63-64bd-4405-812a-f66d9122a2fd not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:03:51.462430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4148274-449c-4ba9-ba89-b52279b14e5f req-0345248d-4177-4ec3-8b4a-6b70f3493a1a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:51.463899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a4148274-449c-4ba9-ba89-b52279b14e5f req-0345248d-4177-4ec3-8b4a-6b70f3493a1a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 943 time: 0.0490353 Nov 05 15:03:51.486962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:51.500880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'port_id': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'mac_address': 'fa:16:3e:4c:0d:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4e8859b-6984-4cb0-97e5-254a052beeeb', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:03:51.514838 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a4148274-449c-4ba9-ba89-b52279b14e5f req-2d795965-29fc-440a-9415-af42d6b4943f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444114 Nov 05 15:03:51.534691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:51.547642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:03:51.566301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:51.570254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:51.619658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:51.761001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:03:52.418603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-925b18ad-c85a-4cc3-82f2-7e862fa6520c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:52.628835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a089ff4-dd49-42b0-9c9b-e8cbcd72e938 req-b6dd6e49-b42a-4c08-ae01-9b3275c76d26 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:52.630297 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4a089ff4-dd49-42b0-9c9b-e8cbcd72e938 req-b6dd6e49-b42a-4c08-ae01-9b3275c76d26 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 944 time: 0.0479879 Nov 05 15:03:52.679587 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4a089ff4-dd49-42b0-9c9b-e8cbcd72e938 req-e8dbbf63-19de-44f2-93cb-4c0e0988470b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433657 Nov 05 15:03:53.381219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:03:53.432953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:03:53.441183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:03:53.441556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:53.463823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:53.519763 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:53.542171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:03:53.544409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa0ae5d5-3901-4c95-a66d-689a6d20fef3" -d '{"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-plugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:03:53.559456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:03:53.564316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:53.587240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:03:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5838016-44c3-462c-8f04-dc5ad877a1a4 x-openstack-request-id: req-b5838016-44c3-462c-8f04-dc5ad877a1a4 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:03:53.587524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-plugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:03:53.587890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b5838016-44c3-462c-8f04-dc5ad877a1a4 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:03:53.588153 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'code': 200} Nov 05 15:03:53.614752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:03:53.751271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fd306a-4da9-4bb8-8464-9d57ce7c3d07 req-94990be4-389f-4565-841b-3239110d05d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:53.753771 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a1fd306a-4da9-4bb8-8464-9d57ce7c3d07 req-94990be4-389f-4565-841b-3239110d05d7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1098 time: 0.0484059 Nov 05 15:03:53.809995 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a1fd306a-4da9-4bb8-8464-9d57ce7c3d07 req-b19b1632-2278-4b51-a2e4-17d6e030511b service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497117 Nov 05 15:03:53.956851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b3e8d-c071-4b4d-8af8-609e9074fa2b req-5a7703ea-d66f-434e-87e9-58c9d3d70ef0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:53.958375 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b17b3e8d-c071-4b4d-8af8-609e9074fa2b req-5a7703ea-d66f-434e-87e9-58c9d3d70ef0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0492117 Nov 05 15:03:54.005341 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b17b3e8d-c071-4b4d-8af8-609e9074fa2b req-af389584-46df-4401-9e1f-193e0f3cfab4 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408897 Nov 05 15:03:54.910752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:55.132816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3b1f12-c9a3-4394-b195-521748e44977 req-d80520c4-fde3-45d4-9ab8-2ed1b579f92d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:55.134277 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3b1f12-c9a3-4394-b195-521748e44977 req-d80520c4-fde3-45d4-9ab8-2ed1b579f92d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0483565 Nov 05 15:03:55.184782 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ee3b1f12-c9a3-4394-b195-521748e44977 req-9234098e-2ff8-4701-98bd-fd78a3beedb7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439382 Nov 05 15:03:55.298354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84b4ed1-c9d2-4f36-b4ff-ba7a25e2804d req-a5278fef-567a-4658-8afb-86933923a631 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:55.299815 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c84b4ed1-c9d2-4f36-b4ff-ba7a25e2804d req-a5278fef-567a-4658-8afb-86933923a631 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0512073 Nov 05 15:03:55.346404 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c84b4ed1-c9d2-4f36-b4ff-ba7a25e2804d req-b1b9a2aa-fcb6-4d93-9b41-d04aafd6494a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408263 Nov 05 15:03:55.616507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1270e0f7-21f5-43dc-b801-3b365a83adea req-ead7658e-0235-4d30-9126-9cee29b7b38f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:55.617992 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1270e0f7-21f5-43dc-b801-3b365a83adea req-ead7658e-0235-4d30-9126-9cee29b7b38f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0765517 Nov 05 15:03:55.622268 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-135686b4-538e-44e5-8051-f2bf894e52d4 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0689387 Nov 05 15:03:55.677028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1270e0f7-21f5-43dc-b801-3b365a83adea req-42cbf170-7068-401c-8571-0f6862404b4e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520322 Nov 05 15:03:55.932139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:03:56.671378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-6f649808-b166-429b-a982-05796e0d3496 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:56.672858 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-6f649808-b166-429b-a982-05796e0d3496 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1098 time: 0.0397334 Nov 05 15:03:56.763372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-1adcabc1-d371-463e-8478-8a23579e8709 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:56.764795 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-1adcabc1-d371-463e-8478-8a23579e8709 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0829537 Nov 05 15:03:56.791933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e781f9-97b1-4405-b429-9253f917ddd1 req-a3ce659a-3f95-4e6a-8c98-f456cb892d7c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:56.793465 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b8e781f9-97b1-4405-b429-9253f917ddd1 req-a3ce659a-3f95-4e6a-8c98-f456cb892d7c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0487280 Nov 05 15:03:56.811237 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-d5e1c7bc-abee-405b-a50c-a527994ebd02 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0390766 Nov 05 15:03:56.842487 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b8e781f9-97b1-4405-b429-9253f917ddd1 req-aa6b93f0-aece-4863-9ddd-b0d496808c3d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425365 Nov 05 15:03:56.859640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-50767a2f-f9fa-46c3-b018-e93c59c69ed5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:56.861137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-50767a2f-f9fa-46c3-b018-e93c59c69ed5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0428050 Nov 05 15:03:56.892147 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-c48f4027-b826-4f55-a369-c1f3f91f29f3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245678 Nov 05 15:03:56.982960 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-8327d3c3-9648-476e-a57c-ad050227723b service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841718 Nov 05 15:03:57.071328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-95b285a2-ce85-4d99-8216-aa8635895962 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806186 Nov 05 15:03:57.956302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e49248e-3f11-4527-b052-7ac7574b29a8 req-4dfa8590-a7da-4e6b-8ede-e977afef03d0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:57.957842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5e49248e-3f11-4527-b052-7ac7574b29a8 req-4dfa8590-a7da-4e6b-8ede-e977afef03d0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0488579 Nov 05 15:03:58.008576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5e49248e-3f11-4527-b052-7ac7574b29a8 req-b23a11ed-cf03-444e-8474-c947a456171d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448499 Nov 05 15:03:59.122276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf30b631-3240-4696-b9b1-2cd71a715126 req-3e5e9fef-0984-49cd-865b-7c54df0f0c36 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:03:59.123718 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf30b631-3240-4696-b9b1-2cd71a715126 req-3e5e9fef-0984-49cd-865b-7c54df0f0c36 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0474148 Nov 05 15:03:59.169509 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf30b631-3240-4696-b9b1-2cd71a715126 req-09c0c2d8-3918-4c35-ad2c-f915fe67edc2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400174 Nov 05 15:04:00.282433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e10dde-75b9-4bc1-926f-b8dc5962d4b3 req-7cca7794-5081-4d71-b246-bf108bdd838e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:00.283885 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22e10dde-75b9-4bc1-926f-b8dc5962d4b3 req-7cca7794-5081-4d71-b246-bf108bdd838e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0481670 Nov 05 15:04:00.329665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-22e10dde-75b9-4bc1-926f-b8dc5962d4b3 req-a7e03e0b-d831-476a-ab28-6e8ee298858a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399594 Nov 05 15:04:01.447470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91cb943-64f5-4455-bfea-0cc3d2067fbe req-f50369eb-64ff-46f8-81e5-808e053b4a22 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:01.448925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a91cb943-64f5-4455-bfea-0cc3d2067fbe req-f50369eb-64ff-46f8-81e5-808e053b4a22 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0518777 Nov 05 15:04:01.495292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a91cb943-64f5-4455-bfea-0cc3d2067fbe req-908507b8-7ea3-488a-bf60-cc56f370c9ae tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400281 Nov 05 15:04:02.609333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ecdcdc-8549-41fc-aa16-b8b71dcd4838 req-c61dfd1e-8c9a-4da2-b781-738f12773f3a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:02.610813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31ecdcdc-8549-41fc-aa16-b8b71dcd4838 req-c61dfd1e-8c9a-4da2-b781-738f12773f3a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0493512 Nov 05 15:04:02.657552 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31ecdcdc-8549-41fc-aa16-b8b71dcd4838 req-df5956b4-2bbf-48cf-933b-725866eb3fde tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408192 Nov 05 15:04:03.780655 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7117c6a0-8d03-47f2-81f0-f4f10cd3dd5b req-48487bb2-ebd7-43f9-82cc-13943db8c00c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:03.782011 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7117c6a0-8d03-47f2-81f0-f4f10cd3dd5b req-48487bb2-ebd7-43f9-82cc-13943db8c00c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0473642 Nov 05 15:04:03.828034 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7117c6a0-8d03-47f2-81f0-f4f10cd3dd5b req-cf9684b8-904b-4ec8-a576-8ec660fe7d40 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402660 Nov 05 15:04:04.945427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-135da8d6-622d-463b-b188-d1a336eaeaf3 req-bc3d7498-5374-4e3a-950e-390333e5f60b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:04.946889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-135da8d6-622d-463b-b188-d1a336eaeaf3 req-bc3d7498-5374-4e3a-950e-390333e5f60b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0515485 Nov 05 15:04:04.992841 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-135da8d6-622d-463b-b188-d1a336eaeaf3 req-a9a6f684-3a14-42a5-bdc5-7fff5c15d2b5 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394115 Nov 05 15:04:06.109251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2044e4bd-cf9d-4df7-a091-d89811671020 req-579804e5-528c-4bd9-8f1f-30eb33f12204 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:06.110693 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2044e4bd-cf9d-4df7-a091-d89811671020 req-579804e5-528c-4bd9-8f1f-30eb33f12204 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0507476 Nov 05 15:04:06.158093 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2044e4bd-cf9d-4df7-a091-d89811671020 req-be582f14-b11b-434a-9971-84717d64d33c tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415320 Nov 05 15:04:07.269596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de366a98-961c-4020-8911-51bf32f97e9d req-ad980847-4c89-49c6-a7e4-c0f7fe0ec899 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:07.271030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-de366a98-961c-4020-8911-51bf32f97e9d req-ad980847-4c89-49c6-a7e4-c0f7fe0ec899 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0481880 Nov 05 15:04:07.317435 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-de366a98-961c-4020-8911-51bf32f97e9d req-1500eaff-c9ef-46d3-b760-4b8f57901d9b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404730 Nov 05 15:04:08.429261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-421cd97f-51ca-412a-b978-0d520b58202a req-cdcd5278-666a-406c-b8da-bbba2cd60208 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:08.430742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-421cd97f-51ca-412a-b978-0d520b58202a req-cdcd5278-666a-406c-b8da-bbba2cd60208 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0481162 Nov 05 15:04:08.477683 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-421cd97f-51ca-412a-b978-0d520b58202a req-98d33718-6db8-4380-97ba-1f7feb742733 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405033 Nov 05 15:04:08.572666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-adb023ae-b9a6-40c6-b0fe-e2e94a1b0eb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:08.574148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-adb023ae-b9a6-40c6-b0fe-e2e94a1b0eb2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1098 time: 0.0398474 Nov 05 15:04:08.678007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-7edaea98-776a-4a76-9d13-8bf4a9d02d46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:08.679473 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-7edaea98-776a-4a76-9d13-8bf4a9d02d46 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0868721 Nov 05 15:04:08.722339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-3159e56a-5453-4907-85b1-3506301f6438 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0362554 Nov 05 15:04:08.773589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-98148b0c-e6b4-46d8-a2b3-4a61aa40440f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:08.774989 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-98148b0c-e6b4-46d8-a2b3-4a61aa40440f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0459895 Nov 05 15:04:08.806013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-26ab34e2-bebe-41c1-9fec-9650b4720f00 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239878 Nov 05 15:04:08.891869 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-a9b4b52f-baf2-4beb-8688-a2a1334dc521 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785217 Nov 05 15:04:08.983764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c24d6f2f-f835-46aa-ac6f-9f5168e0a794 req-9cab1b64-f299-4e77-98dd-f61d74347872 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851851 Nov 05 15:04:09.593827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373de84c-57fe-4e85-aea9-1ac1e1a85de6 req-7276a628-d360-4d87-9985-673aeb81bd03 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:09.595322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-373de84c-57fe-4e85-aea9-1ac1e1a85de6 req-7276a628-d360-4d87-9985-673aeb81bd03 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0496325 Nov 05 15:04:09.643965 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-373de84c-57fe-4e85-aea9-1ac1e1a85de6 req-6dadcb6c-266a-4809-9032-75542425d7dc tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414271 Nov 05 15:04:10.776615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f202156-4a4f-43a6-9891-d8043f552cc4 req-5240c188-e37d-4258-bfce-9a7f8c849449 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:10.778612 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7f202156-4a4f-43a6-9891-d8043f552cc4 req-5240c188-e37d-4258-bfce-9a7f8c849449 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0664465 Nov 05 15:04:10.827674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7f202156-4a4f-43a6-9891-d8043f552cc4 req-0a29bbbc-6366-4fe4-abd9-ff5cfbfe8a67 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431900 Nov 05 15:04:11.942359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ae2d3e-6636-4c37-a296-4f0fda40c128 req-b10582bd-57b7-4db8-b43c-caac54747fbf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:11.943813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8ae2d3e-6636-4c37-a296-4f0fda40c128 req-b10582bd-57b7-4db8-b43c-caac54747fbf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0504932 Nov 05 15:04:11.993825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e8ae2d3e-6636-4c37-a296-4f0fda40c128 req-aaa24639-12d1-4031-9232-ecd6d4772910 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436614 Nov 05 15:04:13.107501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e6f3a7-f790-48ae-bfbc-627f0dc41d92 req-663b8f2f-618a-4cf2-8abc-2892f3618953 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:13.109098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b9e6f3a7-f790-48ae-bfbc-627f0dc41d92 req-663b8f2f-618a-4cf2-8abc-2892f3618953 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0482090 Nov 05 15:04:13.155549 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b9e6f3a7-f790-48ae-bfbc-627f0dc41d92 req-f093ac35-7bf9-4e4c-9c96-c751e8ce527f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406005 Nov 05 15:04:14.269958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d364db9f-4001-47a2-a206-88da47a3c602 req-624ab95e-42c9-44e1-b457-d4c6671b162e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:14.271424 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d364db9f-4001-47a2-a206-88da47a3c602 req-624ab95e-42c9-44e1-b457-d4c6671b162e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0486603 Nov 05 15:04:14.318252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d364db9f-4001-47a2-a206-88da47a3c602 req-89b6faea-fc46-49b9-8702-e9ce979d1f1a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410042 Nov 05 15:04:15.431314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42dd7330-9d8e-4aff-b519-6322180320a0 req-5ce4a37b-bf4a-4848-ad87-e06f837d0add tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:15.432796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42dd7330-9d8e-4aff-b519-6322180320a0 req-5ce4a37b-bf4a-4848-ad87-e06f837d0add tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0475338 Nov 05 15:04:15.479488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42dd7330-9d8e-4aff-b519-6322180320a0 req-4785d95d-87f9-4a75-8d11-8364b7f3fb6f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401297 Nov 05 15:04:16.594069 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-013caa6a-1a6d-47f0-b0e5-63ec77834b9b req-7be18c61-d151-4968-b33d-f414a1ebfcc8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:16.595680 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-013caa6a-1a6d-47f0-b0e5-63ec77834b9b req-7be18c61-d151-4968-b33d-f414a1ebfcc8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0491645 Nov 05 15:04:16.641181 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-013caa6a-1a6d-47f0-b0e5-63ec77834b9b req-915f325b-0122-4311-b818-ba183bbb695b tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396328 Nov 05 15:04:17.758875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcd688b-d5c0-41c5-911f-01c0d4ead8ed req-c541da64-15b2-40ec-a7f6-01ad5cfc6840 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:17.760256 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0dcd688b-d5c0-41c5-911f-01c0d4ead8ed req-c541da64-15b2-40ec-a7f6-01ad5cfc6840 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0524766 Nov 05 15:04:17.806576 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0dcd688b-d5c0-41c5-911f-01c0d4ead8ed req-d03f9333-a2c9-4734-85f0-b386675e3d5d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405054 Nov 05 15:04:18.371517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:18.923620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bddd89ba-da1e-4add-8570-c086948615f6 req-a588acf6-5017-4c2b-a4b3-83271d7a18b5 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:18.925114 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bddd89ba-da1e-4add-8570-c086948615f6 req-a588acf6-5017-4c2b-a4b3-83271d7a18b5 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0508809 Nov 05 15:04:18.970486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bddd89ba-da1e-4add-8570-c086948615f6 req-9be47fe5-ba19-4ad6-97d2-2d012c17cf27 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396092 Nov 05 15:04:19.538009 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:04:20.083176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a219832d-989f-476a-9630-fbc75ed81fb0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:20.084599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb657e9d-b0ba-4885-867f-4ce0d07b12e9 req-d0131498-38e5-42f0-89ee-7fe837550aa9 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:20.086223 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bb657e9d-b0ba-4885-867f-4ce0d07b12e9 req-d0131498-38e5-42f0-89ee-7fe837550aa9 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0492032 Nov 05 15:04:20.133015 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bb657e9d-b0ba-4885-867f-4ce0d07b12e9 req-d44342fd-130a-44e6-9c11-b4df02a16ac9 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409560 Nov 05 15:04:21.245537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b515d3-5482-4e57-b1d8-4966fc4f71f3 req-0f866c01-4b6b-4704-b4dc-c4217c989ef8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:21.247024 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1b515d3-5482-4e57-b1d8-4966fc4f71f3 req-0f866c01-4b6b-4704-b4dc-c4217c989ef8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0479863 Nov 05 15:04:21.294079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1b515d3-5482-4e57-b1d8-4966fc4f71f3 req-8295dc8d-4904-42cd-9553-1291aa70f07a tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410368 Nov 05 15:04:22.408693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aead2bd-04b4-481c-9e51-129b32dada34 req-724d38df-4be5-4e6d-9a7a-eac42b0cce00 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:22.410180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6aead2bd-04b4-481c-9e51-129b32dada34 req-724d38df-4be5-4e6d-9a7a-eac42b0cce00 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0490808 Nov 05 15:04:22.420884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-53315cd4-2f74-4fc7-9146-2d121603d6fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:22.464370 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6aead2bd-04b4-481c-9e51-129b32dada34 req-4df0adae-8928-4673-8853-41ebcf1c43f8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439422 Nov 05 15:04:23.449147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:23.585870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917ceaac-cbe8-42f6-81fc-235956c23d10 req-3b396b3b-d94a-4c69-8fcd-bde442a4ce5d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:23.587341 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-917ceaac-cbe8-42f6-81fc-235956c23d10 req-3b396b3b-d94a-4c69-8fcd-bde442a4ce5d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0517914 Nov 05 15:04:23.680080 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-917ceaac-cbe8-42f6-81fc-235956c23d10 req-3553828f-2f75-4dd8-8c85-23cc0c98dfce tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801859 Nov 05 15:04:23.681553 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-c051f0d8-ecdb-4597-9a7d-3081aab83fbc service neutron] 10.222.0.32 "GET /v2.0/ports/e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0876300 Nov 05 15:04:23.879414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-ddc4f532-5429-47fd-90f8-d5d394241aad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:23.880794 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-ddc4f532-5429-47fd-90f8-d5d394241aad service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929&tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0 HTTP/1.1" status: 200 len: 1098 time: 0.0410132 Nov 05 15:04:23.943656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-5c658f2a-6c44-4262-b6f5-0c476b995c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:23.945167 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-5c658f2a-6c44-4262-b6f5-0c476b995c90 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1098 time: 0.0433767 Nov 05 15:04:24.030815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-91d58145-5c08-4418-9e69-bded1eb840be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:24.032236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-91d58145-5c08-4418-9e69-bded1eb840be service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0807154 Nov 05 15:04:24.077443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-75808b46-f6e1-49ee-ba82-9809b52dd4c5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0376041 Nov 05 15:04:24.124986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110848-8fb6-4a81-8d27-972622f566ec req-f32b16be-cb9d-4d18-b6f8-17df0995f177 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:24.126377 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-f32b16be-cb9d-4d18-b6f8-17df0995f177 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0417960 Nov 05 15:04:24.157756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-63cc5866-1f6d-4a85-909d-048100e84783 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233359 Nov 05 15:04:24.246195 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-3f07b1a9-1c5b-4d4c-9f58-80d75707ec62 service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795932 Nov 05 15:04:24.337128 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02110848-8fb6-4a81-8d27-972622f566ec req-05c2834e-1e95-48cd-b24b-57ac6bf3a76d service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833693 Nov 05 15:04:24.799619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b4da48-ddcf-4d0e-8ab4-0b5f6e0bd417 req-586893a0-db44-476a-a579-ef2f8d39f39d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:24.801079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e2b4da48-ddcf-4d0e-8ab4-0b5f6e0bd417 req-586893a0-db44-476a-a579-ef2f8d39f39d tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0477853 Nov 05 15:04:24.848380 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e2b4da48-ddcf-4d0e-8ab4-0b5f6e0bd417 req-fcee65b0-d7b1-4390-a0a5-891f0ac1aef8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414960 Nov 05 15:04:24.912484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:25.936833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:25.968040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3969865-37b3-4665-b707-b6d89f97139d req-7c67d020-4ae3-499a-a61b-ce9915efa5aa tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:25.969543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a3969865-37b3-4665-b707-b6d89f97139d req-7c67d020-4ae3-499a-a61b-ce9915efa5aa tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0536699 Nov 05 15:04:26.017379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a3969865-37b3-4665-b707-b6d89f97139d req-2647c5ae-f6e9-4986-b755-2f38453b934f tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419335 Nov 05 15:04:26.251816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-545481b5-9d7f-459d-9e9f-14e42da031b8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:26.253292 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-545481b5-9d7f-459d-9e9f-14e42da031b8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929&tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0734458 Nov 05 15:04:26.262290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11fe1aaa-9088-4f63-b926-666f0f3912b4 req-5994ae5a-85a3-4db8-8044-31ee37f275e1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:26.263948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11fe1aaa-9088-4f63-b926-666f0f3912b4 req-5994ae5a-85a3-4db8-8044-31ee37f275e1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0977221 Nov 05 15:04:26.337765 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11fe1aaa-9088-4f63-b926-666f0f3912b4 req-248721c8-20da-493b-a812-5466ba6a7670 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678501 Nov 05 15:04:26.347297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-4a75f9e7-f3c4-4a03-93cf-6b9239ac0daa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:26.352349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-4a75f9e7-f3c4-4a03-93cf-6b9239ac0daa service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 1098 time: 0.0526717 Nov 05 15:04:26.439611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-7d217337-db1e-44b6-904c-a72c6bb40fe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:26.441166 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-7d217337-db1e-44b6-904c-a72c6bb40fe4 service neutron] 10.222.0.32 "GET /v2.0/networks?id=78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 200 len: 915 time: 0.0858634 Nov 05 15:04:26.482511 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-ded85665-aa15-473b-adb0-814cea80e319 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 200 len: 217 time: 0.0342104 Nov 05 15:04:26.537758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-1fba1067-73d6-4721-be29-50e82b1e6342 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:26.539245 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-1fba1067-73d6-4721-be29-50e82b1e6342 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 200 len: 854 time: 0.0473244 Nov 05 15:04:26.569429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-3dfd2ab9-ac8c-4983-a0f0-d68dbbe3b730 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=78ee7829-f79d-422a-9d77-83226dafd6af&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236270 Nov 05 15:04:26.656383 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-08d05bf4-c983-4af2-ba0c-dc6213a259dd service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802627 Nov 05 15:04:26.747032 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-edd95b82-8e01-4ab7-a40d-c6d794e09a3d req-beeba4a5-0d60-4768-b1d9-e15ad111148d service neutron] 10.222.0.32 "GET /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830123 Nov 05 15:04:27.454143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d35e68-7b40-4b30-a031-8630d3a4cc67 req-3d20f9bd-fe88-4727-972e-ace9315328e0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:27.455612 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a6d35e68-7b40-4b30-a031-8630d3a4cc67 req-3d20f9bd-fe88-4727-972e-ace9315328e0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0490267 Nov 05 15:04:27.492060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:04:27.494226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:04:27.502164 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a6d35e68-7b40-4b30-a031-8630d3a4cc67 req-3a8fa309-9747-434a-8167-7f241d631918 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406916 Nov 05 15:04:27.620187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ad3631-ac05-4ee2-8ce5-b17607a2f59e req-6b2ac19e-cbc3-4e32-8b51-079d41cd9791 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:27.622316 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4ad3631-ac05-4ee2-8ce5-b17607a2f59e req-6b2ac19e-cbc3-4e32-8b51-079d41cd9791 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0522988 Nov 05 15:04:27.672621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4ad3631-ac05-4ee2-8ce5-b17607a2f59e req-b1ee061d-ec55-44a4-b140-c6a670b86dd7 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440271 Nov 05 15:04:27.791533 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-490b62da-77f5-4992-8440-2fd097c83ed6 req-29e9140f-98ac-49c4-8129-152f20f8437e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:27.793040 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-490b62da-77f5-4992-8440-2fd097c83ed6 req-29e9140f-98ac-49c4-8129-152f20f8437e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0520315 Nov 05 15:04:27.799951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:27.802529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:27.819765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'network_id': '78ee7829-f79d-422a-9d77-83226dafd6af', 'port_id': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'mac_address': 'fa:16:3e:4c:0d:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4e8859b-6984-4cb0-97e5-254a052beeeb', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:04:27.834952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:27.837184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85986da1-a5e1-4d07-943d-9299f1a284eb" -d '{"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-unplugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:27.841713 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-490b62da-77f5-4992-8440-2fd097c83ed6 req-df049ea4-6187-4e1e-87e6-1746f2e5f1f1 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420189 Nov 05 15:04:27.871252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:27.878621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-864e5703-cb35-4fff-9225-91ee746f4599 x-openstack-request-id: req-864e5703-cb35-4fff-9225-91ee746f4599 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:27.878894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-unplugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:27.879144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-864e5703-cb35-4fff-9225-91ee746f4599 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:27.879529 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'code': 200} Nov 05 15:04:27.880218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:27.907414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:27.930429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:04:27.949026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:27.976927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.977194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.977520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.977853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.978184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.978517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.978843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.979166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.979539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.979991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.980133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.980524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:27.998575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 15:04:27.998932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 15:04:28.179230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97084823-1c22-42e3-a4cb-9e4ff4419799 req-0c7f859e-3ed7-4bc1-b400-10a433dc1a84 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:28.180703 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-97084823-1c22-42e3-a4cb-9e4ff4419799 req-0c7f859e-3ed7-4bc1-b400-10a433dc1a84 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 943 time: 0.0486588 Nov 05 15:04:28.226700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-97084823-1c22-42e3-a4cb-9e4ff4419799 req-6057df77-d542-4ab3-9ec8-6880830d55a0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398374 Nov 05 15:04:28.535556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:28.547930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:04:28.566499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:28.570077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:28.621385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:28.629957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:04:29.340561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da5f245f-eb28-41a2-b192-6e1323b36b35 req-b30b7a7e-3bb6-4599-8335-c416556e8fa0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:29.342031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da5f245f-eb28-41a2-b192-6e1323b36b35 req-b30b7a7e-3bb6-4599-8335-c416556e8fa0 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 944 time: 0.0485191 Nov 05 15:04:29.391971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-da5f245f-eb28-41a2-b192-6e1323b36b35 req-2ac41878-9c51-41ed-8669-fce4adcec0d8 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/security-groups?id=0c0dc4e2-4017-4d31-ae82-26859e23426b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440619 Nov 05 15:04:29.538148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:29.588622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:29.589031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:29.663500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:29.694599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:29.698450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:29.748106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:29.753626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-f371120b-ab60-4db2-ab52-9f537f85dc0e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:29.755095 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-f371120b-ab60-4db2-ab52-9f537f85dc0e tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 945 time: 0.0488536 Nov 05 15:04:29.840357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Deleting port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:04:29.841137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:29.881012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:29.883302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42afc0d4-6cce-4593-a6b0-f2c104390653" -d '{"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-plugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:29.918022 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98594a40-500b-4404-91cc-9f0eb831ff7e x-openstack-request-id: req-98594a40-500b-4404-91cc-9f0eb831ff7e {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:29.918319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-plugged", "status": "completed", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:29.919068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-98594a40-500b-4404-91cc-9f0eb831ff7e {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:29.919475 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'code': 200} Nov 05 15:04:29.931694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] For port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,segment=NetworkSegment(6f11f15a-725e-4a95-9453-824af715b913),segment_id=6f11f15a-725e-4a95-9453-824af715b913)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:29.932055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:29.945336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Calling delete_port for e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:04:30.068663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:30.079640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:04:30.096130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Pushing event deleted for resources: {'Port': ['ID=e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:30.120327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.120703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.121044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.121428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.121755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.122616 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.122945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.123269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.123598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.123922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.124247 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.124592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:30.145775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] No DVR routers for this DVR port e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:04:30.148103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:30.151466 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-02d5354e-59d8-43c2-b529-357bba6c1ccc req-067942d3-2d7a-4d2b-bc12-e4666a42d0cf tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.32 "DELETE /v2.0/ports/e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 HTTP/1.1" status: 204 len: 173 time: 0.3905113 Nov 05 15:04:30.151845 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-deleted', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:30.154748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-305c956e-c950-4f3a-a9e6-9577b15f5245" -d '{"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-deleted", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:30.199172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78008f47-f74f-4c9d-8ddf-64596878a60f x-openstack-request-id: req-78008f47-f74f-4c9d-8ddf-64596878a60f {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:30.199664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ee8b3f13-8d54-4a2d-9ea0-f07733816929", "name": "network-vif-deleted", "tag": "e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:30.200546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-78008f47-f74f-4c9d-8ddf-64596878a60f {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:30.200897 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ee8b3f13-8d54-4a2d-9ea0-f07733816929', 'name': 'network-vif-deleted', 'tag': 'e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13', 'status': 'completed', 'code': 200} Nov 05 15:04:30.499976 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-05a48bf3-2200-4f0d-902f-4ab6585781d7 req-d55aadff-e889-4f9b-8d3c-2f7a741b17c2 tempest-ServerDiskConfigTestJSON-872412392 tempest-ServerDiskConfigTestJSON-872412392-project] 10.222.0.30 "GET /v2.0/ports?device_id=ee8b3f13-8d54-4a2d-9ea0-f07733816929 HTTP/1.1" status: 200 len: 210 time: 0.0297339 Nov 05 15:04:31.619331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48428) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:31.663172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Deleting subnet e4e8859b-6984-4cb0-97e5-254a052beeeb {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:04:31.666217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:31.947889 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:31.985702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.034262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.059852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e4e8859b-6984-4cb0-97e5-254a052beeeb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:32.061799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.064917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bbf267c4-5fc6-404f-9cd5-a908f331f7a8 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/e4e8859b-6984-4cb0-97e5-254a052beeeb HTTP/1.1" status: 204 len: 168 time: 0.4445760 Nov 05 15:04:32.067305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48430) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:32.134503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.208671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.228003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['78ee7829-f79d-422a-9d77-83226dafd6af']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:32.236837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f11f15a-725e-4a95-9453-824af715b913') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:32.237126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f11f15a-725e-4a95-9453-824af715b913') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:32.249955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.262909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.268807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:04:32.269259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:04:32.271119 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:04:32.322649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.327937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.331075 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] 10.222.0.30 "DELETE /v2.0/networks/78ee7829-f79d-422a-9d77-83226dafd6af HTTP/1.1" status: 204 len: 168 time: 0.2628794 Nov 05 15:04:32.344003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123cf5cf-714f-4f5d-a731-8f4748daa8c9 admin admin] Pushing event deleted for resources: {'Network': ['ID=78ee7829-f79d-422a-9d77-83226dafd6af,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:32.433969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48434) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:32.473444 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7a67bd22-1176-4f92-b81f-c747f32d17e8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=76f7bbafc2d84fd5bffe13625b3e0ab0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0379422 Nov 05 15:04:32.475449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48436) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:32.522286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.545922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.596385 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.598978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:32.600149 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0c0dc4e2-4017-4d31-ae82-26859e23426b HTTP/1.1" status: 204 len: 168 time: 0.1238165 Nov 05 15:04:32.607944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-462f168b-99e9-4920-90b9-90e46508ed84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c0dc4e2-4017-4d31-ae82-26859e23426b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:33.232545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 48458) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:33.325915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-304172151-network', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:33.346802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:04:33.349073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.357261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.428857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.432540 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.454397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:04:33.469432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d2a6552-d93f-4059-90db-819502e24d3c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:33.473576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.474065 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Added segment 11e39521-7ffb-45e0-a44d-400d4e354f3c of type vlan for network b7856e81-af33-4465-b684-ce86f847a4ff Nov 05 15:04:33.515670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.538880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.539827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:33.540391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.553799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:04:33.573570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:04:33.573908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e3710d7e-fcc3-4194-9f7d-0cbb6f32bc13 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:04:33.617914 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3842890 Nov 05 15:04:33.621082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48462) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:33.626063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Request body: {'subnet': {'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-304172151-subnet', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:33.635129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10792e44-6b10-4aaf-8a60-e2e401c44d8e admin admin] Pushing event updated for resources: {'Network': ['ID=b7856e81-af33-4465-b684-ce86f847a4ff,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:33.645999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network b7856e81-af33-4465-b684-ce86f847a4ff details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:04:33.646197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:04:33.648362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.810009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.864935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:33.872516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:04:33.872867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Network hostable DHCP agents. Network: b7856e81-af33-4465-b684-ce86f847a4ff, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:04:33.888970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Network b7856e81-af33-4465-b684-ce86f847a4ff is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:04:33.897068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, b7856e81-af33-4465-b684-ce86f847a4ff) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:33.901240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:33.901836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.906971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-788955d6-b7ed-4e7e-bde6-3999a243f4f6 None None] Network b7856e81-af33-4465-b684-ce86f847a4ff requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:04:33.917917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2e76ef7-517b-48a9-994c-d4aadefec5f6 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.2957070 Nov 05 15:04:33.920571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48464) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:33.924708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:33.947235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.948213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-788955d6-b7ed-4e7e-bde6-3999a243f4f6 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:04:33.977937 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:04:33.987910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88339878-3051-47cf-a788-76c0a5191ce5 None None] Network b7856e81-af33-4465-b684-ce86f847a4ff requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:04:34.035009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-88339878-3051-47cf-a788-76c0a5191ce5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:04:34.062474 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:04:34.071546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54c73a59-b8a2-4d69-9138-5fe9dc21f138 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:04:34.136068 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54c73a59-b8a2-4d69-9138-5fe9dc21f138 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:04:34.170916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.336352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-215a6f61-f043-4728-a392-166196734d6f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-b7856e81-af33-4465-b684-ce86f847a4ff', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:04:34.339412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.392080 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.421623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.496043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-215a6f61-f043-4728-a392-166196734d6f None None] Allocated IP 172.20.0.2 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/a6d31dda-fe07-44f3-bab5-45f7cf292122) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:04:34.525894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Allocated IP 172.26.5.203 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/411e6cc4-2575-4825-92b9-644ffe190b2a) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:04:34.628727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.645445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.651295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.663136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.688378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-215a6f61-f043-4728-a392-166196734d6f None None] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:34.691347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-215a6f61-f043-4728-a392-166196734d6f None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:34.693827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-215a6f61-f043-4728-a392-166196734d6f None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:04:34.710378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215a6f61-f043-4728-a392-166196734d6f None None] Pushing event updated for resources: {'Port': ['ID=a6d31dda-fe07-44f3-bab5-45f7cf292122,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:34.711438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:34.717904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:34.724031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:04:34.727461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Pushing event updated for resources: {'Port': ['ID=411e6cc4-2575-4825-92b9-644ffe190b2a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:34.758350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-215a6f61-f043-4728-a392-166196734d6f None None] Attempting to bind port a6d31dda-fe07-44f3-bab5-45f7cf292122 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:04:34.758718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-215a6f61-f043-4728-a392-166196734d6f None None] Attempting to bind port a6d31dda-fe07-44f3-bab5-45f7cf292122 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:04:34.759075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-215a6f61-f043-4728-a392-166196734d6f None None] Attempting to bind port a6d31dda-fe07-44f3-bab5-45f7cf292122 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:04:34.764408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-215a6f61-f043-4728-a392-166196734d6f None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:04:34.764811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-215a6f61-f043-4728-a392-166196734d6f None None] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:04:34.765207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.765591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-215a6f61-f043-4728-a392-166196734d6f None None] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:04:34.766056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-215a6f61-f043-4728-a392-166196734d6f None None] Bound port: a6d31dda-fe07-44f3-bab5-45f7cf292122, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:04:34.766414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.830510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-215a6f61-f043-4728-a392-166196734d6f None None] For port a6d31dda-fe07-44f3-bab5-45f7cf292122, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:04:34.833576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-215a6f61-f043-4728-a392-166196734d6f None None] For port a6d31dda-fe07-44f3-bab5-45f7cf292122, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a6d31dda-fe07-44f3-bab5-45f7cf292122,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:04:34.837144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-215a6f61-f043-4728-a392-166196734d6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:34.893443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215a6f61-f043-4728-a392-166196734d6f None None] Pushing event updated for resources: {'Port': ['ID=a6d31dda-fe07-44f3-bab5-45f7cf292122,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:34.981722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.201308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.340719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Router e1950744-76aa-4eb7-9e17-c45963ef40dc is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:04:35.448814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:04:35.458643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:04:35.470796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.471506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:35.474887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:35.475174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6408f680-bf33-420b-b50e-6db2c60aa04c admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.5508077 Nov 05 15:04:35.475265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48466) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:35.587991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:35.769327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a6d31dda-fe07-44f3-bab5-45f7cf292122 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:35.837621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-912922d2-9888-4b1b-aea1-52c05a9b6e96 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:04:35.860706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:34Z', 'revision_number': 3, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:35.901231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a6d31dda-fe07-44f3-bab5-45f7cf292122 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:35.901592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.907998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:04:35.908342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Updating router e1950744-76aa-4eb7-9e17-c45963ef40dc port 411e6cc4-2575-4825-92b9-644ffe190b2a binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:04:35.916064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.972382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cb5d51b4-f849-4bf8-a2e7-076b5d33eeb0 None None] Provisioning complete for port a6d31dda-fe07-44f3-bab5-45f7cf292122 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:35.972712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb5d51b4-f849-4bf8-a2e7-076b5d33eeb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:35.974138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.069063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-912922d2-9888-4b1b-aea1-52c05a9b6e96 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:04:36.367026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Allocated IP 172.20.0.1 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/676adda1-bc37-42f5-8700-223770c339da) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:04:36.447487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.469152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.480780 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb5d51b4-f849-4bf8-a2e7-076b5d33eeb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.504222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.544444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port a6d31dda-fe07-44f3-bab5-45f7cf292122, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a6d31dda-fe07-44f3-bab5-45f7cf292122,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:36.544932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:36.548195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:36.553964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:04:36.561188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.579053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Pushing event updated for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:36.598846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.686609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.db.api [None req-cb5d51b4-f849-4bf8-a2e7-076b5d33eeb0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=113582) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 05 15:04:36.686970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG oslo_db.api [None req-cb5d51b4-f849-4bf8-a2e7-076b5d33eeb0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 05 15:04:36.724035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=a6d31dda-fe07-44f3-bab5-45f7cf292122,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:36.753025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.777099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.785545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.857610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb8d0182-d31e-4b08-8b87-7ba9d8aee6ed None None] Pushing event updated for resources: {'Port': ['ID=411e6cc4-2575-4825-92b9-644ffe190b2a,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:36.860009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Attempting to bind port 411e6cc4-2575-4825-92b9-644ffe190b2a on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:04:36.860385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Attempting to bind port 411e6cc4-2575-4825-92b9-644ffe190b2a by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:04:36.860803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Attempting to bind port 411e6cc4-2575-4825-92b9-644ffe190b2a on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:04:36.866570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:04:36.866962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:04:36.867362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.867751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:04:36.868231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Bound port: 411e6cc4-2575-4825-92b9-644ffe190b2a, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:04:36.868926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.921516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.922012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] For port 411e6cc4-2575-4825-92b9-644ffe190b2a, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:04:36.925396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] For port 411e6cc4-2575-4825-92b9-644ffe190b2a, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=411e6cc4-2575-4825-92b9-644ffe190b2a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:04:36.928007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.930458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:36.996651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:36.997773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:36.999583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb8d0182-d31e-4b08-8b87-7ba9d8aee6ed None None] Pushing event updated for resources: {'Port': ['ID=411e6cc4-2575-4825-92b9-644ffe190b2a,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:37.000109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Pushing event updated for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:37.002983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.098910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:37.100336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:37.115694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:37.221949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:04:37.338988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:04:37.346119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b1d026db-6562-45c0-893b-33dfc7da0cab admin admin] 10.222.0.30 "PUT /v2.0/routers/e1950744-76aa-4eb7-9e17-c45963ef40dc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8699136 Nov 05 15:04:37.364091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 2, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:37.394201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62507aa5-177b-42eb-99a1-f67ad22f7674 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 2, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:04:37.407724 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-af04a98f-0265-497a-8e45-e0d7c132c604 None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:37.408520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af04a98f-0265-497a-8e45-e0d7c132c604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.452410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-af04a98f-0265-497a-8e45-e0d7c132c604 None None] Port 676adda1-bc37-42f5-8700-223770c339da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:04:37.463124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-af04a98f-0265-497a-8e45-e0d7c132c604 None None] Provisioning complete for port a6d31dda-fe07-44f3-bab5-45f7cf292122 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:37.463496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af04a98f-0265-497a-8e45-e0d7c132c604 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.673812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6731b46e-275a-4ea7-b05d-f2afc3f1e56d None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:37.674301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6731b46e-275a-4ea7-b05d-f2afc3f1e56d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.737451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6731b46e-275a-4ea7-b05d-f2afc3f1e56d None None] Port 676adda1-bc37-42f5-8700-223770c339da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:04:37.769122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a6d31dda-fe07-44f3-bab5-45f7cf292122 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:37.825759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port a6d31dda-fe07-44f3-bab5-45f7cf292122 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:37.826313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.879834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7ccdc28f-7b64-46a9-abfc-07eb3f903c00 None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:37.880119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7ccdc28f-7b64-46a9-abfc-07eb3f903c00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:37.942850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7ccdc28f-7b64-46a9-abfc-07eb3f903c00 None None] Port 676adda1-bc37-42f5-8700-223770c339da cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:04:37.976736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48476) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:37.982053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1993639352', 'description': 'tempest-description--985508644'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:38.006975 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.079738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.091099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.125583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.126821 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.1485231 Nov 05 15:04:38.127521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85ad678-6188-48c2-98db-c5ddc219f6ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f81f297a-35ff-4b56-bf39-011da81f52af,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:38.129700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48478) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:38.135088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'security_group_rule': {'security_group_id': 'f81f297a-35ff-4b56-bf39-011da81f52af', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:38.166698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.235138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.239430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.258814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67a34e55-a80d-490d-a88a-c980aee59a14,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:38.267482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.268780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4fdb2660-e173-4a69-948f-62dab62110d9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1381402 Nov 05 15:04:38.271526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48480) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:38.276013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'security_group_rule': {'security_group_id': 'f81f297a-35ff-4b56-bf39-011da81f52af', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:38.303545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.364358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.368656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.389936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b9a2cb47-bcd9-45c4-8ee8-db5f36df1575,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:38.396478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.400815 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 48482) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:38.401384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ca5e127f-8db1-461e-b365-13a0c1fd0e68 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1283963 Nov 05 15:04:38.405644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:38.441096 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.552388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.668022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Allocated IP 172.26.5.150 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/ea33816b-3d3e-42b8-b418-f4498d9f0ea0) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:04:38.778848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.811844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.847600 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:38.850363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:38.855926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:04:38.883044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=ea33816b-3d3e-42b8-b418-f4498d9f0ea0,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:38.948552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:38.981712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.128569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.133251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.198814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=ea33816b-3d3e-42b8-b418-f4498d9f0ea0,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:39.212106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.227299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.228549 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7f0d7947-61e6-4311-b2ac-520bc10d0b50 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8266153 Nov 05 15:04:39.386027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-52ad4b64-8814-4761-89fe-90741a6c5ca0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1993639352&fields=id&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 267 time: 0.0507941 Nov 05 15:04:39.486585 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a919449c-d504-451e-9966-be000005a8ca None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:04:39.497396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-3e88c25b-20f1-40f9-9a3b-593e19fa19a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:39.497917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:39.498513 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:39.502441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-3e88c25b-20f1-40f9-9a3b-593e19fa19a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1078565 Nov 05 15:04:39.513930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-76c605f1-09b1-470c-83f9-af55cf87b291 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/quotas/cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 375 time: 0.0092506 Nov 05 15:04:39.576692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-e0000398-b34b-468f-a6bd-7fee94916271 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0574448 Nov 05 15:04:39.600133 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:39.677977 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-2098568c-9307-42e5-b5ec-832fd95ac41e service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897636 Nov 05 15:04:39.753249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 411e6cc4-2575-4825-92b9-644ffe190b2a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:39.779077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-32af31a5-b039-4476-9304-4414c2831d69 service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923345 Nov 05 15:04:39.813127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 411e6cc4-2575-4825-92b9-644ffe190b2a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:39.813562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.893190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 2, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:39.897035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.919787 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a919449c-d504-451e-9966-be000005a8ca None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:04:39.920193 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a919449c-d504-451e-9966-be000005a8ca None None] Updating router e1950744-76aa-4eb7-9e17-c45963ef40dc port 676adda1-bc37-42f5-8700-223770c339da binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:04:39.929499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 411e6cc4-2575-4825-92b9-644ffe190b2a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=411e6cc4-2575-4825-92b9-644ffe190b2a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:39.935196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:39.946371 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.000387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=411e6cc4-2575-4825-92b9-644ffe190b2a,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:40.021212 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a091ba7c-11b0-4f81-9a05-32ab99aae5e4 req-4fa74e79-14b5-4024-bc5d-912f8bc99db8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 210 time: 0.0996122 Nov 05 15:04:40.216985 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.222351 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.268710 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Pushing event updated for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:40.276510 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.277185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.278207 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.278701 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.279948 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.280298 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.280655 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.280989 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.281310 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.282525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.282525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.282525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:04:40.342666 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a919449c-d504-451e-9966-be000005a8ca None None] Attempting to bind port 676adda1-bc37-42f5-8700-223770c339da on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:04:40.343027 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a919449c-d504-451e-9966-be000005a8ca None None] Attempting to bind port 676adda1-bc37-42f5-8700-223770c339da by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:04:40.343565 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a919449c-d504-451e-9966-be000005a8ca None None] Attempting to bind port 676adda1-bc37-42f5-8700-223770c339da on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:04:40.349000 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a919449c-d504-451e-9966-be000005a8ca None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 4, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:04:40.349357 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a919449c-d504-451e-9966-be000005a8ca None None] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:04:40.349820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.350218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a919449c-d504-451e-9966-be000005a8ca None None] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:04:40.350680 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-a919449c-d504-451e-9966-be000005a8ca None None] Bound port: 676adda1-bc37-42f5-8700-223770c339da, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:04:40.351060 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.428323 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-a919449c-d504-451e-9966-be000005a8ca None None] For port 676adda1-bc37-42f5-8700-223770c339da, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:04:40.432214 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-a919449c-d504-451e-9966-be000005a8ca None None] For port 676adda1-bc37-42f5-8700-223770c339da, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=676adda1-bc37-42f5-8700-223770c339da,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:04:40.438016 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-a919449c-d504-451e-9966-be000005a8ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.492196 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9951820-7d0d-484a-a10a-52b30986512d None None] Pushing event updated for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:40.507093 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:40.507696 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:40.582633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:40.583147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.620393 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:40.667743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.706257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] For port 676adda1-bc37-42f5-8700-223770c339da, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=676adda1-bc37-42f5-8700-223770c339da,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:40.710437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.765247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83d793c1-7748-4af0-b3d9-8f9f00f20b45 None None] Pushing event updated for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:40.825096 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-a919449c-d504-451e-9966-be000005a8ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:40.833472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7c8585f5-5d70-460e-a835-09255d5b6c55 None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:40.834104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7c8585f5-5d70-460e-a835-09255d5b6c55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:40.852398 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a919449c-d504-451e-9966-be000005a8ca None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:04:40.997608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-e83e877d-912e-4ec2-95bb-8a1ea839db46 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:40.999871 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-e83e877d-912e-4ec2-95bb-8a1ea839db46 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1525385 Nov 05 15:04:41.073126 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-f8cc72f6-8bdb-4383-a131-b02aa7bee965 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 380 time: 0.0631158 Nov 05 15:04:41.084540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'port': {'device_id': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'admin_state_up': True, 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'security_groups': ['f81f297a-35ff-4b56-bf39-011da81f52af']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:41.157899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-50613847-9fa6-4922-b3f6-b3392d0f211c req-00bfbfdb-5856-4e99-b043-ab8962b5c191 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 210 time: 0.0697291 Nov 05 15:04:41.221661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:04:41.225432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.352515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Allocated IP 172.20.0.11 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/37164ce9-3357-458b-af2a-062675058515) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:04:41.501358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.534807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.574782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:04:41.577763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:04:41.583316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:04:41.613741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:41.641720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:41.642361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.659886 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-1bf50a43-f9a2-4e0c-8c56-91e60fa6ee4c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5792658 Nov 05 15:04:41.675913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Request body: {'port': {'device_id': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:41.736731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.759151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 676adda1-bc37-42f5-8700-223770c339da up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:41.819341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 676adda1-bc37-42f5-8700-223770c339da triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:41.819991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.872554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8de79ad2-85f2-4318-9d1c-ee3991089a45 None None] Provisioning complete for port 37164ce9-3357-458b-af2a-062675058515 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:41.872860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8de79ad2-85f2-4318-9d1c-ee3991089a45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:41.934722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-8de79ad2-85f2-4318-9d1c-ee3991089a45 None None] Port 37164ce9-3357-458b-af2a-062675058515 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:04:41.936940 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 411e6cc4-2575-4825-92b9-644ffe190b2a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:41.985748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 411e6cc4-2575-4825-92b9-644ffe190b2a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:41.986112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.004795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37164ce9-3357-458b-af2a-062675058515 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:04:42.012790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.024822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Transition to ACTIVE for port object 37164ce9-3357-458b-af2a-062675058515 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:04:42.028786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.088667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Pushing event updated for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:42.170400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Attempting to bind port 37164ce9-3357-458b-af2a-062675058515 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:04:42.170755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Attempting to bind port 37164ce9-3357-458b-af2a-062675058515 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:04:42.171088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Attempting to bind port 37164ce9-3357-458b-af2a-062675058515 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:04:42.175851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Port 37164ce9-3357-458b-af2a-062675058515 on network b7856e81-af33-4465-b684-ce86f847a4ff not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:04:42.176086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Attempting to bind port 37164ce9-3357-458b-af2a-062675058515 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:04:42.181061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 4, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:04:42.181430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:04:42.181810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:04:42.182259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Bound port: 37164ce9-3357-458b-af2a-062675058515, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:04:42.182749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.254506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:04:42.257653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=37164ce9-3357-458b-af2a-062675058515,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:04:42.262568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.278679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec117e0-9a70-43ec-a14c-d2dc793b60e0 req-19cf7966-55aa-48e9-9e73-f89ce14c7dd3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.280155 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3ec117e0-9a70-43ec-a14c-d2dc793b60e0 req-19cf7966-55aa-48e9-9e73-f89ce14c7dd3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 944 time: 0.0505128 Nov 05 15:04:42.299905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.300557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:42.301975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] 10.222.0.32 "PUT /v2.0/ports/37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1094 time: 0.6323452 Nov 05 15:04:42.302427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'tag': '37164ce9-3357-458b-af2a-062675058515'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:42.304776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49c5096e-1ee6-410d-a66c-f0e7e090d89b" -d '{"events": [{"name": "network-changed", "server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "tag": "37164ce9-3357-458b-af2a-062675058515"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:42.333141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb37ff95-f077-4a39-aa6c-2984d34dbb09 service neutron] Pushing event updated for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:42.358030 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3ec117e0-9a70-43ec-a14c-d2dc793b60e0 req-e1368d8a-2fb6-4858-9f18-2f4a56260f00 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0718236 Nov 05 15:04:42.373539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b387b4c7-ff60-481f-95fa-dfe033f965c6 x-openstack-request-id: req-b387b4c7-ff60-481f-95fa-dfe033f965c6 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:42.373833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "tag": "37164ce9-3357-458b-af2a-062675058515", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:42.374087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b387b4c7-ff60-481f-95fa-dfe033f965c6 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:42.374498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'tag': '37164ce9-3357-458b-af2a-062675058515', 'status': 'completed', 'code': 200} Nov 05 15:04:42.405672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-a7d79533-c859-4663-b0d8-ac1bd7663bf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.407379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-a7d79533-c859-4663-b0d8-ac1bd7663bf3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1097 time: 0.0546849 Nov 05 15:04:42.454981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-c1143176-465a-465a-9cb6-7f213ba24c5e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 217 time: 0.0373473 Nov 05 15:04:42.513126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-d8214b75-da7c-4748-ab29-a0bb0467b665 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.514604 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-d8214b75-da7c-4748-ab29-a0bb0467b665 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0521700 Nov 05 15:04:42.561135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-16372cd0-170a-43bd-af12-d9fef5cdf627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.562609 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-16372cd0-170a-43bd-af12-d9fef5cdf627 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408185 Nov 05 15:04:42.649856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-24692ceb-484f-4bde-b0b1-167afdcaaffc service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797908 Nov 05 15:04:42.741692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-33ab4f43-6766-4ea5-97e7-dd97543f7f07 req-84a07f82-f877-44aa-8b46-7b63494b7dec service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852292 Nov 05 15:04:42.822073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-1f8f1aab-b661-4da8-b61f-19101d38942e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.823572 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-1f8f1aab-b661-4da8-b61f-19101d38942e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1097 time: 0.0394974 Nov 05 15:04:42.914467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-29910e13-5683-4db5-aa52-dc8da8a5d804 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:42.915959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-29910e13-5683-4db5-aa52-dc8da8a5d804 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0855968 Nov 05 15:04:42.958464 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-f094d72e-04a7-40d9-a36a-ec957c5f639a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 217 time: 0.0351002 Nov 05 15:04:43.007268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-f41f1585-c9a6-4aca-b8fb-c3a6a0afd4c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:43.008715 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-f41f1585-c9a6-4aca-b8fb-c3a6a0afd4c5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0423872 Nov 05 15:04:43.053931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-f1c5e969-3da2-4e09-b874-cc16472b7e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:43.055401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-f1c5e969-3da2-4e09-b874-cc16472b7e84 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0390565 Nov 05 15:04:43.145449 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-62bebad6-401b-401e-beac-8a3db5015ed5 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826859 Nov 05 15:04:43.232888 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-49c5096e-1ee6-410d-a66c-f0e7e090d89b req-6a654d37-694d-4d25-bb2f-6c8ace5aac4d service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795825 Nov 05 15:04:43.466638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb910370-39de-428d-badd-2395b719f025 req-9d884fae-ab3d-4bb7-960d-fb865851d89f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:43.468104 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cb910370-39de-428d-badd-2395b719f025 req-9d884fae-ab3d-4bb7-960d-fb865851d89f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 944 time: 0.0500553 Nov 05 15:04:43.517524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cb910370-39de-428d-badd-2395b719f025 req-db44a24f-0c3e-43fb-9643-7d83d9230baa tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435071 Nov 05 15:04:44.690413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fd90c7-99a1-4494-9948-060caa58ae0b req-5a76af0c-d541-4d22-9d1a-6fc0579b1b4f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:44.692029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-99fd90c7-99a1-4494-9948-060caa58ae0b req-5a76af0c-d541-4d22-9d1a-6fc0579b1b4f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 944 time: 0.1071565 Nov 05 15:04:44.738397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-99fd90c7-99a1-4494-9948-060caa58ae0b req-ecbd3a5b-c060-4399-95f0-ef5dd1bfe2f9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404549 Nov 05 15:04:45.614998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 37164ce9-3357-458b-af2a-062675058515 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:04:45.709444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=37164ce9-3357-458b-af2a-062675058515,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:45.721126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '37164ce9-3357-458b-af2a-062675058515', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '37164ce9-3357-458b-af2a-062675058515', 'mac_address': 'fa:16:3e:73:79:cf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:04:45.756441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:45.769825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37164ce9-3357-458b-af2a-062675058515 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:04:45.789511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=37164ce9-3357-458b-af2a-062675058515,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:45.794524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:45.845056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:45.853369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5dfa7c7-1e7b-4c88-94a0-af02b55b3aaf req-ac864feb-5f19-4695-8741-f4d2cd38d0fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:45.854839 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5dfa7c7-1e7b-4c88-94a0-af02b55b3aaf req-ac864feb-5f19-4695-8741-f4d2cd38d0fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 945 time: 0.0481300 Nov 05 15:04:45.900308 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5dfa7c7-1e7b-4c88-94a0-af02b55b3aaf req-74623f3d-999c-4767-88ce-44de34328214 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395701 Nov 05 15:04:45.999346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['37164ce9-3357-458b-af2a-062675058515'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:04:47.011898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7a31fb-f518-46ce-8ad1-373bff1cc09e req-7e5c37a7-32ae-44f6-aa59-9bb73e6ab462 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:47.013377 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3f7a31fb-f518-46ce-8ad1-373bff1cc09e req-7e5c37a7-32ae-44f6-aa59-9bb73e6ab462 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 945 time: 0.0470316 Nov 05 15:04:47.059441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3f7a31fb-f518-46ce-8ad1-373bff1cc09e req-446ccab2-af53-4856-be0e-b2cab3c6f34e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403144 Nov 05 15:04:47.620161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 37164ce9-3357-458b-af2a-062675058515 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:04:47.671520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 37164ce9-3357-458b-af2a-062675058515 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:04:47.675640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 37164ce9-3357-458b-af2a-062675058515 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:04:47.676010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:47.752565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:47.774984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37164ce9-3357-458b-af2a-062675058515'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:47.777236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c5b6976-0b2e-40ed-90da-3fc55ad58daf" -d '{"events": [{"server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "name": "network-vif-plugged", "status": "completed", "tag": "37164ce9-3357-458b-af2a-062675058515"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:47.789553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=37164ce9-3357-458b-af2a-062675058515,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:04:47.794259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:47.817384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bddd77a-9c41-484c-bddf-743b34d72af9 x-openstack-request-id: req-3bddd77a-9c41-484c-bddf-743b34d72af9 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:47.817666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "name": "network-vif-plugged", "status": "completed", "tag": "37164ce9-3357-458b-af2a-062675058515", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:47.817912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3bddd77a-9c41-484c-bddf-743b34d72af9 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:47.818294 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37164ce9-3357-458b-af2a-062675058515', 'code': 200} Nov 05 15:04:47.843324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:04:47.982923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38437c7-133e-4694-b82e-54952cd280f4 req-6f70f412-0eea-430b-81e4-ec60806a5ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:47.984378 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a38437c7-133e-4694-b82e-54952cd280f4 req-6f70f412-0eea-430b-81e4-ec60806a5ef6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0419111 Nov 05 15:04:48.026731 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a38437c7-133e-4694-b82e-54952cd280f4 req-31a01f7f-4338-4c69-82df-74f485e2f411 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351954 Nov 05 15:04:48.170544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1dd92cd-f9d3-4902-b201-a1cdbad0ebfe req-8da99fae-d3cf-4e57-81ba-dc5ef0c1b422 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:48.172000 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1dd92cd-f9d3-4902-b201-a1cdbad0ebfe req-8da99fae-d3cf-4e57-81ba-dc5ef0c1b422 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0471437 Nov 05 15:04:48.218120 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1dd92cd-f9d3-4902-b201-a1cdbad0ebfe req-d3bd0ab7-88e0-4d92-a1c0-83241d3f74be tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401759 Nov 05 15:04:48.383350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:49.335329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2bef78-2ead-465a-9a48-4141b715df0d req-0f400ee6-0709-4ef5-8659-96b64f26c466 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:49.336828 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b2bef78-2ead-465a-9a48-4141b715df0d req-0f400ee6-0709-4ef5-8659-96b64f26c466 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0515978 Nov 05 15:04:49.384637 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b2bef78-2ead-465a-9a48-4141b715df0d req-8533f1be-371b-422c-97dd-415e63873fc8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399687 Nov 05 15:04:49.493699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2e1c2f-86d7-4de5-9ad7-023e5ccede20 req-493ef38a-82de-47eb-af29-5ba4f2c87727 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:49.495168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9f2e1c2f-86d7-4de5-9ad7-023e5ccede20 req-493ef38a-82de-47eb-af29-5ba4f2c87727 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0475602 Nov 05 15:04:49.504274 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48536) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:04:49.508692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'floatingip': {'port_id': '37164ce9-3357-458b-af2a-062675058515'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:04:49.804015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:50.084868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3d3515d5-c214-451f-9151-96865712ac6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:50.234500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:50.238833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:50.338147 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 associated. External IP: 172.26.5.150, port: 37164ce9-3357-458b-af2a-062675058515. Nov 05 15:04:50.546988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:04:50.654666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:04:50.659062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:50.664557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:04:50.674526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:50.675137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:50.686673 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a5ffe40c-863f-4297-ab58-465cdf83c673 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "PUT /v2.0/floatingips/8b0fa759-110d-4bf0-acb1-99357bf80a68 HTTP/1.1" status: 200 len: 992 time: 1.1813080 Nov 05 15:04:50.687345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'tag': '37164ce9-3357-458b-af2a-062675058515'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:04:50.689920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91179c28-b32f-4520-8bdf-619d00ac74c9" -d '{"events": [{"name": "network-changed", "server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "tag": "37164ce9-3357-458b-af2a-062675058515"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:04:50.730356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:04:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0763e544-b2e2-4e8a-bf5c-ea745f28908a x-openstack-request-id: req-0763e544-b2e2-4e8a-bf5c-ea745f28908a {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:04:50.731504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "tag": "37164ce9-3357-458b-af2a-062675058515", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:04:50.731932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0763e544-b2e2-4e8a-bf5c-ea745f28908a {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:04:50.732534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'tag': '37164ce9-3357-458b-af2a-062675058515', 'status': 'completed', 'code': 200} Nov 05 15:04:50.789622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:50.802020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-9c5c12b0-4058-4f11-a8ad-d3189559d54a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:50.803539 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-9c5c12b0-4058-4f11-a8ad-d3189559d54a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0489769 Nov 05 15:04:50.897595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-eab1fc2e-e8aa-4e0d-9612-3f024f66cf15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:50.899104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-eab1fc2e-e8aa-4e0d-9612-3f024f66cf15 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0886545 Nov 05 15:04:50.974087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-83861adf-dcc5-4d70-a510-0c37b8daf0a3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1000 time: 0.0681124 Nov 05 15:04:51.026058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-06da02d8-bd92-40ee-a344-339dcfe48e0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:51.028125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-06da02d8-bd92-40ee-a344-339dcfe48e0d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0460796 Nov 05 15:04:51.074685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-611b73ea-c837-476e-ab93-634af3a3342f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:04:51.076249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-611b73ea-c837-476e-ab93-634af3a3342f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0420880 Nov 05 15:04:51.173647 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-74379679-c091-462c-be1d-8d023ef6432f service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896997 Nov 05 15:04:51.173869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '37164ce9-3357-458b-af2a-062675058515', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:73:79:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:04:50Z', 'revision_number': 1, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:51.203530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:04:51.211918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:04:51.212550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:04:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:51.266195 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-91179c28-b32f-4520-8bdf-619d00ac74c9 req-514c138a-b416-4691-a573-cd607628988b service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851493 Nov 05 15:04:51.329283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:04:51.553596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '37164ce9-3357-458b-af2a-062675058515', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:73:79:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:04:50Z', 'revision_number': 1, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:04:51.582834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b51a810-b8c4-4b19-b860-a2842333e03f None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '37164ce9-3357-458b-af2a-062675058515', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:73:79:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:04:50Z', 'revision_number': 1, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:04:51.774046 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7906382-104d-46ce-b21a-c8e704312724 None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:04:52.422334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a7eb4bb3-e96b-45bc-a2f7-cbdc3f8b83c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:53.449328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:54.915152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:55.939000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:04:56.536605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:05:10.592989 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-d63ceceb-49ab-49a6-8196-f0ab67fe8213 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0814033 Nov 05 15:05:10.679588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-5bf4cfbb-fbb3-4c7a-9419-3b9d35677ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:10.681090 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-5bf4cfbb-fbb3-4c7a-9419-3b9d35677ce6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0445502 Nov 05 15:05:10.783590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-782e7d3a-fac1-4b4a-ac3e-5c76b3c480c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:10.785028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-782e7d3a-fac1-4b4a-ac3e-5c76b3c480c8 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0842826 Nov 05 15:05:10.853058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-0e89037a-9df8-4cec-bf30-19f44130a2c1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1002 time: 0.0608110 Nov 05 15:05:10.900025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-e95a055a-c891-47a1-84ae-c1052c0d970f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:10.901465 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-e95a055a-c891-47a1-84ae-c1052c0d970f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0417228 Nov 05 15:05:10.947208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-0f22ec2e-a153-4c77-9500-2083570b66f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:10.948800 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-0f22ec2e-a153-4c77-9500-2083570b66f7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0406663 Nov 05 15:05:10.959981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-747644c2-dfff-4671-b52f-2f12decb4a67 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:05:10.961069 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-747644c2-dfff-4671-b52f-2f12decb4a67 service neutron] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055339 Nov 05 15:05:11.051392 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-b7c7be99-6ef7-4be6-b6fa-fb40302cb6ad service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831811 Nov 05 15:05:11.137234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d5e5ff5-88bb-48d4-a7ba-55f306dc66a4 req-5d8515c8-4fc4-45de-bc31-578c1deef141 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0791206 Nov 05 15:05:18.379350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:20.086580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dba8e346-44cb-469a-a5d6-a6d99474f0a9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:22.422951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8a38c68-75e0-418f-8a40-b212b9f1684f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:23.453882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:24.917074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:25.943457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:28.042902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8b1c21-b534-4a0f-bb2f-f42ac24a8da2 req-12b2add7-6572-4abf-97da-9b7606620ed8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:28.044371 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a8b1c21-b534-4a0f-bb2f-f42ac24a8da2 req-12b2add7-6572-4abf-97da-9b7606620ed8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0489101 Nov 05 15:05:28.090608 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a8b1c21-b534-4a0f-bb2f-f42ac24a8da2 req-8f785365-66a1-4b40-a5f9-d9c51f8b8674 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405319 Nov 05 15:05:28.346226 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-b903c0da-b2ab-4e6c-9829-be16d82a4733 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0715532 Nov 05 15:05:28.354455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8eb1cf-7a65-4af6-bb5d-61461d5b2240 req-d1212f61-ebba-4346-b8fc-b48563911fde tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:28.355834 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b8eb1cf-7a65-4af6-bb5d-61461d5b2240 req-d1212f61-ebba-4346-b8fc-b48563911fde tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0722303 Nov 05 15:05:28.405367 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b8eb1cf-7a65-4af6-bb5d-61461d5b2240 req-40081fb6-5827-4ba9-90a0-7c03aaddae94 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426979 Nov 05 15:05:29.423425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-b9919166-6e70-4afe-9b46-1e463433d9c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:29.424947 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-b9919166-6e70-4afe-9b46-1e463433d9c0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0415730 Nov 05 15:05:29.520928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-f508bd16-03f5-4f25-9bf0-f62cee94f331 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:29.522471 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-f508bd16-03f5-4f25-9bf0-f62cee94f331 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0883858 Nov 05 15:05:29.522620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dda91e-03c0-4d2a-b63f-99906cdcc325 req-f0fb6305-90b0-4ac2-9a02-e61671f20616 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:29.524097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-96dda91e-03c0-4d2a-b63f-99906cdcc325 req-f0fb6305-90b0-4ac2-9a02-e61671f20616 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0493598 Nov 05 15:05:29.573796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-96dda91e-03c0-4d2a-b63f-99906cdcc325 req-286a4fc6-47e1-4082-99b3-60bedb5b692c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437596 Nov 05 15:05:29.588768 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-0e3d260f-1b08-4f5f-8dd5-8861b227a063 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1002 time: 0.0595627 Nov 05 15:05:29.641528 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-2c98c527-cf53-4cc8-9e8a-d2c69709552e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:29.643005 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-2c98c527-cf53-4cc8-9e8a-d2c69709552e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0476971 Nov 05 15:05:29.687644 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-a86f1ac2-d714-41f1-a3ca-18f3936e605e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:29.689062 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-a86f1ac2-d714-41f1-a3ca-18f3936e605e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0390756 Nov 05 15:05:29.775743 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-80926821-efdf-46b5-a1b6-ec587145d529 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792918 Nov 05 15:05:29.867356 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-f7957076-5e36-4b3d-af46-78db28ea6eef service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845008 Nov 05 15:05:30.690240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea8d1ab-1d38-4446-94b1-38fcb758a762 req-31ab1fa6-d2a0-4461-8975-af62819ce0a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:30.691715 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7ea8d1ab-1d38-4446-94b1-38fcb758a762 req-31ab1fa6-d2a0-4461-8975-af62819ce0a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0495021 Nov 05 15:05:30.736721 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7ea8d1ab-1d38-4446-94b1-38fcb758a762 req-86821d20-a014-4fe3-b00a-e47bcbc7c9ea tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391700 Nov 05 15:05:31.850624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0835fdb2-22f7-4015-8c86-988cf6c6dc6b req-6efaf628-9af8-497b-ac4d-bd94ee1f8c34 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:31.852100 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0835fdb2-22f7-4015-8c86-988cf6c6dc6b req-6efaf628-9af8-497b-ac4d-bd94ee1f8c34 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0489330 Nov 05 15:05:31.899158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0835fdb2-22f7-4015-8c86-988cf6c6dc6b req-342169c6-f2cb-4a2b-b03d-a96218227ff5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411518 Nov 05 15:05:33.016137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ecf2db-5155-4189-9727-6f1dee389894 req-55829104-8ffc-4912-87e3-b8a144c843e2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:33.017614 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9ecf2db-5155-4189-9727-6f1dee389894 req-55829104-8ffc-4912-87e3-b8a144c843e2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0523152 Nov 05 15:05:33.065091 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9ecf2db-5155-4189-9727-6f1dee389894 req-bac84217-9283-47f7-b6a8-8639b218348a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416138 Nov 05 15:05:33.535941 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:05:34.177814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a23112-5f0b-4b01-a86b-81ab111c06f6 req-9ac4db1e-6e2b-46ec-8db7-20c8959a7a83 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:34.179278 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37a23112-5f0b-4b01-a86b-81ab111c06f6 req-9ac4db1e-6e2b-46ec-8db7-20c8959a7a83 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0469551 Nov 05 15:05:34.226479 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-37a23112-5f0b-4b01-a86b-81ab111c06f6 req-e9e4aa6e-4175-4f9c-b45c-c6212ee4251e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401385 Nov 05 15:05:35.338122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4fe3bb-0191-4cf6-94cb-846bbcfb87aa req-7c59d244-3e16-40ab-9208-260ad60e6fb2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:35.339564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e4fe3bb-0191-4cf6-94cb-846bbcfb87aa req-7c59d244-3e16-40ab-9208-260ad60e6fb2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0478792 Nov 05 15:05:35.384643 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e4fe3bb-0191-4cf6-94cb-846bbcfb87aa req-021443ff-9619-47db-9205-ddb6c2c89335 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385523 Nov 05 15:05:36.806374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c0c81f-b21a-4929-9774-5536d1d0975a req-6f9e1d48-d91a-4c5a-abd1-187e7022766d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:36.807997 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a7c0c81f-b21a-4929-9774-5536d1d0975a req-6f9e1d48-d91a-4c5a-abd1-187e7022766d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.3561549 Nov 05 15:05:36.855263 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a7c0c81f-b21a-4929-9774-5536d1d0975a req-5935d8b3-8bc5-4718-b3ac-8f49f12cfe47 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412819 Nov 05 15:05:37.971375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7861230-134c-416c-ae3e-723003df7abe req-08b33967-0b25-4437-86ab-eb6ea380edee tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:37.972916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7861230-134c-416c-ae3e-723003df7abe req-08b33967-0b25-4437-86ab-eb6ea380edee tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0484891 Nov 05 15:05:38.023599 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7861230-134c-416c-ae3e-723003df7abe req-0381f38d-dc0e-4cfd-9ded-7e9b06541d99 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442917 Nov 05 15:05:39.140134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203eafa6-a63f-460d-ab6a-32ce47f3351f req-e31fcd77-8dba-46fa-8859-d6fafe4964f8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:39.141623 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-203eafa6-a63f-460d-ab6a-32ce47f3351f req-e31fcd77-8dba-46fa-8859-d6fafe4964f8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0479491 Nov 05 15:05:39.187471 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-203eafa6-a63f-460d-ab6a-32ce47f3351f req-6d50d9e0-8469-4cee-bf41-b239ccbcdb23 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400252 Nov 05 15:05:40.305790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5426a2bf-9bc2-4aef-b40f-f508e0270ed5 req-98c47204-0137-4f77-a231-09ff741747bb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:40.307521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5426a2bf-9bc2-4aef-b40f-f508e0270ed5 req-98c47204-0137-4f77-a231-09ff741747bb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0478137 Nov 05 15:05:40.355388 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5426a2bf-9bc2-4aef-b40f-f508e0270ed5 req-aa7881ef-7a2e-449d-8bc4-eaf87fab7127 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404177 Nov 05 15:05:41.442747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-bb095403-419e-46b6-98d6-553555c45083 service neutron] 10.222.0.32 "GET /v2.0/ports/37164ce9-3357-458b-af2a-062675058515/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0539343 Nov 05 15:05:41.474903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e64388-1e65-4e9d-b6bc-30300013085e req-1eabb794-7679-4715-86ee-111d23ecac01 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.476378 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9e64388-1e65-4e9d-b6bc-30300013085e req-1eabb794-7679-4715-86ee-111d23ecac01 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0531278 Nov 05 15:05:41.526059 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9e64388-1e65-4e9d-b6bc-30300013085e req-efda5a52-64b0-46a1-9f40-fbb9de5bc12c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430980 Nov 05 15:05:41.638535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-49582ba4-5a39-4be1-8581-fd0873008dd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.639921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-49582ba4-5a39-4be1-8581-fd0873008dd1 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1099 time: 0.0403235 Nov 05 15:05:41.708062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-b33b5ba9-fa68-470e-b632-afa30924ef8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.709642 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-b33b5ba9-fa68-470e-b632-afa30924ef8c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0475259 Nov 05 15:05:41.796606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-40b28376-c527-4343-a0ef-76a0b9735b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.798045 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-40b28376-c527-4343-a0ef-76a0b9735b44 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0817754 Nov 05 15:05:41.865794 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-164651e4-73e5-4f20-9c75-19e9b66cb86d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1002 time: 0.0603189 Nov 05 15:05:41.913000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-c97d7249-24be-41ca-b36e-bdfe85043c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.914382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-c97d7249-24be-41ca-b36e-bdfe85043c45 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0423298 Nov 05 15:05:41.958701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-d79b8dab-95e9-441b-a1c9-77268671dc15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:41.960133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-d79b8dab-95e9-441b-a1c9-77268671dc15 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384283 Nov 05 15:05:42.055538 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-e12c152e-5217-4d22-be28-a85e489e1881 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877914 Nov 05 15:05:42.144002 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fe736a2-2ea5-4de2-b99e-da6216515a42 req-89a8d44a-4f53-44ba-91f0-c0cc1f50565a service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809381 Nov 05 15:05:42.643147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb4ef63-5e03-4f57-ae07-a1c2e701a38d req-9c8abcf9-5ea9-4150-9894-1815d6c1cd6b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:42.645270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2cb4ef63-5e03-4f57-ae07-a1c2e701a38d req-9c8abcf9-5ea9-4150-9894-1815d6c1cd6b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0503075 Nov 05 15:05:42.704374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2cb4ef63-5e03-4f57-ae07-a1c2e701a38d req-375c213a-b11b-4d8a-b91f-4f43b3307105 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532448 Nov 05 15:05:43.819570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ade2c0d-acc0-4b73-8960-def1eb97203b req-b4564003-b905-40f1-ac72-e4266129115a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:43.820981 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6ade2c0d-acc0-4b73-8960-def1eb97203b req-b4564003-b905-40f1-ac72-e4266129115a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0485935 Nov 05 15:05:43.866913 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6ade2c0d-acc0-4b73-8960-def1eb97203b req-6fca34a3-e836-4613-8990-489a6dd30345 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399356 Nov 05 15:05:44.060773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b3290e8-620b-4e4c-8481-4e6d5002d08a req-d082eb60-85fb-45b5-8f9a-3fe1df9514c6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.063152 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b3290e8-620b-4e4c-8481-4e6d5002d08a req-d082eb60-85fb-45b5-8f9a-3fe1df9514c6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0502717 Nov 05 15:05:44.072217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-1a5a4037-007a-4a8a-b0b7-2621b0ec998c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.073696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-1a5a4037-007a-4a8a-b0b7-2621b0ec998c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 946 time: 0.0504990 Nov 05 15:05:44.114713 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b3290e8-620b-4e4c-8481-4e6d5002d08a req-c8caf33e-0b56-43e7-8496-24b7a21391f5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458345 Nov 05 15:05:44.153546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-3878d200-d071-49b2-90c1-5e87f73eaf21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.155041 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-3878d200-d071-49b2-90c1-5e87f73eaf21 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 1099 time: 0.0405219 Nov 05 15:05:44.245813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-63b260cf-1561-4a9d-b199-c26bb6ea2f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.247277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-63b260cf-1561-4a9d-b199-c26bb6ea2f48 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0859461 Nov 05 15:05:44.315322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-3825ba0f-f05d-453c-8914-6cc0a532c015 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 200 len: 1002 time: 0.0598159 Nov 05 15:05:44.363078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-eb0ab352-a819-4dcc-a028-257313b2eb49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.364411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-eb0ab352-a819-4dcc-a028-257313b2eb49 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0418262 Nov 05 15:05:44.412582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-b0adc5f1-faa9-42eb-8482-726589cbfe4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:44.414009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-b0adc5f1-faa9-42eb-8482-726589cbfe4b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0421703 Nov 05 15:05:44.500210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-2caab6fc-85e3-4394-a298-8364e90a88c0 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784764 Nov 05 15:05:44.589270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-864e9819-5db3-43f0-b7bc-92f2e4420668 req-ef1c5940-db21-4d41-a21a-42edb7722b55 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824263 Nov 05 15:05:45.492243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1447c72-09a5-48f9-9065-2d4017c9d330 req-64254619-d19e-43c6-a53e-159fa70c8b3d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:45.493826 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e1447c72-09a5-48f9-9065-2d4017c9d330 req-64254619-d19e-43c6-a53e-159fa70c8b3d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.3100832 Nov 05 15:05:45.539670 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e1447c72-09a5-48f9-9065-2d4017c9d330 req-2ec1d36f-279d-4a31-9326-198885b817d4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394158 Nov 05 15:05:45.651370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049b9b85-527e-4d03-b2dd-e5b43452358c req-e6d5c6ec-5cac-45c8-88ed-58f86327aeb1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:45.652864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-049b9b85-527e-4d03-b2dd-e5b43452358c req-e6d5c6ec-5cac-45c8-88ed-58f86327aeb1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0477431 Nov 05 15:05:45.699932 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-049b9b85-527e-4d03-b2dd-e5b43452358c req-d31982cb-a9ec-486d-ab7f-04cc67828f6a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410793 Nov 05 15:05:45.809441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c234402a-4d78-43a7-8158-af5229b08619 req-cf5c0105-3700-4c82-9781-17cbeb2568fd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:45.810811 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c234402a-4d78-43a7-8158-af5229b08619 req-cf5c0105-3700-4c82-9781-17cbeb2568fd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0471334 Nov 05 15:05:45.856125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c234402a-4d78-43a7-8158-af5229b08619 req-772e7c8f-6d38-4644-a2f6-ccc305f1c6e4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389259 Nov 05 15:05:46.090663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7555d278-f01f-4430-b7f5-52d94ee200ac req-678a63c0-8858-4705-b75b-52fc097b424e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:46.092011 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7555d278-f01f-4430-b7f5-52d94ee200ac req-678a63c0-8858-4705-b75b-52fc097b424e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0507133 Nov 05 15:05:46.137816 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7555d278-f01f-4430-b7f5-52d94ee200ac req-3694abdb-21dd-4a3c-b70d-6d73c9b16a6c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392234 Nov 05 15:05:47.251603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7d8e49-5670-4baa-bdff-b93a4d35b10b req-fce8ecd6-f850-400c-96c7-38043f4d31e6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:47.253205 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d7d8e49-5670-4baa-bdff-b93a4d35b10b req-fce8ecd6-f850-400c-96c7-38043f4d31e6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0480728 Nov 05 15:05:47.299248 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d7d8e49-5670-4baa-bdff-b93a4d35b10b req-7351a3ea-4c95-466e-bb8f-088fa212bd57 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397792 Nov 05 15:05:47.734926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09427308-8e47-489a-854d-7775e83d9827 req-66887d89-92a8-4d7c-9cc9-21a72299e311 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:47.736372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09427308-8e47-489a-854d-7775e83d9827 req-66887d89-92a8-4d7c-9cc9-21a72299e311 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 946 time: 0.0482907 Nov 05 15:05:47.824849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Deleting port 37164ce9-3357-458b-af2a-062675058515 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:05:47.825092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:47.909614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] For port 37164ce9-3357-458b-af2a-062675058515, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=37164ce9-3357-458b-af2a-062675058515,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:05:47.909968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.119519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.119793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.120105 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 disassociated. External IP: 172.26.5.150, port: 37164ce9-3357-458b-af2a-062675058515. Nov 05 15:05:48.120440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Calling delete_port for 37164ce9-3357-458b-af2a-062675058515 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:05:48.243164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.269012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'Port': ['ID=37164ce9-3357-458b-af2a-062675058515,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:48.278515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.278867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.279210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.279555 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.280408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.280769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.281107 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.281446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.282293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.282293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.282462 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.282716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:48.391406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.409677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d65f6ada-4243-442e-980b-2607f3c57e56 req-2207d933-df8e-452c-b460-d497bd459a3b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=f3a4ea18-4685-4dfc-815a-0c2aff7f260a HTTP/1.1" status: 200 len: 210 time: 0.0312481 Nov 05 15:05:48.438088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:05:48.546077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:05:48.555909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:05:48.565729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:05:48.566414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:05:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:05:48.585021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] No DVR routers for this DVR port 37164ce9-3357-458b-af2a-062675058515 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:05:48.587575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:48.590887 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09427308-8e47-489a-854d-7775e83d9827 req-f9a7d520-f801-4171-8f43-d08b01ffefd2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "DELETE /v2.0/ports/37164ce9-3357-458b-af2a-062675058515 HTTP/1.1" status: 204 len: 173 time: 0.8485863 Nov 05 15:05:48.591340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'name': 'network-vif-deleted', 'tag': '37164ce9-3357-458b-af2a-062675058515'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:05:48.594261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75136f30-9499-491d-806a-7cfd7fd0e50c" -d '{"events": [{"server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "name": "network-vif-deleted", "tag": "37164ce9-3357-458b-af2a-062675058515"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:05:48.635806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:05:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db77bf07-ca6d-440b-97ea-d455496114d3 x-openstack-request-id: req-db77bf07-ca6d-440b-97ea-d455496114d3 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:05:48.636103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3a4ea18-4685-4dfc-815a-0c2aff7f260a", "name": "network-vif-deleted", "tag": "37164ce9-3357-458b-af2a-062675058515", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:05:48.636361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-db77bf07-ca6d-440b-97ea-d455496114d3 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:05:48.636813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3a4ea18-4685-4dfc-815a-0c2aff7f260a', 'name': 'network-vif-deleted', 'tag': '37164ce9-3357-458b-af2a-062675058515', 'status': 'completed', 'code': 200} Nov 05 15:05:48.675286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:05:48.869790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:05:48.900860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:05:48.910230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:05:48.910829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:05:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:05:49.018178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:05:49.209621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:05:49.234441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-413b7000-03c0-4943-b8b8-8081940079dd None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:05:49.444885 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-856ba280-9bae-4683-bfe1-a320d2ec39e4 None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:05:49.657278 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-d2b02355-4298-4ac8-ab4e-af922b9e34e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1993639352&fields=id&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 267 time: 0.0495050 Nov 05 15:05:49.762671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-2161bfd4-011e-47e4-984f-6640080492b6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:49.764034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-2161bfd4-011e-47e4-984f-6640080492b6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.0997918 Nov 05 15:05:49.778335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-5f6ed899-5ac3-47b9-be9c-c9232bc82005 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/quotas/cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 375 time: 0.0086510 Nov 05 15:05:49.829958 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-070ab5a7-9be9-4158-8114-653e80e20450 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0459023 Nov 05 15:05:49.846297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-162ae411-27dd-43ac-b4fd-0d634a56b24a service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:05:49.847227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-162ae411-27dd-43ac-b4fd-0d634a56b24a service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055904 Nov 05 15:05:49.936288 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-bf7c1613-5b5b-4bf5-b811-ae8fdf685175 service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834427 Nov 05 15:05:50.022564 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-d95516ad-300e-4c8b-aa13-d01585454b96 service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802176 Nov 05 15:05:50.089225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ab428429-03c1-42c1-8de6-a16edaa24011 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:50.188813 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dd3b10d3-ab51-4621-95bb-fc43b00d8d0e req-c25294a2-b757-4dff-8449-b6fc74f44061 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 210 time: 0.0326626 Nov 05 15:05:51.094645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-9771fb80-9ab6-4451-bd76-d428ab2945fe tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:51.096888 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-9771fb80-9ab6-4451-bd76-d428ab2945fe tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1129165 Nov 05 15:05:51.165548 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-64ec2882-6890-4c5e-ac05-255ebc9bed89 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 380 time: 0.0592759 Nov 05 15:05:51.175169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'port': {'device_id': '634c90d9-e8ad-41fd-b320-94950106d463', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'admin_state_up': True, 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'security_groups': ['f81f297a-35ff-4b56-bf39-011da81f52af']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:05:51.297184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d94978e2-b724-4f62-b188-80129e80d40b req-461d81ce-e35a-400c-bb0d-4b2dc20326e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 210 time: 0.0338526 Nov 05 15:05:51.312587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:05:51.316238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.455617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Allocated IP 172.20.0.7 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/40e0f4ca-b269-4052-af11-0074791fcf55) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:05:51.587748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.621254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.665832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:05:51.671335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:05:51.683989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:05:51.714822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:51.745402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:51.746013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.762749 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-1b172c29-aa77-460e-9971-b4a3507997d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5911756 Nov 05 15:05:51.774854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Request body: {'port': {'device_id': '634c90d9-e8ad-41fd-b320-94950106d463', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:05:51.831725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.903492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-12da0857-c00d-46b8-a5e2-b40de3d859c8 None None] Provisioning complete for port 40e0f4ca-b269-4052-af11-0074791fcf55 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:05:51.904073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-12da0857-c00d-46b8-a5e2-b40de3d859c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:51.927238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 37164ce9-3357-458b-af2a-062675058515 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:05:51.950857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 37164ce9-3357-458b-af2a-062675058515 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:05:51.951128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 37164ce9-3357-458b-af2a-062675058515 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:05:51.959918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-12da0857-c00d-46b8-a5e2-b40de3d859c8 None None] Port 40e0f4ca-b269-4052-af11-0074791fcf55 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:05:52.088398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 40e0f4ca-b269-4052-af11-0074791fcf55 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:05:52.096405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.109157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Transition to ACTIVE for port object 40e0f4ca-b269-4052-af11-0074791fcf55 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:05:52.112843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.162560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Pushing event updated for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:52.231481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Attempting to bind port 40e0f4ca-b269-4052-af11-0074791fcf55 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:05:52.231908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Attempting to bind port 40e0f4ca-b269-4052-af11-0074791fcf55 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:05:52.232251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Attempting to bind port 40e0f4ca-b269-4052-af11-0074791fcf55 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:05:52.237483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Port 40e0f4ca-b269-4052-af11-0074791fcf55 on network b7856e81-af33-4465-b684-ce86f847a4ff not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:05:52.237806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Attempting to bind port 40e0f4ca-b269-4052-af11-0074791fcf55 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:05:52.243067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 5, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:05:52.243408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:05:52.243794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:05:52.244223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Bound port: 40e0f4ca-b269-4052-af11-0074791fcf55, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:05:52.244610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.313167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:05:52.316872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=40e0f4ca-b269-4052-af11-0074791fcf55,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:05:52.321149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.354129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.354599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.356332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] 10.222.0.32 "PUT /v2.0/ports/40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1093 time: 0.5857301 Nov 05 15:05:52.358663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:05:52.361818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e28c6c8e-bd25-4e69-be84-0b648da493d0" -d '{"events": [{"name": "network-changed", "server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:05:52.402508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b5f232-c681-4a20-9edc-31cd92faef43 service neutron] Pushing event updated for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:52.455132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-9c109c64-31ce-4144-93e4-12b15a86fc72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.456845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-9c109c64-31ce-4144-93e4-12b15a86fc72 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1096 time: 0.0477831 Nov 05 15:05:52.463047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08778713-5934-4c53-965f-bfbfd1c94a1e req-343cff35-487e-4462-9ed3-ac9cd74334c6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.465368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-08778713-5934-4c53-965f-bfbfd1c94a1e req-343cff35-487e-4462-9ed3-ac9cd74334c6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 943 time: 0.0919135 Nov 05 15:05:52.469988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d28b6a8d-be49-4e22-adb0-16297ebde7ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:52.474930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:05:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e38e2fd4-d454-4afe-877c-9c7482e1a6e9 x-openstack-request-id: req-e38e2fd4-d454-4afe-877c-9c7482e1a6e9 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:05:52.476926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:05:52.477408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e38e2fd4-d454-4afe-877c-9c7482e1a6e9 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:05:52.478252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55', 'status': 'completed', 'code': 200} Nov 05 15:05:52.516767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-6009465d-1b44-4cc7-8c1a-319687775797 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 217 time: 0.0497713 Nov 05 15:05:52.534278 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-08778713-5934-4c53-965f-bfbfd1c94a1e req-9f52160e-71e7-4f93-8b5a-bec589055382 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580649 Nov 05 15:05:52.570240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c4072610-50e6-4f35-beb4-e34a4d075f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.571739 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-c4072610-50e6-4f35-beb4-e34a4d075f7d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0473502 Nov 05 15:05:52.618157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-472fd82d-4b54-42a8-bf95-68ac2eec1dfe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.619652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-472fd82d-4b54-42a8-bf95-68ac2eec1dfe service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0412657 Nov 05 15:05:52.711427 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-5317d17e-6202-4b36-bf3c-bec7420cecdd service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844884 Nov 05 15:05:52.798194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97c00ea3-4126-479d-a4e8-d62e81b364dc req-41ecab94-2d97-41ed-a113-bd71de7c5b6a service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798488 Nov 05 15:05:52.880328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-f737d9b3-e3f4-41bf-ba5c-66d8e0d079ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.881820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-f737d9b3-e3f4-41bf-ba5c-66d8e0d079ad service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1096 time: 0.0400870 Nov 05 15:05:52.976770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-5a5c4757-4a1a-48de-8052-b327f26c9eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:52.978147 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-5a5c4757-4a1a-48de-8052-b327f26c9eb4 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0876915 Nov 05 15:05:53.020504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-89e21b19-689e-46af-9511-1fc987501106 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 217 time: 0.0345643 Nov 05 15:05:53.068066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-ee91769c-2366-49fc-aa02-a81ccc527659 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:53.069512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-ee91769c-2366-49fc-aa02-a81ccc527659 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0419357 Nov 05 15:05:53.119131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-c0950bff-20e1-4970-a7da-3ba874bb948e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:53.120679 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-c0950bff-20e1-4970-a7da-3ba874bb948e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0430939 Nov 05 15:05:53.207676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-adf779a6-9f8e-4e86-bad2-d7038cccd07e service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792305 Nov 05 15:05:53.298677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e28c6c8e-bd25-4e69-be84-0b648da493d0 req-8788ac20-1145-4a61-a43e-2e7afc5f4da4 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835905 Nov 05 15:05:53.453767 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:53.654362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9eafb8-6782-45c0-bbaa-a9075723cfeb req-06be188b-99de-44db-bcae-83ded1e26fcf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:53.656344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a9eafb8-6782-45c0-bbaa-a9075723cfeb req-06be188b-99de-44db-bcae-83ded1e26fcf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 943 time: 0.0498991 Nov 05 15:05:53.702413 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a9eafb8-6782-45c0-bbaa-a9075723cfeb req-853cf40a-854c-40cc-b339-7eb1018eb581 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401409 Nov 05 15:05:54.816321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f507bac2-a2e9-406e-a776-0f9ab7241d66 req-ff23665c-8030-46d5-9857-0a4b30ee915f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:54.817724 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f507bac2-a2e9-406e-a776-0f9ab7241d66 req-ff23665c-8030-46d5-9857-0a4b30ee915f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 943 time: 0.0485718 Nov 05 15:05:54.866399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f507bac2-a2e9-406e-a776-0f9ab7241d66 req-8ae07031-d990-48a7-8c0c-b2243e3f59f2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428009 Nov 05 15:05:54.921046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:55.943037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 40e0f4ca-b269-4052-af11-0074791fcf55 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:05:55.954276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:55.979772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d42be2-3d5a-47ee-9681-f3132a2de5cf req-c9617ba8-295c-43b6-81b3-42d4f5fb5a9b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:55.981270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96d42be2-3d5a-47ee-9681-f3132a2de5cf req-c9617ba8-295c-43b6-81b3-42d4f5fb5a9b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 943 time: 0.0478709 Nov 05 15:05:56.036901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96d42be2-3d5a-47ee-9681-f3132a2de5cf req-c1d46ee0-6b7e-4ab3-84d5-4931c551d534 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495839 Nov 05 15:05:56.042507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=40e0f4ca-b269-4052-af11-0074791fcf55,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:05:56.054601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '40e0f4ca-b269-4052-af11-0074791fcf55', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '40e0f4ca-b269-4052-af11-0074791fcf55', 'mac_address': 'fa:16:3e:1d:15:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:05:56.091668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:56.108126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 40e0f4ca-b269-4052-af11-0074791fcf55 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:05:56.128887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=40e0f4ca-b269-4052-af11-0074791fcf55,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:05:56.132689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:56.177652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:56.184793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.185142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.185477 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.186363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.186690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.187016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.187336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.187654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.187973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.188288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.188625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.188970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:05:56.337188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['40e0f4ca-b269-4052-af11-0074791fcf55'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:05:57.149240 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c627c818-7d62-4031-87ac-c918d266a0cd req-fc8b36ac-8c93-4a5d-905c-cf20c2e40316 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:57.150715 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c627c818-7d62-4031-87ac-c918d266a0cd req-fc8b36ac-8c93-4a5d-905c-cf20c2e40316 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 944 time: 0.0483122 Nov 05 15:05:57.196860 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c627c818-7d62-4031-87ac-c918d266a0cd req-c70b4bab-97f8-476c-860e-84666a6aeac0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397472 Nov 05 15:05:57.948151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 40e0f4ca-b269-4052-af11-0074791fcf55 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:05:57.994903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 40e0f4ca-b269-4052-af11-0074791fcf55 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:05:57.999347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 40e0f4ca-b269-4052-af11-0074791fcf55 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:05:57.999711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:58.084526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:58.108601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:05:58.110838 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6be4db32-46a1-4db9-9d41-b65d59df1fe6" -d '{"events": [{"server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "name": "network-vif-plugged", "status": "completed", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:05:58.123008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=40e0f4ca-b269-4052-af11-0074791fcf55,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:05:58.127542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:05:58.152707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:05:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3945f4bc-e327-4ca1-9eb9-f64c37c3b72f x-openstack-request-id: req-3945f4bc-e327-4ca1-9eb9-f64c37c3b72f {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:05:58.152992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "name": "network-vif-plugged", "status": "completed", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:05:58.153244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3945f4bc-e327-4ca1-9eb9-f64c37c3b72f {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:05:58.153630 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55', 'code': 200} Nov 05 15:05:58.178241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:05:58.314596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885f1595-1696-4967-87df-ce2e079a0500 req-fdfab23c-04b6-44f6-861b-3fee31f53832 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:58.315170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a5ae1a-5760-4e7d-bfa0-f771bc2d9e2d req-3cbd4376-3b71-4f85-b415-ec873ecc5266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:58.316134 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-885f1595-1696-4967-87df-ce2e079a0500 req-fdfab23c-04b6-44f6-861b-3fee31f53832 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0483112 Nov 05 15:05:58.316438 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52a5ae1a-5760-4e7d-bfa0-f771bc2d9e2d req-3cbd4376-3b71-4f85-b415-ec873ecc5266 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0395210 Nov 05 15:05:58.367370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52a5ae1a-5760-4e7d-bfa0-f771bc2d9e2d req-9e9cfb77-7f26-45fb-b5d7-e4f23e3b0d10 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438976 Nov 05 15:05:58.368288 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-885f1595-1696-4967-87df-ce2e079a0500 req-46f14e54-3d52-488d-a6f2-53b8b5b6b4f2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458114 Nov 05 15:05:59.489925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc14386c-5668-46a5-9296-95e51e258a37 req-d0f151fd-41fb-4de1-830a-a3bbba7240ef tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:05:59.491409 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc14386c-5668-46a5-9296-95e51e258a37 req-d0f151fd-41fb-4de1-830a-a3bbba7240ef tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0520356 Nov 05 15:05:59.541951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc14386c-5668-46a5-9296-95e51e258a37 req-d44f2089-bce2-471f-a212-c2ecccb37c36 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423944 Nov 05 15:06:00.659780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5891fb48-d2fa-464d-aa7b-dbe97cf5a84c req-a1046856-a0bd-4f64-a24a-7ecd9bf81604 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:00.661340 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5891fb48-d2fa-464d-aa7b-dbe97cf5a84c req-a1046856-a0bd-4f64-a24a-7ecd9bf81604 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0521586 Nov 05 15:06:00.707016 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5891fb48-d2fa-464d-aa7b-dbe97cf5a84c req-396e54c0-3537-43a0-b7a6-5ff5d48b8c6f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398648 Nov 05 15:06:00.818654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccf1b26-61b7-44c7-894b-5d4d9c97207c req-46fb17d6-68a3-49d4-90cd-97f8f055cb9e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:00.820015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ccf1b26-61b7-44c7-894b-5d4d9c97207c req-46fb17d6-68a3-49d4-90cd-97f8f055cb9e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0515156 Nov 05 15:06:00.828942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 48748) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:06:00.833417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'floatingip': {'port_id': '40e0f4ca-b269-4052-af11-0074791fcf55'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:06:00.871181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:01.293019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:01.296823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:01.656917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 associated. External IP: 172.26.5.150, port: 40e0f4ca-b269-4052-af11-0074791fcf55. Nov 05 15:06:01.851594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:06:01.954746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:06:01.959529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:01.964042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:06:01.973718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:06:01.974326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:05:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:06:01.989536 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-56eaac91-c3ec-46c0-831a-db89711a26e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "PUT /v2.0/floatingips/8b0fa759-110d-4bf0-acb1-99357bf80a68 HTTP/1.1" status: 200 len: 991 time: 1.1594770 Nov 05 15:06:01.990216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:06:01.992495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d511c30b-d977-44e5-bcdf-d41b5742e4be" -d '{"events": [{"name": "network-changed", "server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:06:02.033040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:06:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47568f1e-ff83-4900-9427-8e735ddab410 x-openstack-request-id: req-47568f1e-ff83-4900-9427-8e735ddab410 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:06:02.033332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:06:02.033594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-47568f1e-ff83-4900-9427-8e735ddab410 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:06:02.033982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55', 'status': 'completed', 'code': 200} Nov 05 15:06:02.082883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:06:02.098618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-d30e9760-26e5-4a54-9f40-24ed7ff5148e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:02.100194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-d30e9760-26e5-4a54-9f40-24ed7ff5148e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0405791 Nov 05 15:06:02.188952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-3a3c3d0f-c89a-4070-b2e6-f962567588bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:02.190420 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-3a3c3d0f-c89a-4070-b2e6-f962567588bf service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0832171 Nov 05 15:06:02.259378 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-051e7c2e-f8cb-45b0-a50b-269c4ee37ae6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 999 time: 0.0615809 Nov 05 15:06:02.304663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '40e0f4ca-b269-4052-af11-0074791fcf55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:1d:15:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '634c90d9-e8ad-41fd-b320-94950106d463', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:06:01Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:06:02.308485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-50bbb7fe-c77f-4162-8a68-8558837c305a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:02.309967 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-50bbb7fe-c77f-4162-8a68-8558837c305a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0443254 Nov 05 15:06:02.330741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:06:02.339315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:06:02.339911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:05:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:06:02.355158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-95d44981-a4d8-4a15-bbe7-59e857129e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:02.356686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-95d44981-a4d8-4a15-bbe7-59e857129e67 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0399463 Nov 05 15:06:02.446226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:06:02.447664 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-aae62da9-7243-4e85-a7c0-dcfb4a896bc5 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842836 Nov 05 15:06:02.537429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d511c30b-d977-44e5-bcdf-d41b5742e4be req-c6982028-897f-487c-9199-2572ff201e4c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827012 Nov 05 15:06:02.668142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '40e0f4ca-b269-4052-af11-0074791fcf55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:1d:15:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '634c90d9-e8ad-41fd-b320-94950106d463', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:06:01Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:06:02.697654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f50baa9d-bba1-452a-9e5c-fb3592777198 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '40e0f4ca-b269-4052-af11-0074791fcf55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:1d:15:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '634c90d9-e8ad-41fd-b320-94950106d463', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:06:01Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:06:02.871219 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7975b9cc-d4f8-4b58-8d8f-f809ea34f69b None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:06:10.533932 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:06:10.549895 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-eda48395-67af-4259-bf62-9a990a343f1d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396795 Nov 05 15:06:10.635840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-72060e5a-1c65-4622-adb7-822eb3a7bb29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:10.637379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-72060e5a-1c65-4622-adb7-822eb3a7bb29 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0435822 Nov 05 15:06:10.743060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-fe9caaee-3d64-4ffe-8876-b97610413129 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:10.744533 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-fe9caaee-3d64-4ffe-8876-b97610413129 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0866148 Nov 05 15:06:10.812487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-d80696d1-a2ba-4dcd-9d05-1eacf9eefe6f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1001 time: 0.0596018 Nov 05 15:06:10.857821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-ce430181-8ec8-4e52-9784-c0e7a0d79af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:10.859720 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-ce430181-8ec8-4e52-9784-c0e7a0d79af5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0413747 Nov 05 15:06:10.906489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-c5f2b28f-e1a9-435e-ae27-204d55082cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:10.907905 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-c5f2b28f-e1a9-435e-ae27-204d55082cf7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0381038 Nov 05 15:06:10.996923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-f3642095-b4b5-4c90-87e6-be185f565a67 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818257 Nov 05 15:06:11.086428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2710b6a8-4636-4c97-b742-4aff203a6ddf req-87f0e9db-2e53-4f24-a80c-be60455c4493 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821142 Nov 05 15:06:18.390570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:20.091812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7a1bbdba-813a-42d7-9acf-c1ef9e6ed22e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:22.422545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7a37cb7a-23ce-490e-8577-8f7eb7cb836e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:23.455753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:24.923333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:25.954422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:38.234503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b8e497f-23b4-45d6-9361-f1f90f0c65b0 req-67114e13-3560-4c3d-a5e4-77c591658cb0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:38.235897 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b8e497f-23b4-45d6-9361-f1f90f0c65b0 req-67114e13-3560-4c3d-a5e4-77c591658cb0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0501065 Nov 05 15:06:38.287692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b8e497f-23b4-45d6-9361-f1f90f0c65b0 req-6a9999b0-f7fa-4504-809a-0afbddea0f5e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456312 Nov 05 15:06:39.405378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe6e7f6-ff81-4fc6-87ad-73b5081eb7bf req-184e4ad5-a262-4e26-9bdf-a316ba871c75 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:39.406888 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-afe6e7f6-ff81-4fc6-87ad-73b5081eb7bf req-184e4ad5-a262-4e26-9bdf-a316ba871c75 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0495119 Nov 05 15:06:39.457187 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-afe6e7f6-ff81-4fc6-87ad-73b5081eb7bf req-8f2bcdec-1d39-47b9-9b45-b6ce0bf43ccf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443103 Nov 05 15:06:40.572484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f290cb-34ad-4df8-add6-e7aa2423292d req-42ff193f-d699-4d8b-b1a3-5739b8961d70 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:40.573993 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-23f290cb-34ad-4df8-add6-e7aa2423292d req-42ff193f-d699-4d8b-b1a3-5739b8961d70 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0490458 Nov 05 15:06:40.619757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-23f290cb-34ad-4df8-add6-e7aa2423292d req-2a047aea-0f4e-465e-bb90-32e199061b2d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392776 Nov 05 15:06:41.733585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-358f4e8e-ee4b-4f8c-a042-11e8f9d2555f req-482b3a4f-e802-4c35-bac4-450ad826027d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:41.735066 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-358f4e8e-ee4b-4f8c-a042-11e8f9d2555f req-482b3a4f-e802-4c35-bac4-450ad826027d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0483034 Nov 05 15:06:41.782707 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-358f4e8e-ee4b-4f8c-a042-11e8f9d2555f req-55a5f15b-49bf-4463-b72b-f953ba73448a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416851 Nov 05 15:06:42.906449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc65257-1335-4817-9c8d-aa41166510aa req-88fb9ff4-2f02-4f8b-9bc6-4f3f91f74ed1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:42.907932 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dfc65257-1335-4817-9c8d-aa41166510aa req-88fb9ff4-2f02-4f8b-9bc6-4f3f91f74ed1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0599735 Nov 05 15:06:42.960285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dfc65257-1335-4817-9c8d-aa41166510aa req-4d98330f-d7a3-49f4-9574-b090bf3064ee tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464249 Nov 05 15:06:44.072954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2da3d5-bb54-42f9-91c0-b9b912f6a00b req-5ee2cd99-e615-4092-8c5c-3d819668601f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:44.074399 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ba2da3d5-bb54-42f9-91c0-b9b912f6a00b req-5ee2cd99-e615-4092-8c5c-3d819668601f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0484016 Nov 05 15:06:44.119987 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ba2da3d5-bb54-42f9-91c0-b9b912f6a00b req-70487e2e-5b04-46a1-ae1c-3e799021711b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391607 Nov 05 15:06:45.236364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0bdba6-309d-4940-9fee-15d4b362d994 req-e93704a8-10cf-4815-a0fc-3a1c9d36e24a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:45.237842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c0bdba6-309d-4940-9fee-15d4b362d994 req-e93704a8-10cf-4815-a0fc-3a1c9d36e24a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0511472 Nov 05 15:06:45.291913 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2c0bdba6-309d-4940-9fee-15d4b362d994 req-9cd0e091-5639-4b28-a8bf-387dfbd275f7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481229 Nov 05 15:06:46.412387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a269934-92e6-4e79-bb9e-b1a9642bb787 req-e2fea666-e7e2-4d30-8a14-a0ba0b1b5783 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:46.413872 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6a269934-92e6-4e79-bb9e-b1a9642bb787 req-e2fea666-e7e2-4d30-8a14-a0ba0b1b5783 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0523434 Nov 05 15:06:46.459841 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6a269934-92e6-4e79-bb9e-b1a9642bb787 req-52567b4b-46c7-41cf-877e-926509e20cc5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401323 Nov 05 15:06:47.533735 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:06:47.573337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a974e7d2-52fc-4634-833f-105dc40cc707 req-0126c0ff-ae11-4940-9c77-294087cd3650 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:47.574801 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a974e7d2-52fc-4634-833f-105dc40cc707 req-0126c0ff-ae11-4940-9c77-294087cd3650 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0488565 Nov 05 15:06:47.621206 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a974e7d2-52fc-4634-833f-105dc40cc707 req-3c785190-adc5-43bb-8245-2671275ec314 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404272 Nov 05 15:06:48.405753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:48.738994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847a2932-608a-4908-9deb-7949e570bd00 req-299faa3f-03cf-4bc7-bff3-afb6f6335f0d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:48.740644 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-847a2932-608a-4908-9deb-7949e570bd00 req-299faa3f-03cf-4bc7-bff3-afb6f6335f0d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0487523 Nov 05 15:06:48.790930 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-847a2932-608a-4908-9deb-7949e570bd00 req-cb0e5e69-b1b6-4089-b247-365543f451f8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433142 Nov 05 15:06:49.903156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2d31fe-2954-4e24-80c8-4bb5ccbe09b9 req-a7e7dce9-b760-4035-9cd8-bd00b78fdb5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:49.904661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ee2d31fe-2954-4e24-80c8-4bb5ccbe09b9 req-a7e7dce9-b760-4035-9cd8-bd00b78fdb5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0476112 Nov 05 15:06:49.954395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ee2d31fe-2954-4e24-80c8-4bb5ccbe09b9 req-56f57e36-5788-4823-8cc5-5e4c4ddbb8ac tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437799 Nov 05 15:06:50.093345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a38586af-a803-42aa-b6bb-ae8e74a908ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:51.069163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b2aa86b-e1e7-4a46-9199-f8656d043405 req-4ec19133-4694-427d-b681-52ef052d25ae tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:51.070532 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b2aa86b-e1e7-4a46-9199-f8656d043405 req-4ec19133-4694-427d-b681-52ef052d25ae tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0488873 Nov 05 15:06:51.121524 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2b2aa86b-e1e7-4a46-9199-f8656d043405 req-0cc8e697-d34d-4d82-8c28-699ab887b993 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449579 Nov 05 15:06:52.235888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b76b3fb-6dbf-4b71-bfbe-a02ed35a4e93 req-c220adc2-8422-487b-a6bd-240233a9ec21 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:52.237387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b76b3fb-6dbf-4b71-bfbe-a02ed35a4e93 req-c220adc2-8422-487b-a6bd-240233a9ec21 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0477064 Nov 05 15:06:52.283536 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b76b3fb-6dbf-4b71-bfbe-a02ed35a4e93 req-7e107e6a-4d58-4b6d-860c-1ee254f0ab84 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403087 Nov 05 15:06:52.423618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-21ab8136-665d-4c5d-9625-c896cc3edea7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:53.397229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2332db17-95c0-45ce-902e-1789cd7e9000 req-52a8d018-57d2-4947-8607-42f23b880333 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:53.398699 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2332db17-95c0-45ce-902e-1789cd7e9000 req-52a8d018-57d2-4947-8607-42f23b880333 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0495346 Nov 05 15:06:53.449426 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2332db17-95c0-45ce-902e-1789cd7e9000 req-f46e8a30-93b3-48f8-80e6-8bd777bfd802 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438986 Nov 05 15:06:53.475797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:54.566645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa99bec-0bce-43c3-a024-a6e0c6a84e40 req-c585d890-0005-483a-8e70-01681cfeec02 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:54.568807 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-daa99bec-0bce-43c3-a024-a6e0c6a84e40 req-c585d890-0005-483a-8e70-01681cfeec02 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0495641 Nov 05 15:06:54.616747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-daa99bec-0bce-43c3-a024-a6e0c6a84e40 req-51aa97b4-8da1-443a-a3e2-c1b8a286500b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418203 Nov 05 15:06:54.865912 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-3bf2818d-d408-40f3-be46-85d5378717af service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0723305 Nov 05 15:06:54.874294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b67906c-7439-4dfd-8017-8c57b7d3098f req-b72fcf3c-e6a2-471d-abde-6bd3b3fb487d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:54.875699 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5b67906c-7439-4dfd-8017-8c57b7d3098f req-b72fcf3c-e6a2-471d-abde-6bd3b3fb487d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0734341 Nov 05 15:06:54.925541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5b67906c-7439-4dfd-8017-8c57b7d3098f req-87711fd3-9508-4bb1-bb2a-4659d0078048 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433679 Nov 05 15:06:54.926890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:55.934699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-dcbe7c8e-04f4-4526-a3f9-95b09466e4ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:55.936775 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-dcbe7c8e-04f4-4526-a3f9-95b09466e4ab service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0406344 Nov 05 15:06:55.948154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:06:56.028743 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-7d231551-4114-4054-9688-1b1f9aee06ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:56.030714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-7d231551-4114-4054-9688-1b1f9aee06ef service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0881932 Nov 05 15:06:56.044822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366cc25c-5864-4e65-9435-f0c3b822db25 req-06f1b16a-b13b-42b5-9de7-380454197628 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:56.046905 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-366cc25c-5864-4e65-9435-f0c3b822db25 req-06f1b16a-b13b-42b5-9de7-380454197628 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0504210 Nov 05 15:06:56.093753 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-366cc25c-5864-4e65-9435-f0c3b822db25 req-71501d0c-8f5d-4582-83f5-194692d949ed tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408187 Nov 05 15:06:56.097077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-ebb9f193-50fc-48d2-aadf-3038337e2183 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1001 time: 0.0586243 Nov 05 15:06:56.150989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-86052e31-5f3f-4c32-af95-739c9dfd44b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:56.152422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-86052e31-5f3f-4c32-af95-739c9dfd44b1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0481336 Nov 05 15:06:56.196894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-d2c610ec-d38c-438c-aae7-4b58ba2b2455 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:56.198339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-d2c610ec-d38c-438c-aae7-4b58ba2b2455 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0391564 Nov 05 15:06:56.285796 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-2f0bff4e-dcd5-40b6-a980-7a9e3276c677 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801530 Nov 05 15:06:56.380778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-7aa34bb1-ca26-4490-8327-ac541e2db235 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876205 Nov 05 15:06:57.209276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1133c3-cf7d-43aa-aaf6-a8c86b42bf26 req-af95b3ff-442a-4b6d-ab8d-f9b8325feca9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:57.210792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4b1133c3-cf7d-43aa-aaf6-a8c86b42bf26 req-af95b3ff-442a-4b6d-ab8d-f9b8325feca9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0497205 Nov 05 15:06:57.257214 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4b1133c3-cf7d-43aa-aaf6-a8c86b42bf26 req-796a3af7-0558-4548-8108-0cfa7da1090e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406220 Nov 05 15:06:57.940643 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-01819938-f024-442f-8d07-134001ba1c0f service neutron] 10.222.0.32 "GET /v2.0/ports/40e0f4ca-b269-4052-af11-0074791fcf55/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0631862 Nov 05 15:06:58.140665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-6c9c328c-35c5-476c-913a-16a5108be47e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.142261 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-6c9c328c-35c5-476c-913a-16a5108be47e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1098 time: 0.0413237 Nov 05 15:06:58.204557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-ec5367dc-f76e-4ab3-a070-4643cce51d10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.206079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-ec5367dc-f76e-4ab3-a070-4643cce51d10 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0407996 Nov 05 15:06:58.301232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-c0a9b59d-6980-411f-a45e-30e33037a2c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.302763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-c0a9b59d-6980-411f-a45e-30e33037a2c1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0900536 Nov 05 15:06:58.369024 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-179d9468-e7ea-401a-9bc3-a4eef8b2b3dc service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1001 time: 0.0595193 Nov 05 15:06:58.378476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ddfb59f-d672-4200-be83-354f4d67ab90 req-380c1576-a1f5-4382-8e89-68a670af180e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.379931 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8ddfb59f-d672-4200-be83-354f4d67ab90 req-380c1576-a1f5-4382-8e89-68a670af180e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0528245 Nov 05 15:06:58.417971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-7c5f2998-8b52-477d-a67b-99750f122856 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.419438 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-7c5f2998-8b52-477d-a67b-99750f122856 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0429883 Nov 05 15:06:58.428021 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8ddfb59f-d672-4200-be83-354f4d67ab90 req-d14c426b-5593-4ab8-9daa-382459005e4e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421042 Nov 05 15:06:58.468517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-319f088b-ca70-46e9-a00d-6659f547d64c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:58.470051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-319f088b-ca70-46e9-a00d-6659f547d64c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0433934 Nov 05 15:06:58.558916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-f0fe3f91-af5e-4a81-ae62-fdd6544b31c0 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811436 Nov 05 15:06:58.658064 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d36f6e8c-8026-4efc-95e5-04457ec4f124 req-8df865ac-e771-4a30-a80a-391d6598922a service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0925853 Nov 05 15:06:59.541690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0e15c8-9591-497d-beff-67c05bdfad77 req-ca2b3752-445e-46f2-bd87-e4a4ada45979 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:06:59.543133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-de0e15c8-9591-497d-beff-67c05bdfad77 req-ca2b3752-445e-46f2-bd87-e4a4ada45979 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0483577 Nov 05 15:06:59.590328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-de0e15c8-9591-497d-beff-67c05bdfad77 req-5c7dbd20-2d33-4cc6-ac6d-3838c12d6b5b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407917 Nov 05 15:07:00.714147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4373b20-1bce-41f2-821b-5d89ec395d5f req-4b44170f-33a3-46c8-9920-62c6d95df359 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:00.715604 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f4373b20-1bce-41f2-821b-5d89ec395d5f req-4b44170f-33a3-46c8-9920-62c6d95df359 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0484123 Nov 05 15:07:00.761320 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f4373b20-1bce-41f2-821b-5d89ec395d5f req-44c33eaf-fbdf-43fb-be8f-c812ca6fa3f2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397851 Nov 05 15:07:00.969102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50587d-559d-44fa-b66e-716deb6debeb req-ed112652-2647-4ffc-bea6-7aaf583e77fd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:00.970607 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-ed112652-2647-4ffc-bea6-7aaf583e77fd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0539992 Nov 05 15:07:00.973131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9bd945-da3a-4ed3-a3c7-0d7ec2502dc7 req-c1cf8e41-b0a4-4827-b09c-38cd1b286b5c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:00.974585 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8b9bd945-da3a-4ed3-a3c7-0d7ec2502dc7 req-c1cf8e41-b0a4-4827-b09c-38cd1b286b5c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0664861 Nov 05 15:07:01.024018 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8b9bd945-da3a-4ed3-a3c7-0d7ec2502dc7 req-13102104-efd6-4bc5-9879-062d27b96bf6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428693 Nov 05 15:07:01.055440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50587d-559d-44fa-b66e-716deb6debeb req-0d8e36e7-633d-4381-9a5e-99909861743c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:01.057220 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-0d8e36e7-633d-4381-9a5e-99909861743c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0403717 Nov 05 15:07:01.145750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50587d-559d-44fa-b66e-716deb6debeb req-03d57dbe-b751-4ada-89f5-8ce945a3cbb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:01.147179 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-03d57dbe-b751-4ada-89f5-8ce945a3cbb0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0835369 Nov 05 15:07:01.211053 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-b75ca72b-ff75-4af0-a3fe-61977035a9ad service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1001 time: 0.0565081 Nov 05 15:07:01.266811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50587d-559d-44fa-b66e-716deb6debeb req-c504058e-ab16-4ccb-b7a4-5878f5928bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:01.268279 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-c504058e-ab16-4ccb-b7a4-5878f5928bc3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0498149 Nov 05 15:07:01.316750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50587d-559d-44fa-b66e-716deb6debeb req-003dc3cd-8ce0-4e7d-8b77-da31c57da337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:01.318140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-003dc3cd-8ce0-4e7d-8b77-da31c57da337 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0424922 Nov 05 15:07:01.404949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-aa95c151-4537-4072-bf00-ac03c8c2fc87 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789504 Nov 05 15:07:01.494908 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8a50587d-559d-44fa-b66e-716deb6debeb req-7a70f635-c3cf-454a-990e-a2f8a5901d75 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839088 Nov 05 15:07:02.140149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8eccd7-d2f7-4bdc-926a-141e2ca5688f req-abcf4321-7249-45c4-9b21-6cc2efafe23b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.141654 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8c8eccd7-d2f7-4bdc-926a-141e2ca5688f req-abcf4321-7249-45c4-9b21-6cc2efafe23b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0485077 Nov 05 15:07:02.188192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8c8eccd7-d2f7-4bdc-926a-141e2ca5688f req-cb8e43b1-aa20-4f20-8fc3-1db9ddf79ef6 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408189 Nov 05 15:07:02.300583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78630383-daba-45b8-8dcc-cfdc9f35bead req-138de622-6b8e-409b-a1eb-aa362466bed5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.302039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78630383-daba-45b8-8dcc-cfdc9f35bead req-138de622-6b8e-409b-a1eb-aa362466bed5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0482483 Nov 05 15:07:02.348214 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78630383-daba-45b8-8dcc-cfdc9f35bead req-b4123242-c4a7-43a2-9a9e-b86b67237991 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399089 Nov 05 15:07:02.546300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf65c2ff-1f96-4892-9b53-9a53c102b6b8 req-d1a9cd06-49f7-4e25-8887-163ff7404fde tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.547899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf65c2ff-1f96-4892-9b53-9a53c102b6b8 req-d1a9cd06-49f7-4e25-8887-163ff7404fde tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0496778 Nov 05 15:07:02.574677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-249378d1-f451-4b3a-af70-08ac1eeb4f94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.576875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-249378d1-f451-4b3a-af70-08ac1eeb4f94 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 1098 time: 0.0448799 Nov 05 15:07:02.601423 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf65c2ff-1f96-4892-9b53-9a53c102b6b8 req-4ad23f6b-8198-4fb5-b142-fc7ff03184fa tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462179 Nov 05 15:07:02.665485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-65ff99f2-07a2-48a8-a3a0-4a424910d672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.666940 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-65ff99f2-07a2-48a8-a3a0-4a424910d672 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0843101 Nov 05 15:07:02.734132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-d53babb9-f585-40e0-9fc4-641f5d85190f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 200 len: 1001 time: 0.0601020 Nov 05 15:07:02.781353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-68a5e21f-25d2-457c-9916-fde563161b3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.782753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-68a5e21f-25d2-457c-9916-fde563161b3f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0424404 Nov 05 15:07:02.828268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-6afc1d8d-8249-4ef7-9d6c-c9d567eb88fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:02.829802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-6afc1d8d-8249-4ef7-9d6c-c9d567eb88fb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0395386 Nov 05 15:07:02.921804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-8cb774e4-8183-4dad-9ef8-880f9452722c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839653 Nov 05 15:07:03.009203 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3bfcf8c7-cfe9-48f6-8ed0-9b05ee612fa4 req-1ec267de-c760-45c6-8920-9f036ef08882 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806303 Nov 05 15:07:03.718081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512c34fc-c33e-4340-ade3-c5174a44bbc5 req-6d75956e-4be7-4518-91a6-fb8f03884cbc tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:03.719510 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-512c34fc-c33e-4340-ade3-c5174a44bbc5 req-6d75956e-4be7-4518-91a6-fb8f03884cbc tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0480800 Nov 05 15:07:03.765578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-512c34fc-c33e-4340-ade3-c5174a44bbc5 req-e6f0c594-0372-4b4a-9339-c32abddc8072 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401509 Nov 05 15:07:03.996561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0ae813-85d5-4eaa-9c42-4c3f4b60de7f req-f781bff6-6b5b-4f8a-9cb9-4e169c0160b7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:03.998075 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8e0ae813-85d5-4eaa-9c42-4c3f4b60de7f req-f781bff6-6b5b-4f8a-9cb9-4e169c0160b7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0524557 Nov 05 15:07:04.044231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8e0ae813-85d5-4eaa-9c42-4c3f4b60de7f req-d1b447b0-a680-49c6-bea7-bce84df8e83a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403004 Nov 05 15:07:05.158634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f4497c-c6ed-4cc1-8d64-57247d23d142 req-0d68151b-566a-4f97-974b-1f2161e8152b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:05.160097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18f4497c-c6ed-4cc1-8d64-57247d23d142 req-0d68151b-566a-4f97-974b-1f2161e8152b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0483930 Nov 05 15:07:05.206250 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18f4497c-c6ed-4cc1-8d64-57247d23d142 req-00fd3c58-ef7b-4183-8fc3-a85f55b1d736 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402303 Nov 05 15:07:05.607850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-75696c0b-89cf-4f52-8ca1-886cfbe95002 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:05.609348 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-75696c0b-89cf-4f52-8ca1-886cfbe95002 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 945 time: 0.0487607 Nov 05 15:07:05.698658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Deleting port 40e0f4ca-b269-4052-af11-0074791fcf55 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:07:05.698989 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:05.786170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] For port 40e0f4ca-b269-4052-af11-0074791fcf55, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=40e0f4ca-b269-4052-af11-0074791fcf55,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:07:05.786539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:05.959675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:05.960037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:05.960353 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 disassociated. External IP: 172.26.5.150, port: 40e0f4ca-b269-4052-af11-0074791fcf55. Nov 05 15:07:05.960720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Calling delete_port for 40e0f4ca-b269-4052-af11-0074791fcf55 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:07:06.085928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:06.112337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'Port': ['ID=40e0f4ca-b269-4052-af11-0074791fcf55,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:06.124605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.124960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.125302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.125641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.125971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.126301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.126630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.126958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.127284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.127614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.127939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.128263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:06.242472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:07:06.318672 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-817bbbdc-1ac1-4003-b35c-b5de476bb85e req-8ba77803-49bf-498b-b3dc-d32492b2e1f7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=634c90d9-e8ad-41fd-b320-94950106d463 HTTP/1.1" status: 200 len: 210 time: 0.0295696 Nov 05 15:07:06.375576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:07:06.386255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:07:06.395808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:07:06.396348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:06:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:06.416621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] No DVR routers for this DVR port 40e0f4ca-b269-4052-af11-0074791fcf55 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:07:06.419151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:06.423000 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1fecd431-b95b-4f5c-be8c-132c35b886fb req-b0d6bc97-2edd-47ed-8223-c37aa8fb2b5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "DELETE /v2.0/ports/40e0f4ca-b269-4052-af11-0074791fcf55 HTTP/1.1" status: 204 len: 173 time: 0.8062348 Nov 05 15:07:06.423443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'name': 'network-vif-deleted', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:07:06.425716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47b1dfdb-d97a-4d53-8da1-31e1c59a295d" -d '{"events": [{"server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "name": "network-vif-deleted", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:07:06.468972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:07:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec5cdad1-1d58-43ea-a9be-04011a558322 x-openstack-request-id: req-ec5cdad1-1d58-43ea-a9be-04011a558322 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:07:06.469269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "634c90d9-e8ad-41fd-b320-94950106d463", "name": "network-vif-deleted", "tag": "40e0f4ca-b269-4052-af11-0074791fcf55", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:07:06.469521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ec5cdad1-1d58-43ea-a9be-04011a558322 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:07:06.469920 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '634c90d9-e8ad-41fd-b320-94950106d463', 'name': 'network-vif-deleted', 'tag': '40e0f4ca-b269-4052-af11-0074791fcf55', 'status': 'completed', 'code': 200} Nov 05 15:07:06.509466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:07:06.707725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:06.733699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:07:06.741696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:07:06.742281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:06:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:06.846121 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:07:07.040352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:07.068555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cff32a5-15f3-402b-96ec-a889f44b3bb3 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:07:07.288129 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2a56397-621c-41af-872f-c779b687aa5d None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:07:07.564334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-5a34c357-dd37-4020-b588-44e3befd9d03 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1993639352&fields=id&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 267 time: 0.0422649 Nov 05 15:07:07.667732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-0bf5eb65-e383-4893-8c34-74b5a47a5d00 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:07.669211 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-0bf5eb65-e383-4893-8c34-74b5a47a5d00 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.0981696 Nov 05 15:07:07.684318 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-2a131b15-5ae2-40bd-be9d-9164041f872a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/quotas/cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 375 time: 0.0089681 Nov 05 15:07:08.008163 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-0d93a21a-ba96-4125-82f5-189584d2b7a2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3180227 Nov 05 15:07:08.146006 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-fbdfa518-02fa-485e-beab-bd8991f17672 service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257014 Nov 05 15:07:08.234923 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-820a48be-c3c8-4e53-b73c-4ef5c836f81b service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829687 Nov 05 15:07:08.387569 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-89631a49-c11f-4adc-b750-6a801c0d7800 req-1a6ac4eb-df5c-4287-b9ac-ab880a765422 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 210 time: 0.0261652 Nov 05 15:07:09.266333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-823ad2da-1076-4ccc-9004-e17c59164e81 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:09.267779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-823ad2da-1076-4ccc-9004-e17c59164e81 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1032090 Nov 05 15:07:09.336712 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-901e174a-931b-4ebf-9684-d92c89876972 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 380 time: 0.0583179 Nov 05 15:07:09.350190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'port': {'device_id': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'admin_state_up': True, 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'security_groups': ['f81f297a-35ff-4b56-bf39-011da81f52af']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:07:09.483377 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-566d03ef-ef21-4703-bcb3-143c764ffd95 req-027f5db7-5b33-4a11-99c1-bee5a48b7127 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 210 time: 0.0279541 Nov 05 15:07:09.484335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:07:09.487774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:09.615299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Allocated IP 172.20.0.5 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/8026d1d6-d06a-4595-b58e-c35521ca0657) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:07:09.757703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:09.789990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:09.830432 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:07:09.835319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:07:09.838957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:07:09.862637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:09.890955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:09.891706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:09.909512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-f5465821-0f00-4ab5-986e-01b10f6d11fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5664697 Nov 05 15:07:09.923273 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Request body: {'port': {'device_id': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:07:09.983495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.040132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f6d848e7-3b04-4eed-96cc-8965156c8b3e None None] Provisioning complete for port 8026d1d6-d06a-4595-b58e-c35521ca0657 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:07:10.040710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6d848e7-3b04-4eed-96cc-8965156c8b3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.073445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-f6d848e7-3b04-4eed-96cc-8965156c8b3e None None] Port 8026d1d6-d06a-4595-b58e-c35521ca0657 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:07:10.172210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 40e0f4ca-b269-4052-af11-0074791fcf55 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:07:10.192431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 40e0f4ca-b269-4052-af11-0074791fcf55 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:07:10.192800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 40e0f4ca-b269-4052-af11-0074791fcf55 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:07:10.236985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8026d1d6-d06a-4595-b58e-c35521ca0657 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:07:10.244167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.255701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Transition to ACTIVE for port object 8026d1d6-d06a-4595-b58e-c35521ca0657 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:07:10.259956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.330115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:10.383698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Attempting to bind port 8026d1d6-d06a-4595-b58e-c35521ca0657 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:07:10.384028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Attempting to bind port 8026d1d6-d06a-4595-b58e-c35521ca0657 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:07:10.384357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Attempting to bind port 8026d1d6-d06a-4595-b58e-c35521ca0657 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:07:10.389086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Port 8026d1d6-d06a-4595-b58e-c35521ca0657 on network b7856e81-af33-4465-b684-ce86f847a4ff not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:07:10.389402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Attempting to bind port 8026d1d6-d06a-4595-b58e-c35521ca0657 on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:07:10.394998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 6, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:07:10.395328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:07:10.395701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:07:10.396125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Bound port: 8026d1d6-d06a-4595-b58e-c35521ca0657, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:07:10.396501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.461105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:07:10.464441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:07:10.468814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.507853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:10.508502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:10.509952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] 10.222.0.32 "PUT /v2.0/ports/8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1093 time: 0.5918705 Nov 05 15:07:10.510412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:07:10.512704 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58183040-b373-4a33-8158-2cc20bbc1750" -d '{"events": [{"name": "network-changed", "server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:07:10.538699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885cc0af-258f-402e-b093-86c14c7fbda8 service neutron] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:10.617512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-e5177bae-8182-450b-b91e-bb7cebb99eba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:10.620826 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-e5177bae-8182-450b-b91e-bb7cebb99eba service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1096 time: 0.0547698 Nov 05 15:07:10.629665 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e60f189-b841-4a0d-b0fe-30c5cb14d0da req-db433efe-427a-4a11-8865-7b4c8f321e81 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:10.637109 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1e60f189-b841-4a0d-b0fe-30c5cb14d0da req-db433efe-427a-4a11-8865-7b4c8f321e81 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 943 time: 0.0575836 Nov 05 15:07:10.643438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:07:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24c7129c-0f7d-464f-932b-ca87e5137edf x-openstack-request-id: req-24c7129c-0f7d-464f-932b-ca87e5137edf {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:07:10.644099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:07:10.644574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-24c7129c-0f7d-464f-932b-ca87e5137edf {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:07:10.645148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'status': 'completed', 'code': 200} Nov 05 15:07:10.678541 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-dd8f807f-9ff4-425c-926f-12223f16e6ec service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 217 time: 0.0496681 Nov 05 15:07:10.687726 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1e60f189-b841-4a0d-b0fe-30c5cb14d0da req-79b4673a-c68e-48d7-9ffa-5dd61dc93339 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497291 Nov 05 15:07:10.731233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-608053f4-9fee-4081-9d6d-58696dce93d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:10.733329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-608053f4-9fee-4081-9d6d-58696dce93d1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0466793 Nov 05 15:07:10.778159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-71d590f2-f3b2-46c4-b2e6-9e607718df52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:10.779641 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-71d590f2-f3b2-46c4-b2e6-9e607718df52 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398088 Nov 05 15:07:10.872692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-555d713b-14b0-4429-829f-5d0bd60477d6 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858948 Nov 05 15:07:10.959030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c789b0c-30a3-48a4-8b44-eb537b90c21b req-b8be9cf1-92b7-4365-b18f-f8091655f47c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0793970 Nov 05 15:07:11.041005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58183040-b373-4a33-8158-2cc20bbc1750 req-45404572-c993-430c-b875-dd3511069822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:11.042498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-45404572-c993-430c-b875-dd3511069822 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1096 time: 0.0401144 Nov 05 15:07:11.133035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58183040-b373-4a33-8158-2cc20bbc1750 req-7e417e78-73d2-45f7-b5d8-eba25c1e0696 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:11.134468 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-7e417e78-73d2-45f7-b5d8-eba25c1e0696 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0846593 Nov 05 15:07:11.176507 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-8998874f-8e6a-4c5e-9ab7-4a78e96ec372 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 217 time: 0.0345488 Nov 05 15:07:11.228244 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58183040-b373-4a33-8158-2cc20bbc1750 req-0addba90-27d5-4f09-9f18-f5de3de0d622 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:11.229594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-0addba90-27d5-4f09-9f18-f5de3de0d622 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0454574 Nov 05 15:07:11.273456 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58183040-b373-4a33-8158-2cc20bbc1750 req-129a758c-eb00-4563-890f-f44c090408fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:11.274878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-129a758c-eb00-4563-890f-f44c090408fc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0378606 Nov 05 15:07:11.362636 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-b2de9b7b-40e8-488d-9d2f-1223349cc74e service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796928 Nov 05 15:07:11.455294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58183040-b373-4a33-8158-2cc20bbc1750 req-8fa9830c-d11a-4298-bcba-0803cf889209 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838947 Nov 05 15:07:11.808419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db66c830-d0f6-46d7-abb8-ddaa603aba97 req-ae82b4c0-9786-4210-a38b-4b0239ec86c8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:11.809843 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db66c830-d0f6-46d7-abb8-ddaa603aba97 req-ae82b4c0-9786-4210-a38b-4b0239ec86c8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 943 time: 0.0512695 Nov 05 15:07:11.856336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db66c830-d0f6-46d7-abb8-ddaa603aba97 req-7cfacb4a-acda-45e1-b9d8-dd146566b3db tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401223 Nov 05 15:07:12.970520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3149198-7d00-459a-aff7-9bcc02ac64f6 req-15c75225-ed25-41fd-98aa-c198052f7bca tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:12.972705 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b3149198-7d00-459a-aff7-9bcc02ac64f6 req-15c75225-ed25-41fd-98aa-c198052f7bca tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 943 time: 0.0505097 Nov 05 15:07:13.021018 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b3149198-7d00-459a-aff7-9bcc02ac64f6 req-2daf1422-c1b6-4afa-a487-ed4295f7e31e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416052 Nov 05 15:07:14.138141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dff3bcd-83d8-4f10-a69b-4ae99664316e req-02620659-543a-494f-b1b3-346f067927a5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:14.139594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4dff3bcd-83d8-4f10-a69b-4ae99664316e req-02620659-543a-494f-b1b3-346f067927a5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 943 time: 0.0525861 Nov 05 15:07:14.186290 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4dff3bcd-83d8-4f10-a69b-4ae99664316e req-0dfd1c3a-5977-4afb-8380-0a77ee034c36 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408475 Nov 05 15:07:14.187723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:07:14.283177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:07:14.294249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'mac_address': 'fa:16:3e:4a:e6:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:07:14.333476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:14.346066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8026d1d6-d06a-4595-b58e-c35521ca0657 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:07:14.364683 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:07:14.368159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:14.418163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:14.424975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.425321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.425660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.425986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.426311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.426635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.426956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.427276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.427601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.427914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.428234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.428568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:07:14.576165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8026d1d6-d06a-4595-b58e-c35521ca0657'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:07:15.304857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269a7fe1-b7e8-47c2-836b-4bcd980467c5 req-d78b7bc8-dd69-4a65-9728-9004de1da11f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:15.307279 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-269a7fe1-b7e8-47c2-836b-4bcd980467c5 req-d78b7bc8-dd69-4a65-9728-9004de1da11f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 944 time: 0.0535812 Nov 05 15:07:15.353660 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-269a7fe1-b7e8-47c2-836b-4bcd980467c5 req-36fe1c85-ced8-46a5-b741-662d5e69eda4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398338 Nov 05 15:07:16.204716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:07:16.251812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 8026d1d6-d06a-4595-b58e-c35521ca0657 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:07:16.255529 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8026d1d6-d06a-4595-b58e-c35521ca0657 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:07:16.255895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:16.472575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068ff45a-b022-4945-b5a3-59d7201db2e2 req-b4d55dcd-2b3a-41cd-be4b-6964500a9f7f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:16.474072 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-068ff45a-b022-4945-b5a3-59d7201db2e2 req-b4d55dcd-2b3a-41cd-be4b-6964500a9f7f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 944 time: 0.0512943 Nov 05 15:07:16.485286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:16.507761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:07:16.510032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b72f132c-0209-4416-bf74-5f1265c68cdb" -d '{"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-plugged", "status": "completed", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:07:16.522690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:07:16.524348 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-068ff45a-b022-4945-b5a3-59d7201db2e2 req-c8675e59-d978-4e14-ab4d-67b26218342b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435026 Nov 05 15:07:16.529917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:16.577148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:07:16.610095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:07:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d906a21-cdeb-4630-bb54-4d08ac930173 x-openstack-request-id: req-4d906a21-cdeb-4630-bb54-4d08ac930173 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:07:16.610387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-plugged", "status": "completed", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:07:16.610636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4d906a21-cdeb-4630-bb54-4d08ac930173 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:07:16.611021 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'code': 200} Nov 05 15:07:16.779383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92285582-15e3-42e4-8102-e85fe6723ed1 req-63350016-5b39-4248-a3f6-fe8ae047d0f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:16.780862 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92285582-15e3-42e4-8102-e85fe6723ed1 req-63350016-5b39-4248-a3f6-fe8ae047d0f0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0390406 Nov 05 15:07:16.827584 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92285582-15e3-42e4-8102-e85fe6723ed1 req-27589649-0c95-49a7-88c4-6c92a14bc470 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403268 Nov 05 15:07:17.639208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55535271-79c0-4f7c-b579-5168707f902d req-04bb1d75-a697-4435-9ec8-a3d78fa82d1e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:17.641213 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55535271-79c0-4f7c-b579-5168707f902d req-04bb1d75-a697-4435-9ec8-a3d78fa82d1e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0489881 Nov 05 15:07:17.687429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-55535271-79c0-4f7c-b579-5168707f902d req-ce1493d0-98da-485b-8f2b-744c1cbe02ff tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403855 Nov 05 15:07:18.400562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:18.807267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d95f964-dcaa-450e-9634-486484d7c2cf req-bd4ad23c-2440-403c-85aa-7eca69ccfce5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:18.808746 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d95f964-dcaa-450e-9634-486484d7c2cf req-bd4ad23c-2440-403c-85aa-7eca69ccfce5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0523813 Nov 05 15:07:18.855064 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2d95f964-dcaa-450e-9634-486484d7c2cf req-7836796e-896c-4f9b-92b0-6e4c69a0d2e8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398149 Nov 05 15:07:18.963467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c40df-8df6-42b2-a35e-994deabb8958 req-6f475e14-4bdb-44c1-9e67-727b23273508 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:18.965031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ba4c40df-8df6-42b2-a35e-994deabb8958 req-6f475e14-4bdb-44c1-9e67-727b23273508 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0486271 Nov 05 15:07:18.973524 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 48986) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:07:18.978124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'floatingip': {'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:07:19.017887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:19.447686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:19.451379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:19.552233 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 associated. External IP: 172.26.5.150, port: 8026d1d6-d06a-4595-b58e-c35521ca0657. Nov 05 15:07:19.758051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:07:19.864969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:07:19.871697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:19.876306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:07:19.885689 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:07:19.886302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:06:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:19.898543 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f678faf2-36cc-43d8-ab2c-0f6161240768 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "PUT /v2.0/floatingips/8b0fa759-110d-4bf0-acb1-99357bf80a68 HTTP/1.1" status: 200 len: 991 time: 0.9239247 Nov 05 15:07:19.899184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:07:19.901656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446" -d '{"events": [{"name": "network-changed", "server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:07:19.994001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:07:20.000574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:07:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac802d92-f03b-4a8d-b6c2-807d77689267 x-openstack-request-id: req-ac802d92-f03b-4a8d-b6c2-807d77689267 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:07:20.000868 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:07:20.001123 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ac802d92-f03b-4a8d-b6c2-807d77689267 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:07:20.001530 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'status': 'completed', 'code': 200} Nov 05 15:07:20.063676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-598ea90e-f152-49a9-acf4-1f9624f30e5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:20.065236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-598ea90e-f152-49a9-acf4-1f9624f30e5c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0436916 Nov 05 15:07:20.103266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f49ca2d4-a2cf-4424-8d19-51e668c89357 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:20.155730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-424012d7-79e5-45da-8798-bb4e7f3e9c97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:20.157270 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-424012d7-79e5-45da-8798-bb4e7f3e9c97 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0858386 Nov 05 15:07:20.226301 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-9f1c8441-207c-4a9f-b931-7f6dfc59aa79 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 999 time: 0.0622931 Nov 05 15:07:20.233853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:4a:e6:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:07:19Z', 'revision_number': 9, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:20.260431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:07:20.269415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:07:20.270044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:06:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:20.274647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-0ee54921-0f5a-4e8e-892c-d8fc41c237ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:20.276112 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-0ee54921-0f5a-4e8e-892c-d8fc41c237ff service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0433626 Nov 05 15:07:20.320758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-675c837e-e279-481e-8510-7241197116eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:20.322284 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-675c837e-e279-481e-8510-7241197116eb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397520 Nov 05 15:07:20.377451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:07:20.413531 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-316df025-7c0a-4d62-85ab-e2d426cee9e0 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842905 Nov 05 15:07:20.502736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-dc195f03-9d90-4bbe-bb24-ea62a2b1c446 req-7b8481fe-695c-49c6-8ddb-e7aa8c162a3d service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823588 Nov 05 15:07:20.603087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:4a:e6:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:07:19Z', 'revision_number': 9, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:07:20.629901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30ff4640-5410-4e5b-a220-66b0bda57a9c None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:4a:e6:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:07:19Z', 'revision_number': 9, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:07:20.818563 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b8a5d74-b5cb-4c3c-86f0-f1ad049b09ed None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:07:22.423943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d27ab15a-5f1f-40c9-aa80-b7d99c1c2587 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:23.461739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:24.534429 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:07:24.923820 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:25.950255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:48.407526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:50.098625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0d783704-29b2-4ae2-8b8f-e4f537d19b32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:52.425008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-52480542-102a-4b4a-b3c2-dc5477704c81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:53.464865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:54.925571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:55.951284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:07:57.232850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ced070b-6b77-4752-a54f-73992bb198b1 req-adfdc9ca-5ebb-4100-8bb9-0d818ad47c0f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:57.234925 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2ced070b-6b77-4752-a54f-73992bb198b1 req-adfdc9ca-5ebb-4100-8bb9-0d818ad47c0f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0491040 Nov 05 15:07:57.315172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2ced070b-6b77-4752-a54f-73992bb198b1 req-f7892ab3-af32-4587-9d2a-2b3c8e049004 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741277 Nov 05 15:07:57.318789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-2c0e34fb-e2bd-48c0-8e4d-79fbcf153344 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1455214 Nov 05 15:07:58.362077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-e9e520c0-cf47-46ca-acbb-0d99dd2db4ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:58.363550 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-e9e520c0-cf47-46ca-acbb-0d99dd2db4ab service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0410066 Nov 05 15:07:58.432275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea306c1-fe25-46d3-8ed3-a47f70b767b0 req-c7bee790-a7d8-4a19-a6de-75eb975d7357 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:58.433853 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2ea306c1-fe25-46d3-8ed3-a47f70b767b0 req-c7bee790-a7d8-4a19-a6de-75eb975d7357 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0494881 Nov 05 15:07:58.453099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-761b15ef-64f6-4169-b40a-851b76feb40f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:58.454580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-761b15ef-64f6-4169-b40a-851b76feb40f service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0842471 Nov 05 15:07:58.485277 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2ea306c1-fe25-46d3-8ed3-a47f70b767b0 req-121b3838-574f-4e61-91b6-0c26e1d43592 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448191 Nov 05 15:07:58.525301 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-26f4e1e1-8990-48d8-b18a-eb75ba65fa25 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1002 time: 0.0640783 Nov 05 15:07:58.574670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-1437cdce-89b1-447c-a8c9-7756221927d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:58.576096 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-1437cdce-89b1-447c-a8c9-7756221927d9 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0435839 Nov 05 15:07:58.621482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-a18c2402-5971-4017-9fec-6313467faad2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:58.622872 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-a18c2402-5971-4017-9fec-6313467faad2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394135 Nov 05 15:07:58.712985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-9b979a73-a84b-46ef-9cb1-17927360425d service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828948 Nov 05 15:07:58.802889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-60ce1349-3159-4065-bdbc-d8068814f6fe service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825174 Nov 05 15:07:59.606440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35040a5-18a9-4dcb-88c9-c4e19f06ce1b req-355dbd8c-ac52-419a-ad9a-5c22ca652c6a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:07:59.607917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b35040a5-18a9-4dcb-88c9-c4e19f06ce1b req-355dbd8c-ac52-419a-ad9a-5c22ca652c6a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0539827 Nov 05 15:07:59.654540 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b35040a5-18a9-4dcb-88c9-c4e19f06ce1b req-a13d54f7-2fd9-4f12-a92e-1a7558159435 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407000 Nov 05 15:08:00.777190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c8fe2f-df18-466b-8e28-baca3d19cdc9 req-844602a3-2104-4811-a2e5-4d8238a06b7b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:00.778557 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-50c8fe2f-df18-466b-8e28-baca3d19cdc9 req-844602a3-2104-4811-a2e5-4d8238a06b7b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0484297 Nov 05 15:08:00.824851 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-50c8fe2f-df18-466b-8e28-baca3d19cdc9 req-a402eb7d-5b36-419a-a515-54745d7f564c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397143 Nov 05 15:08:01.536122 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:08:01.939402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6393180-e1f3-4ee6-8f09-cd7be1bbb9e4 req-2103cc84-05dc-4e75-924b-1f8812cfa939 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:01.940884 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e6393180-e1f3-4ee6-8f09-cd7be1bbb9e4 req-2103cc84-05dc-4e75-924b-1f8812cfa939 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0490394 Nov 05 15:08:01.988389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e6393180-e1f3-4ee6-8f09-cd7be1bbb9e4 req-16753e4e-d8f2-4f21-b142-340dbe2dce19 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415168 Nov 05 15:08:03.103697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60801124-28f7-44ef-b4de-59aa123c5517 req-8449b4f6-758a-476d-8671-ffdd0a20b89e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:03.105241 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-60801124-28f7-44ef-b4de-59aa123c5517 req-8449b4f6-758a-476d-8671-ffdd0a20b89e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0490930 Nov 05 15:08:03.152435 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-60801124-28f7-44ef-b4de-59aa123c5517 req-c5c005f6-7692-4883-a7c9-25f86f5bea10 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412688 Nov 05 15:08:04.270073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4bb84ed-2360-493d-84fb-d8c3679bad88 req-9d218268-0a86-418e-ad2a-402acb3493d7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:04.271521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4bb84ed-2360-493d-84fb-d8c3679bad88 req-9d218268-0a86-418e-ad2a-402acb3493d7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0532427 Nov 05 15:08:04.317352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4bb84ed-2360-493d-84fb-d8c3679bad88 req-e4c0f6b5-9ea6-4661-822d-c03f0bcde8e2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399842 Nov 05 15:08:05.433864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6f82df-1c38-4554-91d9-2edd466d0b08 req-3f6dad57-2655-47f0-aabc-11f74b4d478d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:05.435323 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bd6f82df-1c38-4554-91d9-2edd466d0b08 req-3f6dad57-2655-47f0-aabc-11f74b4d478d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0521665 Nov 05 15:08:05.483774 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bd6f82df-1c38-4554-91d9-2edd466d0b08 req-e9936cd2-d53b-4e0f-8f60-08017997d1a3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420058 Nov 05 15:08:06.599838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7ec4b8-9cea-4aa2-bad8-3787d88849de req-909a09f2-7666-4445-ac0c-47f098179383 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:06.601334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ac7ec4b8-9cea-4aa2-bad8-3787d88849de req-909a09f2-7666-4445-ac0c-47f098179383 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0493276 Nov 05 15:08:06.648119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ac7ec4b8-9cea-4aa2-bad8-3787d88849de req-3741955d-1ff0-4670-8fa0-06e384d8801d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406570 Nov 05 15:08:07.763587 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219272e1-5066-400e-a7d2-8fa199a92f5f req-3f2baee9-391e-43bb-bdc1-1445ba19c45c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:07.765076 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-219272e1-5066-400e-a7d2-8fa199a92f5f req-3f2baee9-391e-43bb-bdc1-1445ba19c45c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0494757 Nov 05 15:08:07.812076 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-219272e1-5066-400e-a7d2-8fa199a92f5f req-767abbce-ad47-4e89-a6e9-7029b6a0264a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410235 Nov 05 15:08:08.925753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42de27e0-f86b-447b-be1e-6f91b13379bc req-6c66d06a-47d7-4108-9ee7-2c0ee55f2926 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:08.927227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42de27e0-f86b-447b-be1e-6f91b13379bc req-6c66d06a-47d7-4108-9ee7-2c0ee55f2926 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0478060 Nov 05 15:08:08.979387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42de27e0-f86b-447b-be1e-6f91b13379bc req-2fe4e866-97de-418b-ba1d-c5547a7eb4b4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459201 Nov 05 15:08:10.098543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4df1ba-197e-4f19-9b18-4675beff5847 req-e6dca32a-fd2b-481c-83a4-37d063d59ba9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.100030 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6f4df1ba-197e-4f19-9b18-4675beff5847 req-e6dca32a-fd2b-481c-83a4-37d063d59ba9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0532568 Nov 05 15:08:10.146537 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6f4df1ba-197e-4f19-9b18-4675beff5847 req-096a0c98-4a02-446a-a838-3fdab8b8ae23 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405812 Nov 05 15:08:10.343373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-384fa14e-40f1-48ae-a112-e671bb9228ee service neutron] 10.222.0.32 "GET /v2.0/ports/8026d1d6-d06a-4595-b58e-c35521ca0657/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0560150 Nov 05 15:08:10.545822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-a3db59b2-9132-4520-bf60-9a4c0b4f5994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.547985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-a3db59b2-9132-4520-bf60-9a4c0b4f5994 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1098 time: 0.0412495 Nov 05 15:08:10.607497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-ccc1b340-2172-467e-a1fd-aea90c13ae5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.608909 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-ccc1b340-2172-467e-a1fd-aea90c13ae5d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0398033 Nov 05 15:08:10.706290 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-d1642d06-1af8-44f4-b205-6b1b11e8a6f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.707774 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-d1642d06-1af8-44f4-b205-6b1b11e8a6f0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0924282 Nov 05 15:08:10.773022 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-6a4ea69c-8f6b-49c8-8f38-e05c64556d12 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1002 time: 0.0576246 Nov 05 15:08:10.825050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-ee16cc3a-68c9-40d1-b05f-2fdf3d5f5c97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.826571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-ee16cc3a-68c9-40d1-b05f-2fdf3d5f5c97 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0465553 Nov 05 15:08:10.871310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-31fafb91-baa9-438b-98d7-484ec06fbe54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:10.872708 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-31fafb91-baa9-438b-98d7-484ec06fbe54 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389488 Nov 05 15:08:10.961215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-83ff3125-7f3f-4a9a-a539-076c71166452 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807009 Nov 05 15:08:11.055758 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a419834a-21c3-4641-a850-b8d98a2f2ac1 req-6836c034-5906-47de-809f-44fa735fd6a8 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880737 Nov 05 15:08:11.261653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c543fe-831a-43a1-bcdd-ede818ab006c req-15c471a5-da81-460f-a04b-a2e1b7639477 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:11.263099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-51c543fe-831a-43a1-bcdd-ede818ab006c req-15c471a5-da81-460f-a04b-a2e1b7639477 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0483286 Nov 05 15:08:11.310798 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-51c543fe-831a-43a1-bcdd-ede818ab006c req-2fcb8b16-a1eb-4cdc-b90c-d11c0e6c0c93 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411828 Nov 05 15:08:12.427156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf8eea6-2d63-4e8d-9cc2-64902abbc9c8 req-8cc670c0-ed97-4116-8421-c7fc1802262e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:12.428692 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dcf8eea6-2d63-4e8d-9cc2-64902abbc9c8 req-8cc670c0-ed97-4116-8421-c7fc1802262e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0496151 Nov 05 15:08:12.477716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dcf8eea6-2d63-4e8d-9cc2-64902abbc9c8 req-0e4eba07-cab8-49d7-86d6-5a1184877937 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426712 Nov 05 15:08:12.533318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-2455f043-58b4-4963-931c-740a984551a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:12.535134 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-2455f043-58b4-4963-931c-740a984551a0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0418146 Nov 05 15:08:12.650529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-651178fe-b928-495d-aa62-acadcb8a0195 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:12.652135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-651178fe-b928-495d-aa62-acadcb8a0195 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0947540 Nov 05 15:08:12.716570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-4226e7c7-e9b1-4fe3-b3c0-61ff1623d205 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1002 time: 0.0571163 Nov 05 15:08:12.768981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-1d27a237-af20-46d7-be33-d5ad4f914178 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:12.770376 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-1d27a237-af20-46d7-be33-d5ad4f914178 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0458698 Nov 05 15:08:12.815715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-36b4841a-2fa0-44f8-a5a3-13be913d3cfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:12.817173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-36b4841a-2fa0-44f8-a5a3-13be913d3cfb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384951 Nov 05 15:08:12.902966 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-030bcd4a-bf37-47f7-bcd5-cc6947b97aeb service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0780532 Nov 05 15:08:12.993267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-610ac3c4-163f-4aff-9e06-5bdade49b794 req-cb11b535-4011-4cf9-89e1-db3cfd04b2a8 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835557 Nov 05 15:08:13.595548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b74b50-70cb-4373-9a2f-6ed7b3cbf665 req-522a85ff-02c0-4ccf-949d-280f0f69f1f0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:13.597045 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10b74b50-70cb-4373-9a2f-6ed7b3cbf665 req-522a85ff-02c0-4ccf-949d-280f0f69f1f0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0500879 Nov 05 15:08:13.643889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10b74b50-70cb-4373-9a2f-6ed7b3cbf665 req-ef9c5884-92ff-4b4f-895a-ae7a6c44e5a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409322 Nov 05 15:08:13.954320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-ab57bae1-f989-4ea3-bce1-041263970f5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:13.955784 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-ab57bae1-f989-4ea3-bce1-041263970f5f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0802667 Nov 05 15:08:13.972962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad96c466-4936-4e4d-93c5-eb8fa73c6d6b req-b5665c04-54bf-4fc6-8886-b22e8fed30af tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:13.974337 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ad96c466-4936-4e4d-93c5-eb8fa73c6d6b req-b5665c04-54bf-4fc6-8886-b22e8fed30af tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0693624 Nov 05 15:08:14.058028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ad96c466-4936-4e4d-93c5-eb8fa73c6d6b req-51dcb168-165f-4f13-adc9-2e66742d5eed tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774860 Nov 05 15:08:14.059659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-219c1659-277c-4e80-ac17-4be59f6e8096 service neutron] 10.222.0.32 "GET /v2.0/ports/8026d1d6-d06a-4595-b58e-c35521ca0657/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0951557 Nov 05 15:08:14.127761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-df21cdba-b356-4e8b-adc2-69f2738bb2f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:14.129260 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-df21cdba-b356-4e8b-adc2-69f2738bb2f4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0436513 Nov 05 15:08:14.217485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f5384e98-b454-4fa7-9c15-54a942f46565 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:14.219561 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f5384e98-b454-4fa7-9c15-54a942f46565 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0831327 Nov 05 15:08:14.285570 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-3d173d9a-436b-4340-96eb-5798baded355 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1002 time: 0.0598133 Nov 05 15:08:14.333264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f097e533-0a4c-4894-bf1c-bb580fe6601d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:14.334632 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f097e533-0a4c-4894-bf1c-bb580fe6601d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0420525 Nov 05 15:08:14.378917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-b30c9c58-ee60-47f4-9925-681a888b88c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:14.380374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-b30c9c58-ee60-47f4-9925-681a888b88c5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393760 Nov 05 15:08:14.469650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-018483cf-a926-4a56-b69a-35028ed06cd4 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820434 Nov 05 15:08:14.563833 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-2e39405c-b69b-4edf-958f-4610c5b3cbc0 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859590 Nov 05 15:08:15.173773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a64b83f-202f-4621-987c-b64634bc4e2d req-86a7fc04-24c6-4f7d-aeda-08fe5b676dcb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:15.175231 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6a64b83f-202f-4621-987c-b64634bc4e2d req-86a7fc04-24c6-4f7d-aeda-08fe5b676dcb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0480671 Nov 05 15:08:15.225166 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6a64b83f-202f-4621-987c-b64634bc4e2d req-8da2186b-a070-4868-b36a-249b39610492 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438447 Nov 05 15:08:16.341905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bebc02d-37cf-4288-8f72-e8cc385d09ed req-dc0ca388-a56d-4ecd-b448-b1706bc86d5a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:16.343531 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0bebc02d-37cf-4288-8f72-e8cc385d09ed req-dc0ca388-a56d-4ecd-b448-b1706bc86d5a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0514021 Nov 05 15:08:16.390537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0bebc02d-37cf-4288-8f72-e8cc385d09ed req-e5088a20-eb21-4e99-b180-a8221630a9e5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409594 Nov 05 15:08:17.177569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-ccbbae34-1bc3-4fed-a0ca-f0cab3ca1b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.179055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-ccbbae34-1bc3-4fed-a0ca-f0cab3ca1b5d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1098 time: 0.3231952 Nov 05 15:08:17.240146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-6e1523a3-d9af-4530-98ff-a2f28c8545f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.241622 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-6e1523a3-d9af-4530-98ff-a2f28c8545f2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 1098 time: 0.0393591 Nov 05 15:08:17.328667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-e0b46293-f3b3-4e7a-bd7f-81923aaab403 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.330148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-e0b46293-f3b3-4e7a-bd7f-81923aaab403 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0816858 Nov 05 15:08:17.396837 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-3b424f4b-9d5e-4b28-a469-b00fdf5a1ad5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 200 len: 1002 time: 0.0601344 Nov 05 15:08:17.445050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-dd0d9e01-7781-4120-b750-0f3516251922 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.446455 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-dd0d9e01-7781-4120-b750-0f3516251922 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0425823 Nov 05 15:08:17.492575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f536277d-2d87-45e5-a47e-abf1edd95eb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.494117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-f536277d-2d87-45e5-a47e-abf1edd95eb1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407529 Nov 05 15:08:17.506147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbebbf98-7b37-42ce-9543-1005d144f906 req-890dc0d9-dae7-4896-904b-68a45d9d6a6e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:17.507625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fbebbf98-7b37-42ce-9543-1005d144f906 req-890dc0d9-dae7-4896-904b-68a45d9d6a6e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0501459 Nov 05 15:08:17.554518 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fbebbf98-7b37-42ce-9543-1005d144f906 req-b6250dfa-f285-4964-ab79-c272a045a6d7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409880 Nov 05 15:08:17.587789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-9d057ae8-8f94-4059-8cd0-ae4f6bf41094 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853276 Nov 05 15:08:17.676994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fd667396-4bb8-42d2-9e0a-ed832c7f83f0 req-b2007e61-314e-48d5-bc48-1ee4386ab01e service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822268 Nov 05 15:08:18.417267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:18.676011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c543e2e4-43c2-4a37-8e69-ccfab900e298 req-dcffc49d-f2fd-4a97-8d86-dec329621aba tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:18.677419 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c543e2e4-43c2-4a37-8e69-ccfab900e298 req-dcffc49d-f2fd-4a97-8d86-dec329621aba tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0539205 Nov 05 15:08:18.724429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c543e2e4-43c2-4a37-8e69-ccfab900e298 req-df8f186a-3c96-460c-bf2c-a3b40664800f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402546 Nov 05 15:08:19.837545 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94396474-9acd-427f-a89a-9569f5698ede req-e7b5f16d-83ed-4df9-a0ee-c4459515348b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:19.839002 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-94396474-9acd-427f-a89a-9569f5698ede req-e7b5f16d-83ed-4df9-a0ee-c4459515348b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0485227 Nov 05 15:08:19.885618 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-94396474-9acd-427f-a89a-9569f5698ede req-24744b21-8bd0-4fa5-8e9f-fb13db65b8ff tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401695 Nov 05 15:08:19.998201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c81395-8bdc-4e41-ac7c-8e68397a0893 req-1e7df4b7-ca44-42f3-b16e-5e00921b03bf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:19.999684 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95c81395-8bdc-4e41-ac7c-8e68397a0893 req-1e7df4b7-ca44-42f3-b16e-5e00921b03bf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0476279 Nov 05 15:08:20.045921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95c81395-8bdc-4e41-ac7c-8e68397a0893 req-606fb485-12e5-4a4a-b4c4-2ee6797590d4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402088 Nov 05 15:08:20.100116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d1c6e953-47fb-42fc-843f-44f9a29fbaaa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:20.162964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-358da36a-b472-4445-ba5f-97bbbb404bd2 req-67b430e0-d6ca-4d50-abeb-ee2c1c50bbcb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:20.164431 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-358da36a-b472-4445-ba5f-97bbbb404bd2 req-67b430e0-d6ca-4d50-abeb-ee2c1c50bbcb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0527697 Nov 05 15:08:20.210901 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-358da36a-b472-4445-ba5f-97bbbb404bd2 req-c2f6db51-576d-477c-aba0-902f8e22c910 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405772 Nov 05 15:08:20.433724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c4186b-6a54-41dd-9e43-2276747e78cd req-170dfb12-2942-495d-bd23-669481b80a21 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:20.435180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36c4186b-6a54-41dd-9e43-2276747e78cd req-170dfb12-2942-495d-bd23-669481b80a21 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0484948 Nov 05 15:08:20.481810 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36c4186b-6a54-41dd-9e43-2276747e78cd req-bc159c6c-b043-493f-b313-a149d8a4aabf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402379 Nov 05 15:08:20.520273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:08:20.619668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:20.630178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'mac_address': 'fa:16:3e:4a:e6:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:08:20.666429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:20.680060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8026d1d6-d06a-4595-b58e-c35521ca0657 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:08:20.699861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:20.704800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:20.757334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:20.764376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.764759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.765100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.765435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.766259 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.766594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.766966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.767385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.767914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.768478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.769103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.769675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:20.776315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['8026d1d6-d06a-4595-b58e-c35521ca0657'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:08:21.600662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d383d46-cf5a-4039-8173-0140abcc09a6 req-e984920f-dcb8-4d1c-adda-a4b974e1c820 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:21.602117 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3d383d46-cf5a-4039-8173-0140abcc09a6 req-e984920f-dcb8-4d1c-adda-a4b974e1c820 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 944 time: 0.0521870 Nov 05 15:08:21.648212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3d383d46-cf5a-4039-8173-0140abcc09a6 req-44fa782a-7015-4f1b-a9cd-7be5e507ca23 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400906 Nov 05 15:08:22.425134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db39bdaf-92bd-43d5-a154-1660c4325079 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.486451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-12be18ca-423c-477c-a359-89b4f628a7fe tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:22.487973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-12be18ca-423c-477c-a359-89b4f628a7fe tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 944 time: 0.0485120 Nov 05 15:08:22.528231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:08:22.577008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Deleting port 8026d1d6-d06a-4595-b58e-c35521ca0657 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:08:22.577343 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.580894 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 8026d1d6-d06a-4595-b58e-c35521ca0657 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:08:22.582575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.659091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.668624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:22.669167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.683166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:08:22.685471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6da115ad-f278-4575-b027-28cd5d87bd7c" -d '{"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-plugged", "status": "completed", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:08:22.699859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 8026d1d6-d06a-4595-b58e-c35521ca0657, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=8026d1d6-d06a-4595-b58e-c35521ca0657,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:22.706125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.738565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:08:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05777e04-7f72-4b3e-9150-0a37fccb6deb x-openstack-request-id: req-05777e04-7f72-4b3e-9150-0a37fccb6deb {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:08:22.738865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-plugged", "status": "completed", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:08:22.739102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-05777e04-7f72-4b3e-9150-0a37fccb6deb {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:08:22.739502 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'code': 200} Nov 05 15:08:22.768910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:22.782417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbdff6fc-9c1d-401e-92af-82dab80ab771 req-1bf389f8-f822-47f5-8dcd-50246a2ef8a1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:22.783918 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cbdff6fc-9c1d-401e-92af-82dab80ab771 req-1bf389f8-f822-47f5-8dcd-50246a2ef8a1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=1558464e-fea4-4b8c-a6e6-e898a00a7c8c HTTP/1.1" status: 200 len: 945 time: 0.0502350 Nov 05 15:08:22.836278 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cbdff6fc-9c1d-401e-92af-82dab80ab771 req-529401e7-7146-4447-8cc2-c5bef0373e56 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456352 Nov 05 15:08:22.864982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.865345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:22.865661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 disassociated. External IP: 172.26.5.150, port: 8026d1d6-d06a-4595-b58e-c35521ca0657. Nov 05 15:08:22.866007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Calling delete_port for 8026d1d6-d06a-4595-b58e-c35521ca0657 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:08:22.991934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:23.019661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'Port': ['ID=8026d1d6-d06a-4595-b58e-c35521ca0657,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:23.031681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.032131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.032361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.032719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.033303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.033414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.033681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.034003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.034322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.034639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.034956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.035708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:08:23.149251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:08:23.257660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:08:23.267792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:08:23.277897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:08:23.278502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:08:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:23.296325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] No DVR routers for this DVR port 8026d1d6-d06a-4595-b58e-c35521ca0657 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:08:23.298877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:23.302264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-00cce30e-c26a-40e2-8777-d1b5ac8392a3 req-cb3e5e39-f677-4d54-9007-6c6e7b330a98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "DELETE /v2.0/ports/8026d1d6-d06a-4595-b58e-c35521ca0657 HTTP/1.1" status: 204 len: 173 time: 0.8084424 Nov 05 15:08:23.302653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-deleted', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:08:23.305209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e52490aa-5afc-47ee-814c-608eec3add35" -d '{"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-deleted", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:08:23.345066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:08:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e18f3646-3fd6-425c-a7e2-7d3a6a653e7b x-openstack-request-id: req-e18f3646-3fd6-425c-a7e2-7d3a6a653e7b {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:08:23.345474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1558464e-fea4-4b8c-a6e6-e898a00a7c8c", "name": "network-vif-deleted", "tag": "8026d1d6-d06a-4595-b58e-c35521ca0657", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:08:23.345944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e18f3646-3fd6-425c-a7e2-7d3a6a653e7b {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:08:23.346458 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1558464e-fea4-4b8c-a6e6-e898a00a7c8c', 'name': 'network-vif-deleted', 'tag': '8026d1d6-d06a-4595-b58e-c35521ca0657', 'status': 'completed', 'code': 200} Nov 05 15:08:23.388082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:08:23.516227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:23.601213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:23.627535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:08:23.635729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:08:23.636325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:08:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:23.742845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:08:23.945636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:23.971170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c85277d-5c89-494a-b099-a374f3b0f698 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:08:24.087566 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-be35d168-8ca0-45a6-8d5d-521980a5fd7f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1993639352&fields=id&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 267 time: 0.0430429 Nov 05 15:08:24.193132 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-024ee2b3-174d-4fea-9e81-fa5f7b2b9019 None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:08:24.198148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-1a20ee52-26cd-4326-ba0d-5055084807d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:24.199648 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-1a20ee52-26cd-4326-ba0d-5055084807d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1045744 Nov 05 15:08:24.215362 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-1740ea44-f449-4ef7-9b85-afc313f2d7ce tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/quotas/cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 375 time: 0.0090883 Nov 05 15:08:24.272234 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-a52086a7-862e-4a4f-9000-3b08c55d2445 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0514882 Nov 05 15:08:24.334549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-84d210c6-d385-42ef-8a54-05117ab53ce0 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:08:24.335536 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-84d210c6-d385-42ef-8a54-05117ab53ce0 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0512545 Nov 05 15:08:24.422848 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-2f78bf22-71d0-4490-b0a0-cd0483115dfc service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803034 Nov 05 15:08:24.514988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-31892db4-4c86-46ce-8dd4-7b8faad96d1f service neutron] 10.222.0.30 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861390 Nov 05 15:08:24.672248 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2edeea16-931e-4c8a-85f5-bba251ccad0e req-bf845c0d-74ef-48fe-99cd-b9ca56759682 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0297635 Nov 05 15:08:24.928246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:25.535873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-26cf4006-7e65-4af6-8a54-3139709db0d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:25.537367 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-26cf4006-7e65-4af6-8a54-3139709db0d8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 811 time: 0.1016827 Nov 05 15:08:25.601349 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-408c826f-54a0-4b7d-b5db-1138f6b6c709 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 380 time: 0.0547969 Nov 05 15:08:25.611375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'port': {'device_id': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'admin_state_up': True, 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'security_groups': ['f81f297a-35ff-4b56-bf39-011da81f52af']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:08:25.729165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Made reservation on behalf of cefa619ed11f4fae94c73d73d2f4f1dc for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:08:25.733028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:25.772019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dc238ce3-be7f-49c0-91f5-fb4fd2987e87 req-ba0e6bd5-9494-40bb-be17-951a4c3533a5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0272329 Nov 05 15:08:25.856426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Allocated IP 172.20.0.7 (b7856e81-af33-4465-b684-ce86f847a4ff/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f/765fb5df-0465-44ba-9628-dd2bb4ccad1c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:08:25.951830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:25.994757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.028155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.072304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Network b7856e81-af33-4465-b684-ce86f847a4ff is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:08:26.077493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:08:26.080550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:08:26.110550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:26.139789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:26.140956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.160515 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-27450f6b-d01d-4fb8-b531-b8d9e31fc157 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5534396 Nov 05 15:08:26.173536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Request body: {'port': {'device_id': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:08:26.229393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.278589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9e3fadf3-4d43-472f-b8a8-49bc8eb82eb0 None None] Provisioning complete for port 765fb5df-0465-44ba-9628-dd2bb4ccad1c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:08:26.278875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9e3fadf3-4d43-472f-b8a8-49bc8eb82eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.316056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9e3fadf3-4d43-472f-b8a8-49bc8eb82eb0 None None] Port 765fb5df-0465-44ba-9628-dd2bb4ccad1c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:08:26.490623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:08:26.498219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.510048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Transition to ACTIVE for port object 765fb5df-0465-44ba-9628-dd2bb4ccad1c will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:08:26.513979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.536180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:08:26.572935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:26.651863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Attempting to bind port 765fb5df-0465-44ba-9628-dd2bb4ccad1c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:08:26.652201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Attempting to bind port 765fb5df-0465-44ba-9628-dd2bb4ccad1c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:08:26.652566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Attempting to bind port 765fb5df-0465-44ba-9628-dd2bb4ccad1c on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:08:26.658124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Port 765fb5df-0465-44ba-9628-dd2bb4ccad1c on network b7856e81-af33-4465-b684-ce86f847a4ff not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:08:26.658452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Attempting to bind port 765fb5df-0465-44ba-9628-dd2bb4ccad1c on network b7856e81-af33-4465-b684-ce86f847a4ff {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:08:26.663977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 8, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:08:26.664326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Checking segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:08:26.664745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Bound using segment: {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:08:26.665179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Bound port: 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '11e39521-7ffb-45e0-a44d-400d4e354f3c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:08:26.665540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.709185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 8026d1d6-d06a-4595-b58e-c35521ca0657 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:08:26.709521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 8026d1d6-d06a-4595-b58e-c35521ca0657 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:08:26.734105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:08:26.737148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:08:26.744179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.781684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:26.782648 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:26.784273 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] 10.222.0.32 "PUT /v2.0/ports/765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1093 time: 0.6157703 Nov 05 15:08:26.786535 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:08:26.789776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-226125a0-7c16-49e2-8ac7-00d5caed5e34" -d '{"events": [{"name": "network-changed", "server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:08:26.820431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a577e3a-6005-438e-a78d-8c7fe487acee service neutron] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:26.855888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:08:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2990fda6-5015-4bdc-a18c-ac2c22da28c7 x-openstack-request-id: req-2990fda6-5015-4bdc-a18c-ac2c22da28c7 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:08:26.856178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:08:26.856430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2990fda6-5015-4bdc-a18c-ac2c22da28c7 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:08:26.856856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'status': 'completed', 'code': 200} Nov 05 15:08:26.887705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-3064a53c-c938-4314-ac9b-67bf60b9e59d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:26.889332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-3064a53c-c938-4314-ac9b-67bf60b9e59d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1096 time: 0.0441098 Nov 05 15:08:26.913192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad62f23-f5f0-4c66-ab34-944049e88631 req-d089a49d-eea7-436d-aa9d-f0a4f499a581 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:26.914709 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cad62f23-f5f0-4c66-ab34-944049e88631 req-d089a49d-eea7-436d-aa9d-f0a4f499a581 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0524538 Nov 05 15:08:26.935736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-570e2051-c4a3-44b3-88c6-0098da19899f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 217 time: 0.0368528 Nov 05 15:08:26.965801 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cad62f23-f5f0-4c66-ab34-944049e88631 req-61424d66-3572-4620-8281-ffea0ca79fd0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448005 Nov 05 15:08:26.991772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-03078dba-6a7d-476c-8b91-6235d94cc777 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:26.993441 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-03078dba-6a7d-476c-8b91-6235d94cc777 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0506110 Nov 05 15:08:27.040225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579e4507-da99-4405-abb4-80d5377fe626 req-fb44a880-fc8f-44f9-8d3e-a51b9465d87d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:27.041626 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-fb44a880-fc8f-44f9-8d3e-a51b9465d87d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0407431 Nov 05 15:08:27.131388 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-70daa855-dd2b-4763-886b-4829eab35867 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824766 Nov 05 15:08:27.222316 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-579e4507-da99-4405-abb4-80d5377fe626 req-c0df5960-accc-4860-a858-c0e7805e96ed service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843110 Nov 05 15:08:27.314011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-8e302238-c74c-4cdb-b82d-78b9aecff2a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:27.315439 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-8e302238-c74c-4cdb-b82d-78b9aecff2a2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1096 time: 0.0411060 Nov 05 15:08:27.406951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-82538d4c-851a-4afe-a337-dda7a2fb435b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:27.408389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-82538d4c-851a-4afe-a337-dda7a2fb435b service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0853996 Nov 05 15:08:27.450304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-d7e6e5d0-c3b4-49a5-b0a6-6aacabb6c0b7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 217 time: 0.0340867 Nov 05 15:08:27.497165 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-9fa575fa-ea11-4959-b4a5-f38c1e1e0aae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:27.498623 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-9fa575fa-ea11-4959-b4a5-f38c1e1e0aae service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0414846 Nov 05 15:08:27.548094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-6a5a0d48-b20c-4955-8655-4907123846a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:27.550193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-6a5a0d48-b20c-4955-8655-4907123846a5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0435085 Nov 05 15:08:27.637599 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-aca7f50e-e1a6-4c16-b6b7-044bd9005219 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793607 Nov 05 15:08:27.729247 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-226125a0-7c16-49e2-8ac7-00d5caed5e34 req-fe5a1c63-3102-41e3-919a-604ac923a57c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834467 Nov 05 15:08:28.085590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5279cb-dadb-42ce-9581-f0aea1418e64 req-84366f39-b70f-4e75-a02f-41a8d777c67d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:28.087034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ad5279cb-dadb-42ce-9581-f0aea1418e64 req-84366f39-b70f-4e75-a02f-41a8d777c67d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0482130 Nov 05 15:08:28.132973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ad5279cb-dadb-42ce-9581-f0aea1418e64 req-2b52d1d0-1335-4e38-8131-4f8cc98a2760 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400078 Nov 05 15:08:28.535561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:08:28.630297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:28.641611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:08:28.676630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:28.690092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:08:28.709201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:28.713402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:28.758246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:28.919296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['765fb5df-0465-44ba-9628-dd2bb4ccad1c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:08:29.245690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae45522-a5ee-4890-af95-17aa01fd4c52 req-489a5389-201a-4254-b41b-d3b35f161dfd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:29.247123 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7ae45522-a5ee-4890-af95-17aa01fd4c52 req-489a5389-201a-4254-b41b-d3b35f161dfd tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 944 time: 0.0480108 Nov 05 15:08:29.296334 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7ae45522-a5ee-4890-af95-17aa01fd4c52 req-b91c51be-0782-4e18-be03-028d7c6eba5e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432954 Nov 05 15:08:30.411891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af43a0f8-eaae-4bdd-abe0-61044b147365 req-60e3deeb-0d82-4b9c-9f19-3c9777c6872f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:30.413387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-af43a0f8-eaae-4bdd-abe0-61044b147365 req-60e3deeb-0d82-4b9c-9f19-3c9777c6872f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 944 time: 0.0491109 Nov 05 15:08:30.460132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-af43a0f8-eaae-4bdd-abe0-61044b147365 req-eb07fd45-65c8-4729-8d1c-72541eadaf7b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409319 Nov 05 15:08:30.552613 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:08:30.600294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 765fb5df-0465-44ba-9628-dd2bb4ccad1c completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:08:30.604536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 765fb5df-0465-44ba-9628-dd2bb4ccad1c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:08:30.604961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:30.683716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:30.706543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:08:30.708805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb6b2a47-30ee-4e01-9664-00cff3c6f3da" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:08:30.722470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:08:30.726542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:30.751791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:08:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-766a2d70-a6b4-4d98-abae-55d18ac6e118 x-openstack-request-id: req-766a2d70-a6b4-4d98-abae-55d18ac6e118 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:08:30.752084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:08:30.752334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-766a2d70-a6b4-4d98-abae-55d18ac6e118 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:08:30.752739 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'code': 200} Nov 05 15:08:30.778125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:08:30.915110 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa4e6ca-1663-4f86-a804-878dbcd173cd req-5fa3b70f-80f8-4265-8895-eba7a742a5c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:30.916674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9fa4e6ca-1663-4f86-a804-878dbcd173cd req-5fa3b70f-80f8-4265-8895-eba7a742a5c3 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0456834 Nov 05 15:08:30.962453 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9fa4e6ca-1663-4f86-a804-878dbcd173cd req-3f0c7a55-59c2-4528-b04d-dfe5249f61c0 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390754 Nov 05 15:08:31.572819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1913008-de68-41b9-b4ed-b122f4617703 req-8b904277-1ff7-471b-999d-df498b082d8b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:31.574290 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c1913008-de68-41b9-b4ed-b122f4617703 req-8b904277-1ff7-471b-999d-df498b082d8b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0490382 Nov 05 15:08:31.620646 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c1913008-de68-41b9-b4ed-b122f4617703 req-bfe94bd3-0291-4bd4-89bd-5d2f82437de5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404880 Nov 05 15:08:32.735283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ff5900-c31f-4658-b273-767688f6c3f1 req-56163957-019d-4b63-9d84-a2be41102ce2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:32.736810 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36ff5900-c31f-4658-b273-767688f6c3f1 req-56163957-019d-4b63-9d84-a2be41102ce2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0493309 Nov 05 15:08:32.782500 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36ff5900-c31f-4658-b273-767688f6c3f1 req-d68e16fa-cde9-4c05-bb4a-4d7e91721297 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397925 Nov 05 15:08:32.892640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1733b88-2599-42d2-9cd7-be3a46503169 req-df602bd4-8118-4dc8-9acc-51646f3a21c4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:32.894093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a1733b88-2599-42d2-9cd7-be3a46503169 req-df602bd4-8118-4dc8-9acc-51646f3a21c4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0478153 Nov 05 15:08:32.902565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49218) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:08:32.906797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Request body: {'floatingip': {'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:08:32.948225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:33.390794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:33.394757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:33.493335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 associated. External IP: 172.26.5.150, port: 765fb5df-0465-44ba-9628-dd2bb4ccad1c. Nov 05 15:08:33.966855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:08:34.071511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:08:34.076800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:34.082013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:08:34.091158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:08:34.091768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:08:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:34.105660 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a9664b9e-8b5f-4450-beec-37d167d6d9c3 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "PUT /v2.0/floatingips/8b0fa759-110d-4bf0-acb1-99357bf80a68 HTTP/1.1" status: 200 len: 992 time: 1.2020695 Nov 05 15:08:34.106342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:08:34.108675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9f0e106-5174-46bb-8b31-33474b894dad" -d '{"events": [{"name": "network-changed", "server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:08:34.153818 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:08:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ae9c3a8-f790-4a92-853b-9975edada093 x-openstack-request-id: req-8ae9c3a8-f790-4a92-853b-9975edada093 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:08:34.154120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:08:34.154370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8ae9c3a8-f790-4a92-853b-9975edada093 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:08:34.154770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'status': 'completed', 'code': 200} Nov 05 15:08:34.208623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:08:34.221685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f0e106-5174-46bb-8b31-33474b894dad req-f8dddb91-c765-4801-ad29-905149e58d31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:34.223178 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-f8dddb91-c765-4801-ad29-905149e58d31 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0446641 Nov 05 15:08:34.317062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f0e106-5174-46bb-8b31-33474b894dad req-a7c8fd04-e5dd-4268-a3d0-3bb329d76370 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:34.318566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-a7c8fd04-e5dd-4268-a3d0-3bb329d76370 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0885785 Nov 05 15:08:34.388081 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-e245154c-5bbe-405a-98dd-c78a26352e29 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1000 time: 0.0618982 Nov 05 15:08:34.437390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:08:33Z', 'revision_number': 13, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:34.438152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f0e106-5174-46bb-8b31-33474b894dad req-b57a7cce-873d-44b8-9d8b-359a74a95233 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:34.439802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-b57a7cce-873d-44b8-9d8b-359a74a95233 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0449131 Nov 05 15:08:34.463596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:08:34.472435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:08:34.473073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:08:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:34.485958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f0e106-5174-46bb-8b31-33474b894dad req-c54b25fa-6c23-4318-91b0-d834fd12a286 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:08:34.487469 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-c54b25fa-6c23-4318-91b0-d834fd12a286 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0411220 Nov 05 15:08:34.575673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:08:34.580860 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-e8dc5723-c1fe-423f-896f-d76689593f1a service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856421 Nov 05 15:08:34.674676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9f0e106-5174-46bb-8b31-33474b894dad req-2d711327-5083-4a36-b446-2f4ea48f4f07 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869386 Nov 05 15:08:34.800674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:08:33Z', 'revision_number': 13, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:08:34.827277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa72def0-fc53-47e5-ac26-4378a570eb89 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '8b0fa759-110d-4bf0-acb1-99357bf80a68', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:04:38Z', 'updated_at': '2021-11-05T15:08:33Z', 'revision_number': 13, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:08:35.009015 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7875f2e-e1db-4e92-807c-15a7c4911301 None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:08:38.542508 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:08:48.430142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:50.102893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eb253e7-14e7-4748-abc1-a5f34056d2bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:52.425991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ee842938-9792-422d-9a3c-ac13e4a2174f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:53.471087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:54.932309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:08:55.955127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:12.702272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a50f802-6739-4574-9a68-ce204b87d998 req-7587e4cb-1b81-4e49-a044-a1df1914c11f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:12.703762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a50f802-6739-4574-9a68-ce204b87d998 req-7587e4cb-1b81-4e49-a044-a1df1914c11f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0560892 Nov 05 15:09:12.749610 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a50f802-6739-4574-9a68-ce204b87d998 req-e29b6777-d417-4835-a30b-c1bf42d88710 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395374 Nov 05 15:09:13.534696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-b8346a1e-b422-47d7-a51a-e2e86164cf7f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0415273 Nov 05 15:09:13.617111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-f5286189-16c8-4707-b926-720dd3845a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:13.618588 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-f5286189-16c8-4707-b926-720dd3845a90 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0406864 Nov 05 15:09:13.724607 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-29c94522-c6ef-439c-ae93-1fcc81813db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:13.726137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-29c94522-c6ef-439c-ae93-1fcc81813db8 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0877626 Nov 05 15:09:13.794566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-79a2b0f5-0a47-4dde-9fc7-341f987d449c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1002 time: 0.0606487 Nov 05 15:09:13.844179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-3403a5ba-515e-430d-842c-eb3983d0a285 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:13.845687 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-3403a5ba-515e-430d-842c-eb3983d0a285 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0441818 Nov 05 15:09:13.896291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-3ed59104-6508-4ca3-8648-a820662ba70d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:13.897865 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-3ed59104-6508-4ca3-8648-a820662ba70d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0449722 Nov 05 15:09:13.988762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-8de7dd0d-18b2-4cdd-8628-98bdff201226 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836854 Nov 05 15:09:14.083848 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e967c0d7-7ea2-45d5-ad62-2ed14ffd1503 req-7454921b-288e-4e8d-a541-a504e238a57c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877395 Nov 05 15:09:15.542364 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:09:18.421879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:20.103334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-970c72b2-3751-4cd5-b9c1-89b23bd99f0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:22.427037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-08c99af7-51fc-4c99-8b36-5a6f7c5612aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:23.474202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:24.868414 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-150a6d60-c87f-49ea-85df-1e0b5b8ced69 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0403650 Nov 05 15:09:24.888502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848d1f49-c238-4988-b7e0-51a37591d6b1 req-fa99fa60-a3de-47f3-b4d2-eabf74043952 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:24.890015 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-848d1f49-c238-4988-b7e0-51a37591d6b1 req-fa99fa60-a3de-47f3-b4d2-eabf74043952 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0516310 Nov 05 15:09:24.936993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:24.939664 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-848d1f49-c238-4988-b7e0-51a37591d6b1 req-c9de7570-007b-49c4-9634-4b06e6b1be07 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426142 Nov 05 15:09:25.930238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-759b3e6d-b30a-4c13-8cf1-129ee526141f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:25.931706 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-759b3e6d-b30a-4c13-8cf1-129ee526141f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0408485 Nov 05 15:09:25.957946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:26.054853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-3598ebf3-193e-4146-ab3e-7133a15f7781 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:26.056230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-3598ebf3-193e-4146-ab3e-7133a15f7781 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.1163850 Nov 05 15:09:26.078422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fee82f-5a3c-4301-9645-0d364935a9f7 req-9bed3a54-09be-496f-b3cc-f941f8cf57cb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:26.079832 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e7fee82f-5a3c-4301-9645-0d364935a9f7 req-9bed3a54-09be-496f-b3cc-f941f8cf57cb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0709000 Nov 05 15:09:26.157555 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-a6233c5e-5a1a-4f44-9bf9-db6d5fb34c22 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1002 time: 0.0937676 Nov 05 15:09:26.177707 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e7fee82f-5a3c-4301-9645-0d364935a9f7 req-7b9f9856-d7e5-456a-94fe-aa8c30df0589 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666203 Nov 05 15:09:26.212001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-4013c77d-bbdb-4947-8863-0a7d7af0db5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:26.213472 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-4013c77d-bbdb-4947-8863-0a7d7af0db5d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0481188 Nov 05 15:09:26.258521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-c760c8e3-cbf1-4866-91e7-080b7bc14d6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:26.259974 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-c760c8e3-cbf1-4866-91e7-080b7bc14d6d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394530 Nov 05 15:09:26.349770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-a2dcedb2-ef63-4bb8-86a7-1665cf44bbef service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827026 Nov 05 15:09:26.436207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-a78310ca-73eb-4703-acff-45f46249ca62 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796812 Nov 05 15:09:27.293969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea966f9-96ae-4ef6-abc9-ecc9ec5cf439 req-0f2980ca-9b22-4231-91fb-8440b68af5a8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:27.295416 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ea966f9-96ae-4ef6-abc9-ecc9ec5cf439 req-0f2980ca-9b22-4231-91fb-8440b68af5a8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0474017 Nov 05 15:09:27.341447 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5ea966f9-96ae-4ef6-abc9-ecc9ec5cf439 req-200c0053-ad6e-4b5a-9f6b-31b5c3486d3e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397098 Nov 05 15:09:28.459518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e00dc12-2298-4fbd-8c83-21e0862fdcb1 req-accc1847-468e-4392-9d96-92dbe964c609 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:28.461027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e00dc12-2298-4fbd-8c83-21e0862fdcb1 req-accc1847-468e-4392-9d96-92dbe964c609 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0529957 Nov 05 15:09:28.510802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2e00dc12-2298-4fbd-8c83-21e0862fdcb1 req-66fd716a-835e-4a28-99b0-69ba11d1ede4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438952 Nov 05 15:09:29.628450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01015cb-a85d-4c1f-9145-d82ca75c8f58 req-147fae9b-cc8a-4005-9664-6730be5764a7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:29.629940 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f01015cb-a85d-4c1f-9145-d82ca75c8f58 req-147fae9b-cc8a-4005-9664-6730be5764a7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0527349 Nov 05 15:09:29.675329 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f01015cb-a85d-4c1f-9145-d82ca75c8f58 req-5c67845e-aab2-47a3-a6fd-656d67189616 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396118 Nov 05 15:09:30.789480 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d51700-7059-42ff-88ba-d6b21157bcc4 req-849fd374-6a75-4100-a377-819c67382a3c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:30.790868 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4d51700-7059-42ff-88ba-d6b21157bcc4 req-849fd374-6a75-4100-a377-819c67382a3c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0484200 Nov 05 15:09:30.837374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4d51700-7059-42ff-88ba-d6b21157bcc4 req-d53aa483-c10b-4e41-8aed-c3af60df50eb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406415 Nov 05 15:09:31.950757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd374bb-cdc2-4bd1-be14-fcc8a63846f0 req-833c86c0-9df4-4175-a4dd-b26b441b03fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:31.952235 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ccd374bb-cdc2-4bd1-be14-fcc8a63846f0 req-833c86c0-9df4-4175-a4dd-b26b441b03fb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0488093 Nov 05 15:09:31.999431 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ccd374bb-cdc2-4bd1-be14-fcc8a63846f0 req-cdbb6310-77c0-42f1-a955-7139e4d02bab tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407858 Nov 05 15:09:33.116781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03b463f-c794-4c2f-9cca-a12100aad0ea req-e2f81b3b-2600-4751-ab06-3144b356b4cf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:33.118227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d03b463f-c794-4c2f-9cca-a12100aad0ea req-e2f81b3b-2600-4751-ab06-3144b356b4cf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0475435 Nov 05 15:09:33.169727 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d03b463f-c794-4c2f-9cca-a12100aad0ea req-5c5645ec-9083-4a1c-8e32-8c500040d987 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450499 Nov 05 15:09:34.288246 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61112605-ce60-4b17-915b-05fd501f9606 req-c90e6491-cbc3-4fa4-8eda-c5183edfc8ab tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:34.289724 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-61112605-ce60-4b17-915b-05fd501f9606 req-c90e6491-cbc3-4fa4-8eda-c5183edfc8ab tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0483017 Nov 05 15:09:34.339364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-61112605-ce60-4b17-915b-05fd501f9606 req-4d81bc66-6b7b-49e9-b99d-309767d1df86 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436924 Nov 05 15:09:35.452846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3b203a-9641-40c0-838c-e44a71802d3f req-8655cf8b-a9c9-4bb6-b17f-5da055d019be tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:35.454294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7b3b203a-9641-40c0-838c-e44a71802d3f req-8655cf8b-a9c9-4bb6-b17f-5da055d019be tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0482147 Nov 05 15:09:35.517566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7b3b203a-9641-40c0-838c-e44a71802d3f req-906a569b-3edf-4479-99dc-88be80bd353e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571868 Nov 05 15:09:36.633272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6801fd-741b-4256-ad6d-a9971503c224 req-eef2e577-3c6e-4301-9229-ae43bcb9de7f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:36.634746 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ec6801fd-741b-4256-ad6d-a9971503c224 req-eef2e577-3c6e-4301-9229-ae43bcb9de7f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0482578 Nov 05 15:09:36.681000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ec6801fd-741b-4256-ad6d-a9971503c224 req-d89fa1b0-4560-4ce0-bfbc-9518fe013713 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403929 Nov 05 15:09:37.850522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e96e653-fa61-414c-99d2-4abc806461ef req-6121153b-613f-446b-a907-17cbcb75a45d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:37.851984 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1e96e653-fa61-414c-99d2-4abc806461ef req-6121153b-613f-446b-a907-17cbcb75a45d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0479183 Nov 05 15:09:37.897714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1e96e653-fa61-414c-99d2-4abc806461ef req-f9d86c02-f78e-440e-93a7-1dd63b9c709b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399067 Nov 05 15:09:39.017396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ab6028-2ea1-4a84-80d9-8d436f46e184 req-6749a33e-a734-46ca-96b7-c0f1368ece09 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:39.018952 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b5ab6028-2ea1-4a84-80d9-8d436f46e184 req-6749a33e-a734-46ca-96b7-c0f1368ece09 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0516059 Nov 05 15:09:39.068318 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b5ab6028-2ea1-4a84-80d9-8d436f46e184 req-441e4271-31e9-4205-82ef-db331d63dbdc tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430496 Nov 05 15:09:40.134018 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-8d15e76b-c62f-4dca-bd13-041738a8ed8d service neutron] 10.222.0.32 "GET /v2.0/ports/765fb5df-0465-44ba-9628-dd2bb4ccad1c/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0588033 Nov 05 15:09:40.184292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-667e1392-c3c2-4d74-ae9b-2b70813dda06 req-a8614e8e-8004-4e4f-aaef-b7c1686a7647 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.185962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-667e1392-c3c2-4d74-ae9b-2b70813dda06 req-a8614e8e-8004-4e4f-aaef-b7c1686a7647 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0487998 Nov 05 15:09:40.234490 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-667e1392-c3c2-4d74-ae9b-2b70813dda06 req-18c7d31b-532d-4eb0-8de6-41ceab413c03 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417709 Nov 05 15:09:40.335038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-92b081b2-b8ff-4129-a824-21bd8c0cbebf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.336574 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-92b081b2-b8ff-4129-a824-21bd8c0cbebf service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1098 time: 0.0411758 Nov 05 15:09:40.401144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-6bb938d6-c99d-40ab-9801-09b317c4e6c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.402602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-6bb938d6-c99d-40ab-9801-09b317c4e6c1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0434053 Nov 05 15:09:40.491342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-07ed98fe-3161-4788-ba24-4c06c2a64571 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.492817 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-07ed98fe-3161-4788-ba24-4c06c2a64571 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0818560 Nov 05 15:09:40.562485 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-6f66660e-a511-4f2d-95b5-bc138d40acd0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1002 time: 0.0619807 Nov 05 15:09:40.610094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-1bf44796-78e6-4c42-9927-81d0dac0fdb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.611536 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-1bf44796-78e6-4c42-9927-81d0dac0fdb0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0416195 Nov 05 15:09:40.654884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-d35d2c33-c4a7-407c-adc2-3f823fa9d211 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:40.656286 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-d35d2c33-c4a7-407c-adc2-3f823fa9d211 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0378201 Nov 05 15:09:40.745456 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-125bc3b8-dd44-43aa-a2f4-5c68f19769fe service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818229 Nov 05 15:09:40.775077 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:09:40.833652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-76d7df73-69be-43da-b19b-ff996e51a50c service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809097 Nov 05 15:09:40.851011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:40.872578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:09:40.874771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-813217c4-fffc-4e52-8c30-da5f48a3bc5b" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-unplugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:09:40.887413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:09:40.892889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:40.937038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:09:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb331658-9b7a-4613-8090-0c6714bf6a87 x-openstack-request-id: req-cb331658-9b7a-4613-8090-0c6714bf6a87 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:09:40.937320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-unplugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:09:40.937570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cb331658-9b7a-4613-8090-0c6714bf6a87 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:09:40.937963 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'code': 200} Nov 05 15:09:40.946727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:09:40.953537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.953889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.954224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.954556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.954886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.955213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.955539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.955864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.957129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.957129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.957355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:40.957659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:09:41.355376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2955d0-eda2-47ee-a55e-274d916b2f01 req-d8b9c9d8-9166-4a9d-aee0-e69714e0e94b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:41.356899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cd2955d0-eda2-47ee-a55e-274d916b2f01 req-d8b9c9d8-9166-4a9d-aee0-e69714e0e94b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0521588 Nov 05 15:09:41.407805 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cd2955d0-eda2-47ee-a55e-274d916b2f01 req-232af93f-35a1-4c48-80d2-5aa70eb08eb4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449660 Nov 05 15:09:42.593755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dac289b-29e6-4ff4-91fc-ff7357eaefa4 req-624de482-a10a-4f56-91da-4e5b1a515be0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:42.595366 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8dac289b-29e6-4ff4-91fc-ff7357eaefa4 req-624de482-a10a-4f56-91da-4e5b1a515be0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.1190324 Nov 05 15:09:42.642921 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8dac289b-29e6-4ff4-91fc-ff7357eaefa4 req-305d9d56-9858-40b2-a7b5-d8a39478b870 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406516 Nov 05 15:09:43.759188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-691299d9-7627-45d8-abd2-c4c974e82b13 req-d1e476f0-a200-4eef-86a2-74356d5710d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:43.760600 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-691299d9-7627-45d8-abd2-c4c974e82b13 req-d1e476f0-a200-4eef-86a2-74356d5710d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0486243 Nov 05 15:09:43.808795 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-691299d9-7627-45d8-abd2-c4c974e82b13 req-58909ad6-b742-4f79-b698-5c5a17f2e680 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421689 Nov 05 15:09:44.929116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8001416f-01c7-4f08-8c37-a2e548a2c67e req-fcf5cbb8-8bb6-47e6-a7a9-7cbc1349bd3b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:44.931361 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8001416f-01c7-4f08-8c37-a2e548a2c67e req-fcf5cbb8-8bb6-47e6-a7a9-7cbc1349bd3b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0538042 Nov 05 15:09:44.979199 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8001416f-01c7-4f08-8c37-a2e548a2c67e req-59138b06-e02e-463f-85f3-4175d69cc075 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419536 Nov 05 15:09:46.137283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec77d8b0-078c-4dc0-980b-a17e3dec4331 req-92bf8185-fb2e-4c8d-b3ad-c2ac8b1699aa tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:46.138722 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec77d8b0-078c-4dc0-980b-a17e3dec4331 req-92bf8185-fb2e-4c8d-b3ad-c2ac8b1699aa tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0914948 Nov 05 15:09:46.186921 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec77d8b0-078c-4dc0-980b-a17e3dec4331 req-1f43335d-cffd-4b87-a758-3723e72aa7bb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417619 Nov 05 15:09:46.806559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:09:46.899207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:09:46.910096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:09:46.946057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:46.958241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:09:46.976336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:09:46.980172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:47.028215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:09:47.037827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['765fb5df-0465-44ba-9628-dd2bb4ccad1c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:09:47.302383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db22e54-cf04-4575-a59b-f81b7130d0fd req-5f5cb23a-f2e9-4f44-83e3-c44c68d1161c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:47.304105 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5db22e54-cf04-4575-a59b-f81b7130d0fd req-5f5cb23a-f2e9-4f44-83e3-c44c68d1161c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 944 time: 0.0484905 Nov 05 15:09:47.354810 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5db22e54-cf04-4575-a59b-f81b7130d0fd req-cd9b8e17-9a65-43c4-a0cd-ee8ef34cf8a1 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444655 Nov 05 15:09:48.413865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:48.475391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab307fe7-6c1d-4d33-830d-5616507ef389 req-ec1306e0-9d54-4053-96c3-38738fa28bff tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:48.476900 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ab307fe7-6c1d-4d33-830d-5616507ef389 req-ec1306e0-9d54-4053-96c3-38738fa28bff tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 944 time: 0.0530562 Nov 05 15:09:48.524414 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ab307fe7-6c1d-4d33-830d-5616507ef389 req-bc33537d-fab4-4229-a7ec-8fcacd648ba5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414529 Nov 05 15:09:48.805879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:09:48.852250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 765fb5df-0465-44ba-9628-dd2bb4ccad1c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:09:48.852716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:48.931444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:48.953419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:09:48.955621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5c63046-0d90-4fa4-b45e-306c7143b17d" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:09:48.968079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:09:48.972664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:49.007281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:09:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e589b3fd-8f67-4940-91c6-6a93e928b2f1 x-openstack-request-id: req-e589b3fd-8f67-4940-91c6-6a93e928b2f1 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:09:49.007605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:09:49.007880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e589b3fd-8f67-4940-91c6-6a93e928b2f1 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:09:49.008270 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'code': 200} Nov 05 15:09:49.022737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:09:49.643763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ce7095-4344-4c34-8a84-1344b4434d45 req-ddafa82a-5d44-42d0-9c5c-dad16327bf9f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:49.645257 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-79ce7095-4344-4c34-8a84-1344b4434d45 req-ddafa82a-5d44-42d0-9c5c-dad16327bf9f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0485449 Nov 05 15:09:49.691498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-79ce7095-4344-4c34-8a84-1344b4434d45 req-547545fe-20f7-4ae2-a4e9-b87d53ec151f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404594 Nov 05 15:09:50.104879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d60a285d-8a95-4bc0-9a5d-6fca2650cf68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:50.813412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b992336c-b29b-49fd-b740-43229dba6243 req-eaf153d9-d5e4-44d0-92ce-0d3627327de5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:50.814888 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b992336c-b29b-49fd-b740-43229dba6243 req-eaf153d9-d5e4-44d0-92ce-0d3627327de5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0492861 Nov 05 15:09:50.862186 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b992336c-b29b-49fd-b740-43229dba6243 req-243cc32f-379b-42c5-8be0-7f2635a56ece tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404878 Nov 05 15:09:51.977964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3655738-03dd-48cb-9abd-edf558f16913 req-fbc7172f-87e8-4762-8d11-7fa65cb89630 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:51.979395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b3655738-03dd-48cb-9abd-edf558f16913 req-fbc7172f-87e8-4762-8d11-7fa65cb89630 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0475676 Nov 05 15:09:52.028910 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b3655738-03dd-48cb-9abd-edf558f16913 req-c5ee859e-5145-4074-bc29-76817c803fdb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434113 Nov 05 15:09:52.433093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e7805873-b7d0-4ed7-a30b-6c3998bde545 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:52.542079 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:09:53.141841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5a9468-b0f7-4684-846d-b312d234f34d req-280e3706-d1a8-4467-b9d1-d17f866f452c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.143305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9d5a9468-b0f7-4684-846d-b312d234f34d req-280e3706-d1a8-4467-b9d1-d17f866f452c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0479622 Nov 05 15:09:53.188808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9d5a9468-b0f7-4684-846d-b312d234f34d req-8bed1ec8-648c-454f-a982-cb4754684ff9 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395396 Nov 05 15:09:53.480381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:53.502324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-c8ac7117-a1ee-4b27-a85d-cb11205d46c2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.504365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-c8ac7117-a1ee-4b27-a85d-cb11205d46c2 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0554452 Nov 05 15:09:53.521074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa490b1-1b1e-466b-b3d6-d355b6966a8e req-15a38dcd-f327-4aef-9e4c-b648ffb87cfb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.522649 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4fa490b1-1b1e-466b-b3d6-d355b6966a8e req-15a38dcd-f327-4aef-9e4c-b648ffb87cfb tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0584865 Nov 05 15:09:53.566832 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-bde429d0-fc83-4029-8db2-7ad0b960d12d service neutron] 10.222.0.32 "GET /v2.0/ports/765fb5df-0465-44ba-9628-dd2bb4ccad1c/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0553746 Nov 05 15:09:53.574896 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4fa490b1-1b1e-466b-b3d6-d355b6966a8e req-59ca27bb-113c-4ee9-b1cf-fb1db3720cd7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462856 Nov 05 15:09:53.630488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-0b77a1b8-f2ec-4900-92bb-f81bfcff7853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.632617 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-0b77a1b8-f2ec-4900-92bb-f81bfcff7853 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0435200 Nov 05 15:09:53.722690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-ca53b8b1-aa50-4660-b6cc-4546f0d9d0ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.724029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-ca53b8b1-aa50-4660-b6cc-4546f0d9d0ce service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0837915 Nov 05 15:09:53.786220 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-a9da59a8-aa0f-447f-aefb-f2e5ba6182bc service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1002 time: 0.0555625 Nov 05 15:09:53.837326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-1029b25c-732f-42ed-b3d5-9d593f82dfd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.838727 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-1029b25c-732f-42ed-b3d5-9d593f82dfd1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0458503 Nov 05 15:09:53.882948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-8fc0f3d7-52ab-4e29-b6cf-423dfda92b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:53.884363 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-8fc0f3d7-52ab-4e29-b6cf-423dfda92b33 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388427 Nov 05 15:09:53.969269 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-bbae7751-5637-48f7-aabd-2d25be2107fb service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0776258 Nov 05 15:09:54.058568 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-a39750cf-3cac-4f9e-a99e-434a5586d150 service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823727 Nov 05 15:09:54.693105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db7d85d-d4df-4b21-a633-3a2936e2cca6 req-48d4ab5c-c1ea-41f2-a06d-92c4758df5e0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:54.694701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5db7d85d-d4df-4b21-a633-3a2936e2cca6 req-48d4ab5c-c1ea-41f2-a06d-92c4758df5e0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0494370 Nov 05 15:09:54.740901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5db7d85d-d4df-4b21-a633-3a2936e2cca6 req-3d36b08c-7ec0-4eb0-9e91-4540958dc183 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403066 Nov 05 15:09:54.937690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:55.856816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5af95d1-6416-409e-9abc-60035995cdd0 req-1c94686f-e56b-4245-8fc4-34bc352b9685 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:55.858275 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5af95d1-6416-409e-9abc-60035995cdd0 req-1c94686f-e56b-4245-8fc4-34bc352b9685 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0484567 Nov 05 15:09:55.904109 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a5af95d1-6416-409e-9abc-60035995cdd0 req-606fa3a5-0542-4ba5-a808-3e5699cbc965 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399885 Nov 05 15:09:55.960444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:57.048950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de03a7b-7ba2-474b-9604-d2a6a8407778 req-18566fa5-3b09-4fa0-8adb-a72ff5c1d6d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:57.051688 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0de03a7b-7ba2-474b-9604-d2a6a8407778 req-18566fa5-3b09-4fa0-8adb-a72ff5c1d6d5 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0705526 Nov 05 15:09:57.101488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0de03a7b-7ba2-474b-9604-d2a6a8407778 req-30d7b369-8dcf-4d03-99b3-e0632201a648 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434253 Nov 05 15:09:58.221595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351c1e81-04da-41c0-8981-7efca7cda2b3 req-ca27e01a-3e6c-4e40-9e0a-007f63d0c790 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.223108 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-351c1e81-04da-41c0-8981-7efca7cda2b3 req-ca27e01a-3e6c-4e40-9e0a-007f63d0c790 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0536017 Nov 05 15:09:58.274660 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-351c1e81-04da-41c0-8981-7efca7cda2b3 req-60a47031-06b3-4759-9133-abe833ef96ec tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438030 Nov 05 15:09:58.509631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-08d315d9-1a6b-42ad-b4da-e90ba0569f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.511123 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-08d315d9-1a6b-42ad-b4da-e90ba0569f32 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6&tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc HTTP/1.1" status: 200 len: 1098 time: 0.0413036 Nov 05 15:09:58.572397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-6f536028-7ac1-46a4-8ff8-ba7ed0c0cfc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.573913 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-6f536028-7ac1-46a4-8ff8-ba7ed0c0cfc1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 1098 time: 0.0408597 Nov 05 15:09:58.665547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-21ae7e06-b67d-4195-b9f1-e1e9c562e82e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.667051 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-21ae7e06-b67d-4195-b9f1-e1e9c562e82e service neutron] 10.222.0.32 "GET /v2.0/networks?id=b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 200 len: 912 time: 0.0863507 Nov 05 15:09:58.733056 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-44df760c-f764-4a43-8e33-e16a6687a365 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 200 len: 1002 time: 0.0588677 Nov 05 15:09:58.779860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-a0bfedbb-337d-4b7e-a18b-6fa650bebe2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.781339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-a0bfedbb-337d-4b7e-a18b-6fa650bebe2b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 200 len: 850 time: 0.0406117 Nov 05 15:09:58.830435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-8e8b7fb1-e64c-4987-8112-a5359d5a35fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:58.832446 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-8e8b7fb1-e64c-4987-8112-a5359d5a35fa service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b7856e81-af33-4465-b684-ce86f847a4ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0446079 Nov 05 15:09:58.845590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:09:58.921714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-d74f7838-4a16-43d6-86b2-72329f6b7d2f service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824499 Nov 05 15:09:58.926597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:58.948597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:09:58.951007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2689105d-cecf-4cd3-8de4-624df2c3b9d1" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-unplugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:09:58.963811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:09:58.968177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:09:59.000482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:09:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d753821f-2d14-447c-a943-ee8bce03aeb5 x-openstack-request-id: req-d753821f-2d14-447c-a943-ee8bce03aeb5 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:09:59.000768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-unplugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:09:59.001019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d753821f-2d14-447c-a943-ee8bce03aeb5 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:09:59.001488 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'code': 200} Nov 05 15:09:59.022322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=9']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:09:59.028135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-59b43d8f-6665-465b-8b88-8c335d9771ea req-0dc761dd-18c8-4283-aa63-1760a7c8469a service neutron] 10.222.0.32 "GET /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989714 Nov 05 15:09:59.393834 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06e5c74-d408-4d5c-8733-7a5fdd40123d req-a6905cfc-dfb3-460d-a3a1-9b4a6463c403 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:09:59.395327 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e06e5c74-d408-4d5c-8733-7a5fdd40123d req-a6905cfc-dfb3-460d-a3a1-9b4a6463c403 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0521340 Nov 05 15:09:59.443304 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e06e5c74-d408-4d5c-8733-7a5fdd40123d req-d38ac878-4e32-4b6a-a9f7-31d17302a838 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418749 Nov 05 15:10:00.563357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805ebb19-cec3-4b0a-b186-249a43a30f6b req-51ed272c-2d2e-4764-a8f2-a4ae87493c9e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:00.564893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-805ebb19-cec3-4b0a-b186-249a43a30f6b req-51ed272c-2d2e-4764-a8f2-a4ae87493c9e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0494351 Nov 05 15:10:00.615566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-805ebb19-cec3-4b0a-b186-249a43a30f6b req-2fdbfacc-d01a-4d55-a12e-190a80ddec81 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441272 Nov 05 15:10:01.731335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25242c47-3a1a-4a1b-abfd-b4b465db6517 req-7fd9b526-ccc7-49bf-9d1c-bf5159f9704b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:01.732818 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-25242c47-3a1a-4a1b-abfd-b4b465db6517 req-7fd9b526-ccc7-49bf-9d1c-bf5159f9704b tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0477681 Nov 05 15:10:01.782634 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-25242c47-3a1a-4a1b-abfd-b4b465db6517 req-3f0baffe-db57-41a8-84be-2629b206da22 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431454 Nov 05 15:10:02.899623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24c13a-ef94-4382-9c29-5c772b4b6a60 req-b7f64091-c25a-4520-9768-79bc76607d02 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:02.901125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4a24c13a-ef94-4382-9c29-5c772b4b6a60 req-b7f64091-c25a-4520-9768-79bc76607d02 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0480375 Nov 05 15:10:02.951174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4a24c13a-ef94-4382-9c29-5c772b4b6a60 req-5f052b2f-4bac-43ee-b47e-2507d9fb966c tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441556 Nov 05 15:10:04.067782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bc82fb-ea33-4a42-a0c4-400d2fe08eb6 req-8e31c99c-5c06-4e9d-b237-f1c9b5a4be55 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:04.070211 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44bc82fb-ea33-4a42-a0c4-400d2fe08eb6 req-8e31c99c-5c06-4e9d-b237-f1c9b5a4be55 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 943 time: 0.0499630 Nov 05 15:10:04.117860 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-44bc82fb-ea33-4a42-a0c4-400d2fe08eb6 req-f6d07ee8-8949-4f6c-922a-cf191694753a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417235 Nov 05 15:10:04.883690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:10:04.977129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:04.988616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'port_id': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'mac_address': 'fa:16:3e:c0:e6:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:10:05.023753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:05.035749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:10:05.055287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:05.058458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:05.109293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=10']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:05.115258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['765fb5df-0465-44ba-9628-dd2bb4ccad1c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:05.496175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef6af27-6417-4b61-bc4c-f3f9415fb39f req-4c10e261-3a12-48c3-bc2c-3d6c2d091280 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:05.497710 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ef6af27-6417-4b61-bc4c-f3f9415fb39f req-4c10e261-3a12-48c3-bc2c-3d6c2d091280 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.3106973 Nov 05 15:10:05.543778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6ef6af27-6417-4b61-bc4c-f3f9415fb39f req-b3efaf65-d99d-43e6-afa5-dd27f1785285 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397179 Nov 05 15:10:06.669950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c395eacd-8f88-4b97-b3a6-70a15ce8db1e req-f993e10b-26a8-468c-9045-212de763aded tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:06.671412 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c395eacd-8f88-4b97-b3a6-70a15ce8db1e req-f993e10b-26a8-468c-9045-212de763aded tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 945 time: 0.0603073 Nov 05 15:10:06.718752 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c395eacd-8f88-4b97-b3a6-70a15ce8db1e req-a8075c99-6f70-406e-9274-3d94092c4e98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412250 Nov 05 15:10:06.896358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:10:06.962615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 765fb5df-0465-44ba-9628-dd2bb4ccad1c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:10:06.963065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:07.046413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:07.069334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:07.071454 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1424da2b-8377-46b7-b2ff-0e9d233b8b67" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:07.083208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:07.087168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:07.118372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8278c830-0f23-4a19-9679-079200edfcc9 x-openstack-request-id: req-8278c830-0f23-4a19-9679-079200edfcc9 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:07.118658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-plugged", "status": "completed", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:07.118903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8278c830-0f23-4a19-9679-079200edfcc9 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:07.119283 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'code': 200} Nov 05 15:10:07.138288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=11']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:07.836866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fc076b-5b55-4534-988e-348d30c5955b req-08c3ddbb-719c-4d22-b889-2f254d76fb98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:07.838317 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b1fc076b-5b55-4534-988e-348d30c5955b req-08c3ddbb-719c-4d22-b889-2f254d76fb98 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0522625 Nov 05 15:10:07.883992 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b1fc076b-5b55-4534-988e-348d30c5955b req-75a4eec5-c7d6-47b5-816d-caac22acbd4d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396841 Nov 05 15:10:08.999901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6f5f00-f1a2-4f34-9b6f-7c27c49aa10e req-3f3f3f90-25ca-4ee5-9ba3-523d43b17c0d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:09.001368 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2f6f5f00-f1a2-4f34-9b6f-7c27c49aa10e req-3f3f3f90-25ca-4ee5-9ba3-523d43b17c0d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0479331 Nov 05 15:10:09.046861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2f6f5f00-f1a2-4f34-9b6f-7c27c49aa10e req-4b29f03b-fdbc-41b3-8f54-e72f77d49226 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395548 Nov 05 15:10:10.169234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430d7202-5c4f-4008-8183-19e46efda87f req-d74c4356-61f3-4e53-909b-43bb1f47a886 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:10.170711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-430d7202-5c4f-4008-8183-19e46efda87f req-d74c4356-61f3-4e53-909b-43bb1f47a886 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0564377 Nov 05 15:10:10.219761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-430d7202-5c4f-4008-8183-19e46efda87f req-c905bbb3-971f-4fe8-84ee-f39a30b32293 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424533 Nov 05 15:10:11.337477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77808709-ddb7-4a07-9769-b31d00fbf2e2 req-39692c69-c32b-4be3-8da4-d1ebdce4a5a8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:11.338941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77808709-ddb7-4a07-9769-b31d00fbf2e2 req-39692c69-c32b-4be3-8da4-d1ebdce4a5a8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0518088 Nov 05 15:10:11.384842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77808709-ddb7-4a07-9769-b31d00fbf2e2 req-de3fb3a8-2225-4ee9-bccb-fd4e17d21ac7 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399725 Nov 05 15:10:11.497012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-802b5b32-d6a7-4913-b18b-7357609254b3 req-906a1483-a847-43c3-bbeb-80c68899e9df tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:11.498555 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-802b5b32-d6a7-4913-b18b-7357609254b3 req-906a1483-a847-43c3-bbeb-80c68899e9df tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0475307 Nov 05 15:10:11.549775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-802b5b32-d6a7-4913-b18b-7357609254b3 req-b58effe2-e01e-4bdd-87ef-71df8d4f48a0 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442996 Nov 05 15:10:11.663039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79fccc74-ead1-4aac-bbdd-3df9512a6c7e req-53e68a9b-9162-4aa7-94f3-2d872c0f81ed tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:11.664503 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-79fccc74-ead1-4aac-bbdd-3df9512a6c7e req-53e68a9b-9162-4aa7-94f3-2d872c0f81ed tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0467837 Nov 05 15:10:11.710443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-79fccc74-ead1-4aac-bbdd-3df9512a6c7e req-47ec2d6a-0789-42c7-a598-cb48df8a218e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400257 Nov 05 15:10:11.935127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfd8fb1-96e5-484f-a9d7-ec8a3db51926 req-e3536317-edc1-469c-8f9f-6597ff17395e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:11.936578 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bbfd8fb1-96e5-484f-a9d7-ec8a3db51926 req-e3536317-edc1-469c-8f9f-6597ff17395e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0466118 Nov 05 15:10:11.985227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bbfd8fb1-96e5-484f-a9d7-ec8a3db51926 req-ecf9ab40-d2ac-4823-ab80-466c9ca67a0e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422876 Nov 05 15:10:13.104417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e58cc46-c626-4894-997e-75766f29ffef req-4469e497-2915-49fe-adb6-3773688d4e6f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:13.105901 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e58cc46-c626-4894-997e-75766f29ffef req-4469e497-2915-49fe-adb6-3773688d4e6f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0476959 Nov 05 15:10:13.152058 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4e58cc46-c626-4894-997e-75766f29ffef req-6bfa6ef9-ff40-4bf4-9027-32c9d85b3c8e tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404141 Nov 05 15:10:14.294590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00e7893-dd1e-4a5a-9028-245cc39ff10f req-55219c15-c056-4d0b-93cf-a4bea6d3f144 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:14.296034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b00e7893-dd1e-4a5a-9028-245cc39ff10f req-55219c15-c056-4d0b-93cf-a4bea6d3f144 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0749757 Nov 05 15:10:14.308030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-40505616-9eba-493f-b309-d185e138f3bf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:14.309376 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-40505616-9eba-493f-b309-d185e138f3bf tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 946 time: 0.0599608 Nov 05 15:10:14.406736 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b00e7893-dd1e-4a5a-9028-245cc39ff10f req-32f32ac4-ffa1-49a9-b1c1-f5d1545a12ce tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups?id=f81f297a-35ff-4b56-bf39-011da81f52af&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0964200 Nov 05 15:10:14.429781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Deleting port 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:14.430163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:14.518112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] For port 765fb5df-0465-44ba-9628-dd2bb4ccad1c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=765fb5df-0465-44ba-9628-dd2bb4ccad1c,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:14.518467 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:14.685995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:14.686258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:14.686568 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68 disassociated. External IP: 172.26.5.150, port: 765fb5df-0465-44ba-9628-dd2bb4ccad1c. Nov 05 15:10:14.686896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Calling delete_port for 765fb5df-0465-44ba-9628-dd2bb4ccad1c owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:14.806773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:14.837771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'Port': ['ID=765fb5df-0465-44ba-9628-dd2bb4ccad1c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:14.850470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.850813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.851152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.851482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.851813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.852138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.852509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.852802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.853123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.853440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.853762 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.854075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:14.962932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:10:15.070680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:10:15.079982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:10:15.089343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:10:15.089953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:09:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:15.109025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] No DVR routers for this DVR port 765fb5df-0465-44ba-9628-dd2bb4ccad1c on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:10:15.112233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:15.115719 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db060375-e987-4ea3-b3f8-976f731dd0cb req-f3405416-1d32-4c1b-afe7-ae299bb50cd8 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.32 "DELETE /v2.0/ports/765fb5df-0465-44ba-9628-dd2bb4ccad1c HTTP/1.1" status: 204 len: 173 time: 0.7998669 Nov 05 15:10:15.116186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-deleted', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:15.119077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7798fcf0-83a9-4114-bc22-7cad1b91068f" -d '{"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-deleted", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:15.158932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f6692b0-6828-471d-8498-bf51bbdb7ffd x-openstack-request-id: req-9f6692b0-6828-471d-8498-bf51bbdb7ffd {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:15.159227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0ed09cd-5633-4989-aedc-f44436e753a6", "name": "network-vif-deleted", "tag": "765fb5df-0465-44ba-9628-dd2bb4ccad1c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:15.159479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9f6692b0-6828-471d-8498-bf51bbdb7ffd {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:15.159879 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0ed09cd-5633-4989-aedc-f44436e753a6', 'name': 'network-vif-deleted', 'tag': '765fb5df-0465-44ba-9628-dd2bb4ccad1c', 'status': 'completed', 'code': 200} Nov 05 15:10:15.202052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:10:15.396439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:15.426158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:10:15.434946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:10:15.435547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:09:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:15.508646 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e1e6fc3c-b58f-43a7-b4dd-c00ebc03bc35 req-1bf171d3-22b0-4d0a-9679-13b3fb5d7d3d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0279298 Nov 05 15:10:15.556325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:10:15.753549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:15.779612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd54a55b-6a57-440b-9576-998cf7c3d23e None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:04:36Z', 'revision_number': 4, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '676adda1-bc37-42f5-8700-223770c339da', 'name': '', 'network_id': 'b7856e81-af33-4465-b684-ce86f847a4ff', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'mac_address': 'fa:16:3e:63:c6:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 1540, 'fixed_ips': [{'subnet_id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:35Z', 'updated_at': '2021-11-05T15:04:40Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'subnets': [{'id': '1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:10:16.005414 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2b46110-afeb-47de-8119-b5b6d3cecf20 None None] New status for floating IP 8b0fa759-110d-4bf0-acb1-99357bf80a68: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:10:16.606138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-40a5b6f8-ea87-42cb-a32d-b482709b7e8f req-06d370dd-613d-4b96-8edb-99c3803fc35d tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0271468 Nov 05 15:10:16.976742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:17.000539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 765fb5df-0465-44ba-9628-dd2bb4ccad1c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:17.000890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 765fb5df-0465-44ba-9628-dd2bb4ccad1c not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:10:17.701695 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-801dd195-783b-4853-865f-4ec86c79e1fa req-22967c7b-76af-40dd-9062-cbd09fc6316f tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0261960 Nov 05 15:10:18.411614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:18.798796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3864bb2e-18d1-4533-9947-5d2c64945e6e req-af0c52e5-7064-4ab9-bee1-15eae2fd91d4 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0ed09cd-5633-4989-aedc-f44436e753a6 HTTP/1.1" status: 200 len: 210 time: 0.0291462 Nov 05 15:10:20.109202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-00c305f9-487a-4d23-9075-706e06496f16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:22.436322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-744d0bc8-6c66-42af-b014-c6f4904d0e1a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.482818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.517710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49536) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:23.572641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.597852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.646963 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.650574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.651963 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "DELETE /v2.0/security-groups/f81f297a-35ff-4b56-bf39-011da81f52af HTTP/1.1" status: 204 len: 168 time: 0.1331730 Nov 05 15:10:23.654666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49538) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:23.661997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f81f297a-35ff-4b56-bf39-011da81f52af,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:23.671100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.api.v2.resource [None req-d7655725-3239-4308-9978-df34e6ec5286 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] show failed (client error): The resource could not be found. Nov 05 15:10:23.675662 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d7655725-3239-4308-9978-df34e6ec5286 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "GET /v2.0/security-groups/f81f297a-35ff-4b56-bf39-011da81f52af HTTP/1.1" status: 404 len: 347 time: 0.0164568 Nov 05 15:10:23.675998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49540) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:23.680883 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.681242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.681589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.681932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.682272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.682608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.682944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.683277 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.683608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.683935 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.684263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.684614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5861646d-70c8-47ba-b518-d7a37b6e576a tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:23.805822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Deleting port ea33816b-3d3e-42b8-b418-f4498d9f0ea0 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:23.806160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.883313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.883654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:23.896001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Calling delete_port for ea33816b-3d3e-42b8-b418-f4498d9f0ea0 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:24.029746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.057721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Pushing event deleted for resources: {'Port': ['ID=ea33816b-3d3e-42b8-b418-f4498d9f0ea0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:24.119380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.121976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.123116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-165d2894-8340-440f-bfb3-d64180658377 tempest-ServerActionsTestJSON-1769592667 tempest-ServerActionsTestJSON-1769592667-project] 10.222.0.30 "DELETE /v2.0/floatingips/8b0fa759-110d-4bf0-acb1-99357bf80a68 HTTP/1.1" status: 204 len: 168 time: 0.4461076 Nov 05 15:10:24.126066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49542) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:24.523212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.761379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Deleting port 676adda1-bc37-42f5-8700-223770c339da {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:24.762050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.837248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] For port 676adda1-bc37-42f5-8700-223770c339da, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=676adda1-bc37-42f5-8700-223770c339da,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:24.837601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:24.850225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Calling delete_port for 676adda1-bc37-42f5-8700-223770c339da owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:24.944855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:25.031433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:25.060233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Pushing event deleted for resources: {'Port': ['ID=676adda1-bc37-42f5-8700-223770c339da,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:25.219664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:25.430272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Router e1950744-76aa-4eb7-9e17-c45963ef40dc has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:10:25.540672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:10:25.545707 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-624fa547-7425-4d22-92a0-5e34983e082e admin admin] 10.222.0.30 "PUT /v2.0/routers/e1950744-76aa-4eb7-9e17-c45963ef40dc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4187169 Nov 05 15:10:25.548779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49546) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:25.553201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Sync routers for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:10:25.563929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:10:25.564568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:25.649883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:25.668563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:10:25.982774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.010804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203'}], 'enable_snat': True}, 'gw_port_id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:10:24Z', 'revision_number': 5, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port': {'id': '411e6cc4-2575-4825-92b9-644ffe190b2a', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:b6:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1539, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:04:34Z', 'updated_at': '2021-11-05T15:04:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:26.033854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.036234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Checking router: e1950744-76aa-4eb7-9e17-c45963ef40dc for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:10:26.044686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Routers {'e1950744-76aa-4eb7-9e17-c45963ef40dc'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:10:26.045285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['e1950744-76aa-4eb7-9e17-c45963ef40dc'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:26.085748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Deleting port 411e6cc4-2575-4825-92b9-644ffe190b2a {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:26.086093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.131072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] Set router e1950744-76aa-4eb7-9e17-c45963ef40dc gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:10:26.162206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] For port 411e6cc4-2575-4825-92b9-644ffe190b2a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=411e6cc4-2575-4825-92b9-644ffe190b2a,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:26.162573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.174993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Calling delete_port for 411e6cc4-2575-4825-92b9-644ffe190b2a owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:26.186410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:10:26Z', 'revision_number': 6, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:26.211811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788edd91-3e45-4fd6-b612-84e169624153 None None] The sync data for ids ['e1950744-76aa-4eb7-9e17-c45963ef40dc'] in dv-neutron-816850-1-hyperv is: [{'id': 'e1950744-76aa-4eb7-9e17-c45963ef40dc', 'name': 'tempest-ServerActionsTestJSON-304172151-router', 'tenant_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:04:33Z', 'updated_at': '2021-11-05T15:10:26Z', 'revision_number': 6, 'project_id': 'cefa619ed11f4fae94c73d73d2f4f1dc', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:10:26.342127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.371687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Pushing event deleted for resources: {'Port': ['ID=411e6cc4-2575-4825-92b9-644ffe190b2a,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:26.429393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.515371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.517475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.559157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.559703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1950744-76aa-4eb7-9e17-c45963ef40dc {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:10:26.564375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.565672 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b0ad51f4-696f-4e99-90a0-a08d50770faf admin admin] 10.222.0.30 "DELETE /v2.0/routers/e1950744-76aa-4eb7-9e17-c45963ef40dc HTTP/1.1" status: 204 len: 168 time: 1.0165405 Nov 05 15:10:26.568214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49548) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:26.615001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Deleting subnet 1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:10:26.618143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.650981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.729322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.783708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.812492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.816433 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f HTTP/1.1" status: 204 len: 168 time: 0.2464230 Nov 05 15:10:26.818074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff3a95f-1494-4903-9dce-422419933206 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1c7b2a84-bfbf-4b78-89fe-b8ec44d26f6f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:26.818249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49550) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:26.818747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fa18347-bbdb-4366-95d8-4b215c417ef4 None None] Network b7856e81-af33-4465-b684-ce86f847a4ff requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:10:26.889504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.951672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Deleting port a6d31dda-fe07-44f3-bab5-45f7cf292122 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:26.952055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:26.984776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] DHCP port deletion for b7856e81-af33-4465-b684-ce86f847a4ff request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:10:27.016842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] For port a6d31dda-fe07-44f3-bab5-45f7cf292122, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a6d31dda-fe07-44f3-bab5-45f7cf292122,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:27.017460 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.030567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Calling delete_port for a6d31dda-fe07-44f3-bab5-45f7cf292122 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:27.037776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Deleting port a6d31dda-fe07-44f3-bab5-45f7cf292122 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:27.038144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.099204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] For port a6d31dda-fe07-44f3-bab5-45f7cf292122, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=a6d31dda-fe07-44f3-bab5-45f7cf292122,segment=NetworkSegment(11e39521-7ffb-45e0-a44d-400d4e354f3c),segment_id=11e39521-7ffb-45e0-a44d-400d4e354f3c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:27.099604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.112995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Calling delete_port for a6d31dda-fe07-44f3-bab5-45f7cf292122 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:27.192000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.220242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] Pushing event deleted for resources: {'Port': ['ID=a6d31dda-fe07-44f3-bab5-45f7cf292122,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:27.226208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36b292a8-f176-4efe-a1cd-3ad379a4ae6c None None] No DVR routers for this DVR port a6d31dda-fe07-44f3-bab5-45f7cf292122 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:10:27.411502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.434639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Pushing event deleted for resources: {'Port': ['ID=a6d31dda-fe07-44f3-bab5-45f7cf292122,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:27.440003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] No DVR routers for this DVR port a6d31dda-fe07-44f3-bab5-45f7cf292122 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:10:27.508703 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.530875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b7856e81-af33-4465-b684-ce86f847a4ff']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:27.539907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '11e39521-7ffb-45e0-a44d-400d4e354f3c') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:27.540192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '11e39521-7ffb-45e0-a44d-400d4e354f3c') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:27.549214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.562860 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.569174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:10:27.569606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self.session.flush() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:10:27.571136 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:10:27.621759 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.626895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.630540 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] 10.222.0.30 "DELETE /v2.0/networks/b7856e81-af33-4465-b684-ce86f847a4ff HTTP/1.1" status: 204 len: 168 time: 0.8104982 Nov 05 15:10:27.641291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55079bc1-371c-4de2-882b-37b2a751bc0e admin admin] Pushing event deleted for resources: {'Network': ['ID=b7856e81-af33-4465-b684-ce86f847a4ff,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:27.734275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49554) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:27.773538 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b46d4ba1-a064-4035-9860-28eaa37508c2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=cefa619ed11f4fae94c73d73d2f4f1dc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0380673 Nov 05 15:10:27.775873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49556) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:27.822232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.847918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.878896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a6d31dda-fe07-44f3-bab5-45f7cf292122 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:27.895708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.898447 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:27.899003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: a6d31dda-fe07-44f3-bab5-45f7cf292122 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:27.901948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device a6d31dda-fe07-44f3-bab5-45f7cf292122 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:10:27.902093 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2d2a6552-d93f-4059-90db-819502e24d3c HTTP/1.1" status: 204 len: 168 time: 0.1227813 Nov 05 15:10:27.902195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 676adda1-bc37-42f5-8700-223770c339da no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:27.908877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437c24ce-d4e3-4454-a7f5-53b93311730e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d2a6552-d93f-4059-90db-819502e24d3c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:27.932293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 676adda1-bc37-42f5-8700-223770c339da {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:27.932660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 676adda1-bc37-42f5-8700-223770c339da not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:10:27.933074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 411e6cc4-2575-4825-92b9-644ffe190b2a no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:27.954765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 411e6cc4-2575-4825-92b9-644ffe190b2a {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:27.955027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 411e6cc4-2575-4825-92b9-644ffe190b2a not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:10:28.563356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49578) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:28.667819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-454521317-network', 'tenant_id': 'e48731d5e87b4153b8d6b77039c45e4f'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:28.688566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Made reservation on behalf of e48731d5e87b4153b8d6b77039c45e4f for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:10:28.691334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.699416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.772593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.775917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.803281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:10:28.808697 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd42744c-7233-4e88-b51f-c681dff0dd71,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:28.817611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.817995 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Added segment e5292afe-c0cf-46d0-b770-ce0df75b79fc of type vlan for network 31e50ff0-6af2-492f-8b28-4c8f14f2193e Nov 05 15:10:28.858763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.882307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.883235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:28.883805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:28.935909 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.3714786 Nov 05 15:10:28.938949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49582) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:28.944693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Request body: {'subnet': {'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-454521317-subnet', 'tenant_id': 'e48731d5e87b4153b8d6b77039c45e4f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:28.947248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed373fd-c9eb-4622-a639-70f829d29844 admin admin] Pushing event updated for resources: {'Network': ['ID=31e50ff0-6af2-492f-8b28-4c8f14f2193e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:28.956846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:10:28.965418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Made reservation on behalf of e48731d5e87b4153b8d6b77039c45e4f for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:10:28.967766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:29.134581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:29.194120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Pushing event updated for resources: {'Subnet': ['ID=b4fd686d-8d97-46c6-897d-7e9827aa8fc4,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:29.201793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Checking segment: {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:10:29.202148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Network hostable DHCP agents. Network: 31e50ff0-6af2-492f-8b28-4c8f14f2193e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:10:29.217379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:10:29.226180 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 31e50ff0-6af2-492f-8b28-4c8f14f2193e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:10:29.231705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:29.232446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:29.234625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9e4a537-103a-48e7-b8d5-8496f92b981b None None] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:10:29.247962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18377df5-6906-455b-9ad2-20e8f4da709d admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3077924 Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c9e4a537-103a-48e7-b8d5-8496f92b981b None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:10:29.305545 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:10:29.314586 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a251725-c195-46ba-80fe-6f879c430f61 None None] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3a251725-c195-46ba-80fe-6f879c430f61 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:10:29.392995 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:10:29.402759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e03d13e5-ed15-4222-b5fd-3003b6a452e8 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:10:29.468051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03d13e5-ed15-4222-b5fd-3003b6a452e8 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:10:29.541092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:10:29.669722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ab4fce4-4a32-42ed-821e-5fa6fe8a9f9c None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:10:29.680194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-a543e74e-2d49-46e5-8bd6-ed841383824a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:29.681703 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-a543e74e-2d49-46e5-8bd6-ed841383824a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 813 time: 0.0994000 Nov 05 15:10:29.696595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-07f2f690-526e-47b3-9087-c2733f5b5146 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/quotas/e48731d5e87b4153b8d6b77039c45e4f HTTP/1.1" status: 200 len: 375 time: 0.0088100 Nov 05 15:10:29.738525 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-26437c4e-08ca-4392-a109-6c94905cc3ab tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0364158 Nov 05 15:10:29.742163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ab4fce4-4a32-42ed-821e-5fa6fe8a9f9c None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:10:29.828138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-bfb2ba52-6f78-4de4-9ab4-dc937995fa9f service neutron] 10.222.0.30 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823092 Nov 05 15:10:29.922333 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-1690c24d-6aa7-417b-81b1-4e140af7fa41 service neutron] 10.222.0.30 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860834 Nov 05 15:10:30.082042 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d6d12925-f5e6-4f63-b260-b42cde5defc9 req-9e524b42-4e9c-47e1-a35c-a4fa10c6054f tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 210 time: 0.0269203 Nov 05 15:10:30.966030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-d57d21e3-bd8b-4fee-b046-6e3e14f3795f tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:30.967483 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-d57d21e3-bd8b-4fee-b046-6e3e14f3795f tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 813 time: 0.1030393 Nov 05 15:10:30.979943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Request body: {'port': {'device_id': 'd0d41068-e357-4aea-8220-4e490af25198', 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e', 'admin_state_up': True, 'tenant_id': 'e48731d5e87b4153b8d6b77039c45e4f'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:31.087943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Made reservation on behalf of e48731d5e87b4153b8d6b77039c45e4f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:10:31.091408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.176817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-601f4aec-06dc-4845-b260-5151a4d2350e req-da45738b-fa73-44be-910e-37df7458435d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 210 time: 0.0269358 Nov 05 15:10:31.219012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Allocated IP 172.20.0.4 (31e50ff0-6af2-492f-8b28-4c8f14f2193e/b4fd686d-8d97-46c6-897d-7e9827aa8fc4/c0be8c87-15b3-46e5-9492-33d1d0632072) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:10:31.364885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.397348 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.439089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:10:31.444514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:10:31.447284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:10:31.472327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Pushing event updated for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:31.505325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:31.505930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.521304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3215ce9f-292d-48b5-9791-e497b81fd02d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5453353 Nov 05 15:10:31.582763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Request body: {'port': {'device_id': 'd0d41068-e357-4aea-8220-4e490af25198', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:31.637685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.888153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0be8c87-15b3-46e5-9492-33d1d0632072 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:10:31.895956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.907780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Transition to ACTIVE for port object c0be8c87-15b3-46e5-9492-33d1d0632072 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:10:31.911130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:31.960298 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Pushing event updated for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:32.027116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Attempting to bind port c0be8c87-15b3-46e5-9492-33d1d0632072 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:10:32.027444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Attempting to bind port c0be8c87-15b3-46e5-9492-33d1d0632072 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:10:32.027771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Attempting to bind port c0be8c87-15b3-46e5-9492-33d1d0632072 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:10:32.032000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Port c0be8c87-15b3-46e5-9492-33d1d0632072 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:10:32.032320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Attempting to bind port c0be8c87-15b3-46e5-9492-33d1d0632072 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:10:32.037653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:10:32.037985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Checking segment: {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:10:32.038368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Bound using segment: {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:10:32.038785 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Bound port: c0be8c87-15b3-46e5-9492-33d1d0632072, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:10:32.039128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:32.100233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:10:32.103124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c0be8c87-15b3-46e5-9492-33d1d0632072,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:10:32.107428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:32.138539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.139168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:32.140560 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] 10.222.0.32 "PUT /v2.0/ports/c0be8c87-15b3-46e5-9492-33d1d0632072 HTTP/1.1" status: 200 len: 1093 time: 0.6112845 Nov 05 15:10:32.141000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:32.143232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83142a07-696a-41b6-871c-815d0ba82cb2" -d '{"events": [{"name": "network-changed", "server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:32.174089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be789229-c282-4e54-80da-c17d663f41c0 service neutron] Pushing event updated for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:32.187740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44169fc9-d213-4d58-ae55-dc0b44b83719 x-openstack-request-id: req-44169fc9-d213-4d58-ae55-dc0b44b83719 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:32.188032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:32.188283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-44169fc9-d213-4d58-ae55-dc0b44b83719 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:32.188703 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072', 'status': 'completed', 'code': 200} Nov 05 15:10:32.223018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3d163aa5-4938-44f5-ae9d-c52b00dad14d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.224686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-3d163aa5-4938-44f5-ae9d-c52b00dad14d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 1096 time: 0.0458832 Nov 05 15:10:32.274246 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-2df1166d-c7fa-4341-af4f-5d6b0da5521a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c0be8c87-15b3-46e5-9492-33d1d0632072 HTTP/1.1" status: 200 len: 217 time: 0.0409849 Nov 05 15:10:32.299034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bc84fa-0d08-4d31-9b2e-9ad64b3ef38c req-59cccca7-5df5-460c-84fe-7be3cd4cd73e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.301176 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42bc84fa-0d08-4d31-9b2e-9ad64b3ef38c req-59cccca7-5df5-460c-84fe-7be3cd4cd73e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 943 time: 0.0506711 Nov 05 15:10:32.325948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-54390223-4a78-496e-a5df-4a55bbf388c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.327417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-54390223-4a78-496e-a5df-4a55bbf388c0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b4fd686d-8d97-46c6-897d-7e9827aa8fc4 HTTP/1.1" status: 200 len: 853 time: 0.0445383 Nov 05 15:10:32.348944 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-42bc84fa-0d08-4d31-9b2e-9ad64b3ef38c req-7c1e426b-94a3-48a7-96ed-e8ded9cf9596 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414333 Nov 05 15:10:32.358506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-8ac4f4dd-59c9-4e05-ab17-3c2aecf74015 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=31e50ff0-6af2-492f-8b28-4c8f14f2193e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245130 Nov 05 15:10:32.449499 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-285f397a-bbf1-4537-863d-d4e34cded333 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839665 Nov 05 15:10:32.538188 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f968e919-4938-49a5-a7c9-5fb952908d87 req-707a628c-9a53-46f7-83f1-5d995a045199 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815182 Nov 05 15:10:32.625801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-24f505c1-0d69-4583-a9b8-cefcb90f1065 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.627248 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-24f505c1-0d69-4583-a9b8-cefcb90f1065 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 1096 time: 0.0416584 Nov 05 15:10:32.720681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-13095907-e973-4203-ae7e-46e68abc9161 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.722195 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-13095907-e973-4203-ae7e-46e68abc9161 service neutron] 10.222.0.32 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 914 time: 0.0872042 Nov 05 15:10:32.763999 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-cfb00d24-0ce9-4c14-9e49-59f5aa63fb6e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c0be8c87-15b3-46e5-9492-33d1d0632072 HTTP/1.1" status: 200 len: 217 time: 0.0344670 Nov 05 15:10:32.814658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-71995ad7-2d2b-4ebb-8911-650cfb059b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:32.816741 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-71995ad7-2d2b-4ebb-8911-650cfb059b59 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b4fd686d-8d97-46c6-897d-7e9827aa8fc4 HTTP/1.1" status: 200 len: 853 time: 0.0461848 Nov 05 15:10:32.848326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-03b44b0b-b787-4224-a92c-2dc41def2518 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=31e50ff0-6af2-492f-8b28-4c8f14f2193e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232682 Nov 05 15:10:32.936922 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-bc9642db-6fcc-4abc-acbc-048ad9ab8932 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810757 Nov 05 15:10:33.026853 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83142a07-696a-41b6-871c-815d0ba82cb2 req-536f2efb-5061-473f-8f1a-2361733d6a50 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823390 Nov 05 15:10:33.463931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10d2484-2da1-4028-8979-42730aba0888 req-baf20501-2350-465e-a556-06e769e52515 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:33.465398 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c10d2484-2da1-4028-8979-42730aba0888 req-baf20501-2350-465e-a556-06e769e52515 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 943 time: 0.0478926 Nov 05 15:10:33.512038 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c10d2484-2da1-4028-8979-42730aba0888 req-8be4f022-8d12-457c-bcd9-ac2e6c800ee2 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406890 Nov 05 15:10:34.626534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5c8579-c429-41e3-bc71-b47afabb0ef4 req-db639229-1490-4165-a0e7-3f84509537e7 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:34.628029 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d5c8579-c429-41e3-bc71-b47afabb0ef4 req-db639229-1490-4165-a0e7-3f84509537e7 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 943 time: 0.0493824 Nov 05 15:10:34.685113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d5c8579-c429-41e3-bc71-b47afabb0ef4 req-410ab5dd-5130-4b03-af9f-d9af06bd0eb9 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509028 Nov 05 15:10:35.002910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c0be8c87-15b3-46e5-9492-33d1d0632072 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:10:35.095298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c0be8c87-15b3-46e5-9492-33d1d0632072,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:35.110396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'c0be8c87-15b3-46e5-9492-33d1d0632072', 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e', 'port_id': 'c0be8c87-15b3-46e5-9492-33d1d0632072', 'mac_address': 'fa:16:3e:b5:d9:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4fd686d-8d97-46c6-897d-7e9827aa8fc4', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:10:35.146046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:35.158635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0be8c87-15b3-46e5-9492-33d1d0632072 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:10:35.177496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c0be8c87-15b3-46e5-9492-33d1d0632072,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:35.181277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:35.227570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:35.390649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['c0be8c87-15b3-46e5-9492-33d1d0632072'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:35.796779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae72a02-0f01-4d43-99f8-0e226a55ae5a req-85073c00-975d-4dae-8bc8-46dd9939022a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:35.798223 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fae72a02-0f01-4d43-99f8-0e226a55ae5a req-85073c00-975d-4dae-8bc8-46dd9939022a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 944 time: 0.0485044 Nov 05 15:10:35.848682 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fae72a02-0f01-4d43-99f8-0e226a55ae5a req-042cf3a4-9071-4270-be6a-c44c0b8b7097 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438209 Nov 05 15:10:36.961479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b7f30f-d85c-4195-825d-883d68cdfdf8 req-e5a5d218-e87c-4c04-a85c-b932352e3e96 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:36.962941 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d7b7f30f-d85c-4195-825d-883d68cdfdf8 req-e5a5d218-e87c-4c04-a85c-b932352e3e96 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 944 time: 0.0485337 Nov 05 15:10:37.008875 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d7b7f30f-d85c-4195-825d-883d68cdfdf8 req-e63a143d-fd82-4338-97f3-4b97e5f2075e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401952 Nov 05 15:10:37.022755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c0be8c87-15b3-46e5-9492-33d1d0632072 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:10:37.079076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port c0be8c87-15b3-46e5-9492-33d1d0632072 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:10:37.082886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port c0be8c87-15b3-46e5-9492-33d1d0632072 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:10:37.083262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:37.162827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:37.186497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:37.188751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19eba267-5e51-4856-bba1-1ed4648eb2c6" -d '{"events": [{"server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "name": "network-vif-plugged", "status": "completed", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:37.202050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c0be8c87-15b3-46e5-9492-33d1d0632072,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:37.205942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:37.232771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23d6b08b-bdf4-4c26-bea5-66a6931cd6fa x-openstack-request-id: req-23d6b08b-bdf4-4c26-bea5-66a6931cd6fa {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:37.233062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "name": "network-vif-plugged", "status": "completed", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:37.233319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-23d6b08b-bdf4-4c26-bea5-66a6931cd6fa {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:37.233706 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072', 'code': 200} Nov 05 15:10:37.257985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:37.388760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cee2fde-3288-4641-a962-3c307d3f1440 req-469f4b1d-8528-4376-bbaf-541cbb733ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:37.390268 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3cee2fde-3288-4641-a962-3c307d3f1440 req-469f4b1d-8528-4376-bbaf-541cbb733ef6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 1098 time: 0.0441020 Nov 05 15:10:37.435526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3cee2fde-3288-4641-a962-3c307d3f1440 req-2ff8c637-d361-49fc-9eb0-7088ab630eda service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370908 Nov 05 15:10:38.122108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3705d509-06c6-4bdb-b5d9-935e4f18e36a req-5b85c7ff-bec7-47a1-ba1e-f0703b1cd3a4 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:38.123525 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3705d509-06c6-4bdb-b5d9-935e4f18e36a req-5b85c7ff-bec7-47a1-ba1e-f0703b1cd3a4 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0488179 Nov 05 15:10:38.170785 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3705d509-06c6-4bdb-b5d9-935e4f18e36a req-40f9ac97-88d9-43a2-a3be-60f77d3d4101 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414314 Nov 05 15:10:39.286703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0a516f-3ef7-4f0d-93cc-604780c07d06 req-f27e24a6-0b41-42cf-a1bb-3816ebaf8b39 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:39.288241 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d0a516f-3ef7-4f0d-93cc-604780c07d06 req-f27e24a6-0b41-42cf-a1bb-3816ebaf8b39 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0491104 Nov 05 15:10:39.342076 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d0a516f-3ef7-4f0d-93cc-604780c07d06 req-f5cd1db1-a5e9-4d34-97da-4ccc911e3e65 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476229 Nov 05 15:10:39.574355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-38b5df6e-eb20-4f4d-a287-0549b3b041b1 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:39.575817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-38b5df6e-eb20-4f4d-a287-0549b3b041b1 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 813 time: 0.1083174 Nov 05 15:10:39.591381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-2035f236-cff7-4083-8271-edc31516e394 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/quotas/e48731d5e87b4153b8d6b77039c45e4f HTTP/1.1" status: 200 len: 375 time: 0.0092690 Nov 05 15:10:39.642748 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-95229352-b101-40bf-8169-0c11c9081a85 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0459578 Nov 05 15:10:39.736369 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-ff9dab2d-4d32-415a-b251-6b82740865d6 service neutron] 10.222.0.30 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860972 Nov 05 15:10:39.829384 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-e56ef610-c499-4435-b4f5-8a60c6a147df service neutron] 10.222.0.30 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863202 Nov 05 15:10:39.984883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2929ae08-45ab-4b12-a8ca-f437916a5897 req-351b2db9-a009-4db6-a863-2137c743b97b tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 210 time: 0.0305765 Nov 05 15:10:40.850691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-4451fec2-847a-41ff-bfd7-ea3b482dc7f2 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:40.852032 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-4451fec2-847a-41ff-bfd7-ea3b482dc7f2 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 813 time: 0.1002212 Nov 05 15:10:40.865266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Request body: {'port': {'device_id': '0dc16dec-a172-4917-b386-c8284c0af1db', 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e', 'admin_state_up': True, 'tenant_id': 'e48731d5e87b4153b8d6b77039c45e4f'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:40.972570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Made reservation on behalf of e48731d5e87b4153b8d6b77039c45e4f for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:10:40.976052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.077573 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7bc513f3-b356-434b-932b-1246f4ac41fc req-4d3c6491-3b9a-4b9d-a0ae-6923a1269ae9 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 210 time: 0.0278320 Nov 05 15:10:41.098131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Allocated IP 172.20.0.13 (31e50ff0-6af2-492f-8b28-4c8f14f2193e/b4fd686d-8d97-46c6-897d-7e9827aa8fc4/bfb0bdd0-714f-4ab4-ad58-2f5971618ed3) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:10:41.241825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.273013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.285398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['c0be8c87-15b3-46e5-9492-33d1d0632072'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:41.316058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Network 31e50ff0-6af2-492f-8b28-4c8f14f2193e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:10:41.322991 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:10:41.327730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:10:41.331458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Pushing event updated for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:41.380619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:41.381235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.396504 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-72760f2d-c465-4508-82c0-9b1915efb103 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5353601 Nov 05 15:10:41.408669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Request body: {'port': {'device_id': '0dc16dec-a172-4917-b386-c8284c0af1db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:41.460986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.713111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:10:41.720325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.732449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Transition to ACTIVE for port object bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:10:41.736964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.792183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Pushing event updated for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:41.855874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Attempting to bind port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:10:41.856477 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Attempting to bind port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:10:41.856602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Attempting to bind port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:10:41.860819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:10:41.861143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Attempting to bind port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 on network 31e50ff0-6af2-492f-8b28-4c8f14f2193e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:10:41.865944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:10:41.866280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Checking segment: {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:10:41.866669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Bound using segment: {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:10:41.867090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Bound port: bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e5292afe-c0cf-46d0-b770-ce0df75b79fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:10:41.867442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.927692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:10:41.930820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:10:41.934486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.971331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:41.971937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:41.973341 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] 10.222.0.32 "PUT /v2.0/ports/bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 HTTP/1.1" status: 200 len: 1094 time: 0.5688946 Nov 05 15:10:41.973776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:41.976004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86b51378-fdc8-4ab8-b897-c085858b4c5c" -d '{"events": [{"name": "network-changed", "server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:41.998614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf48b175-8db6-43d9-89bb-8ce901ce1f7d service neutron] Pushing event updated for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:42.013538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c152fef0-d350-4935-ab43-09630a742e6e x-openstack-request-id: req-c152fef0-d350-4935-ab43-09630a742e6e {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:42.013872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:42.014093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c152fef0-d350-4935-ab43-09630a742e6e {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:42.014491 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3', 'status': 'completed', 'code': 200} Nov 05 15:10:42.059719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-3c49d5b1-cf40-4304-9404-e078bbd0bae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.061132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-3c49d5b1-cf40-4304-9404-e078bbd0bae2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 1097 time: 0.0396328 Nov 05 15:10:42.103169 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-4335ea59-f6a1-4923-9012-b60d26f0b1ea service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 HTTP/1.1" status: 200 len: 217 time: 0.0336413 Nov 05 15:10:42.157494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-f6785322-5c36-4d45-b9dc-3f7fced51b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.159091 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-f6785322-5c36-4d45-b9dc-3f7fced51b0c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b4fd686d-8d97-46c6-897d-7e9827aa8fc4 HTTP/1.1" status: 200 len: 853 time: 0.0482357 Nov 05 15:10:42.190401 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-ffe5a1d7-0dbb-43cf-8de0-9c7e745251cb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=31e50ff0-6af2-492f-8b28-4c8f14f2193e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246758 Nov 05 15:10:42.197395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c07b67-fd60-4fb7-9bc0-39bf82fe7c8c req-02718489-2b19-4dba-a8f7-75537b0fc70a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.198856 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78c07b67-fd60-4fb7-9bc0-39bf82fe7c8c req-02718489-2b19-4dba-a8f7-75537b0fc70a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 944 time: 0.0530989 Nov 05 15:10:42.248079 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78c07b67-fd60-4fb7-9bc0-39bf82fe7c8c req-d2d817e8-5f3b-4fdd-b605-0e7ab83c3f56 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430775 Nov 05 15:10:42.278878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-ac4a2bf6-13a0-415a-ae02-e226f03c550f service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817680 Nov 05 15:10:42.372657 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9eb9a642-4ebb-41b5-a55d-55795518efe1 req-ac5d531c-0ff1-45b4-8f2f-889031cec9e2 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869615 Nov 05 15:10:42.454423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-c70e7bbf-e4c6-4828-8578-c9051eb014f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.455894 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-c70e7bbf-e4c6-4828-8578-c9051eb014f4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 1097 time: 0.0409822 Nov 05 15:10:42.546589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-a15e6249-49ec-444c-ad69-65c90ea3813b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.548047 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-a15e6249-49ec-444c-ad69-65c90ea3813b service neutron] 10.222.0.32 "GET /v2.0/networks?id=31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 200 len: 914 time: 0.0852239 Nov 05 15:10:42.857690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-36ab4430-f69d-40e1-955e-e9a998908439 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 HTTP/1.1" status: 200 len: 217 time: 0.3022256 Nov 05 15:10:42.904791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-eaa2b3c9-3e3b-4d25-b479-3e19a3b4d067 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:42.906166 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-eaa2b3c9-3e3b-4d25-b479-3e19a3b4d067 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b4fd686d-8d97-46c6-897d-7e9827aa8fc4 HTTP/1.1" status: 200 len: 853 time: 0.0412219 Nov 05 15:10:42.937546 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-5a6a0e61-e31e-4265-a3e2-80982005e677 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=31e50ff0-6af2-492f-8b28-4c8f14f2193e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242987 Nov 05 15:10:43.026041 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-ba631ae1-ad0f-4432-b1d6-dc3e791dcf43 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811079 Nov 05 15:10:43.117781 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86b51378-fdc8-4ab8-b897-c085858b4c5c req-e3b99bcc-93e9-4331-9422-0ac6c73fddb5 service neutron] 10.222.0.32 "GET /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841260 Nov 05 15:10:43.364008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b3ebe7-51c4-4a9b-a132-7ce7e364afab req-280d4977-712e-454c-8282-5a2bcf790905 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:43.365489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28b3ebe7-51c4-4a9b-a132-7ce7e364afab req-280d4977-712e-454c-8282-5a2bcf790905 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 944 time: 0.0480835 Nov 05 15:10:43.420625 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28b3ebe7-51c4-4a9b-a132-7ce7e364afab req-24c5faf5-4cba-4446-8ab9-cef496965ce8 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492568 Nov 05 15:10:44.533175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5eac7e1-872e-4222-b389-6fd719a530ef req-94c7e6b7-5ce5-4ea5-b2fb-4720c8f3791d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:44.534725 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f5eac7e1-872e-4222-b389-6fd719a530ef req-94c7e6b7-5ce5-4ea5-b2fb-4720c8f3791d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 944 time: 0.0494356 Nov 05 15:10:44.581414 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f5eac7e1-872e-4222-b389-6fd719a530ef req-3886227d-5b86-41ed-8280-74476f4d58e2 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407791 Nov 05 15:10:45.078174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:10:45.171761 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:45.183806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3', 'network_id': '31e50ff0-6af2-492f-8b28-4c8f14f2193e', 'port_id': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3', 'mac_address': 'fa:16:3e:f0:76:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 630, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4fd686d-8d97-46c6-897d-7e9827aa8fc4', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:10:45.218604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:45.231702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:10:45.250882 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:45.255642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:45.301249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:45.308271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.308647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.308995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.309330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.309840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.309995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.310322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.310648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.310972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.311293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.311614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.311933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:10:45.472474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['bfb0bdd0-714f-4ab4-ad58-2f5971618ed3'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:45.696860 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6643f9-b5f6-4d0c-b10b-52fa725dfef9 req-1f0ca6e2-9d74-4e65-8e89-1e347ca07d41 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:45.698295 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec6643f9-b5f6-4d0c-b10b-52fa725dfef9 req-1f0ca6e2-9d74-4e65-8e89-1e347ca07d41 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 945 time: 0.0470004 Nov 05 15:10:45.743428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec6643f9-b5f6-4d0c-b10b-52fa725dfef9 req-15257808-c1eb-4cac-ae48-44772f3d123a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391643 Nov 05 15:10:46.859120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95bddbdf-58b8-4c30-8c6d-d5727fa775d7 req-0926d2c2-6d05-4481-9b47-be55b4b84e05 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:46.860618 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-95bddbdf-58b8-4c30-8c6d-d5727fa775d7 req-0926d2c2-6d05-4481-9b47-be55b4b84e05 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 945 time: 0.0511887 Nov 05 15:10:46.911378 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-95bddbdf-58b8-4c30-8c6d-d5727fa775d7 req-cc09e0ad-256b-4472-9875-3979d5e8ee2a tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447404 Nov 05 15:10:47.079017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:10:47.126681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:10:47.130898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:10:47.131268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:47.208986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:47.230310 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:47.232639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10bf31ed-1863-489d-8abf-7feda6501ba6" -d '{"events": [{"server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "name": "network-vif-plugged", "status": "completed", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:47.245481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:47.249527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:47.273671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3f104ee-81f1-4e51-811e-a5e1f10efe88 x-openstack-request-id: req-d3f104ee-81f1-4e51-811e-a5e1f10efe88 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:47.273959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "name": "network-vif-plugged", "status": "completed", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:47.274213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d3f104ee-81f1-4e51-811e-a5e1f10efe88 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:47.274599 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3', 'code': 200} Nov 05 15:10:47.299574 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:47.427747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20da975-6447-4554-a28c-ec303671e566 req-e19e316f-e775-43a0-83d9-88dfeaa58577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:47.429294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d20da975-6447-4554-a28c-ec303671e566 req-e19e316f-e775-43a0-83d9-88dfeaa58577 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 1099 time: 0.0423932 Nov 05 15:10:47.472104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d20da975-6447-4554-a28c-ec303671e566 req-76ff5e54-0179-421a-b6df-c1b7b373e834 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361445 Nov 05 15:10:48.023880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed39245-0a16-4226-95ee-9474060f239c req-46792da3-77f4-405a-8fea-65d17aeab04e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:48.025358 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fed39245-0a16-4226-95ee-9474060f239c req-46792da3-77f4-405a-8fea-65d17aeab04e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 946 time: 0.0484426 Nov 05 15:10:48.071098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fed39245-0a16-4226-95ee-9474060f239c req-c4569f88-bbfb-4e26-95ee-b9af88213fe8 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398743 Nov 05 15:10:48.422263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:49.184753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57c10b1-ad3c-4a46-8cc5-61b6775d8342 req-8535c406-057a-41ca-ae04-404ea9a99172 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:49.186212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d57c10b1-ad3c-4a46-8cc5-61b6775d8342 req-8535c406-057a-41ca-ae04-404ea9a99172 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 946 time: 0.0483344 Nov 05 15:10:49.232363 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d57c10b1-ad3c-4a46-8cc5-61b6775d8342 req-002c9076-ff6e-4166-9ee7-d7bb36d7ebce tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403025 Nov 05 15:10:49.457685 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc22144-f37f-44d7-b581-eccda2712e66 req-8bd78d11-3785-448b-b91e-88c85a903016 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:49.459136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5bc22144-f37f-44d7-b581-eccda2712e66 req-8bd78d11-3785-448b-b91e-88c85a903016 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 946 time: 0.0481269 Nov 05 15:10:49.508191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5bc22144-f37f-44d7-b581-eccda2712e66 req-a1873a2e-93b0-48ae-aa34-360645326b26 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432768 Nov 05 15:10:50.111060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0fca80ac-c1ca-4df8-94fb-825d38f18515 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:50.625200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2826c74b-9462-4144-845f-585c69aa0e30 req-cd1cefd0-fdd0-4720-97bf-fc08ec1216a6 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:50.626811 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2826c74b-9462-4144-845f-585c69aa0e30 req-cd1cefd0-fdd0-4720-97bf-fc08ec1216a6 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 946 time: 0.0507073 Nov 05 15:10:50.674068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2826c74b-9462-4144-845f-585c69aa0e30 req-cac50557-6080-46bd-9ed4-543809694e3c tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412145 Nov 05 15:10:50.882136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-24edacf3-5ae1-4669-bb80-e145a4055138 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:50.883610 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-24edacf3-5ae1-4669-bb80-e145a4055138 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 946 time: 0.0488031 Nov 05 15:10:50.973495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Deleting port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:50.973831 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:51.078178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] For port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:51.078431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:51.091812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Calling delete_port for bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:51.218679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:51.230116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['c0be8c87-15b3-46e5-9492-33d1d0632072'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:51.246817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Pushing event deleted for resources: {'Port': ['ID=bfb0bdd0-714f-4ab4-ad58-2f5971618ed3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:51.286859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] No DVR routers for this DVR port bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:10:51.289505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:51.292903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7ee0c46-8acf-4bc2-b79d-d470ead50011 req-2178fe1a-00d3-4b26-8721-2ce6313dfb67 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "DELETE /v2.0/ports/bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 HTTP/1.1" status: 204 len: 173 time: 0.4012082 Nov 05 15:10:51.293392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'name': 'network-vif-deleted', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:51.295955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-101e5591-1950-49f4-b608-064ce6122af7" -d '{"events": [{"server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "name": "network-vif-deleted", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:51.335222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c69f8be-5424-4f98-9b06-e29ae78907b1 x-openstack-request-id: req-3c69f8be-5424-4f98-9b06-e29ae78907b1 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:51.335711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0dc16dec-a172-4917-b386-c8284c0af1db", "name": "network-vif-deleted", "tag": "bfb0bdd0-714f-4ab4-ad58-2f5971618ed3", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:51.336138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3c69f8be-5424-4f98-9b06-e29ae78907b1 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:51.336843 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0dc16dec-a172-4917-b386-c8284c0af1db', 'name': 'network-vif-deleted', 'tag': 'bfb0bdd0-714f-4ab4-ad58-2f5971618ed3', 'status': 'completed', 'code': 200} Nov 05 15:10:51.787050 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d8c76713-aabd-4422-bc3b-ef4927c5a5f4 req-8820b2a1-e3c1-4cbc-9347-c03ed3ad7420 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=0dc16dec-a172-4917-b386-c8284c0af1db HTTP/1.1" status: 200 len: 210 time: 0.0336318 Nov 05 15:10:52.438546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2654bb7e-06ff-47c7-bcbc-283124047375 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:52.935356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db351d5-b12c-4071-8db3-147e72a2ef2f req-77df62e2-8111-4b04-aac2-16450efe3c03 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:52.936829 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8db351d5-b12c-4071-8db3-147e72a2ef2f req-77df62e2-8111-4b04-aac2-16450efe3c03 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0483882 Nov 05 15:10:52.982657 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8db351d5-b12c-4071-8db3-147e72a2ef2f req-edc0b76e-0c6a-43b8-a608-189022ece35d tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394270 Nov 05 15:10:53.103205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:53.118378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36daf2d1-9e5f-4704-b4ff-c8adcb0a0088 req-f989169f-9d54-4cb9-a345-a4f6bc899953 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:53.119964 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36daf2d1-9e5f-4704-b4ff-c8adcb0a0088 req-f989169f-9d54-4cb9-a345-a4f6bc899953 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0493901 Nov 05 15:10:53.123638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:53.123997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device bfb0bdd0-714f-4ab4-ad58-2f5971618ed3 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:10:53.168082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-36daf2d1-9e5f-4704-b4ff-c8adcb0a0088 req-f24d0b5c-7f66-4ce8-b4f6-a1bbae6f37d9 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418589 Nov 05 15:10:53.284589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cc3271-5144-4986-9fb3-b3265485ee93 req-805cdf86-b857-4ee5-aac5-461f2bb51750 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:53.286055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e0cc3271-5144-4986-9fb3-b3265485ee93 req-805cdf86-b857-4ee5-aac5-461f2bb51750 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0520096 Nov 05 15:10:53.332197 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e0cc3271-5144-4986-9fb3-b3265485ee93 req-6ab379cd-99bb-4131-bb96-a87f6711ea68 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402780 Nov 05 15:10:53.485501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:53.499424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42065f72-2c4e-47b4-9743-0e7bb1bcb873 req-b9c8ea38-4cc3-4dc9-953f-a43b6208afdb tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:53.501077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42065f72-2c4e-47b4-9743-0e7bb1bcb873 req-b9c8ea38-4cc3-4dc9-953f-a43b6208afdb tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0514972 Nov 05 15:10:53.549395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42065f72-2c4e-47b4-9743-0e7bb1bcb873 req-b0370b5c-a49b-4248-9faf-84c4b7b1559e tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409482 Nov 05 15:10:53.668238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c25ff61b-0947-4a0e-b322-fc6992dca1fd req-86f5ace0-a4a4-478d-a68a-15e3abd1e222 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:53.669734 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c25ff61b-0947-4a0e-b322-fc6992dca1fd req-86f5ace0-a4a4-478d-a68a-15e3abd1e222 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0524840 Nov 05 15:10:53.719415 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c25ff61b-0947-4a0e-b322-fc6992dca1fd req-b66ce461-f0e2-4f25-8b70-43a07c015c72 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430984 Nov 05 15:10:53.841000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99c4eb2-11f3-4d09-adc6-eea8f700563b req-950585d2-2f28-4d3d-bdbb-351d2052f3cb tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:53.842477 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e99c4eb2-11f3-4d09-adc6-eea8f700563b req-950585d2-2f28-4d3d-bdbb-351d2052f3cb tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0494194 Nov 05 15:10:53.890144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e99c4eb2-11f3-4d09-adc6-eea8f700563b req-c8cd6721-0b63-4e9a-b008-3903abf3861c tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416958 Nov 05 15:10:54.189433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420b693b-5280-45ca-ac81-23e792d61123 req-ba537b7c-5e6c-40b1-9e22-7afbd2e18930 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:54.191017 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-420b693b-5280-45ca-ac81-23e792d61123 req-ba537b7c-5e6c-40b1-9e22-7afbd2e18930 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0523510 Nov 05 15:10:54.239583 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-420b693b-5280-45ca-ac81-23e792d61123 req-3935f7d4-c3bf-4133-a014-a071853754ac tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426936 Nov 05 15:10:54.944873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.354440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e9e37a-4e3a-4a5a-9fd4-62c215f54d3e req-69272b9f-85d2-4f5c-b72c-9b7a295eb007 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:55.356949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b4e9e37a-4e3a-4a5a-9fd4-62c215f54d3e req-69272b9f-85d2-4f5c-b72c-9b7a295eb007 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0491357 Nov 05 15:10:55.408849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b4e9e37a-4e3a-4a5a-9fd4-62c215f54d3e req-58157e45-6e10-48d0-bea2-442574e26995 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.30 "GET /v2.0/security-groups?id=cd42744c-7233-4e88-b51f-c681dff0dd71&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443788 Nov 05 15:10:55.537092 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be401b1f-2122-46b3-baa9-4f394864de05 req-7351337f-ed7b-4dbc-a16b-fdede2316470 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:55.538438 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-be401b1f-2122-46b3-baa9-4f394864de05 req-7351337f-ed7b-4dbc-a16b-fdede2316470 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "GET /v2.0/ports?device_id=d0d41068-e357-4aea-8220-4e490af25198 HTTP/1.1" status: 200 len: 945 time: 0.0472393 Nov 05 15:10:55.623815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Deleting port c0be8c87-15b3-46e5-9492-33d1d0632072 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:10:55.624145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.711324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] For port c0be8c87-15b3-46e5-9492-33d1d0632072, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=c0be8c87-15b3-46e5-9492-33d1d0632072,segment=NetworkSegment(e5292afe-c0cf-46d0-b770-ce0df75b79fc),segment_id=e5292afe-c0cf-46d0-b770-ce0df75b79fc)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:10:55.711679 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.724601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Calling delete_port for c0be8c87-15b3-46e5-9492-33d1d0632072 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:10:55.850131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.861914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['c0be8c87-15b3-46e5-9492-33d1d0632072'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:10:55.880329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Pushing event deleted for resources: {'Port': ['ID=c0be8c87-15b3-46e5-9492-33d1d0632072,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:55.920204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] No DVR routers for this DVR port c0be8c87-15b3-46e5-9492-33d1d0632072 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:10:55.922669 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.926017 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-be401b1f-2122-46b3-baa9-4f394864de05 req-e5288346-8939-48ee-828e-1d31aebbe880 tempest-ServersNegativeTestJSON-1398416879 tempest-ServersNegativeTestJSON-1398416879-project] 10.222.0.32 "DELETE /v2.0/ports/c0be8c87-15b3-46e5-9492-33d1d0632072 HTTP/1.1" status: 204 len: 173 time: 0.3815675 Nov 05 15:10:55.926452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'name': 'network-vif-deleted', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:10:55.929015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be0b6770-7947-41f3-85d9-8779ea6fb3e8" -d '{"events": [{"server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "name": "network-vif-deleted", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:10:55.966869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:55.976253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:10:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd75580d-a54c-4292-9ea4-53642e7e32b3 x-openstack-request-id: req-fd75580d-a54c-4292-9ea4-53642e7e32b3 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:10:55.977008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0d41068-e357-4aea-8220-4e490af25198", "name": "network-vif-deleted", "tag": "c0be8c87-15b3-46e5-9492-33d1d0632072", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:10:55.977265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fd75580d-a54c-4292-9ea4-53642e7e32b3 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:10:55.977668 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0d41068-e357-4aea-8220-4e490af25198', 'name': 'network-vif-deleted', 'tag': 'c0be8c87-15b3-46e5-9492-33d1d0632072', 'status': 'completed', 'code': 200} Nov 05 15:10:56.464240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:56.508734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Deleting subnet b4fd686d-8d97-46c6-897d-7e9827aa8fc4 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:10:56.511709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.549315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.587422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.637395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.660855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b4fd686d-8d97-46c6-897d-7e9827aa8fc4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:56.666409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.669598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cf76b393-91de-4d01-824c-0f3f55672dd4 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/b4fd686d-8d97-46c6-897d-7e9827aa8fc4 HTTP/1.1" status: 204 len: 168 time: 0.2043242 Nov 05 15:10:56.672079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:56.742050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.816581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.836020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['31e50ff0-6af2-492f-8b28-4c8f14f2193e']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:56.844902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e5292afe-c0cf-46d0-b770-ce0df75b79fc') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:56.845196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e5292afe-c0cf-46d0-b770-ce0df75b79fc') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:10:56.859144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.871623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.877254 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:10:56.877628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:10:56.879733 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:10:56.931426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.936833 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:56.939949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] 10.222.0.30 "DELETE /v2.0/networks/31e50ff0-6af2-492f-8b28-4c8f14f2193e HTTP/1.1" status: 204 len: 168 time: 0.2669377 Nov 05 15:10:56.951115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da6fd76-bb44-4eab-89c3-1723f060da34 admin admin] Pushing event deleted for resources: {'Network': ['ID=31e50ff0-6af2-492f-8b28-4c8f14f2193e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:57.046988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49732) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:57.086606 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-45a2a6cc-71dd-41ac-bc4b-4a681557fb19 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e48731d5e87b4153b8d6b77039c45e4f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0383291 Nov 05 15:10:57.088830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:57.134431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:57.154682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:57.207928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:57.210697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:57.211944 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cd42744c-7233-4e88-b51f-c681dff0dd71 HTTP/1.1" status: 204 len: 168 time: 0.1221578 Nov 05 15:10:57.220089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c06f1f3-b090-40d2-9d3a-f1741b88d1cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd42744c-7233-4e88-b51f-c681dff0dd71,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:57.879446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49756) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:10:57.973547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1772771902'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:10:57.994642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:10:57.998362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.007605 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.082645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.087100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.113359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 602} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:10:58.123578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'SecurityGroup': ['ID=71aa1e5d-d772-4ee4-95d7-3e3748ea2399,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:58.128532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.129394 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Added segment 73eadb05-63cf-4b9e-9387-6804a34cfc30 of type vlan for network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 Nov 05 15:10:58.168427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.193425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.199326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:10:58.199910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:10:58.258169 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3776326 Nov 05 15:10:58.271057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4001d02a-fc9b-4fd8-89cd-661e2aceec12 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Network': ['ID=152c22b1-ddbc-4b3a-9c14-099c0780ecf2,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:10:58.280926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:10:59.131693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c0be8c87-15b3-46e5-9492-33d1d0632072 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:10:59.155816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: c0be8c87-15b3-46e5-9492-33d1d0632072 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:10:59.156155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device c0be8c87-15b3-46e5-9492-33d1d0632072 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:11:01.520796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49760) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:01.525934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'subnet': {'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:01.609708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:01.613281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:01.801268 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:01.857819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Subnet': ['ID=ac0468cb-772d-4a26-9baf-ed71c6702b71,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:01.866791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking segment: {'id': '73eadb05-63cf-4b9e-9387-6804a34cfc30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:01.867143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network hostable DHCP agents. Network: 152c22b1-ddbc-4b3a-9c14-099c0780ecf2, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:01.883628 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:01.891899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 152c22b1-ddbc-4b3a-9c14-099c0780ecf2) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:01.895971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:01.896581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:01.900444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cd13ebb-0502-4821-83f2-def2d35948e8 None None] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:01.913215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6524728f-3c5e-4c4a-89cb-116af022c6f4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3913238 Nov 05 15:11:01.916586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49762) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:01.921362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-883487267'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:01.942719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:01.946177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0cd13ebb-0502-4821-83f2-def2d35948e8 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:01.973629 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:01.975289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 617} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:01.984578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:01.984747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8b2dd3e-be03-437b-ac76-bb2a0f1f21e7 None None] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:01.984953 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Added segment d4445050-fcd2-4737-9d9d-c7731e211752 of type vlan for network 43dee881-b4a0-40d4-b4cb-c7621fd20416 Nov 05 15:11:02.024394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.048416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.055063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:02.055698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e8b2dd3e-be03-437b-ac76-bb2a0f1f21e7 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:02.057141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:02.064680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bd22549-c2d4-4faa-8da3-236d00ff3cf1 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:02.131570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bd22549-c2d4-4faa-8da3-236d00ff3cf1 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:02.152300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2346888 Nov 05 15:11:02.156694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49764) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:02.163039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'subnet': {'network_id': '43dee881-b4a0-40d4-b4cb-c7621fd20416', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:02.169240 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46515291-7703-4bc7-a733-ddf06ea22481 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Network': ['ID=43dee881-b4a0-40d4-b4cb-c7621fd20416,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:02.185955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 43dee881-b4a0-40d4-b4cb-c7621fd20416 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:02.252668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:02.256179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.400554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-152c22b1-ddbc-4b3a-9c14-099c0780ecf2', 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2', 'tenant_id': '434d208bdc1a4c5682fffde3cc170b46', 'fixed_ips': [{'subnet_id': 'ac0468cb-772d-4a26-9baf-ed71c6702b71'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:11:02.401481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.447479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.508961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Subnet': ['ID=732b1cf6-691c-48da-9d5c-a949be77fdb9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:02.525646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking segment: {'id': 'd4445050-fcd2-4737-9d9d-c7731e211752', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 617, 'network_id': '43dee881-b4a0-40d4-b4cb-c7621fd20416'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:02.526002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network hostable DHCP agents. Network: 43dee881-b4a0-40d4-b4cb-c7621fd20416, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:02.542541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Allocated IP 2001:db8:0:ffff::2 (152c22b1-ddbc-4b3a-9c14-099c0780ecf2/ac0468cb-772d-4a26-9baf-ed71c6702b71/bc7e8667-57a2-4c17-9cdb-08a352526683) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:02.543899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network 43dee881-b4a0-40d4-b4cb-c7621fd20416 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:02.554258 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 43dee881-b4a0-40d4-b4cb-c7621fd20416) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:02.558497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:02.559099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.575000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bff050ba-736f-4030-b9bb-428ef527c32e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.4169199 Nov 05 15:11:02.577724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49766) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:02.674042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.689832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.695714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.738148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:02.742507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:02.744161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Pushing event updated for resources: {'Port': ['ID=bc7e8667-57a2-4c17-9cdb-08a352526683,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:02.746312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:02.756390 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.796955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Attempting to bind port bc7e8667-57a2-4c17-9cdb-08a352526683 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:02.797333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Attempting to bind port bc7e8667-57a2-4c17-9cdb-08a352526683 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '73eadb05-63cf-4b9e-9387-6804a34cfc30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:02.797699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Attempting to bind port bc7e8667-57a2-4c17-9cdb-08a352526683 on network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:02.803027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:02.803470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Checking segment: {'id': '73eadb05-63cf-4b9e-9387-6804a34cfc30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:02.803892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.804328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Bound using segment: {'id': '73eadb05-63cf-4b9e-9387-6804a34cfc30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:02.805149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Bound port: bc7e8667-57a2-4c17-9cdb-08a352526683, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '73eadb05-63cf-4b9e-9387-6804a34cfc30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 602, 'network_id': '152c22b1-ddbc-4b3a-9c14-099c0780ecf2'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:02.805478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.819426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.846452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Subnet': ['ID=732b1cf6-691c-48da-9d5c-a949be77fdb9,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:02.872474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] For port bc7e8667-57a2-4c17-9cdb-08a352526683, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:02.875744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] For port bc7e8667-57a2-4c17-9cdb-08a352526683, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bc7e8667-57a2-4c17-9cdb-08a352526683,segment=NetworkSegment(73eadb05-63cf-4b9e-9387-6804a34cfc30),segment_id=73eadb05-63cf-4b9e-9387-6804a34cfc30)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:02.880770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.913699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.937832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43dee881-b4a0-40d4-b4cb-c7621fd20416']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:02.938302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c08d778c-8217-4796-bfce-d87d5b08de9e None None] Pushing event updated for resources: {'Port': ['ID=bc7e8667-57a2-4c17-9cdb-08a352526683,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:02.949060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4445050-fcd2-4737-9d9d-c7731e211752') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:02.949362 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4445050-fcd2-4737-9d9d-c7731e211752') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:02.959251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.972628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.978796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Releasing vlan 617 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:02.979186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:02.982296 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:03.044085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.051746 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.054949 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/43dee881-b4a0-40d4-b4cb-c7621fd20416 HTTP/1.1" status: 204 len: 168 time: 0.4763033 Nov 05 15:11:03.058566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49768) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:03.073074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-339798102'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:03.079274 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935862ae-c8cd-45cf-9cc9-85e9f620530a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Network': ['ID=43dee881-b4a0-40d4-b4cb-c7621fd20416,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:03.114745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:03.118376 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.146182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 616} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:03.155994 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.156337 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Added segment 9e2e460c-d1ca-44e0-890d-2d5540294f88 of type vlan for network ccfb542c-8b3f-44f8-837e-5adef1feec39 Nov 05 15:11:03.198313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.228210 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.233670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:03.234239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.292952 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2333360 Nov 05 15:11:03.295618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49770) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:03.302757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'subnet': {'network_id': 'ccfb542c-8b3f-44f8-837e-5adef1feec39', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:03.310475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b93b6e7-01b4-4729-936e-9b5a1c157225 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Network': ['ID=ccfb542c-8b3f-44f8-837e-5adef1feec39,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:03.320236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ccfb542c-8b3f-44f8-837e-5adef1feec39 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:03.394589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:03.398186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.458165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Performing IP validity checks on allocation pools {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Nov 05 15:11:03.458596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.ipam_backend_mixin [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking for overlaps among allocation pools and gateway ip {{(pid=113581) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Nov 05 15:11:03.592723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.662666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Subnet': ['ID=d0cd3946-a513-4113-a803-6048d35625a0,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:03.672920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking segment: {'id': '9e2e460c-d1ca-44e0-890d-2d5540294f88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 616, 'network_id': 'ccfb542c-8b3f-44f8-837e-5adef1feec39'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:03.673307 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network hostable DHCP agents. Network: ccfb542c-8b3f-44f8-837e-5adef1feec39, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:03.691933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network ccfb542c-8b3f-44f8-837e-5adef1feec39 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:03.701588 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, ccfb542c-8b3f-44f8-837e-5adef1feec39) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:03.707557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:03.708152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.724451 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bda0017b-c141-4c18-adfd-1b5e53409812 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.4277294 Nov 05 15:11:03.727016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49772) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:03.819400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56bfdfe0-c907-4304-8450-34d22900c1df None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:03.827667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.887366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.908921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56bfdfe0-c907-4304-8450-34d22900c1df None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:03.916866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] Provisioning complete for port bc7e8667-57a2-4c17-9cdb-08a352526683 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:03.917239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.950394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bc7e8667-57a2-4c17-9cdb-08a352526683 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:03.953164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:03.980028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Subnet': ['ID=d0cd3946-a513-4113-a803-6048d35625a0,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:04.043111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.063978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ccfb542c-8b3f-44f8-837e-5adef1feec39']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:04.073790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9e2e460c-d1ca-44e0-890d-2d5540294f88') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:04.074090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9e2e460c-d1ca-44e0-890d-2d5540294f88') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:04.084326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.100252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.106586 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Releasing vlan 616 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:04.107181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:04.110371 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:04.132225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bc7e8667-57a2-4c17-9cdb-08a352526683 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:04.132623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.168191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.170519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.173452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.177733 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/ccfb542c-8b3f-44f8-837e-5adef1feec39 HTTP/1.1" status: 204 len: 168 time: 0.4496226 Nov 05 15:11:04.181434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49774) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:04.187308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1774593258'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:04.195291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3a16bb-2e16-4d1d-885d-b3488ff1e7c4 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Network': ['ID=ccfb542c-8b3f-44f8-837e-5adef1feec39,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:04.221725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:04.225341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.227120 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] For port bc7e8667-57a2-4c17-9cdb-08a352526683, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bc7e8667-57a2-4c17-9cdb-08a352526683,segment=NetworkSegment(73eadb05-63cf-4b9e-9387-6804a34cfc30),segment_id=73eadb05-63cf-4b9e-9387-6804a34cfc30)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:04.238297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.248795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:04.258307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.258705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Added segment 9d6b17ca-080d-4690-a337-a3377125fc2a of type vlan for network 2df39510-103a-4578-b679-128ed9db969d Nov 05 15:11:04.297272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.322744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.328516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:04.329217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.362234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6464aa3-c8b1-483a-8b09-7ff776e9a476 None None] Pushing event updated for resources: {'Port': ['ID=bc7e8667-57a2-4c17-9cdb-08a352526683,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:04.392501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2066908 Nov 05 15:11:04.393181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49776) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:04.398534 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'subnet': {'network_id': '2df39510-103a-4578-b679-128ed9db969d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:04.404422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642f16c3-a3e4-4704-85e3-3ecb7940706a tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Network': ['ID=2df39510-103a-4578-b679-128ed9db969d,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:04.416357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 2df39510-103a-4578-b679-128ed9db969d details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:04.515231 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:04.518971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.707847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.769787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Subnet': ['ID=15f56045-2310-42f3-9148-a422a2d5f8e8,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:04.780353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking segment: {'id': '9d6b17ca-080d-4690-a337-a3377125fc2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '2df39510-103a-4578-b679-128ed9db969d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:04.780752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network hostable DHCP agents. Network: 2df39510-103a-4578-b679-128ed9db969d, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:04.799469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network 2df39510-103a-4578-b679-128ed9db969d is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:04.809497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 2df39510-103a-4578-b679-128ed9db969d) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:04.813878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:04.814474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.830258 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f7bd6db7-d9f9-4ac7-a109-baea5f693c29 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4357872 Nov 05 15:11:04.834306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49778) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:04.840255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-676871564'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:04.846594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f760cd96-5f96-4d5b-887e-3deafb936dc5 None None] Network 43dee881-b4a0-40d4-b4cb-c7621fd20416 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:04.861193 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:04.865253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.868116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72101c99-a5b4-4a98-b1a4-41c48b243fc2 None None] Network ccfb542c-8b3f-44f8-837e-5adef1feec39 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:04.870140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f09f6ae8-77b4-49ea-a37d-d61c79ea3f18 None None] Network 2df39510-103a-4578-b679-128ed9db969d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f760cd96-5f96-4d5b-887e-3deafb936dc5 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.880863 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:04.893715 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 610} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:04.898614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.898977 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Added segment ea9b3d05-4527-406f-876c-5595ce3d1a03 of type vlan for network 2d0290b3-4d25-483b-b020-5de795deb7fc Nov 05 15:11:04.923766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc16005b-3e08-46f0-9154-249ca9f8cd1f None None] Network 43dee881-b4a0-40d4-b4cb-c7621fd20416 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-72101c99-a5b4-4a98-b1a4-41c48b243fc2 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.931447 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:04.939855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.947390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0fcfae6-7668-4f3f-a532-147654762e74 None None] Network ccfb542c-8b3f-44f8-837e-5adef1feec39 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-cc16005b-3e08-46f0-9154-249ca9f8cd1f None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.952090 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-c0fcfae6-7668-4f3f-a532-147654762e74 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:04.971726 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:04.973626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.979737 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:04.980324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:04.982187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-89cfaeff-7b45-49e8-832a-1010f7b535f0 None None] Provisioning complete for port bc7e8667-57a2-4c17-9cdb-08a352526683 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:04.982553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-89cfaeff-7b45-49e8-832a-1010f7b535f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f09f6ae8-77b4-49ea-a37d-d61c79ea3f18 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:05.024195 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:05.033497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3be3a363-74a9-4311-9e1d-7e1ac3e0ddf7 None None] Network 2df39510-103a-4578-b679-128ed9db969d requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:05.039609 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2041574 Nov 05 15:11:05.042600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49780) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:05.047599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Request body: {'subnet': {'network_id': '2d0290b3-4d25-483b-b020-5de795deb7fc', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:05.057469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b9ece2-0cba-4580-b8c3-44ae19e1b700 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Network': ['ID=2d0290b3-4d25-483b-b020-5de795deb7fc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:05.076032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 2d0290b3-4d25-483b-b020-5de795deb7fc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:05.137427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Made reservation on behalf of 434d208bdc1a4c5682fffde3cc170b46 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:05.141114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-3be3a363-74a9-4311-9e1d-7e1ac3e0ddf7 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:05.193741 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:05.202806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6d7cc46-8338-42c0-8ef0-7462885e167d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:05.275051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6d7cc46-8338-42c0-8ef0-7462885e167d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:05.328078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.388026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event updated for resources: {'Subnet': ['ID=b3dfd2d6-746e-4bd0-9e12-6d022037a502,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:05.396961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Checking segment: {'id': 'ea9b3d05-4527-406f-876c-5595ce3d1a03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '2d0290b3-4d25-483b-b020-5de795deb7fc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:05.397336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network hostable DHCP agents. Network: 2d0290b3-4d25-483b-b020-5de795deb7fc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:05.413104 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Network 2d0290b3-4d25-483b-b020-5de795deb7fc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:05.421410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 2d0290b3-4d25-483b-b020-5de795deb7fc) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:05.425637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:05.426246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.442506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-668ee0d4-3da4-42ab-8ee4-79647d8b223b tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.3988416 Nov 05 15:11:05.445014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49782) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:05.482604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-2df39510-103a-4578-b679-128ed9db969d', 'network_id': '2df39510-103a-4578-b679-128ed9db969d', 'tenant_id': '434d208bdc1a4c5682fffde3cc170b46', 'fixed_ips': [{'subnet_id': '15f56045-2310-42f3-9148-a422a2d5f8e8'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:11:05.483501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.545266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.622014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Allocated IP 2001:db8::2 (2df39510-103a-4578-b679-128ed9db969d/15f56045-2310-42f3-9148-a422a2d5f8e8/244a65d4-8a98-44d9-a564-1eb6e31c578e) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:05.633105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.692068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.718424 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Subnet': ['ID=b3dfd2d6-746e-4bd0-9e12-6d022037a502,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:05.782725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.804940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d0290b3-4d25-483b-b020-5de795deb7fc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:05.814841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ea9b3d05-4527-406f-876c-5595ce3d1a03') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:05.815206 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ea9b3d05-4527-406f-876c-5595ce3d1a03') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:05.825837 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.839322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.845993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Releasing vlan 610 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:05.846305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:05.850113 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:05.915333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bc7e8667-57a2-4c17-9cdb-08a352526683 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:05.915746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.923916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.928049 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/2d0290b3-4d25-483b-b020-5de795deb7fc HTTP/1.1" status: 204 len: 168 time: 0.4820855 Nov 05 15:11:05.930794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49784) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:05.937660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b45a51-434b-470d-9559-26674699bd0c tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Network': ['ID=2d0290b3-4d25-483b-b020-5de795deb7fc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:05.945660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.954369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:05.958943 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea70ae67-56cf-4694-b449-e206f5a72cca tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] GET failed (client error): The resource could not be found. Nov 05 15:11:05.960492 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ea70ae67-56cf-4694-b449-e206f5a72cca tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "GET /v2.0/subnets/b3dfd2d6-746e-4bd0-9e12-6d022037a502 HTTP/1.1" status: 404 len: 337 time: 0.0285199 Nov 05 15:11:05.963138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49786) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:05.981086 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-4204a26a-ce90-4f99-8edd-324729635693 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:05.981596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4204a26a-ce90-4f99-8edd-324729635693 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:05.989169 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4204a26a-ce90-4f99-8edd-324729635693 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/2d0290b3-4d25-483b-b020-5de795deb7fc HTTP/1.1" status: 404 len: 339 time: 0.0203378 Nov 05 15:11:05.989169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49788) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.012737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Network 2df39510-103a-4578-b679-128ed9db969d is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:06.014282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Pushing event updated for resources: {'Port': ['ID=244a65d4-8a98-44d9-a564-1eb6e31c578e,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:06.017991 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-cfd122c0-e167-45c8-b90c-5818b67ba5fc tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:06.018429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cfd122c0-e167-45c8-b90c-5818b67ba5fc tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:06.019098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:06.023772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:06.024029 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cfd122c0-e167-45c8-b90c-5818b67ba5fc tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/subnets/b3dfd2d6-746e-4bd0-9e12-6d022037a502 HTTP/1.1" status: 404 len: 337 time: 0.0318196 Nov 05 15:11:06.024318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49790) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.043589 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-6284e428-0e5c-42ac-8f32-4311a3f2df27 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:06.044121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6284e428-0e5c-42ac-8f32-4311a3f2df27 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:06.047102 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6284e428-0e5c-42ac-8f32-4311a3f2df27 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/2d0290b3-4d25-483b-b020-5de795deb7fc HTTP/1.1" status: 404 len: 339 time: 0.0218589 Nov 05 15:11:06.049667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49792) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.054905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bc7e8667-57a2-4c17-9cdb-08a352526683 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:06.055334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.100829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Deleting subnet 15f56045-2310-42f3-9148-a422a2d5f8e8 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:11:06.103939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.107615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Attempting to bind port 244a65d4-8a98-44d9-a564-1eb6e31c578e on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:06.107976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Attempting to bind port 244a65d4-8a98-44d9-a564-1eb6e31c578e by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '9d6b17ca-080d-4690-a337-a3377125fc2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '2df39510-103a-4578-b679-128ed9db969d'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:06.108329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Attempting to bind port 244a65d4-8a98-44d9-a564-1eb6e31c578e on network 2df39510-103a-4578-b679-128ed9db969d {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:06.117815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:06.118184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Checking segment: {'id': '9d6b17ca-080d-4690-a337-a3377125fc2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '2df39510-103a-4578-b679-128ed9db969d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:06.118612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.118994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Bound using segment: {'id': '9d6b17ca-080d-4690-a337-a3377125fc2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '2df39510-103a-4578-b679-128ed9db969d'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:06.119473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Bound port: 244a65d4-8a98-44d9-a564-1eb6e31c578e, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9d6b17ca-080d-4690-a337-a3377125fc2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '2df39510-103a-4578-b679-128ed9db969d'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:06.119845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.144190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.216880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] For port 244a65d4-8a98-44d9-a564-1eb6e31c578e, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:06.220373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] For port 244a65d4-8a98-44d9-a564-1eb6e31c578e, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=244a65d4-8a98-44d9-a564-1eb6e31c578e,segment=NetworkSegment(9d6b17ca-080d-4690-a337-a3377125fc2a),segment_id=9d6b17ca-080d-4690-a337-a3377125fc2a)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:06.225132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.233571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.282217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4515d221-aa3c-4eba-b111-47c864d4c4f5 None None] Pushing event updated for resources: {'Port': ['ID=244a65d4-8a98-44d9-a564-1eb6e31c578e,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:06.297518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.326139 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Subnet': ['ID=15f56045-2310-42f3-9148-a422a2d5f8e8,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:06.329967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.336333 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9a15ee4f-caa6-4ae6-826d-9d851d0fe7f1 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/subnets/15f56045-2310-42f3-9148-a422a2d5f8e8 HTTP/1.1" status: 204 len: 168 time: 0.2851024 Nov 05 15:11:06.336507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49794) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.428149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.491510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Deleting port 244a65d4-8a98-44d9-a564-1eb6e31c578e {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:11:06.491847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.541521 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:11:06.555381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] For port 244a65d4-8a98-44d9-a564-1eb6e31c578e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=244a65d4-8a98-44d9-a564-1eb6e31c578e,segment=NetworkSegment(9d6b17ca-080d-4690-a337-a3377125fc2a),segment_id=9d6b17ca-080d-4690-a337-a3377125fc2a)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:06.555746 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.568116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Calling delete_port for 244a65d4-8a98-44d9-a564-1eb6e31c578e owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:11:06.649840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.674603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Port': ['ID=244a65d4-8a98-44d9-a564-1eb6e31c578e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:06.679236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No DVR routers for this DVR port 244a65d4-8a98-44d9-a564-1eb6e31c578e on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:11:06.758485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.778316 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2df39510-103a-4578-b679-128ed9db969d']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:06.787849 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9d6b17ca-080d-4690-a337-a3377125fc2a') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:06.788147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9d6b17ca-080d-4690-a337-a3377125fc2a') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:06.799347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.813600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.820207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:06.820631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:06.823631 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:06.884697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.888766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:06.892319 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/2df39510-103a-4578-b679-128ed9db969d HTTP/1.1" status: 204 len: 168 time: 0.5548921 Nov 05 15:11:06.896036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49796) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.907489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459bed40-a3bf-45f8-8b4c-7e9fd1677f2f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Network': ['ID=2df39510-103a-4578-b679-128ed9db969d,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:06.924787 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2a7dd84-b26b-4f19-8776-e92f77613779 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:06.925260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2a7dd84-b26b-4f19-8776-e92f77613779 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:06.930843 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d2a7dd84-b26b-4f19-8776-e92f77613779 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/subnets/d0cd3946-a513-4113-a803-6048d35625a0 HTTP/1.1" status: 404 len: 337 time: 0.0314815 Nov 05 15:11:06.931429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49798) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.949724 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-bd29dc91-86c1-4d70-a11c-7c53dd1aa741 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:06.950261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bd29dc91-86c1-4d70-a11c-7c53dd1aa741 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:06.953236 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bd29dc91-86c1-4d70-a11c-7c53dd1aa741 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/ccfb542c-8b3f-44f8-837e-5adef1feec39 HTTP/1.1" status: 404 len: 339 time: 0.0212388 Nov 05 15:11:06.955813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49800) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:06.986388 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae01bb37-e25e-46b4-8d4d-99e47e77953e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:06.986835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ae01bb37-e25e-46b4-8d4d-99e47e77953e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:06.990679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ae01bb37-e25e-46b4-8d4d-99e47e77953e tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/subnets/732b1cf6-691c-48da-9d5c-a949be77fdb9 HTTP/1.1" status: 404 len: 337 time: 0.0333102 Nov 05 15:11:06.993627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:07.012084 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.pecan_wsgi.hooks.translation [None req-227724c6-f41a-48fc-94ec-d7b7bd788bcf tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] DELETE failed (client error): The resource could not be found. Nov 05 15:11:07.012787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-227724c6-f41a-48fc-94ec-d7b7bd788bcf tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=113581) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 05 15:11:07.015798 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-227724c6-f41a-48fc-94ec-d7b7bd788bcf tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/43dee881-b4a0-40d4-b4cb-c7621fd20416 HTTP/1.1" status: 404 len: 339 time: 0.0216660 Nov 05 15:11:07.018378 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49806) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:07.070782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Deleting subnet ac0468cb-772d-4a26-9baf-ed71c6702b71 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:11:07.074064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.115267 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.183196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff695ac9-5b16-453c-8392-38d7a2c77eae None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:07.209215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.246839 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b8c6a1ed-0b3c-4814-9649-b58a25cc71f8 None None] Could not find standard attr ID for object 244a65d4-8a98-44d9-a564-1eb6e31c578e. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 15:11:07.260347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff695ac9-5b16-453c-8392-38d7a2c77eae None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:07.270054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.296543 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Subnet': ['ID=ac0468cb-772d-4a26-9baf-ed71c6702b71,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:07.301842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.307688 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5e057e44-4cdd-42cd-b154-b4fb3559737f tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/subnets/ac0468cb-772d-4a26-9baf-ed71c6702b71 HTTP/1.1" status: 204 len: 168 time: 0.2860923 Nov 05 15:11:07.307864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49808) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:07.387071 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.439595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Deleting port bc7e8667-57a2-4c17-9cdb-08a352526683 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:11:07.439814 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.509020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] For port bc7e8667-57a2-4c17-9cdb-08a352526683, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bc7e8667-57a2-4c17-9cdb-08a352526683,segment=NetworkSegment(73eadb05-63cf-4b9e-9387-6804a34cfc30),segment_id=73eadb05-63cf-4b9e-9387-6804a34cfc30)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:07.510047 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.517194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c668904-ed38-43f0-adf5-9fab08177a3e None None] DHCP port deletion for 2df39510-103a-4578-b679-128ed9db969d request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:11:07.524208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Calling delete_port for bc7e8667-57a2-4c17-9cdb-08a352526683 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:11:07.539534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70f97925-81a9-46e5-9593-c15cf66a740d None None] Network 2d0290b3-4d25-483b-b020-5de795deb7fc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:07.543686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24efa6cc-f312-4f22-b56a-778753999aa6 None None] Network 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-70f97925-81a9-46e5-9593-c15cf66a740d None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:07.564682 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:07.595381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2008194-6eaf-42f9-a537-7cece7789a66 None None] Network 2d0290b3-4d25-483b-b020-5de795deb7fc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f2008194-6eaf-42f9-a537-7cece7789a66 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:07.610909 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:07.612147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.641619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Port': ['ID=bc7e8667-57a2-4c17-9cdb-08a352526683,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:07.650983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] No DVR routers for this DVR port bc7e8667-57a2-4c17-9cdb-08a352526683 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:11:07.703771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9afd1077-5aff-4ee9-bfe8-d179e3cc097e None None] DHCP port deletion for 152c22b1-ddbc-4b3a-9c14-099c0780ecf2 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:11:07.723607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e232023-bbb7-4180-a681-654f1c24b6cc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:07.738272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.760195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['152c22b1-ddbc-4b3a-9c14-099c0780ecf2']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:07.770985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73eadb05-63cf-4b9e-9387-6804a34cfc30') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:07.771273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73eadb05-63cf-4b9e-9387-6804a34cfc30') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:07.783154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.794445 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e232023-bbb7-4180-a681-654f1c24b6cc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:07.802141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.808187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Releasing vlan 602 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:07.808625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:07.811503 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:07.890845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.899204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:07.905486 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] 10.222.0.30 "DELETE /v2.0/networks/152c22b1-ddbc-4b3a-9c14-099c0780ecf2 HTTP/1.1" status: 204 len: 168 time: 0.5943599 Nov 05 15:11:07.919326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ae7809-bb8e-4587-b020-46d7dfecf6b0 tempest-NetworksIpV6Test-973734561 tempest-NetworksIpV6Test-973734561-project] Pushing event deleted for resources: {'Network': ['ID=152c22b1-ddbc-4b3a-9c14-099c0780ecf2,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:07.933752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bc7e8667-57a2-4c17-9cdb-08a352526683 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:11:07.980208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: bc7e8667-57a2-4c17-9cdb-08a352526683 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:11:07.980696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bc7e8667-57a2-4c17-9cdb-08a352526683 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:11:08.074433 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60a3605e-e27e-45b0-9c2c-18a44ae8c03d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:08.138978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60a3605e-e27e-45b0-9c2c-18a44ae8c03d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:08.161758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49814) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:08.324292 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f973c5df-e5f8-48e4-92d8-679a172b3081 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=434d208bdc1a4c5682fffde3cc170b46&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1613023 Nov 05 15:11:08.326802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49818) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:08.377780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:08.402584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:08.457634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:08.460207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:08.461384 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/71aa1e5d-d772-4ee4-95d7-3e3748ea2399 HTTP/1.1" status: 204 len: 168 time: 0.1336579 Nov 05 15:11:08.469157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8986eed0-885a-4573-a6a8-ed268fd26aac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71aa1e5d-d772-4ee4-95d7-3e3748ea2399,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:09.121455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49840) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:09.213648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-2025037717', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:09.244261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.245309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.294325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.298229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.314667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.315821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1858b165-cb3d-41d9-82a0-dbbf60951dc7 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.1933670 Nov 05 15:11:09.318497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49844) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:09.323199 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1761011043'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:09.342427 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Made reservation on behalf of 654cf57e00ff46fdb3d46d2f632a979c for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:09.346308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.355054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.429629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.433245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.459311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 630} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:09.468394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event updated for resources: {'SecurityGroup': ['ID=310537b8-dd8a-4df9-ac96-495aaae95a53,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:09.474804 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.475153 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Added segment 045a0946-df8a-4bea-b43b-478b586b10e0 of type vlan for network d206c128-1214-4a00-88a9-b55bd9495088 Nov 05 15:11:09.514617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.541002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.546692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:09.547215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.609655 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.2901537 Nov 05 15:11:09.613515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49846) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:09.619850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'subnet': {'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:09.620732 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691834e4-235b-442d-a807-7254219790da tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event updated for resources: {'Network': ['ID=d206c128-1214-4a00-88a9-b55bd9495088,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:09.631262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d206c128-1214-4a00-88a9-b55bd9495088 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:09.711782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Made reservation on behalf of 654cf57e00ff46fdb3d46d2f632a979c for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:09.715367 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.906943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:09.965976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event updated for resources: {'Subnet': ['ID=45acee7c-b6ac-4229-87d9-35e0e2993229,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:09.974376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Checking segment: {'id': '045a0946-df8a-4bea-b43b-478b586b10e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:09.974733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Network hostable DHCP agents. Network: d206c128-1214-4a00-88a9-b55bd9495088, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:09.990697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Network d206c128-1214-4a00-88a9-b55bd9495088 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:09.999590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d206c128-1214-4a00-88a9-b55bd9495088) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:10.004117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:10.004734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.009526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b8d46b8-bd8c-411c-9966-4ba83ceacfca None None] Network d206c128-1214-4a00-88a9-b55bd9495088 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:10.025015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e9fb345e-5cd2-4093-82e6-bbbe3b9eac57 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4102514 Nov 05 15:11:10.026964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49848) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:10.031930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-70817416'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:10.053131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Made reservation on behalf of 654cf57e00ff46fdb3d46d2f632a979c for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:10.056902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.085075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:10.094450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.094789 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Added segment 038a6f37-4679-4ddd-88a4-41ee77453542 of type vlan for network d32e9ce9-5de2-4441-a5be-c86220c25987 Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-5b8d46b8-bd8c-411c-9966-4ba83ceacfca None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:10.104141 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:10.115788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-691f6602-0b27-470b-a8a1-6a2181721814 None None] Network d206c128-1214-4a00-88a9-b55bd9495088 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:10.138595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.167703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.174113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:10.179347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-691f6602-0b27-470b-a8a1-6a2181721814 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:10.214448 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:10.224797 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-942aca2e-6f5f-4b90-a981-952129d95bf5 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:10.239686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.2116737 Nov 05 15:11:10.242624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49850) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:10.247744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'subnet': {'network_id': 'd32e9ce9-5de2-4441-a5be-c86220c25987', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:10.259591 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafc14b6-c29c-49f9-86d0-34d89abc40bc tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event updated for resources: {'Network': ['ID=d32e9ce9-5de2-4441-a5be-c86220c25987,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:10.271468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network d32e9ce9-5de2-4441-a5be-c86220c25987 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:10.345686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-942aca2e-6f5f-4b90-a981-952129d95bf5 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:10.368517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Made reservation on behalf of 654cf57e00ff46fdb3d46d2f632a979c for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:10.372266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.556399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.566955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-d206c128-1214-4a00-88a9-b55bd9495088', 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088', 'tenant_id': '654cf57e00ff46fdb3d46d2f632a979c', 'fixed_ips': [{'subnet_id': '45acee7c-b6ac-4229-87d9-35e0e2993229'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:11:10.567811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.614670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event updated for resources: {'Subnet': ['ID=d9558ed1-63e1-4b80-8a37-a51d3d8b52eb,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:10.625222 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Checking segment: {'id': '038a6f37-4679-4ddd-88a4-41ee77453542', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'd32e9ce9-5de2-4441-a5be-c86220c25987'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:10.625660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Network hostable DHCP agents. Network: d32e9ce9-5de2-4441-a5be-c86220c25987, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:10.641946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Network d32e9ce9-5de2-4441-a5be-c86220c25987 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:10.650689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, d32e9ce9-5de2-4441-a5be-c86220c25987) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:10.654838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:10.655509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.671781 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ba9f8a8-3a7e-4902-985c-27c9a8972889 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4280553 Nov 05 15:11:10.674547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49852) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:10.679832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-990d1ca6-d362-4d28-a386-15437a78301d tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Request body: {'router': {'external_gateway_info': {'network_id': 'd32e9ce9-5de2-4441-a5be-c86220c25987'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:10.710303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Allocated IP 172.20.0.2 (d206c128-1214-4a00-88a9-b55bd9495088/45acee7c-b6ac-4229-87d9-35e0e2993229/ff9ee472-d9a0-4ac2-bca4-92685f18cdbc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:10.861069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.866471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.904146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Network d206c128-1214-4a00-88a9-b55bd9495088 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:10.909303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:10.913748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:10.921257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Pushing event updated for resources: {'Port': ['ID=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:10.973766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Attempting to bind port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:10.974126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Attempting to bind port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '045a0946-df8a-4bea-b43b-478b586b10e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:10.974479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Attempting to bind port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc on network d206c128-1214-4a00-88a9-b55bd9495088 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:10.979685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:10.980047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Checking segment: {'id': '045a0946-df8a-4bea-b43b-478b586b10e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:10.980440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:10.980867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Bound using segment: {'id': '045a0946-df8a-4bea-b43b-478b586b10e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:10.981307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Bound port: ff9ee472-d9a0-4ac2-bca4-92685f18cdbc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '045a0946-df8a-4bea-b43b-478b586b10e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 630, 'network_id': 'd206c128-1214-4a00-88a9-b55bd9495088'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:10.981687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.049089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] For port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:11.052426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] For port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,segment=NetworkSegment(045a0946-df8a-4bea-b43b-478b586b10e0),segment_id=045a0946-df8a-4bea-b43b-478b586b10e0)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:11.056666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.124947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90687039-84a0-47a1-b3f3-641a8b09389e None None] Pushing event updated for resources: {'Port': ['ID=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:11.221517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-990d1ca6-d362-4d28-a386-15437a78301d tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.341411 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.api.v2.resource [None req-990d1ca6-d362-4d28-a386-15437a78301d tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 05 15:11:11.342464 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-990d1ca6-d362-4d28-a386-15437a78301d tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "PUT /v2.0/routers/bdb54e25-24d5-4074-94a4-2bcb4085e5ce HTTP/1.1" status: 400 len: 364 time: 0.6664362 Nov 05 15:11:11.348497 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49854) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:11.410929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Deleting subnet d9558ed1-63e1-4b80-8a37-a51d3d8b52eb {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:11:11.414877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.460043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.508824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.567492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.593030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event deleted for resources: {'Subnet': ['ID=d9558ed1-63e1-4b80-8a37-a51d3d8b52eb,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:11.596943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.600050 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e8875aa-4812-497c-8972-2472e65d1418 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "DELETE /v2.0/subnets/d9558ed1-63e1-4b80-8a37-a51d3d8b52eb HTTP/1.1" status: 204 len: 168 time: 0.2505472 Nov 05 15:11:11.602452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49856) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:11.680577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.765880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.786620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d32e9ce9-5de2-4441-a5be-c86220c25987']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:11.803368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '038a6f37-4679-4ddd-88a4-41ee77453542') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:11.803663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '038a6f37-4679-4ddd-88a4-41ee77453542') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:11.817202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.830691 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.836852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:11.837239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:11.840874 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:11.949380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ff9ee472-d9a0-4ac2-bca4-92685f18cdbc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:12.002377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:12.002751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.044281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba35a68e-8b89-421c-9053-a97ba767a5f7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:12.161459 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.163177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e6245cda-4442-4627-a12d-44d5fe880f5e None None] Provisioning complete for port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:12.163527 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e6245cda-4442-4627-a12d-44d5fe880f5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.166540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba35a68e-8b89-421c-9053-a97ba767a5f7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:12.189010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.193150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.196745 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "DELETE /v2.0/networks/d32e9ce9-5de2-4441-a5be-c86220c25987 HTTP/1.1" status: 204 len: 168 time: 0.5933535 Nov 05 15:11:12.199356 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49858) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:12.213522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62cdab5-bfa5-4d42-97bd-c2d7e2bfef4c tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event deleted for resources: {'Network': ['ID=d32e9ce9-5de2-4441-a5be-c86220c25987,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:12.256992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Deleting subnet 45acee7c-b6ac-4229-87d9-35e0e2993229 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:11:12.260217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.279191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,segment=NetworkSegment(045a0946-df8a-4bea-b43b-478b586b10e0),segment_id=045a0946-df8a-4bea-b43b-478b586b10e0)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:12.287313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.302808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.389351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.458305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.492852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.496223 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "DELETE /v2.0/subnets/45acee7c-b6ac-4229-87d9-35e0e2993229 HTTP/1.1" status: 204 len: 168 time: 0.2958717 Nov 05 15:11:12.497367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c44f5fd-6c46-4774-ae31-6a704814d43e tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event deleted for resources: {'Subnet': ['ID=45acee7c-b6ac-4229-87d9-35e0e2993229,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:12.499520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49860) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:12.548350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:12.580990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.640756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Deleting port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:11:12.641087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.656316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2110c712-bc52-440d-9c7d-598029d6b902 None None] Network d32e9ce9-5de2-4441-a5be-c86220c25987 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:12.659505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06d7b1d5-2325-4b06-9b44-36e05b51efa6 None None] Network d206c128-1214-4a00-88a9-b55bd9495088 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:12.702990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] For port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,segment=NetworkSegment(045a0946-df8a-4bea-b43b-478b586b10e0),segment_id=045a0946-df8a-4bea-b43b-478b586b10e0)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:12.703344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.716357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Calling delete_port for ff9ee472-d9a0-4ac2-bca4-92685f18cdbc owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2110c712-bc52-440d-9c7d-598029d6b902 None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:12.717781 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:12.735319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b94f2728-7086-4309-bbd9-1ea49b1283db None None] Network d32e9ce9-5de2-4441-a5be-c86220c25987 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:12.740194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ec5a874-248e-4165-b18c-d246e3e069ae None None] Provisioning complete for port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:12.740584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ec5a874-248e-4165-b18c-d246e3e069ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-b94f2728-7086-4309-bbd9-1ea49b1283db None None] Exception during message handling: AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 233, in get_network_info Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server network.db_obj.subnets] Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'db_obj' Nov 05 15:11:12.764579 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:12.798368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.810540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ec5a874-248e-4165-b18c-d246e3e069ae None None] Could not find standard attr ID for object ff9ee472-d9a0-4ac2-bca4-92685f18cdbc. {{(pid=113582) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 05 15:11:12.814174 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.plugins.ml2.db [None req-1ec5a874-248e-4165-b18c-d246e3e069ae None None] No ports have port_id starting with ff9ee472-d9a0-4ac2-bca4-92685f18cdbc Nov 05 15:11:12.825323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event deleted for resources: {'Port': ['ID=ff9ee472-d9a0-4ac2-bca4-92685f18cdbc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:12.828964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] No DVR routers for this DVR port ff9ee472-d9a0-4ac2-bca4-92685f18cdbc on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:11:12.879993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f3506b5-db3f-45d5-8976-1df36cf9f181 None None] DHCP port deletion for d206c128-1214-4a00-88a9-b55bd9495088 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:11:12.896903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69d2cdc9-eebb-4c99-a859-04851de17cd2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:12.908186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.929141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d206c128-1214-4a00-88a9-b55bd9495088']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:12.938269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '045a0946-df8a-4bea-b43b-478b586b10e0') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:12.938565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '045a0946-df8a-4bea-b43b-478b586b10e0') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:12.952884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.959232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69d2cdc9-eebb-4c99-a859-04851de17cd2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:12.966312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.972315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Releasing vlan 630 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:11:12.972531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:11:12.975384 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:11:13.031878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.038709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.041960 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "DELETE /v2.0/networks/d206c128-1214-4a00-88a9-b55bd9495088 HTTP/1.1" status: 204 len: 168 time: 0.5413835 Nov 05 15:11:13.044726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49862) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:13.054064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d524aa55-3476-4290-b613-7fe444ae93c6 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Pushing event deleted for resources: {'Network': ['ID=d206c128-1214-4a00-88a9-b55bd9495088,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:13.079000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5bfd04d6-86b1-4e1a-9ed6-5f9aae9cd81a tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "GET /v2.0/ports?device_id=bdb54e25-24d5-4074-94a4-2bcb4085e5ce HTTP/1.1" status: 200 len: 205 time: 0.0329430 Nov 05 15:11:13.081368 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49864) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:13.157857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.172635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c3e7145-8542-4f3f-9fbe-ce6c363ec8e6 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:13.231526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c3e7145-8542-4f3f-9fbe-ce6c363ec8e6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:13.317533 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.319728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.364197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.364720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Fanout notify agent at l3_agent the message router_deleted on router bdb54e25-24d5-4074-94a4-2bcb4085e5ce {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:11:13.374081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.375438 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2f91b5b5-f139-4a57-a60e-9ec2c0855415 tempest-RoutersNegativeTest-1465291465 tempest-RoutersNegativeTest-1465291465-project] 10.222.0.30 "DELETE /v2.0/routers/bdb54e25-24d5-4074-94a4-2bcb4085e5ce HTTP/1.1" status: 204 len: 168 time: 0.2931144 Nov 05 15:11:13.611127 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49870) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:13.740067 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8e8f6602-6fb2-4bed-b42e-80ac40fe4fa8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=654cf57e00ff46fdb3d46d2f632a979c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1277986 Nov 05 15:11:13.742474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49874) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:13.787982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.809224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.860387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.864001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:13.865543 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/310537b8-dd8a-4df9-ac96-495aaae95a53 HTTP/1.1" status: 204 len: 168 time: 0.1221642 Nov 05 15:11:13.873542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de2c2a4-5c14-4427-a963-8c7f6ca5283f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=310537b8-dd8a-4df9-ac96-495aaae95a53,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:13.910796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ff9ee472-d9a0-4ac2-bca4-92685f18cdbc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:11:13.931699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: ff9ee472-d9a0-4ac2-bca4-92685f18cdbc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:11:13.932307 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ff9ee472-d9a0-4ac2-bca4-92685f18cdbc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:11:14.467770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49896) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:14.563455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-1442363407-network', 'tenant_id': '639787a250044e489c1c5e4761a79e9d'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:14.584798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Made reservation on behalf of 639787a250044e489c1c5e4761a79e9d for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:14.587034 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.595228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.669292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.672858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.692989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:14.707928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ce10889-4711-4812-a1d1-c6631211d1ac,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:14.710774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.711109 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Added segment cedd125a-f6b4-47e6-951c-3b35c2bfd1b2 of type vlan for network 74e9ee90-a017-4ed4-951e-773bdcbb531e Nov 05 15:11:14.750678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.776018 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.777006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:14.777575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:14.832882 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.3639228 Nov 05 15:11:14.835755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:14.840855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Request body: {'subnet': {'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-subnet', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:14.841704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4756166-d836-4ad8-9d1c-d44ea715c99c admin admin] Pushing event updated for resources: {'Network': ['ID=74e9ee90-a017-4ed4-951e-773bdcbb531e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:14.852163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:14.862284 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Made reservation on behalf of 639787a250044e489c1c5e4761a79e9d for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:14.864631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.030357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.084705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Pushing event updated for resources: {'Subnet': ['ID=c7345b88-3efa-4a07-9d27-c40dc4415ff8,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:15.096500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.096886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.097228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.097567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.097900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.098231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.098563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.098896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.099223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.099548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.099870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.100193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:15.103495 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Checking segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:15.103855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Network hostable DHCP agents. Network: 74e9ee90-a017-4ed4-951e-773bdcbb531e, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:15.120265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:15.129300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 74e9ee90-a017-4ed4-951e-773bdcbb531e) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:15.133140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:15.133735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.140044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-738e6b23-09a1-43a1-b36f-767d67a7d733 None None] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:15.153914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-97d9a429-e09f-4084-9133-ea0361a606cb admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3146591 Nov 05 15:11:15.154106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 49902) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:15.158434 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:15.178519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.179543 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-738e6b23-09a1-43a1-b36f-767d67a7d733 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:15.212127 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:15.221179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be412615-a1d0-4bcf-bf35-8cabba3bddae None None] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:15.234172 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-be412615-a1d0-4bcf-bf35-8cabba3bddae None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:15.294768 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:15.304232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d93844b4-6166-470c-8386-02c062065f4a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:15.370543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d93844b4-6166-470c-8386-02c062065f4a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:15.372140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.568191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.570635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-74e9ee90-a017-4ed4-951e-773bdcbb531e', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:11:15.571519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.586542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.699693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Allocated IP 172.26.5.247 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/aa66057c-a952-4ff9-ba3c-f05afb1af40b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:15.707814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Allocated IP 172.20.0.2 (74e9ee90-a017-4ed4-951e-773bdcbb531e/c7345b88-3efa-4a07-9d27-c40dc4415ff8/c3333108-5691-4c35-9ef7-a6bbefe3e373) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:15.799581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.833524 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.854021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.859927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.875605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:15.878452 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:15.884514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:15.897037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:15.899823 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:15.905300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:15.907960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Pushing event updated for resources: {'Port': ['ID=aa66057c-a952-4ff9-ba3c-f05afb1af40b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:15.915315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Pushing event updated for resources: {'Port': ['ID=c3333108-5691-4c35-9ef7-a6bbefe3e373,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:15.968544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Attempting to bind port c3333108-5691-4c35-9ef7-a6bbefe3e373 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:15.968920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Attempting to bind port c3333108-5691-4c35-9ef7-a6bbefe3e373 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:15.969347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Attempting to bind port c3333108-5691-4c35-9ef7-a6bbefe3e373 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:15.974855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:15.975226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Checking segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:15.975719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:15.976164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Bound using segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:15.976664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Bound port: c3333108-5691-4c35-9ef7-a6bbefe3e373, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:15.977072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:16.042928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] For port c3333108-5691-4c35-9ef7-a6bbefe3e373, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:16.046230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] For port c3333108-5691-4c35-9ef7-a6bbefe3e373, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c3333108-5691-4c35-9ef7-a6bbefe3e373,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:16.050238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:16.110089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fd51902-ee85-4597-af3f-066a33b81d71 None None] Pushing event updated for resources: {'Port': ['ID=c3333108-5691-4c35-9ef7-a6bbefe3e373,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:16.149202 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:16.369558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:16.496557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Router d59131dd-c8e1-4990-87f1-bb7bfba814e6 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:11:16.598021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:11:16.607643 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Sync routers for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:11:16.616018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:16.619037 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:16.619930 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:16.620396 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-10f59be7-f701-46ba-b2f6-fc877a7e632a admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 1.4653282 Nov 05 15:11:16.620645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:16.728079 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:16.915007 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:16Z', 'revision_number': 3, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:16.942450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Checking router: d59131dd-c8e1-4990-87f1-bb7bfba814e6 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:11:16.942793 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Updating router d59131dd-c8e1-4990-87f1-bb7bfba814e6 port aa66057c-a952-4ff9-ba3c-f05afb1af40b binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:11:16.972963 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.014783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fee8e22-045c-4917-8795-67b3f30d443d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:17.062031 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.102963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] Provisioning complete for port c3333108-5691-4c35-9ef7-a6bbefe3e373 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:17.103329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.106260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fee8e22-045c-4917-8795-67b3f30d443d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:17.237081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.244644 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.268377 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Allocated IP 172.20.0.1 (74e9ee90-a017-4ed4-951e-773bdcbb531e/c7345b88-3efa-4a07-9d27-c40dc4415ff8/1affecfb-2843-4e8e-966a-2a0a24607c03) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:17.270406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.295672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Attempting to bind port aa66057c-a952-4ff9-ba3c-f05afb1af40b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:17.296128 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Attempting to bind port aa66057c-a952-4ff9-ba3c-f05afb1af40b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:17.296584 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Attempting to bind port aa66057c-a952-4ff9-ba3c-f05afb1af40b on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:17.306362 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:17.306839 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:17.307804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.307804 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:17.308216 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Bound port: aa66057c-a952-4ff9-ba3c-f05afb1af40b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:17.308663 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.310244 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Pushing event updated for resources: {'Port': ['ID=aa66057c-a952-4ff9-ba3c-f05afb1af40b,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:17.332326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] For port c3333108-5691-4c35-9ef7-a6bbefe3e373, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c3333108-5691-4c35-9ef7-a6bbefe3e373,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:17.333298 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.333739 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.334202 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.334621 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.335078 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.335496 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.335914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.336320 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.336760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.337158 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.337577 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.337942 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:11:17.338731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.386735 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] For port aa66057c-a952-4ff9-ba3c-f05afb1af40b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:17.391092 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] For port aa66057c-a952-4ff9-ba3c-f05afb1af40b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aa66057c-a952-4ff9-ba3c-f05afb1af40b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:17.396904 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.398690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.426366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79befd8e-ffb2-4b31-9bc1-738cc2956f5b None None] Pushing event updated for resources: {'Port': ['ID=c3333108-5691-4c35-9ef7-a6bbefe3e373,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:17.442278 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.459330 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:17.459976 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:17.463272 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b02772-fd7c-4c92-9fe7-507b29683f0b None None] Pushing event updated for resources: {'Port': ['ID=aa66057c-a952-4ff9-ba3c-f05afb1af40b,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:17.477811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:17.480836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:17.484254 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:17.535539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Pushing event updated for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:17.538067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.575775 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:17.676915 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.761077 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:16Z', 'revision_number': 3, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:17.792621 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f93383dd-144d-4e54-96ed-1ea6b54134ca None None] The sync data for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv is: [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:16Z', 'revision_number': 3, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:11:17.851570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.856929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.922895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Pushing event updated for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:17.942384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:17.957804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c3333108-5691-4c35-9ef7-a6bbefe3e373 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:18.017436 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c3333108-5691-4c35-9ef7-a6bbefe3e373 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:18.019488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.069197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:18.075982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:18.106372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-071a7af0-8297-4db9-a1de-4eb62ddcde28 None None] Provisioning complete for port c3333108-5691-4c35-9ef7-a6bbefe3e373 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:18.106742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-071a7af0-8297-4db9-a1de-4eb62ddcde28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.227296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Router d59131dd-c8e1-4990-87f1-bb7bfba814e6 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:11:18.346195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:11:18.358896 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c20498a9-d5b3-46ae-bd00-9962f2d88991 admin admin] 10.222.0.30 "PUT /v2.0/routers/d59131dd-c8e1-4990-87f1-bb7bfba814e6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7298160 Nov 05 15:11:18.359861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-63095452-37e2-463b-bc14-cf5895e63eec None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:18.359861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-63095452-37e2-463b-bc14-cf5895e63eec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.407516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-63095452-37e2-463b-bc14-cf5895e63eec None None] Port 1affecfb-2843-4e8e-966a-2a0a24607c03 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:11:18.415636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.527521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-263b9e3e-1ca6-4d0f-93b5-d41416a05a54 None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:18.527740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-263b9e3e-1ca6-4d0f-93b5-d41416a05a54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.563678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-263b9e3e-1ca6-4d0f-93b5-d41416a05a54 None None] Port 1affecfb-2843-4e8e-966a-2a0a24607c03 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:11:18.858836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49920) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:18.864496 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-580795048-network', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:18.884150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Made reservation on behalf of 2e0e70eab23846ceab305301ccfda74d for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:18.886426 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.895025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.969910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.974169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:18.998702 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 607} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:11:19.013430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=743f36e4-1be0-4a05-9bb4-2f3fb157a4ad,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:19.017276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.017618 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Added segment 1a7c4d43-c06f-481f-bec0-5ab0278a8446 of type vlan for network 5753a979-e4f9-47e3-b8fb-76f326956171 Nov 05 15:11:19.057088 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.080440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.081858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:19.082443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.137501 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.2775121 Nov 05 15:11:19.140046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49922) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:19.147061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Request body: {'subnet': {'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-subnet', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:19.151386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa0b9f2-da50-4dde-a20c-8f8b9df657a4 admin admin] Pushing event updated for resources: {'Network': ['ID=5753a979-e4f9-47e3-b8fb-76f326956171,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:19.165019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 5753a979-e4f9-47e3-b8fb-76f326956171 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:11:19.171992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Made reservation on behalf of 2e0e70eab23846ceab305301ccfda74d for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:19.174434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.341423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.394964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3f84a153-16ef-483c-ab51-fdcbe7e0bd3c,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:19.405017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Checking segment: {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:19.405369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Network hostable DHCP agents. Network: 5753a979-e4f9-47e3-b8fb-76f326956171, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:11:19.423714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Network 5753a979-e4f9-47e3-b8fb-76f326956171 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:11:19.433282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 5753a979-e4f9-47e3-b8fb-76f326956171) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:19.441557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:19.441993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.443205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Sync routers for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:11:19.449389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f9bab24-7c30-4c0c-9c4f-9351f39c2f42 None None] Network 5753a979-e4f9-47e3-b8fb-76f326956171 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:19.458143 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-94e99607-bf31-4ff5-aa8d-5fb225f2aa01 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3170786 Nov 05 15:11:19.460667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49924) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:19.464790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:19.484783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.485770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.500585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:19.501471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:19.542156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.683841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-8f9bab24-7c30-4c0c-9c4f-9351f39c2f42 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:19.760170 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:19.773193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc24fd8f-9d7a-407a-ac98-3ff6d6623546 None None] Network 5753a979-e4f9-47e3-b8fb-76f326956171 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:11:19.823133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-dc24fd8f-9d7a-407a-ac98-3ff6d6623546 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:11:19.933709 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:11:19.963945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec1d685c-10bd-46d1-922a-bc53b28f6a0f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:19.965743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aa66057c-a952-4ff9-ba3c-f05afb1af40b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:20.156693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec1d685c-10bd-46d1-922a-bc53b28f6a0f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:20.161458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port aa66057c-a952-4ff9-ba3c-f05afb1af40b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:20.161832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.166105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79dba056-bae5-4448-8148-2bd0211ac2f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.210996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.230615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.270146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 4, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1affecfb-2843-4e8e-966a-2a0a24607c03', 'name': '', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'mac_address': 'fa:16:3e:cc:c2:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 1608, 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:17Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 2, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'subnets': [{'id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:20.308930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Checking router: d59131dd-c8e1-4990-87f1-bb7bfba814e6 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:11:20.309287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Updating router d59131dd-c8e1-4990-87f1-bb7bfba814e6 port 1affecfb-2843-4e8e-966a-2a0a24607c03 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:11:20.334507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Allocated IP 172.26.5.239 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/577192df-4850-441f-9157-cfeb705e8fda) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:20.372240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.393811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.436717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.451212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port aa66057c-a952-4ff9-ba3c-f05afb1af40b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aa66057c-a952-4ff9-ba3c-f05afb1af40b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:20.458572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.472953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.516854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:20.522259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:20.524971 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:20.550676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Pushing event updated for resources: {'Port': ['ID=577192df-4850-441f-9157-cfeb705e8fda,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:20.598979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=aa66057c-a952-4ff9-ba3c-f05afb1af40b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:20.724020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-5753a979-e4f9-47e3-b8fb-76f326956171', 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'fixed_ips': [{'subnet_id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:11:20.725045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.776743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.897401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.906717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:20.946853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Allocated IP 172.20.0.2 (5753a979-e4f9-47e3-b8fb-76f326956171/3f84a153-16ef-483c-ab51-fdcbe7e0bd3c/83a0c699-3bc6-46e5-b5ed-78201f36e954) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:20.974991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.034144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f16f5a-17b4-459c-a593-c58c99b6b14c None None] Pushing event updated for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:21.082975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Attempting to bind port 1affecfb-2843-4e8e-966a-2a0a24607c03 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:21.083345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Attempting to bind port 1affecfb-2843-4e8e-966a-2a0a24607c03 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:21.083710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Attempting to bind port 1affecfb-2843-4e8e-966a-2a0a24607c03 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:21.096678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:21.097052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Checking segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:21.097450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.098025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Bound using segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:21.098499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Bound port: 1affecfb-2843-4e8e-966a-2a0a24607c03, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:21.099015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.102821 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Router de99d5c2-da2a-426c-8635-0cdcad74e2aa is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:11:21.210249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.210948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:11:21.215712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] For port 1affecfb-2843-4e8e-966a-2a0a24607c03, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:21.219486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] For port 1affecfb-2843-4e8e-966a-2a0a24607c03, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1affecfb-2843-4e8e-966a-2a0a24607c03,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:21.220828 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Sync routers for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:11:21.221296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.229396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.230629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.230765 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-bc67eb9d-2b57-409e-9581-ba36edb04a39 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 1.7690787 Nov 05 15:11:21.233056 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:21.233547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 49926) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:11:21.233966 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:21.269184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Network 5753a979-e4f9-47e3-b8fb-76f326956171 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:21.277783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:21.284828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:21.296984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Pushing event updated for resources: {'Port': ['ID=83a0c699-3bc6-46e5-b5ed-78201f36e954,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:21.299111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:21.299727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:21.350421 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:21.429444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Attempting to bind port 83a0c699-3bc6-46e5-b5ed-78201f36e954 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:21.429817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Attempting to bind port 83a0c699-3bc6-46e5-b5ed-78201f36e954 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:21.430176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Attempting to bind port 83a0c699-3bc6-46e5-b5ed-78201f36e954 on network 5753a979-e4f9-47e3-b8fb-76f326956171 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:21.473296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:21.473753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Checking segment: {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:21.474091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.474492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Bound using segment: {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:21.474976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Bound port: 83a0c699-3bc6-46e5-b5ed-78201f36e954, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:21.475360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.481195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74f16f5a-17b4-459c-a593-c58c99b6b14c None None] Pushing event updated for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:21.519840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:21.618213 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 3, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:21.644966 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Checking router: de99d5c2-da2a-426c-8635-0cdcad74e2aa for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:11:21.645307 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Updating router de99d5c2-da2a-426c-8635-0cdcad74e2aa port 577192df-4850-441f-9157-cfeb705e8fda binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:11:21.672502 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.686165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.696818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] For port 83a0c699-3bc6-46e5-b5ed-78201f36e954, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:21.701376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] For port 83a0c699-3bc6-46e5-b5ed-78201f36e954, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83a0c699-3bc6-46e5-b5ed-78201f36e954,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:21.710559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.809078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cfdca3-2d63-4f02-824e-06f29fb3ba93 None None] Pushing event updated for resources: {'Port': ['ID=83a0c699-3bc6-46e5-b5ed-78201f36e954,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:21.837327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 4, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1affecfb-2843-4e8e-966a-2a0a24607c03', 'name': '', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'mac_address': 'fa:16:3e:cc:c2:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 1608, 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:17Z', 'updated_at': '2021-11-05T15:11:21Z', 'revision_number': 4, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'subnets': [{'id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:21.866556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af5c6f1c-63e5-477e-92ac-bc0e007fcd73 None None] The sync data for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv is: [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:17Z', 'revision_number': 4, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '1affecfb-2843-4e8e-966a-2a0a24607c03', 'name': '', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'mac_address': 'fa:16:3e:cc:c2:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 1608, 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:17Z', 'updated_at': '2021-11-05T15:11:21Z', 'revision_number': 4, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'subnets': [{'id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:11:21.892835 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Allocated IP 172.20.0.1 (5753a979-e4f9-47e3-b8fb-76f326956171/3f84a153-16ef-483c-ab51-fdcbe7e0bd3c/cf78235b-0a22-4416-a5e0-3aa3cef1a526) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:21.958276 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.963037 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:21.976231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aa66057c-a952-4ff9-ba3c-f05afb1af40b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:22.009898 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ef7b86-5044-46e1-9e5f-881985e4c064 None None] Pushing event updated for resources: {'Port': ['ID=577192df-4850-441f-9157-cfeb705e8fda,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:22.032548 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Attempting to bind port 577192df-4850-441f-9157-cfeb705e8fda on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:22.033025 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Attempting to bind port 577192df-4850-441f-9157-cfeb705e8fda by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:22.033484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Attempting to bind port 577192df-4850-441f-9157-cfeb705e8fda on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:22.040299 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:22.040988 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:22.041270 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.041675 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:22.042120 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Bound port: 577192df-4850-441f-9157-cfeb705e8fda, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:22.042490 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.062420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port aa66057c-a952-4ff9-ba3c-f05afb1af40b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:22.062900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.107531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.116082 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] For port 577192df-4850-441f-9157-cfeb705e8fda, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:22.116082 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] For port 577192df-4850-441f-9157-cfeb705e8fda, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=577192df-4850-441f-9157-cfeb705e8fda,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:22.122443 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.158908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.215129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Network 5753a979-e4f9-47e3-b8fb-76f326956171 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:22.215817 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:22.218172 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:10:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:22.222996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:22.228292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:22.231761 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Pushing event updated for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:22.294226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.375227 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:22.443973 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ef7b86-5044-46e1-9e5f-881985e4c064 None None] Pushing event updated for resources: {'Port': ['ID=577192df-4850-441f-9157-cfeb705e8fda,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:22.452410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.479438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6d2c39b8-7c20-4cb2-8fad-f4ff169431f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.605134 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 3, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:22.640806 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39bb9d12-bb3a-4c0d-9bbb-2cdee62e54a5 None None] The sync data for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv is: [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 3, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:11:22.664806 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.670647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.750234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:22.752239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Pushing event updated for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:22.877962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Network 5753a979-e4f9-47e3-b8fb-76f326956171 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:22.879764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:23.016502 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Router de99d5c2-da2a-426c-8635-0cdcad74e2aa has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:11:23.147157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:11:23.152024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5301708f-60c9-4c58-aad0-c9abc4004d61 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:11:23.161202 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cec76db1-e39c-4754-9d34-d44a67c78b02 admin admin] 10.222.0.30 "PUT /v2.0/routers/de99d5c2-da2a-426c-8635-0cdcad74e2aa/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9261720 Nov 05 15:11:23.247801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5301708f-60c9-4c58-aad0-c9abc4004d61 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:11:23.250606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] Provisioning complete for port 83a0c699-3bc6-46e5-b5ed-78201f36e954 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:23.250973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:23.436358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:23.524792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] For port 83a0c699-3bc6-46e5-b5ed-78201f36e954, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83a0c699-3bc6-46e5-b5ed-78201f36e954,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:23.529857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:23.532171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:23.628749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be960e33-7028-429b-80d1-7087c018d6c2 None None] Pushing event updated for resources: {'Port': ['ID=83a0c699-3bc6-46e5-b5ed-78201f36e954,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:24.031024 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1affecfb-2843-4e8e-966a-2a0a24607c03 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:24.094431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.094806 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.178721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.212270 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c74e765f-928f-4c5f-b5d9-67072040d53e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:24.213865 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c74e765f-928f-4c5f-b5d9-67072040d53e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 817 time: 0.1179636 Nov 05 15:11:24.222553 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 1affecfb-2843-4e8e-966a-2a0a24607c03, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1affecfb-2843-4e8e-966a-2a0a24607c03,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:24.230023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.231020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83a0c699-3bc6-46e5-b5ed-78201f36e954 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:24.231195 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-4767374b-42d5-4e0b-8902-2072fbbb4fde tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/quotas/639787a250044e489c1c5e4761a79e9d HTTP/1.1" status: 200 len: 375 time: 0.0115411 Nov 05 15:11:24.301168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-43660779-9502-4aa1-a5da-5ab5092b874d tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0560641 Nov 05 15:11:24.320117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6bcdd927-9f04-404b-8729-73141af8a708 None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.320576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bcdd927-9f04-404b-8729-73141af8a708 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.322126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:24.372016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 83a0c699-3bc6-46e5-b5ed-78201f36e954 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.372505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.374262 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-6bcdd927-9f04-404b-8729-73141af8a708 None None] Port cf78235b-0a22-4416-a5e0-3aa3cef1a526 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:11:24.414656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6bcdd927-9f04-404b-8729-73141af8a708 None None] Provisioning complete for port 83a0c699-3bc6-46e5-b5ed-78201f36e954 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.415132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6bcdd927-9f04-404b-8729-73141af8a708 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.423167 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-d4d4c212-7d13-4958-bbe4-6285e5e8853a service neutron] 10.222.0.30 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1194284 Nov 05 15:11:24.497207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 577192df-4850-441f-9157-cfeb705e8fda up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:24.538674 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-bdc1761a-7252-4aa4-a439-afba9e099bcd service neutron] 10.222.0.30 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1145904 Nov 05 15:11:24.586863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 577192df-4850-441f-9157-cfeb705e8fda triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.587419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.675114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.712929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 577192df-4850-441f-9157-cfeb705e8fda, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=577192df-4850-441f-9157-cfeb705e8fda,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:24.723607 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.730070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-89126669-47c2-472d-bc88-21b2780f6083 None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.730070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-89126669-47c2-472d-bc88-21b2780f6083 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.782019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e1584138-c5ba-4766-afb8-2d99351357f8 req-78674ecb-c817-4da8-bdf0-31e9941423f0 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 210 time: 0.0486202 Nov 05 15:11:24.823776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-89126669-47c2-472d-bc88-21b2780f6083 None None] Port cf78235b-0a22-4416-a5e0-3aa3cef1a526 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:11:24.831099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=577192df-4850-441f-9157-cfeb705e8fda,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:24.843932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-89126669-47c2-472d-bc88-21b2780f6083 None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:24.844187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-89126669-47c2-472d-bc88-21b2780f6083 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:24.950289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.052395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7749d230-e222-400e-91dc-a6053f9ec348 None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:25.052967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7749d230-e222-400e-91dc-a6053f9ec348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.088939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7749d230-e222-400e-91dc-a6053f9ec348 None None] Port cf78235b-0a22-4416-a5e0-3aa3cef1a526 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:11:25.099009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7749d230-e222-400e-91dc-a6053f9ec348 None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:25.099381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7749d230-e222-400e-91dc-a6053f9ec348 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.211412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Sync routers for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:11:25.221242 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:25.222403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:11:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:25.329469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:25.529095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 4, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'cf78235b-0a22-4416-a5e0-3aa3cef1a526', 'name': '', 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'mac_address': 'fa:16:3e:97:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1620, 'fixed_ips': [{'subnet_id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:21Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 2, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'subnets': [{'id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:25.554776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Checking router: de99d5c2-da2a-426c-8635-0cdcad74e2aa for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:11:25.555127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Updating router de99d5c2-da2a-426c-8635-0cdcad74e2aa port cf78235b-0a22-4416-a5e0-3aa3cef1a526 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:11:25.584552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.743761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c45f6dfa-2350-403b-9718-c1255d8f6873 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:25.745359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c45f6dfa-2350-403b-9718-c1255d8f6873 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 817 time: 0.1208858 Nov 05 15:11:25.759844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Request body: {'port': {'device_id': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'admin_state_up': True, 'tenant_id': '639787a250044e489c1c5e4761a79e9d'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:25.865934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.871928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.879618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-adeca6d7-d601-4fd6-b4ea-15748650a832 req-89593b97-2702-43d3-a312-750697f5abfe tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 210 time: 0.0302613 Nov 05 15:11:25.918478 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Made reservation on behalf of 639787a250044e489c1c5e4761a79e9d for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:11:25.922965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:25.954226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 577192df-4850-441f-9157-cfeb705e8fda up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:25.975970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40dcd6e0-3e90-4d3a-a2ba-216f27ad9929 None None] Pushing event updated for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:26.024756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Attempting to bind port cf78235b-0a22-4416-a5e0-3aa3cef1a526 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:26.025006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Attempting to bind port cf78235b-0a22-4416-a5e0-3aa3cef1a526 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:26.025469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Attempting to bind port cf78235b-0a22-4416-a5e0-3aa3cef1a526 on network 5753a979-e4f9-47e3-b8fb-76f326956171 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:26.035108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.041834 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:26.042214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Checking segment: {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:26.042620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.043020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Bound using segment: {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:26.043494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Bound port: cf78235b-0a22-4416-a5e0-3aa3cef1a526, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a7c4d43-c06f-481f-bec0-5ab0278a8446', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 607, 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:26.043877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.069636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Allocated IP 172.20.0.9 (74e9ee90-a017-4ed4-951e-773bdcbb531e/c7345b88-3efa-4a07-9d27-c40dc4415ff8/857d60b7-2d7a-4170-b21d-9cb0afa0e617) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:11:26.093490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 577192df-4850-441f-9157-cfeb705e8fda triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:26.093865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.154066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] For port cf78235b-0a22-4416-a5e0-3aa3cef1a526, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:26.158075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] For port cf78235b-0a22-4416-a5e0-3aa3cef1a526, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cf78235b-0a22-4416-a5e0-3aa3cef1a526,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:26.165018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.226280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.262686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.271961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:11:26.272628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:11:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:26.312203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:11:26.313354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1affecfb-2843-4e8e-966a-2a0a24607c03 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:26.316319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:11:26.320103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40dcd6e0-3e90-4d3a-a2ba-216f27ad9929 None None] Pushing event updated for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:26.321079 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:11:26.325674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Pushing event updated for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:26.350770 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:26.351148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.374599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:26.375353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.395422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-46a2dbe4-d928-409e-8625-36c5598fbe36 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6403997 Nov 05 15:11:26.409758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Request body: {'port': {'device_id': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:11:26.482271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.621960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:11:26.655917 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 1affecfb-2843-4e8e-966a-2a0a24607c03 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:26.656296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.746193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 857d60b7-2d7a-4170-b21d-9cb0afa0e617 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:11:26.753618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.765735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Transition to ACTIVE for port object 857d60b7-2d7a-4170-b21d-9cb0afa0e617 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:11:26.769514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.803281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:26.903168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] For port cf78235b-0a22-4416-a5e0-3aa3cef1a526, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cf78235b-0a22-4416-a5e0-3aa3cef1a526,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:26.915425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.002101 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7722e41c-e02f-40bc-a30d-ca74609d7cd1 None None] Pushing event updated for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:27.042359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e438b1ae-ef13-484c-ad58-75e01e3ff576 req-0e9507f0-99cb-4825-aa67-007b97346300 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.043915 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e438b1ae-ef13-484c-ad58-75e01e3ff576 req-0e9507f0-99cb-4825-aa67-007b97346300 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 943 time: 0.0659845 Nov 05 15:11:27.048080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 4, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'cf78235b-0a22-4416-a5e0-3aa3cef1a526', 'name': '', 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'mac_address': 'fa:16:3e:97:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1620, 'fixed_ips': [{'subnet_id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:21Z', 'updated_at': '2021-11-05T15:11:26Z', 'revision_number': 4, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'subnets': [{'id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:11:27.077243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e0ebe0cf-1c78-43ed-8223-afa93669106f None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:27.077544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0ebe0cf-1c78-43ed-8223-afa93669106f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.080497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f45686-af8f-4de7-8c3f-3e230ab0bcfa None None] The sync data for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv is: [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:11:22Z', 'revision_number': 4, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'cf78235b-0a22-4416-a5e0-3aa3cef1a526', 'name': '', 'network_id': '5753a979-e4f9-47e3-b8fb-76f326956171', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'mac_address': 'fa:16:3e:97:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 1620, 'fixed_ips': [{'subnet_id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:21Z', 'updated_at': '2021-11-05T15:11:26Z', 'revision_number': 4, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'subnets': [{'id': '3f84a153-16ef-483c-ab51-fdcbe7e0bd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:11:27.098163 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e438b1ae-ef13-484c-ad58-75e01e3ff576 req-1d312410-f698-4f22-83d1-04997d2ef341 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472078 Nov 05 15:11:27.165611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Pushing event updated for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:27.225266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Attempting to bind port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:11:27.225803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Attempting to bind port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:11:27.226137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Attempting to bind port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:27.230596 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:11:27.230912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Attempting to bind port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:11:27.236002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:11:27.236338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Checking segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:11:27.237289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Bound using segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:11:27.237725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Bound port: 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:11:27.238076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.302978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:11:27.305993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:11:27.312076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.347340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.348076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.349438 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] 10.222.0.32 "PUT /v2.0/ports/857d60b7-2d7a-4170-b21d-9cb0afa0e617 HTTP/1.1" status: 200 len: 1093 time: 0.9455853 Nov 05 15:11:27.349882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:11:27.352156 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-09504264-b946-446b-9e8f-29b1a558168f" -d '{"events": [{"name": "network-changed", "server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:11:27.377327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c34b4b94-9966-4721-aef3-db4ff31486b3 service neutron] Pushing event updated for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:27.432126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:11:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35e0fc2e-c783-4f86-a1a9-67229f4ec7c1 x-openstack-request-id: req-35e0fc2e-c783-4f86-a1a9-67229f4ec7c1 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:11:27.432580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:11:27.433021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-35e0fc2e-c783-4f86-a1a9-67229f4ec7c1 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:11:27.433595 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617', 'status': 'completed', 'code': 200} Nov 05 15:11:27.451793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-101e5eca-bb4f-44ce-bf5d-6c99678a4319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.453379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-101e5eca-bb4f-44ce-bf5d-6c99678a4319 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 1096 time: 0.0556698 Nov 05 15:11:27.510844 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-84d57da4-7a50-4ff2-b266-d46d30c87049 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617 HTTP/1.1" status: 200 len: 217 time: 0.0490015 Nov 05 15:11:27.564403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-2ac0a80e-c2e5-435b-9092-ae2f09fdf4c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.565984 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-2ac0a80e-c2e5-435b-9092-ae2f09fdf4c1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 200 len: 856 time: 0.0480905 Nov 05 15:11:27.617256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-4bcf5b06-9e43-43d5-9bcd-445b1912ad01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.618774 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-4bcf5b06-9e43-43d5-9bcd-445b1912ad01 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=74e9ee90-a017-4ed4-951e-773bdcbb531e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0461552 Nov 05 15:11:27.712388 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-18a4245a-1e4f-4073-8e74-63d00c2d39a8 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851264 Nov 05 15:11:27.806128 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9a5430b-24ae-4047-b1a8-b4cb242a82c6 req-819113c0-616c-41a8-b429-d324c840ea09 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862701 Nov 05 15:11:27.890519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09504264-b946-446b-9e8f-29b1a558168f req-2a60cf66-0a79-48a0-b988-888272542986 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.892184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-2a60cf66-0a79-48a0-b988-888272542986 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 1096 time: 0.0427887 Nov 05 15:11:27.935474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cf78235b-0a22-4416-a5e0-3aa3cef1a526 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:27.982879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port cf78235b-0a22-4416-a5e0-3aa3cef1a526 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:27.983126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09504264-b946-446b-9e8f-29b1a558168f req-27bdee6d-2e19-452a-9dde-fc52b3e17cc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:27.983255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:27.984567 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-27bdee6d-2e19-452a-9dde-fc52b3e17cc0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 918 time: 0.0856168 Nov 05 15:11:28.031133 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-b6127d52-eb89-42ed-866f-4ced84e25f51 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617 HTTP/1.1" status: 200 len: 217 time: 0.0387409 Nov 05 15:11:28.079546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09504264-b946-446b-9e8f-29b1a558168f req-606624ef-e9bc-41f8-9d45-e7fc9f22b5a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:28.081542 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-606624ef-e9bc-41f8-9d45-e7fc9f22b5a8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 200 len: 856 time: 0.0429144 Nov 05 15:11:28.126723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09504264-b946-446b-9e8f-29b1a558168f req-1ef78944-f564-4f68-9543-d64e99f934b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:28.128168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-1ef78944-f564-4f68-9543-d64e99f934b5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=74e9ee90-a017-4ed4-951e-773bdcbb531e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388353 Nov 05 15:11:28.219936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b3aafc-9794-4d15-b203-1fc03d6d9921 req-8e07e398-9984-4e73-9f36-6b25cd2d1516 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:28.222022 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7b3aafc-9794-4d15-b203-1fc03d6d9921 req-8e07e398-9984-4e73-9f36-6b25cd2d1516 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 943 time: 0.0499456 Nov 05 15:11:28.222358 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-3c185773-a913-4369-b9b6-719b344175bd service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856686 Nov 05 15:11:28.272385 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c7b3aafc-9794-4d15-b203-1fc03d6d9921 req-6f911f27-5df0-49b1-934f-689e2305b2fd tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443981 Nov 05 15:11:28.309914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-09504264-b946-446b-9e8f-29b1a558168f req-696fa528-8630-49a9-89fd-ee6a7a087666 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809796 Nov 05 15:11:29.273696 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 857d60b7-2d7a-4170-b21d-9cb0afa0e617 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:11:29.367893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:29.379306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '857d60b7-2d7a-4170-b21d-9cb0afa0e617', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'port_id': '857d60b7-2d7a-4170-b21d-9cb0afa0e617', 'mac_address': 'fa:16:3e:b2:43:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 620, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:11:29.392186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebe0e5f-ec3f-4119-95c8-16eeab59c93e req-ad7a37b6-b01f-481f-8d55-59fad4c58bae tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:29.393781 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cebe0e5f-ec3f-4119-95c8-16eeab59c93e req-ad7a37b6-b01f-481f-8d55-59fad4c58bae tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 943 time: 0.0540690 Nov 05 15:11:29.416219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:29.432570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 857d60b7-2d7a-4170-b21d-9cb0afa0e617 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:11:29.441384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cebe0e5f-ec3f-4119-95c8-16eeab59c93e req-a3f678fb-b150-496c-a606-c5f638811973 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415390 Nov 05 15:11:29.451897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:29.460910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:29.507562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:29.657299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['857d60b7-2d7a-4170-b21d-9cb0afa0e617'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:11:30.555580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45358bd7-5b19-4bb2-882c-e6a68933d085 req-04646a27-4747-4682-9da3-d57e8c741cb8 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:30.557071 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-45358bd7-5b19-4bb2-882c-e6a68933d085 req-04646a27-4747-4682-9da3-d57e8c741cb8 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 944 time: 0.0492072 Nov 05 15:11:30.606251 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-45358bd7-5b19-4bb2-882c-e6a68933d085 req-290a2509-6bfc-447f-b6c0-215a8663cfe0 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434315 Nov 05 15:11:31.286962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 857d60b7-2d7a-4170-b21d-9cb0afa0e617 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:11:31.335114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:11:31.339084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:11:31.339458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:31.415976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:31.440805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:11:31.443060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5243cd0-72cf-4235-a290-2480ccfd3b82" -d '{"events": [{"server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "name": "network-vif-plugged", "status": "completed", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:11:31.455167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:31.459406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:31.488936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:11:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b452fd30-d13a-4f27-b6b7-2391f32e6693 x-openstack-request-id: req-b452fd30-d13a-4f27-b6b7-2391f32e6693 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:11:31.489884 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "name": "network-vif-plugged", "status": "completed", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:11:31.490198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b452fd30-d13a-4f27-b6b7-2391f32e6693 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:11:31.490766 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617', 'code': 200} Nov 05 15:11:31.517440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:31.649331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc7d936-22aa-4c80-8f66-271deedd3ccb req-76eb2c82-cd32-43cd-a9e9-3f2b8db51a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:31.651352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddc7d936-22aa-4c80-8f66-271deedd3ccb req-76eb2c82-cd32-43cd-a9e9-3f2b8db51a1b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 1098 time: 0.0410807 Nov 05 15:11:31.697912 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddc7d936-22aa-4c80-8f66-271deedd3ccb req-8eae4ba1-4ab5-4e76-ae84-f8776521c8fe service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381126 Nov 05 15:11:31.724012 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32e9e5a-3373-42ea-bc82-eafa26058526 req-983c014e-f9d6-485f-b6d5-7bbf6ab13c86 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:31.725731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32e9e5a-3373-42ea-bc82-eafa26058526 req-983c014e-f9d6-485f-b6d5-7bbf6ab13c86 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0517364 Nov 05 15:11:31.772867 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f32e9e5a-3373-42ea-bc82-eafa26058526 req-a2bd727b-bbbc-4b44-8b91-40b7ade641ee tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413263 Nov 05 15:11:32.889028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed59345d-8d31-413c-886c-7ebdd0ce71a7 req-fe1fc218-a404-4743-8f6b-3e27d6b17b1a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:32.890486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed59345d-8d31-413c-886c-7ebdd0ce71a7 req-fe1fc218-a404-4743-8f6b-3e27d6b17b1a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0478911 Nov 05 15:11:32.940357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed59345d-8d31-413c-886c-7ebdd0ce71a7 req-1d815086-8790-4a3b-b23c-e91f56839e3a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440304 Nov 05 15:11:33.056281 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db441a0-5f57-407f-bb83-bcb85778437e req-db327440-a423-40a9-b39f-740bc9524b4f tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:33.057700 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5db441a0-5f57-407f-bb83-bcb85778437e req-db327440-a423-40a9-b39f-740bc9524b4f tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0526016 Nov 05 15:11:33.103259 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5db441a0-5f57-407f-bb83-bcb85778437e req-2199b718-e932-4504-9b2c-bcbe44ecdf7c tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396216 Nov 05 15:11:43.539613 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:11:48.421491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:50.118429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-072488a6-e173-4f50-b4fd-704eede157be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:52.443628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-727b2aae-0906-4372-933f-570a8b8aead9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:53.492081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:54.950443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:55.968019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:56.040363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98929286-a25c-4487-987b-655feacf80e0 req-326da28d-6d54-458f-a735-864d403ff2af tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:56.041803 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-98929286-a25c-4487-987b-655feacf80e0 req-326da28d-6d54-458f-a735-864d403ff2af tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0519345 Nov 05 15:11:56.089062 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-98929286-a25c-4487-987b-655feacf80e0 req-b6fd26de-1d8e-4c8c-ac9f-76ebfd7a1b2e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411894 Nov 05 15:11:57.204051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2187e44f-bf27-452a-b07e-08989b3759d6 req-8409101b-51b1-4d1f-bf27-a6996c168c9e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:57.205558 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2187e44f-bf27-452a-b07e-08989b3759d6 req-8409101b-51b1-4d1f-bf27-a6996c168c9e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0481420 Nov 05 15:11:57.252264 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2187e44f-bf27-452a-b07e-08989b3759d6 req-b5af17e0-948f-4e7a-a2cd-f5120aa4af25 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408511 Nov 05 15:11:57.661643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2491a99f-92c7-413f-a509-1a8403d89281 req-0fe0333c-cb14-4d8b-85e1-b3d2fd69358a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:11:57.663099 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2491a99f-92c7-413f-a509-1a8403d89281 req-0fe0333c-cb14-4d8b-85e1-b3d2fd69358a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 945 time: 0.0506251 Nov 05 15:11:57.753819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Deleting port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:11:57.754067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:57.837739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] For port 857d60b7-2d7a-4170-b21d-9cb0afa0e617, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=857d60b7-2d7a-4170-b21d-9cb0afa0e617,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:11:57.838089 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:57.850487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Calling delete_port for 857d60b7-2d7a-4170-b21d-9cb0afa0e617 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:11:57.976690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:57.989016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['857d60b7-2d7a-4170-b21d-9cb0afa0e617'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:11:58.005476 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Pushing event deleted for resources: {'Port': ['ID=857d60b7-2d7a-4170-b21d-9cb0afa0e617,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:11:58.049505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] No DVR routers for this DVR port 857d60b7-2d7a-4170-b21d-9cb0afa0e617 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:11:58.052325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:11:58.055577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2491a99f-92c7-413f-a509-1a8403d89281 req-ba2c01af-f79b-4457-ae56-f5341b6d1fb2 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "DELETE /v2.0/ports/857d60b7-2d7a-4170-b21d-9cb0afa0e617 HTTP/1.1" status: 204 len: 173 time: 0.3863845 Nov 05 15:11:58.056076 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'name': 'network-vif-deleted', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:11:58.058384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-655b74a9-43bb-4a58-aa64-c1a328f6ed1c" -d '{"events": [{"server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "name": "network-vif-deleted", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:11:58.094611 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:11:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd684a3a-e81c-4b26-9c86-f319fbc88704 x-openstack-request-id: req-bd684a3a-e81c-4b26-9c86-f319fbc88704 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:11:58.094900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65ba40f8-d715-4fca-ae68-7b8160ab0754", "name": "network-vif-deleted", "tag": "857d60b7-2d7a-4170-b21d-9cb0afa0e617", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:11:58.095195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bd684a3a-e81c-4b26-9c86-f319fbc88704 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:11:58.095575 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65ba40f8-d715-4fca-ae68-7b8160ab0754', 'name': 'network-vif-deleted', 'tag': '857d60b7-2d7a-4170-b21d-9cb0afa0e617', 'status': 'completed', 'code': 200} Nov 05 15:11:58.359903 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab3d84be-9490-479d-9f15-d8c3b0af31f4 req-3001d51f-2315-4c85-8bbf-ec26908ae619 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=65ba40f8-d715-4fca-ae68-7b8160ab0754 HTTP/1.1" status: 200 len: 210 time: 0.0302880 Nov 05 15:12:00.057683 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-528367f0-fccc-436a-b8a5-8b7476221780 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:00.059143 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-528367f0-fccc-436a-b8a5-8b7476221780 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 817 time: 0.1026776 Nov 05 15:12:00.073595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6c0960e1-ff87-452c-8f24-2fd20417f9bf tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/quotas/639787a250044e489c1c5e4761a79e9d HTTP/1.1" status: 200 len: 375 time: 0.0087337 Nov 05 15:12:00.123773 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-77ad6b65-f791-4f1e-8db6-a5d99098ea92 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0450745 Nov 05 15:12:00.218644 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-03e4ba72-d529-4b95-89f6-2d996fed8cf0 service neutron] 10.222.0.30 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837889 Nov 05 15:12:00.305181 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-215d6da9-cb62-4d89-a21b-a8b71a3c33e5 service neutron] 10.222.0.30 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799422 Nov 05 15:12:00.459299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ec3a584d-5fbf-4741-be2e-dee1967aa17f req-cfe693c9-7d3b-4608-955c-4184cf487c7e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 210 time: 0.0261278 Nov 05 15:12:01.441029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 857d60b7-2d7a-4170-b21d-9cb0afa0e617 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:01.449087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-1d0985f9-0449-4716-9a51-9ddf3cd1679b tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:01.450704 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-1d0985f9-0449-4716-9a51-9ddf3cd1679b tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 817 time: 0.0996587 Nov 05 15:12:01.461169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 857d60b7-2d7a-4170-b21d-9cb0afa0e617 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:01.461515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 857d60b7-2d7a-4170-b21d-9cb0afa0e617 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:01.466619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Request body: {'port': {'device_id': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'admin_state_up': True, 'tenant_id': '639787a250044e489c1c5e4761a79e9d'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:01.563824 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e74f9c94-aee3-421b-8dd2-d07a9646187c req-56b976ba-f6bb-427f-90b6-a8681ffb7bb9 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 210 time: 0.0316205 Nov 05 15:12:01.585727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Made reservation on behalf of 639787a250044e489c1c5e4761a79e9d for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:12:01.589490 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:01.712577 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Allocated IP 172.20.0.7 (74e9ee90-a017-4ed4-951e-773bdcbb531e/c7345b88-3efa-4a07-9d27-c40dc4415ff8/d96143d6-4854-4817-a1b3-fd88a5c05bc9) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:01.855912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:01.887971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:01.929941 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:01.934916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:01.938696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:01.968968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Pushing event updated for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:01.996803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:01.997438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.013460 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-6302eab1-953f-4937-911e-67e843743935 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5508182 Nov 05 15:12:02.026193 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Request body: {'port': {'device_id': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:02.085570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.164762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0208d580-23b4-4522-bba1-14cb7dee7719 None None] Provisioning complete for port d96143d6-4854-4817-a1b3-fd88a5c05bc9 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:02.165166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0208d580-23b4-4522-bba1-14cb7dee7719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.199087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-0208d580-23b4-4522-bba1-14cb7dee7719 None None] Port d96143d6-4854-4817-a1b3-fd88a5c05bc9 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:02.340125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d96143d6-4854-4817-a1b3-fd88a5c05bc9 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:12:02.347234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.358681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Transition to ACTIVE for port object d96143d6-4854-4817-a1b3-fd88a5c05bc9 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:12:02.361932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.415734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Pushing event updated for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:02.482867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Attempting to bind port d96143d6-4854-4817-a1b3-fd88a5c05bc9 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:02.483500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Attempting to bind port d96143d6-4854-4817-a1b3-fd88a5c05bc9 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:02.484126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Attempting to bind port d96143d6-4854-4817-a1b3-fd88a5c05bc9 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:02.489292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Port d96143d6-4854-4817-a1b3-fd88a5c05bc9 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:12:02.489621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Attempting to bind port d96143d6-4854-4817-a1b3-fd88a5c05bc9 on network 74e9ee90-a017-4ed4-951e-773bdcbb531e {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:02.495218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 11, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:02.495561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Checking segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:02.495973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Bound using segment: {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:02.496399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Bound port: d96143d6-4854-4817-a1b3-fd88a5c05bc9, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:02.497208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.563137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:02.566770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:02.571083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.608142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:02.608791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:02.610193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] 10.222.0.32 "PUT /v2.0/ports/d96143d6-4854-4817-a1b3-fd88a5c05bc9 HTTP/1.1" status: 200 len: 1093 time: 0.5883436 Nov 05 15:12:02.611218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:12:02.613449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-522af58a-6975-4b8a-b6ed-d52563d39e6d" -d '{"events": [{"name": "network-changed", "server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:12:02.642553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b7c475-c3ac-478b-a4a2-7aeb0ae9cf65 service neutron] Pushing event updated for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:02.683550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:12:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9cd4de5d-9c01-4f0a-bcd3-13873aa4179b x-openstack-request-id: req-9cd4de5d-9c01-4f0a-bcd3-13873aa4179b {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:12:02.683842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:12:02.684096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9cd4de5d-9c01-4f0a-bcd3-13873aa4179b {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:12:02.684530 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9', 'status': 'completed', 'code': 200} Nov 05 15:12:02.734252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-73cf75b3-fb68-476f-a118-9c17dff68736 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:02.736311 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-73cf75b3-fb68-476f-a118-9c17dff68736 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 1096 time: 0.0761156 Nov 05 15:12:02.748352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8898a49-6ae1-4d37-9a06-4d6188542ba5 req-856f9666-5f85-4ab6-a924-d378b5b1501a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:02.749902 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c8898a49-6ae1-4d37-9a06-4d6188542ba5 req-856f9666-5f85-4ab6-a924-d378b5b1501a tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 943 time: 0.0803721 Nov 05 15:12:02.791476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-0ac6316b-b58a-428f-a200-bdb1be3c0f0a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9 HTTP/1.1" status: 200 len: 217 time: 0.0405970 Nov 05 15:12:02.868687 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c8898a49-6ae1-4d37-9a06-4d6188542ba5 req-3f079340-0aec-4cc2-8e78-83cc12d56898 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798604 Nov 05 15:12:02.870377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-42536b1e-9ef9-431a-8f27-ba8357daa6c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:02.871845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-42536b1e-9ef9-431a-8f27-ba8357daa6c3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 200 len: 856 time: 0.0672266 Nov 05 15:12:02.918482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-60fe1e2e-00ad-476f-a760-148ccdfa5b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:02.919959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-60fe1e2e-00ad-476f-a760-148ccdfa5b3a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=74e9ee90-a017-4ed4-951e-773bdcbb531e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397718 Nov 05 15:12:03.009224 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-40cf77ca-f075-45e1-91dc-5c8c3a325f2f service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820532 Nov 05 15:12:03.098218 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef80933d-1d12-4830-b17e-4a8ff2b677d2 req-ac79a534-a3a4-4394-af8f-9d4be241eaea service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811243 Nov 05 15:12:03.192709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-06acae22-5dbc-4a1b-9ab7-cb94a9ce7ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:03.194200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-06acae22-5dbc-4a1b-9ab7-cb94a9ce7ccc service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 1096 time: 0.0461717 Nov 05 15:12:03.280047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-f52ad02e-465a-4da2-aba0-8c56ffa8e1fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:03.281512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-f52ad02e-465a-4da2-aba0-8c56ffa8e1fb service neutron] 10.222.0.32 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 918 time: 0.0807683 Nov 05 15:12:03.326157 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-fa8382f7-3109-4634-89db-394bedb48047 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9 HTTP/1.1" status: 200 len: 217 time: 0.0370047 Nov 05 15:12:03.372971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-5ab3849d-f2df-4fa0-aab8-8aded73a9416 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:03.374360 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-5ab3849d-f2df-4fa0-aab8-8aded73a9416 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 200 len: 856 time: 0.0413098 Nov 05 15:12:03.418868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-0d6c67eb-41b9-4387-a83c-aea24c25dac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:03.420299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-0d6c67eb-41b9-4387-a83c-aea24c25dac7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=74e9ee90-a017-4ed4-951e-773bdcbb531e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388541 Nov 05 15:12:03.511797 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-4f77ed28-d283-47b9-a73a-22b7343f29b2 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836315 Nov 05 15:12:03.602325 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-522af58a-6975-4b8a-b6ed-d52563d39e6d req-c3e51c62-d41a-41a9-afc9-25228472319e service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830510 Nov 05 15:12:03.982452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bc86c4-16f1-47ff-b377-ca33c1819c82 req-43cf4975-19e1-4d4f-90db-23b2e7e25a6c tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:03.983919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-72bc86c4-16f1-47ff-b377-ca33c1819c82 req-43cf4975-19e1-4d4f-90db-23b2e7e25a6c tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 943 time: 0.0486214 Nov 05 15:12:04.030405 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-72bc86c4-16f1-47ff-b377-ca33c1819c82 req-c3a26335-661c-4066-bca3-aaedc89f56ff tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400364 Nov 05 15:12:05.143508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0685fcb6-e50d-4193-8381-643ad2e18662 req-6ea19b01-f276-4ba0-8317-fc9ac5414955 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:05.144977 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0685fcb6-e50d-4193-8381-643ad2e18662 req-6ea19b01-f276-4ba0-8317-fc9ac5414955 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 943 time: 0.0486784 Nov 05 15:12:05.190962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0685fcb6-e50d-4193-8381-643ad2e18662 req-ec8ad776-332f-4081-bc94-136f5218b145 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401800 Nov 05 15:12:05.471026 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device d96143d6-4854-4817-a1b3-fd88a5c05bc9 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:12:05.566660 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:05.577638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9', 'network_id': '74e9ee90-a017-4ed4-951e-773bdcbb531e', 'port_id': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9', 'mac_address': 'fa:16:3e:ab:c2:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 620, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c7345b88-3efa-4a07-9d27-c40dc4415ff8', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:12:05.613899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:05.627031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d96143d6-4854-4817-a1b3-fd88a5c05bc9 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:12:05.649506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:05.653487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:05.699530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:05.706759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.707106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.707441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.707768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.708093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.708417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.708766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.709104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.709411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.709725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.710041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.710356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:05.857869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['d96143d6-4854-4817-a1b3-fd88a5c05bc9'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:12:06.302183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f94c960-2276-4cd7-94d5-05e82ed32d40 req-ea29e914-32d3-4bfd-9a5a-a48954807eb1 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:06.303629 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f94c960-2276-4cd7-94d5-05e82ed32d40 req-ea29e914-32d3-4bfd-9a5a-a48954807eb1 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 944 time: 0.0482500 Nov 05 15:12:06.349879 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f94c960-2276-4cd7-94d5-05e82ed32d40 req-d07ecc87-4eb0-4029-9b95-eae5618605e1 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404744 Nov 05 15:12:07.466699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5601dc37-1180-4482-be9b-e4b6aef009ec req-5bcda6ce-4b46-451d-82d2-36e37a35c050 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:07.468175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5601dc37-1180-4482-be9b-e4b6aef009ec req-5bcda6ce-4b46-451d-82d2-36e37a35c050 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 944 time: 0.0529153 Nov 05 15:12:07.487819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device d96143d6-4854-4817-a1b3-fd88a5c05bc9 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:07.515881 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5601dc37-1180-4482-be9b-e4b6aef009ec req-6760bbf5-48d5-4699-9a6c-5e30547ca7cd tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418053 Nov 05 15:12:07.536251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port d96143d6-4854-4817-a1b3-fd88a5c05bc9 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:12:07.540234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port d96143d6-4854-4817-a1b3-fd88a5c05bc9 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:07.540635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:07.615400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:07.637574 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:12:07.639716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8822cce1-7492-4975-967c-a8bf0c7bad97" -d '{"events": [{"server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "name": "network-vif-plugged", "status": "completed", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:12:07.653790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:07.657642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:07.686180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:12:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8074449-8c3d-4239-b7ae-42285bf527fe x-openstack-request-id: req-b8074449-8c3d-4239-b7ae-42285bf527fe {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:12:07.686472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "name": "network-vif-plugged", "status": "completed", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:12:07.686719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b8074449-8c3d-4239-b7ae-42285bf527fe {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:12:07.687098 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9', 'code': 200} Nov 05 15:12:07.715230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:07.838043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4098d6b1-9d34-4027-9715-cea9da9d6a98 req-db0ec5d4-9399-4047-bfab-d9dd5cbe50ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:07.839496 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4098d6b1-9d34-4027-9715-cea9da9d6a98 req-db0ec5d4-9399-4047-bfab-d9dd5cbe50ac service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 1098 time: 0.0395997 Nov 05 15:12:07.886685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4098d6b1-9d34-4027-9715-cea9da9d6a98 req-4a7a94a5-b305-4cc2-91f8-f234bf219233 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373452 Nov 05 15:12:08.635964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f586cd-8bf8-40a6-bd39-aebc70e28085 req-29c04f17-743f-49d0-a2b6-dd265a6e415b tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:08.637465 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86f586cd-8bf8-40a6-bd39-aebc70e28085 req-29c04f17-743f-49d0-a2b6-dd265a6e415b tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0516982 Nov 05 15:12:08.683566 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86f586cd-8bf8-40a6-bd39-aebc70e28085 req-a22dfe6f-e8fc-41d1-8560-fff81a6fccfd tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397694 Nov 05 15:12:09.801707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aac1f2f3-9e28-4c19-8ef3-f5cdf9b8eaaf req-0d53b32d-774e-4d77-8af9-adb320657894 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:09.803072 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aac1f2f3-9e28-4c19-8ef3-f5cdf9b8eaaf req-0d53b32d-774e-4d77-8af9-adb320657894 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0529633 Nov 05 15:12:09.852597 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-aac1f2f3-9e28-4c19-8ef3-f5cdf9b8eaaf req-8ef9df5d-ba05-45f3-9ae1-fff223aad14c tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433433 Nov 05 15:12:09.964807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0642a14f-0997-4177-b603-0f20c0bbac3a req-1427fe53-88e7-4bc7-9fdd-00f227338ecb tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:09.966562 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0642a14f-0997-4177-b603-0f20c0bbac3a req-1427fe53-88e7-4bc7-9fdd-00f227338ecb tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0495000 Nov 05 15:12:10.013384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0642a14f-0997-4177-b603-0f20c0bbac3a req-86f8be6a-367d-47fb-8287-e36d31f1c76c tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404129 Nov 05 15:12:18.431132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:18.534658 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-9b4e1d09-648f-4cfd-af1d-d0e6a4d1879e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399380 Nov 05 15:12:18.617347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-b41ac358-fba9-48ac-96b6-50e96a6f50fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:18.618802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-b41ac358-fba9-48ac-96b6-50e96a6f50fd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=639787a250044e489c1c5e4761a79e9d&device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 1098 time: 0.0441430 Nov 05 15:12:18.719572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-712ae704-ea4d-403d-91ec-413b3325b9aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:18.720956 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-712ae704-ea4d-403d-91ec-413b3325b9aa service neutron] 10.222.0.32 "GET /v2.0/networks?id=74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 200 len: 918 time: 0.0829167 Nov 05 15:12:18.764194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-09e35662-ceb9-4e1c-85f7-059d6d07b9fb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9 HTTP/1.1" status: 200 len: 217 time: 0.0364356 Nov 05 15:12:18.810614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-112ff7eb-7ae3-4d4c-8b0d-ed0003a03e99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:18.811975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-112ff7eb-7ae3-4d4c-8b0d-ed0003a03e99 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 200 len: 856 time: 0.0412354 Nov 05 15:12:18.855238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-612ad421-1297-46ff-a6bb-eca322fc23b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:18.856726 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-612ad421-1297-46ff-a6bb-eca322fc23b5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=74e9ee90-a017-4ed4-951e-773bdcbb531e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385308 Nov 05 15:12:18.948656 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-2994e169-6b5c-472d-b8b9-39a4ee689f18 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823755 Nov 05 15:12:19.037539 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19c686e4-65c1-4d85-b0c2-42994bf8889d req-d61baf46-c365-45c2-8b94-6080cb500cd4 service neutron] 10.222.0.32 "GET /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816305 Nov 05 15:12:20.118822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4bd94241-0f38-473b-afae-7aa5a9b304de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:20.540364 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:12:22.442301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8270f53c-c5ba-45da-b047-d7820c674a83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:23.493206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:24.954464 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:25.971966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:32.425851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b49996-41cf-45fb-86e8-012a3feb6d35 req-64c4c40b-4d2e-4a01-90ce-47fa28e47f95 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:32.427235 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2b49996-41cf-45fb-86e8-012a3feb6d35 req-64c4c40b-4d2e-4a01-90ce-47fa28e47f95 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0486465 Nov 05 15:12:32.473819 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f2b49996-41cf-45fb-86e8-012a3feb6d35 req-99979b66-b9e5-431a-bfd5-108734e9b3e6 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405691 Nov 05 15:12:33.592515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-086d67a8-87f8-479c-93a1-c5a592d95231 req-9aa74a0a-d9b5-48d1-a786-c8b11a54fe00 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:33.594569 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-086d67a8-87f8-479c-93a1-c5a592d95231 req-9aa74a0a-d9b5-48d1-a786-c8b11a54fe00 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0487108 Nov 05 15:12:33.642465 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-086d67a8-87f8-479c-93a1-c5a592d95231 req-e1424277-2260-4ebc-b0c4-937720be9063 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/security-groups?id=9ce10889-4711-4812-a1d1-c6631211d1ac&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419099 Nov 05 15:12:34.004737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-20aff7c5-f257-4cae-8b68-d1b2c8a947c3 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:34.006175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-20aff7c5-f257-4cae-8b68-d1b2c8a947c3 tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 945 time: 0.0514920 Nov 05 15:12:34.090934 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Deleting port d96143d6-4854-4817-a1b3-fd88a5c05bc9 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:34.091262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:34.178587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] For port d96143d6-4854-4817-a1b3-fd88a5c05bc9, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=d96143d6-4854-4817-a1b3-fd88a5c05bc9,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:34.178943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:34.191769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Calling delete_port for d96143d6-4854-4817-a1b3-fd88a5c05bc9 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:34.317373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:34.329466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['d96143d6-4854-4817-a1b3-fd88a5c05bc9'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:12:34.345873 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Pushing event deleted for resources: {'Port': ['ID=d96143d6-4854-4817-a1b3-fd88a5c05bc9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:34.357602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.357955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.358300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.358642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.358979 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.359984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.360295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.360656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.360984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.361311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.361642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.361967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:34.394957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] No DVR routers for this DVR port d96143d6-4854-4817-a1b3-fd88a5c05bc9 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:12:34.397361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:34.400670 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e7cf8192-f4a1-4354-8421-bd48ef8aa5b2 req-aadfde34-9b23-47cf-9017-eb3833ef133e tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.32 "DELETE /v2.0/ports/d96143d6-4854-4817-a1b3-fd88a5c05bc9 HTTP/1.1" status: 204 len: 173 time: 0.3885407 Nov 05 15:12:34.401115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'name': 'network-vif-deleted', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:12:34.403350 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e32d63dd-c72b-4ab1-a5d4-fb8aa2b0ffa6" -d '{"events": [{"server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "name": "network-vif-deleted", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:12:34.494090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:12:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44c2b950-db8c-4414-ad56-a5c49413297a x-openstack-request-id: req-44c2b950-db8c-4414-ad56-a5c49413297a {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:12:34.494384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e", "name": "network-vif-deleted", "tag": "d96143d6-4854-4817-a1b3-fd88a5c05bc9", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:12:34.494635 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-44c2b950-db8c-4414-ad56-a5c49413297a {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:12:34.495034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e', 'name': 'network-vif-deleted', 'tag': 'd96143d6-4854-4817-a1b3-fd88a5c05bc9', 'status': 'completed', 'code': 200} Nov 05 15:12:34.750901 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fc793633-17c7-46c4-a374-9cd2dbe8e73d req-47f507a5-8d06-464c-ad94-e89a7988983f tempest-TestEncryptedCinderVolumes-1405383769 tempest-TestEncryptedCinderVolumes-1405383769-project] 10.222.0.30 "GET /v2.0/ports?device_id=8ed1f16d-3c99-4aa5-bd4b-6c8f39bee27e HTTP/1.1" status: 200 len: 210 time: 0.0274971 Nov 05 15:12:35.841296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50240) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:36.174099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:36.410897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Deleting port 1affecfb-2843-4e8e-966a-2a0a24607c03 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:36.411231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:36.485880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] For port 1affecfb-2843-4e8e-966a-2a0a24607c03, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=1affecfb-2843-4e8e-966a-2a0a24607c03,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:36.486159 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:36.498301 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Calling delete_port for 1affecfb-2843-4e8e-966a-2a0a24607c03 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:36.951974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:36.975029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Pushing event deleted for resources: {'Port': ['ID=1affecfb-2843-4e8e-966a-2a0a24607c03,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:37.137856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:37.345391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Router d59131dd-c8e1-4990-87f1-bb7bfba814e6 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:12:37.447438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:37.452434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-003f37c1-8583-4772-a804-a56686c35597 admin admin] 10.222.0.30 "PUT /v2.0/routers/d59131dd-c8e1-4990-87f1-bb7bfba814e6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6101108 Nov 05 15:12:37.455532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50242) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:37.458199 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Sync routers for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:37.467752 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:37.468375 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:37.557103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:37.569920 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:37.643898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device d96143d6-4854-4817-a1b3-fd88a5c05bc9 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:37.660789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:37.663902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: d96143d6-4854-4817-a1b3-fd88a5c05bc9 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:37.664507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device d96143d6-4854-4817-a1b3-fd88a5c05bc9 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:37.712174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Deleting port aa66057c-a952-4ff9-ba3c-f05afb1af40b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:37.712521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:37.745095 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247'}], 'enable_snat': True}, 'gw_port_id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:12:36Z', 'revision_number': 5, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port': {'id': 'aa66057c-a952-4ff9-ba3c-f05afb1af40b', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:d2:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1607, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:11:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:37.774514 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Checking router: d59131dd-c8e1-4990-87f1-bb7bfba814e6 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:37.783090 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Routers {'d59131dd-c8e1-4990-87f1-bb7bfba814e6'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:37.783677 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:37.787820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] For port aa66057c-a952-4ff9-ba3c-f05afb1af40b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=aa66057c-a952-4ff9-ba3c-f05afb1af40b,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:37.788259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:37.806372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Calling delete_port for aa66057c-a952-4ff9-ba3c-f05afb1af40b owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:37.958909 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] Set router d59131dd-c8e1-4990-87f1-bb7bfba814e6 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:37.972600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.003791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Pushing event deleted for resources: {'Port': ['ID=aa66057c-a952-4ff9-ba3c-f05afb1af40b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:38.010100 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:12:37Z', 'revision_number': 6, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:38.039284 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebb3a94b-0305-45a3-97f6-92b873fac495 None None] The sync data for ids ['d59131dd-c8e1-4990-87f1-bb7bfba814e6'] in dv-neutron-816850-1-hyperv is: [{'id': 'd59131dd-c8e1-4990-87f1-bb7bfba814e6', 'name': 'tempest-TestEncryptedCinderVolumes-1442363407-router', 'tenant_id': '639787a250044e489c1c5e4761a79e9d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:15Z', 'updated_at': '2021-11-05T15:12:37Z', 'revision_number': 6, 'project_id': '639787a250044e489c1c5e4761a79e9d', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:38.062952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.155362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.158119 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.200812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.201371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d59131dd-c8e1-4990-87f1-bb7bfba814e6 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:12:38.205819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.206949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-92c1f1ad-801a-4be9-9375-78b62e703342 admin admin] 10.222.0.30 "DELETE /v2.0/routers/d59131dd-c8e1-4990-87f1-bb7bfba814e6 HTTP/1.1" status: 204 len: 168 time: 0.7505155 Nov 05 15:12:38.209627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50244) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:38.257201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Deleting subnet c7345b88-3efa-4a07-9d27-c40dc4415ff8 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:12:38.260280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.293532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.367386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.423985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.447550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c7345b88-3efa-4a07-9d27-c40dc4415ff8,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:38.458952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.458952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-98d1263f-4fbe-4fcb-ac55-65be7de71bcb admin admin] 10.222.0.30 "DELETE /v2.0/subnets/c7345b88-3efa-4a07-9d27-c40dc4415ff8 HTTP/1.1" status: 204 len: 168 time: 0.2471485 Nov 05 15:12:38.460573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50246) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:38.463749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4b48ad8-a24c-40d4-bb4f-295e693c961b None None] Network 74e9ee90-a017-4ed4-951e-773bdcbb531e requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:38.540396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.595813 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Deleting port c3333108-5691-4c35-9ef7-a6bbefe3e373 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:38.596154 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.810234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] DHCP port deletion for 74e9ee90-a017-4ed4-951e-773bdcbb531e request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:12:38.862909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Deleting port c3333108-5691-4c35-9ef7-a6bbefe3e373 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:38.863284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.931568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] For port c3333108-5691-4c35-9ef7-a6bbefe3e373, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c3333108-5691-4c35-9ef7-a6bbefe3e373,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:38.932120 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:38.946550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Calling delete_port for c3333108-5691-4c35-9ef7-a6bbefe3e373 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:38.994008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] For port c3333108-5691-4c35-9ef7-a6bbefe3e373, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c3333108-5691-4c35-9ef7-a6bbefe3e373,segment=NetworkSegment(cedd125a-f6b4-47e6-951c-3b35c2bfd1b2),segment_id=cedd125a-f6b4-47e6-951c-3b35c2bfd1b2)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:38.994505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.008159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Calling delete_port for c3333108-5691-4c35-9ef7-a6bbefe3e373 owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:39.033985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.048631 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] No DVR routers for this DVR port c3333108-5691-4c35-9ef7-a6bbefe3e373 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:12:39.073754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992d7a31-7475-4b84-a4d2-1cd57049466f None None] Pushing event deleted for resources: {'Port': ['ID=c3333108-5691-4c35-9ef7-a6bbefe3e373,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:39.092773 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.121187 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Pushing event deleted for resources: {'Port': ['ID=c3333108-5691-4c35-9ef7-a6bbefe3e373,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:39.127145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] No DVR routers for this DVR port c3333108-5691-4c35-9ef7-a6bbefe3e373 on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:12:39.136237 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.136619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.136970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.137313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.137651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.137987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.138360 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.138917 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.139499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.140079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.141385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.141964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:39.215642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.235492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74e9ee90-a017-4ed4-951e-773bdcbb531e']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:39.244429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:39.244770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cedd125a-f6b4-47e6-951c-3b35c2bfd1b2') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:39.254479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.267391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.273206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Releasing vlan 620 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:12:39.274008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:12:39.275209 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:12:39.330437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.335346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.338599 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] 10.222.0.30 "DELETE /v2.0/networks/74e9ee90-a017-4ed4-951e-773bdcbb531e HTTP/1.1" status: 204 len: 168 time: 0.8761642 Nov 05 15:12:39.341641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50248) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:39.349433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b4867d-a08e-4ae5-902f-7ce88659393a admin admin] Pushing event deleted for resources: {'Network': ['ID=74e9ee90-a017-4ed4-951e-773bdcbb531e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:39.683804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.920698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Deleting port cf78235b-0a22-4416-a5e0-3aa3cef1a526 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:39.921034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:39.948335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aa66057c-a952-4ff9-ba3c-f05afb1af40b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:39.968125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: aa66057c-a952-4ff9-ba3c-f05afb1af40b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:39.968995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device aa66057c-a952-4ff9-ba3c-f05afb1af40b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:39.969400 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1affecfb-2843-4e8e-966a-2a0a24607c03 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:39.988369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 1affecfb-2843-4e8e-966a-2a0a24607c03 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:39.988811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 1affecfb-2843-4e8e-966a-2a0a24607c03 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:39.989216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c3333108-5691-4c35-9ef7-a6bbefe3e373 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:40.000932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] For port cf78235b-0a22-4416-a5e0-3aa3cef1a526, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=cf78235b-0a22-4416-a5e0-3aa3cef1a526,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:40.001291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:40.010633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: c3333108-5691-4c35-9ef7-a6bbefe3e373 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:40.010973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c3333108-5691-4c35-9ef7-a6bbefe3e373 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:40.013891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Calling delete_port for cf78235b-0a22-4416-a5e0-3aa3cef1a526 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:40.191774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:40.216225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf78235b-0a22-4416-a5e0-3aa3cef1a526,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:40.371814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:40.873468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Router de99d5c2-da2a-426c-8635-0cdcad74e2aa has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:12:40.976309 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:40.981331 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a618000a-6522-4f17-9e74-688ba6089742 admin admin] 10.222.0.30 "PUT /v2.0/routers/de99d5c2-da2a-426c-8635-0cdcad74e2aa/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6386120 Nov 05 15:12:40.983869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50250) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:40.987188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Sync routers for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:40.997463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:40.998156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:41.087312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.104336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:41.186581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.243486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Deleting port 577192df-4850-441f-9157-cfeb705e8fda {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:41.243825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.277742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239'}], 'enable_snat': True}, 'gw_port_id': '577192df-4850-441f-9157-cfeb705e8fda', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:12:40Z', 'revision_number': 5, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port': {'id': '577192df-4850-441f-9157-cfeb705e8fda', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:14:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1618, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:11:20Z', 'updated_at': '2021-11-05T15:11:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:41.304559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Checking router: de99d5c2-da2a-426c-8635-0cdcad74e2aa for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:41.312585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Routers {'de99d5c2-da2a-426c-8635-0cdcad74e2aa'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:41.313169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:41.323176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] For port 577192df-4850-441f-9157-cfeb705e8fda, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=577192df-4850-441f-9157-cfeb705e8fda,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:41.323538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.336139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Calling delete_port for 577192df-4850-441f-9157-cfeb705e8fda owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:41.395898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] Set router de99d5c2-da2a-426c-8635-0cdcad74e2aa gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:41.450339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:12:41Z', 'revision_number': 6, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:41.476707 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5eac8a85-5c57-419d-b3b3-244197ebbe01 None None] The sync data for ids ['de99d5c2-da2a-426c-8635-0cdcad74e2aa'] in dv-neutron-816850-1-hyperv is: [{'id': 'de99d5c2-da2a-426c-8635-0cdcad74e2aa', 'name': 'tempest-TestEncryptedCinderVolumes-580795048-router', 'tenant_id': '2e0e70eab23846ceab305301ccfda74d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:11:19Z', 'updated_at': '2021-11-05T15:12:41Z', 'revision_number': 6, 'project_id': '2e0e70eab23846ceab305301ccfda74d', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:41.504423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.534780 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Pushing event deleted for resources: {'Port': ['ID=577192df-4850-441f-9157-cfeb705e8fda,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:41.592152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.680563 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.682641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.725658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.726114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router de99d5c2-da2a-426c-8635-0cdcad74e2aa {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:12:41.730384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.731509 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-48b26a16-7219-450b-9cad-5f68780acff9 admin admin] 10.222.0.30 "DELETE /v2.0/routers/de99d5c2-da2a-426c-8635-0cdcad74e2aa HTTP/1.1" status: 204 len: 168 time: 0.7460091 Nov 05 15:12:41.734113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50252) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:41.780840 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Deleting subnet 3f84a153-16ef-483c-ab51-fdcbe7e0bd3c {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:12:41.784259 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.817034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.897970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.957642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.984009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3f84a153-16ef-483c-ab51-fdcbe7e0bd3c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:41.986295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:41.989811 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2761485-68cb-4ba1-8e85-c2b9c62080c9 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/3f84a153-16ef-483c-ab51-fdcbe7e0bd3c HTTP/1.1" status: 204 len: 168 time: 0.2547538 Nov 05 15:12:41.990156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21971d1e-c653-47e5-9f02-a9225fd6ba17 None None] Network 5753a979-e4f9-47e3-b8fb-76f326956171 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:41.992282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50254) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:42.061379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.118545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Deleting port 83a0c699-3bc6-46e5-b5ed-78201f36e954 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:12:42.118883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.186631 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] For port 83a0c699-3bc6-46e5-b5ed-78201f36e954, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=83a0c699-3bc6-46e5-b5ed-78201f36e954,segment=NetworkSegment(1a7c4d43-c06f-481f-bec0-5ab0278a8446),segment_id=1a7c4d43-c06f-481f-bec0-5ab0278a8446)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:42.186908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.201166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Calling delete_port for 83a0c699-3bc6-46e5-b5ed-78201f36e954 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:12:42.290465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.320580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] No DVR routers for this DVR port 83a0c699-3bc6-46e5-b5ed-78201f36e954 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:12:42.324594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Pushing event deleted for resources: {'Port': ['ID=83a0c699-3bc6-46e5-b5ed-78201f36e954,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:42.329312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-012059b3-3771-4c50-b5d2-1117aac7da88 None None] DHCP port deletion for 5753a979-e4f9-47e3-b8fb-76f326956171 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:12:42.343733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cf78235b-0a22-4416-a5e0-3aa3cef1a526 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:42.365604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: cf78235b-0a22-4416-a5e0-3aa3cef1a526 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:42.366054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device cf78235b-0a22-4416-a5e0-3aa3cef1a526 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:42.405113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.426483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5753a979-e4f9-47e3-b8fb-76f326956171']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:42.436742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a7c4d43-c06f-481f-bec0-5ab0278a8446') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:42.437039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a7c4d43-c06f-481f-bec0-5ab0278a8446') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:42.447969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.461723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.468024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Releasing vlan 607 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:12:42.468481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:12:42.470155 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:12:42.530713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.536281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.541140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] 10.222.0.30 "DELETE /v2.0/networks/5753a979-e4f9-47e3-b8fb-76f326956171 HTTP/1.1" status: 204 len: 168 time: 0.5463746 Nov 05 15:12:42.551918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc716c4b-adaa-4bf4-8e80-35266d392f37 admin admin] Pushing event deleted for resources: {'Network': ['ID=5753a979-e4f9-47e3-b8fb-76f326956171,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:42.702261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50258) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:42.741328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3e8ef60a-ee12-4e2a-9575-8955d2663b05 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=639787a250044e489c1c5e4761a79e9d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0379336 Nov 05 15:12:42.743622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50260) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:42.787622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.808571 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.852649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.855163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:42.856328 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9ce10889-4711-4812-a1d1-c6631211d1ac HTTP/1.1" status: 204 len: 168 time: 0.1118288 Nov 05 15:12:42.865021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9610a3-44cc-493e-a2fc-ddd0e22a8bb6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ce10889-4711-4812-a1d1-c6631211d1ac,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:43.168245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50266) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:43.209639 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b9ecd2d-3fed-4913-83ae-cf4187831104 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2e0e70eab23846ceab305301ccfda74d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0402265 Nov 05 15:12:43.212158 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50268) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:43.258542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:43.279612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:43.329516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:43.332065 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:43.333261 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/743f36e4-1be0-4a05-9bb4-2f3fb157a4ad HTTP/1.1" status: 204 len: 168 time: 0.1202950 Nov 05 15:12:43.342062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895eb85d-0c9d-46e4-b295-aa3ba42005ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=743f36e4-1be0-4a05-9bb4-2f3fb157a4ad,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:43.947130 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83a0c699-3bc6-46e5-b5ed-78201f36e954 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:43.966942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 83a0c699-3bc6-46e5-b5ed-78201f36e954 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:43.967285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 83a0c699-3bc6-46e5-b5ed-78201f36e954 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:43.967691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 577192df-4850-441f-9157-cfeb705e8fda no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:12:43.986877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 577192df-4850-441f-9157-cfeb705e8fda {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:12:43.987200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 577192df-4850-441f-9157-cfeb705e8fda not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:12:44.068165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50290) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:44.160369 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1900869733-network', 'tenant_id': 'ec691eaac94e4150af738df6009495e2'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:44.181555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Made reservation on behalf of ec691eaac94e4150af738df6009495e2 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:12:44.183742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.192852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.267339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.271064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.295287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 621} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:12:44.304653 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97977614-5703-4480-9ca8-4f0d61cd5b6c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:44.310529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.310864 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Added segment 83bc0ae6-9055-474f-ba29-fcfe7c493940 of type vlan for network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 Nov 05 15:12:44.349752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.374365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.375382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:44.375959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.431357 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3620133 Nov 05 15:12:44.434353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50294) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:44.438409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82f0356-9f9c-4f88-b639-42bb862e05dd admin admin] Pushing event updated for resources: {'Network': ['ID=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:44.439357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Request body: {'subnet': {'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1900869733-subnet', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:44.448483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:12:44.460369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Made reservation on behalf of ec691eaac94e4150af738df6009495e2 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:12:44.462696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.625173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.677836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Pushing event updated for resources: {'Subnet': ['ID=edfe133f-f329-4d1d-974f-646d1ea42078,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:44.692214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Checking segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:44.692594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Network hostable DHCP agents. Network: a2c2dfb3-6512-49cf-b141-1528a1cdbcf9, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:12:44.708821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:12:44.717105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, a2c2dfb3-6512-49cf-b141-1528a1cdbcf9) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:44.721570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:44.722182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.727244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-400ca675-be09-4365-b8b4-f2d5bb3c19e4 None None] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:44.737857 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b3fb3381-779e-43c0-be8d-6728ad21633c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3023844 Nov 05 15:12:44.740680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50296) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:44.745263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:44.766955 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.768122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-400ca675-be09-4365-b8b4-f2d5bb3c19e4 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:12:44.800592 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:12:44.809410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0e3b718-c3dc-4b9e-ac24-c01044877a5e None None] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:44.827217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-f0e3b718-c3dc-4b9e-ac24-c01044877a5e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:12:44.884536 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:12:44.893318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-189021db-1337-4d9a-ab83-c105687d997e None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:12:44.958903 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-189021db-1337-4d9a-ab83-c105687d997e None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:12:44.964577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.158435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:12:45.159300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.166766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.185654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.291762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Allocated IP 172.26.5.179 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/23fe6a2b-3236-4300-b156-515efaeb1ac4) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:45.293829 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Allocated IP 172.20.0.2 (a2c2dfb3-6512-49cf-b141-1528a1cdbcf9/edfe133f-f329-4d1d-974f-646d1ea42078/08613e0f-27fd-40bb-be08-5aa9921ba1dc) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:45.393135 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.426225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.440315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.446115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.469309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:45.474173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:45.481349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:45.485794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:45.492225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:45.495727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:45.502380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Pushing event updated for resources: {'Port': ['ID=08613e0f-27fd-40bb-be08-5aa9921ba1dc,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:45.502555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Pushing event updated for resources: {'Port': ['ID=23fe6a2b-3236-4300-b156-515efaeb1ac4,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:45.553703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Attempting to bind port 08613e0f-27fd-40bb-be08-5aa9921ba1dc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:45.553974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Attempting to bind port 08613e0f-27fd-40bb-be08-5aa9921ba1dc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:45.554329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Attempting to bind port 08613e0f-27fd-40bb-be08-5aa9921ba1dc on network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:45.559212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:45.559580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Checking segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:45.559972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.560357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Bound using segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:45.560846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Bound port: 08613e0f-27fd-40bb-be08-5aa9921ba1dc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:45.561217 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.624299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] For port 08613e0f-27fd-40bb-be08-5aa9921ba1dc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:45.627629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] For port 08613e0f-27fd-40bb-be08-5aa9921ba1dc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=08613e0f-27fd-40bb-be08-5aa9921ba1dc,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:45.632308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.690474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ca3638-180b-4e1d-a2e1-c05aa8590f81 None None] Pushing event updated for resources: {'Port': ['ID=08613e0f-27fd-40bb-be08-5aa9921ba1dc,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:45.738896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.961599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:45.981804 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 08613e0f-27fd-40bb-be08-5aa9921ba1dc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:46.030788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 08613e0f-27fd-40bb-be08-5aa9921ba1dc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:46.031666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.093798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Router 88d7a766-db07-4a48-a658-81f5d212360b is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:12:46.111920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.143759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 08613e0f-27fd-40bb-be08-5aa9921ba1dc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=08613e0f-27fd-40bb-be08-5aa9921ba1dc,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:46.147712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.194564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=08613e0f-27fd-40bb-be08-5aa9921ba1dc,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:46.204922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:46.213338 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Sync routers for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:46.222232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.226126 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-d23d6529-ea75-48bf-86c4-a2b38b2470e7 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.4817619 Nov 05 15:12:46.226281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:46.226281 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:46.226569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50298) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:46.339863 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:46.526516 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:45Z', 'revision_number': 3, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:46.552978 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Checking router: 88d7a766-db07-4a48-a658-81f5d212360b for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:46.553318 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Updating router 88d7a766-db07-4a48-a658-81f5d212360b port 23fe6a2b-3236-4300-b156-515efaeb1ac4 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:12:46.582319 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.600062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21c1d622-238a-41c8-b13d-c57ec9006b47 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:12:46.665772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.681608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-69475da3-8292-44f7-a2a2-59554902739b None None] Provisioning complete for port 08613e0f-27fd-40bb-be08-5aa9921ba1dc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:46.681974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69475da3-8292-44f7-a2a2-59554902739b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.709892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21c1d622-238a-41c8-b13d-c57ec9006b47 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:12:46.837915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Allocated IP 172.20.0.1 (a2c2dfb3-6512-49cf-b141-1528a1cdbcf9/edfe133f-f329-4d1d-974f-646d1ea42078/d39450cc-6550-442b-943e-f1ff3492be0b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:46.841547 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.847924 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.895901 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Pushing event updated for resources: {'Port': ['ID=23fe6a2b-3236-4300-b156-515efaeb1ac4,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:46.908651 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.909080 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.909493 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.909886 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.910283 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.910700 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.911164 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.911554 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.911940 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.912321 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.912720 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.913212 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:12:46.920312 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Attempting to bind port 23fe6a2b-3236-4300-b156-515efaeb1ac4 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:46.920937 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Attempting to bind port 23fe6a2b-3236-4300-b156-515efaeb1ac4 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:46.922009 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Attempting to bind port 23fe6a2b-3236-4300-b156-515efaeb1ac4 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:46.927634 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:46.928004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:46.928405 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.928820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:46.929278 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Bound port: 23fe6a2b-3236-4300-b156-515efaeb1ac4, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:46.929652 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.948692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.981474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:46.983562 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] For port 23fe6a2b-3236-4300-b156-515efaeb1ac4, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:46.993155 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] For port 23fe6a2b-3236-4300-b156-515efaeb1ac4, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23fe6a2b-3236-4300-b156-515efaeb1ac4,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:46.998255 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.025235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:47.030189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:47.033920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:47.056760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Pushing event updated for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:47.061286 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:47.061963 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:47.076937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.095274 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66e51f9-4803-49b8-9387-d24c74548cfa None None] Pushing event updated for resources: {'Port': ['ID=23fe6a2b-3236-4300-b156-515efaeb1ac4,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:47.177760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:47.212733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.374628 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:45Z', 'revision_number': 3, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:47.385302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.393917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.407826 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebd1bef9-e834-45e2-a56c-1e6524936900 None None] The sync data for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv is: [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:45Z', 'revision_number': 3, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:47.458637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Pushing event updated for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:47.465375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.562901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7f089a02-bf47-4ee1-adaa-c01e0aa4885a None None] Provisioning complete for port 08613e0f-27fd-40bb-be08-5aa9921ba1dc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:47.563497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7f089a02-bf47-4ee1-adaa-c01e0aa4885a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.568790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:47.570565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:47.788656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e0b6a767-7d38-471c-bf63-aa618edb143a None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:47.789044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e0b6a767-7d38-471c-bf63-aa618edb143a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:47.830974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e0b6a767-7d38-471c-bf63-aa618edb143a None None] Port d39450cc-6550-442b-943e-f1ff3492be0b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:47.961655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fec4db5d-0c59-493e-95a4-39a3ba7bc8bd None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:47.962323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fec4db5d-0c59-493e-95a4-39a3ba7bc8bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.005123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-fec4db5d-0c59-493e-95a4-39a3ba7bc8bd None None] Port d39450cc-6550-442b-943e-f1ff3492be0b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:48.017417 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Router 88d7a766-db07-4a48-a658-81f5d212360b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:12:48.043779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 08613e0f-27fd-40bb-be08-5aa9921ba1dc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:48.098143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 08613e0f-27fd-40bb-be08-5aa9921ba1dc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:48.098519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.133064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:48.143589 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c72e3204-81b1-44db-a6c7-215f27e97d01 admin admin] 10.222.0.30 "PUT /v2.0/routers/88d7a766-db07-4a48-a658-81f5d212360b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9104991 Nov 05 15:12:48.195423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23fe6a2b-3236-4300-b156-515efaeb1ac4 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:48.250238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 23fe6a2b-3236-4300-b156-515efaeb1ac4 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:48.250615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.338102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.359705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 23fe6a2b-3236-4300-b156-515efaeb1ac4, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23fe6a2b-3236-4300-b156-515efaeb1ac4,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:48.365887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.419110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=23fe6a2b-3236-4300-b156-515efaeb1ac4,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:48.439836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.638440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50314) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:48.643508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-189714978-network', 'tenant_id': '61be67ac57904682ab75aaa1833edaff'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:48.664034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Made reservation on behalf of 61be67ac57904682ab75aaa1833edaff for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:12:48.666319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.678919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.751261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.754677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.781798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:12:48.791694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6898da89-9e40-4a8f-985b-8d6b4d9f7226,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:48.797231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.797554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Added segment 0bf15b54-eca7-4dec-9526-3d314e990269 of type vlan for network fe758d2d-a046-4952-8f79-70a7d7a11abc Nov 05 15:12:48.846992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.872067 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.873033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:48.873602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:48.929473 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.2897515 Nov 05 15:12:48.932315 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50316) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:48.937257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Request body: {'subnet': {'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-189714978-subnet', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:48.942074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68819408-79e9-4a0e-88db-f985ba657d16 admin admin] Pushing event updated for resources: {'Network': ['ID=fe758d2d-a046-4952-8f79-70a7d7a11abc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:48.958062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fe758d2d-a046-4952-8f79-70a7d7a11abc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:12:48.962461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Made reservation on behalf of 61be67ac57904682ab75aaa1833edaff for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:12:48.965480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.101285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Sync routers for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:49.112323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:49.113099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:49.141003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.196520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Pushing event updated for resources: {'Subnet': ['ID=fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:49.207259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Checking segment: {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:49.207626 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Network hostable DHCP agents. Network: fe758d2d-a046-4952-8f79-70a7d7a11abc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:12:49.219716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:49.224570 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Network fe758d2d-a046-4952-8f79-70a7d7a11abc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:12:49.233335 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fe758d2d-a046-4952-8f79-70a7d7a11abc) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:49.237866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:12:49.238472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.248614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b413e19-e7ff-4131-bbfc-c75bd6056e5a None None] Network fe758d2d-a046-4952-8f79-70a7d7a11abc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:49.254794 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31e7851e-34a3-4ab9-b258-8b293cd8772e admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3213825 Nov 05 15:12:49.257471 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50318) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:49.261750 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:12:49.283265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.284289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.338919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.481211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-0b413e19-e7ff-4131-bbfc-c75bd6056e5a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:12:49.545817 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:12:49.570592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43bdd329-2927-40f5-aa21-19d09185d83e None None] Network fe758d2d-a046-4952-8f79-70a7d7a11abc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-43bdd329-2927-40f5-aa21-19d09185d83e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:12:49.677405 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:12:49.686377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a962d9de-ae4f-4a43-bf3d-bc41ceda97ae None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:12:49.689185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.708399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.729676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 2, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:49.759578 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Checking router: 88d7a766-db07-4a48-a658-81f5d212360b for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:49.759850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Updating router 88d7a766-db07-4a48-a658-81f5d212360b port d39450cc-6550-442b-943e-f1ff3492be0b binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:12:49.806725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.819131 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Allocated IP 172.26.5.51 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/4094f21a-0436-46d4-81f1-885e2944329c) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:49.826326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a962d9de-ae4f-4a43-bf3d-bc41ceda97ae None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:12:49.923022 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.959604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:49.976003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23fe6a2b-3236-4300-b156-515efaeb1ac4 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:49.996110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:50.000911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:50.006865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:50.032822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Pushing event updated for resources: {'Port': ['ID=4094f21a-0436-46d4-81f1-885e2944329c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:50.172855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 23fe6a2b-3236-4300-b156-515efaeb1ac4 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:50.173225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.174974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e821ea74-c2a5-4c57-ad9e-221d8444640d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.273090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.320734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.350814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.386670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fe758d2d-a046-4952-8f79-70a7d7a11abc', 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'fixed_ips': [{'subnet_id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:12:50.387523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.440087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed8a5b9-d612-4642-b380-7a97f0b28e8c None None] Pushing event updated for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:50.524423 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.547273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Attempting to bind port d39450cc-6550-442b-943e-f1ff3492be0b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:50.547628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Attempting to bind port d39450cc-6550-442b-943e-f1ff3492be0b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:50.547982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Attempting to bind port d39450cc-6550-442b-943e-f1ff3492be0b on network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:50.576515 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:50.576811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Checking segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:50.577204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.578151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Bound using segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:50.578630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Bound port: d39450cc-6550-442b-943e-f1ff3492be0b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:50.579951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.628861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Allocated IP 172.20.0.2 (fe758d2d-a046-4952-8f79-70a7d7a11abc/fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5/159b4807-022a-49af-87b5-981cf11ce483) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:50.709017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] For port d39450cc-6550-442b-943e-f1ff3492be0b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:50.729466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] For port d39450cc-6550-442b-943e-f1ff3492be0b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d39450cc-6550-442b-943e-f1ff3492be0b,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:50.739810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.833411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:50.833947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:50.889348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed8a5b9-d612-4642-b380-7a97f0b28e8c None None] Pushing event updated for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:50.928503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.957260 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:50.994165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Router a1b8770d-9cfc-4a9c-975b-948102cdae20 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:12:51.118233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:51.130679 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Sync routers for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:51.137532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.142390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50320) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:12:51.142999 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2c0478da-392d-43ee-ab49-c58a6344a748 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 1.8839347 Nov 05 15:12:51.160911 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:51.163334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Pushing event updated for resources: {'Port': ['ID=159b4807-022a-49af-87b5-981cf11ce483,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:51.164567 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:51.190686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Network fe758d2d-a046-4952-8f79-70a7d7a11abc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:51.193794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:51.202203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:51.209319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:51.362781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Attempting to bind port 159b4807-022a-49af-87b5-981cf11ce483 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:51.363149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Attempting to bind port 159b4807-022a-49af-87b5-981cf11ce483 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:51.363514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Attempting to bind port 159b4807-022a-49af-87b5-981cf11ce483 on network fe758d2d-a046-4952-8f79-70a7d7a11abc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:51.373020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:51.373302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Checking segment: {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:51.373710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.374105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Bound using segment: {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:51.375153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Bound port: 159b4807-022a-49af-87b5-981cf11ce483, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:51.375534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.421988 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:51.491319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] For port 159b4807-022a-49af-87b5-981cf11ce483, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:51.509132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] For port 159b4807-022a-49af-87b5-981cf11ce483, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=159b4807-022a-49af-87b5-981cf11ce483,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:51.516879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.594531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:50Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:51.596785 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb7ed60-370e-4b78-8267-c0125e47f977 None None] Pushing event updated for resources: {'Port': ['ID=159b4807-022a-49af-87b5-981cf11ce483,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:51.623844 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8125024f-01eb-475b-88ab-a2f300e7e9c4 None None] The sync data for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv is: [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:50Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:51.648970 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:50Z', 'revision_number': 3, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:51.688113 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Checking router: a1b8770d-9cfc-4a9c-975b-948102cdae20 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:51.688394 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Updating router a1b8770d-9cfc-4a9c-975b-948102cdae20 port 4094f21a-0436-46d4-81f1-885e2944329c binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:12:51.717771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.722658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:51.942185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Allocated IP 172.20.0.1 (fe758d2d-a046-4952-8f79-70a7d7a11abc/fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5/6a73d2dc-ed82-44a8-ae5d-40de216d68a5) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:12:52.094183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d39450cc-6550-442b-943e-f1ff3492be0b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:52.095243 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.105614 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.108222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.154214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:52.154752 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.156579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.165483 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Attempting to bind port 4094f21a-0436-46d4-81f1-885e2944329c on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:52.165960 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Attempting to bind port 4094f21a-0436-46d4-81f1-885e2944329c by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:52.166209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Attempting to bind port 4094f21a-0436-46d4-81f1-885e2944329c on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:52.177107 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:52.177484 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:52.177887 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.178277 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:52.178759 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Bound port: 4094f21a-0436-46d4-81f1-885e2944329c, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:52.179135 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.221096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Network fe758d2d-a046-4952-8f79-70a7d7a11abc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:52.229902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:52.232814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:12:52.239151 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] For port 4094f21a-0436-46d4-81f1-885e2944329c, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:52.246352 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] For port 4094f21a-0436-46d4-81f1-885e2944329c, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4094f21a-0436-46d4-81f1-885e2944329c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:52.253959 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f0789-971b-4878-9a7f-8ee9110644da None None] Pushing event updated for resources: {'Port': ['ID=4094f21a-0436-46d4-81f1-885e2944329c,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.258019 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.268652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Pushing event updated for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.285933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.296536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.325757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port d39450cc-6550-442b-943e-f1ff3492be0b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d39450cc-6550-442b-943e-f1ff3492be0b,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:52.331560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.335796 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:52.336958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 159b4807-022a-49af-87b5-981cf11ce483 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:52.337333 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:52.346123 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f0789-971b-4878-9a7f-8ee9110644da None None] Pushing event updated for resources: {'Port': ['ID=4094f21a-0436-46d4-81f1-885e2944329c,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.458737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.480019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d91f1d00-79b1-4cb4-8930-c774443de089 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.489083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 159b4807-022a-49af-87b5-981cf11ce483 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:52.489642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.509876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.526264 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:52.599491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.642974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 159b4807-022a-49af-87b5-981cf11ce483, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=159b4807-022a-49af-87b5-981cf11ce483,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:52.649268 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.711169 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=159b4807-022a-49af-87b5-981cf11ce483,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.782176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.790157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.833530 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:50Z', 'revision_number': 3, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:52.867135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Pushing event updated for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:52.869614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:52.870040 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba4f9095-9d1d-4400-b110-9b71fe782663 None None] The sync data for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv is: [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:50Z', 'revision_number': 3, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:52.901781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d012afbb-bf34-422d-856a-8b63372be57f None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:12:52.984299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Network fe758d2d-a046-4952-8f79-70a7d7a11abc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:12:52.985826 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:12:52.998362 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9c4dc217-1cea-4c29-bb23-4e73d349eafd None None] Provisioning complete for port 159b4807-022a-49af-87b5-981cf11ce483 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:52.998738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9c4dc217-1cea-4c29-bb23-4e73d349eafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:53.022938 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d012afbb-bf34-422d-856a-8b63372be57f None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:12:53.108964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Router a1b8770d-9cfc-4a9c-975b-948102cdae20 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:12:53.231281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:12:53.238026 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ad0eec2e-10a5-4927-9aaf-5c88a1151d2d admin admin] 10.222.0.30 "PUT /v2.0/routers/a1b8770d-9cfc-4a9c-975b-948102cdae20/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0935526 Nov 05 15:12:53.498530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:53.902176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7aca53a9-366f-41bc-9a22-03c0fc5836e2 None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:53.902647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7aca53a9-366f-41bc-9a22-03c0fc5836e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:53.962777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-7aca53a9-366f-41bc-9a22-03c0fc5836e2 None None] Port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:53.986104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7aca53a9-366f-41bc-9a22-03c0fc5836e2 None None] Provisioning complete for port 159b4807-022a-49af-87b5-981cf11ce483 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:53.986484 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7aca53a9-366f-41bc-9a22-03c0fc5836e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.128057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d39450cc-6550-442b-943e-f1ff3492be0b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:54.188037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.188703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.253919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e176dba8-b799-45d4-a601-ebfcb0729a77 None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.254279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e176dba8-b799-45d4-a601-ebfcb0729a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.303219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e176dba8-b799-45d4-a601-ebfcb0729a77 None None] Port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:54.346587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e176dba8-b799-45d4-a601-ebfcb0729a77 None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.347273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e176dba8-b799-45d4-a601-ebfcb0729a77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.385590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4094f21a-0436-46d4-81f1-885e2944329c up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:54.536006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4094f21a-0436-46d4-81f1-885e2944329c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.536677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.633980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.658373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 4094f21a-0436-46d4-81f1-885e2944329c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4094f21a-0436-46d4-81f1-885e2944329c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:54.662608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.663486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 159b4807-022a-49af-87b5-981cf11ce483 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:54.753758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a96f4a1c-b9d8-4a83-9f01-cb29a0ce0c81 None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.753758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a96f4a1c-b9d8-4a83-9f01-cb29a0ce0c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.776543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=4094f21a-0436-46d4-81f1-885e2944329c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:54.808819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 159b4807-022a-49af-87b5-981cf11ce483 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.809732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.811058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a96f4a1c-b9d8-4a83-9f01-cb29a0ce0c81 None None] Port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:54.850799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a96f4a1c-b9d8-4a83-9f01-cb29a0ce0c81 None None] Provisioning complete for port d39450cc-6550-442b-943e-f1ff3492be0b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:54.851181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a96f4a1c-b9d8-4a83-9f01-cb29a0ce0c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:54.986291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:55.246234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Sync routers for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:12:55.260984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:55.261612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:55.381287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:55.606157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 4, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6a73d2dc-ed82-44a8-ae5d-40de216d68a5', 'name': '', 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'mac_address': 'fa:16:3e:07:72:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_interface', 'standard_attr_id': 1646, 'fixed_ips': [{'subnet_id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:51Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 2, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'subnets': [{'id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:55.639625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Checking router: a1b8770d-9cfc-4a9c-975b-948102cdae20 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:12:55.639929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Updating router a1b8770d-9cfc-4a9c-975b-948102cdae20 port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:12:55.667095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:55.992907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:55.998539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4094f21a-0436-46d4-81f1-885e2944329c up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:56.001614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.029539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.096854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751e4b37-482f-4b81-96cb-7c5371d01eac None None] Pushing event updated for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:56.162425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4094f21a-0436-46d4-81f1-885e2944329c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:56.162721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.165941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Attempting to bind port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:12:56.166100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Attempting to bind port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:12:56.166442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Attempting to bind port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 on network fe758d2d-a046-4952-8f79-70a7d7a11abc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:12:56.197350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:12:56.197725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Checking segment: {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:12:56.198137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.198536 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Bound using segment: {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:12:56.199025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Bound port: 6a73d2dc-ed82-44a8-ae5d-40de216d68a5, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0bf15b54-eca7-4dec-9526-3d314e990269', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:12:56.199409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.338438 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] For port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:12:56.361115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-de8f67e9-554c-4e17-be0b-e7e74a6ecc00 None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:56.361549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de8f67e9-554c-4e17-be0b-e7e74a6ecc00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.364292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] For port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:12:56.393170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:56.454694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-de8f67e9-554c-4e17-be0b-e7e74a6ecc00 None None] Port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:12:56.463299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:12:56.464486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:12:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:56.527141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751e4b37-482f-4b81-96cb-7c5371d01eac None None] Pushing event updated for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:56.787602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:12:56.820547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:56.820547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:57.018754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:57.076967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] For port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:12:57.086577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:12:57.130915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 4, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6a73d2dc-ed82-44a8-ae5d-40de216d68a5', 'name': '', 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'mac_address': 'fa:16:3e:07:72:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_interface', 'standard_attr_id': 1646, 'fixed_ips': [{'subnet_id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:51Z', 'updated_at': '2021-11-05T15:12:56Z', 'revision_number': 4, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'subnets': [{'id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:12:57.165385 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05f1295e-89df-42b4-baa6-2a3d1453ff90 None None] The sync data for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv is: [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 4, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6a73d2dc-ed82-44a8-ae5d-40de216d68a5', 'name': '', 'network_id': 'fe758d2d-a046-4952-8f79-70a7d7a11abc', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'mac_address': 'fa:16:3e:07:72:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_interface', 'standard_attr_id': 1646, 'fixed_ips': [{'subnet_id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:51Z', 'updated_at': '2021-11-05T15:12:56Z', 'revision_number': 4, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'subnets': [{'id': 'fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:12:57.170981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee37e47-dcaa-49fd-bc17-60732449645a None None] Pushing event updated for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:12:57.539237 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:12:58.072531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:12:58.153642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:12:58.156014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:03.651956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-94f0d4ab-c328-41cb-b498-861c8d6cb598 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:03.653410 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-94f0d4ab-c328-41cb-b498-861c8d6cb598 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 815 time: 0.1062918 Nov 05 15:13:03.671802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-ceb41c11-722a-4db3-be35-d676148f22d2 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/quotas/ec691eaac94e4150af738df6009495e2 HTTP/1.1" status: 200 len: 375 time: 0.0107327 Nov 05 15:13:03.730554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-48bd8029-5ce7-4288-8248-bd089a113736 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0502541 Nov 05 15:13:03.909086 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-153d894c-306c-40f3-a7cd-3d1d5eafb473 service neutron] 10.222.0.30 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672883 Nov 05 15:13:04.001838 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-bf9960b0-5d92-442b-b3c8-b35f4223a90e service neutron] 10.222.0.30 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866222 Nov 05 15:13:04.153480 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52ea9e14-7355-4c2c-b8a4-8edfde95400d req-47132138-4fde-48dd-afee-767d3fb6d1b2 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 210 time: 0.0262501 Nov 05 15:13:05.058526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-80d20ae5-fc45-4f89-9bed-593ef4fb5fb5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:05.059970 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-80d20ae5-fc45-4f89-9bed-593ef4fb5fb5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 815 time: 0.1078763 Nov 05 15:13:05.073048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'port': {'device_id': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'admin_state_up': True, 'tenant_id': 'ec691eaac94e4150af738df6009495e2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:05.180575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Made reservation on behalf of ec691eaac94e4150af738df6009495e2 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:13:05.184126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:05.278263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97e106a2-167b-4661-87a5-e90014bbe5d6 req-6eaad6f6-7cf0-441d-b985-4d2c0d4c1acc tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 210 time: 0.0380414 Nov 05 15:13:05.344928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Allocated IP 172.20.0.10 (a2c2dfb3-6512-49cf-b141-1528a1cdbcf9/edfe133f-f329-4d1d-974f-646d1ea42078/ccdd9609-3b05-43a7-a8cf-4dba86265ca2) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:13:05.546624 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:05.593170 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:05.658559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:13:05.663973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:13:05.667135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:13:05.700009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:05.741634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:05.742389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:05.760807 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-85e981fc-d9d4-498b-b501-45971f5be6c1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6911356 Nov 05 15:13:05.964970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c86ee905-de2e-4d65-92bf-8feb6771dd1f None None] Provisioning complete for port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:13:05.965572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c86ee905-de2e-4d65-92bf-8feb6771dd1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:06.000075 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c86ee905-de2e-4d65-92bf-8feb6771dd1f None None] Port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:13:06.398659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3972069e-59d8-467e-b519-09f07fec21bc req-d4a6ae14-2060-4f4c-84a8-ca0b464e9632 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:06.400118 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3972069e-59d8-467e-b519-09f07fec21bc req-d4a6ae14-2060-4f4c-84a8-ca0b464e9632 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0527015 Nov 05 15:13:06.454788 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3972069e-59d8-467e-b519-09f07fec21bc req-c177f8e7-daf7-41a9-a4ae-f4561b523233 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480185 Nov 05 15:13:07.582071 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fa4c7a-3b85-4498-96e6-221e042d534f req-13548c7c-2479-4d9c-abfc-70b9dd936dc1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:07.583550 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-15fa4c7a-3b85-4498-96e6-221e042d534f req-13548c7c-2479-4d9c-abfc-70b9dd936dc1 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0587029 Nov 05 15:13:07.632757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-15fa4c7a-3b85-4498-96e6-221e042d534f req-c255e2ad-d1e7-4ac3-80ce-02a337a4daa7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431764 Nov 05 15:13:08.751000 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf70e3a-e145-4fc5-b77b-ec6c174be409 req-632b0d6f-6c36-404c-9443-c3d7a1473895 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:08.752711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdf70e3a-e145-4fc5-b77b-ec6c174be409 req-632b0d6f-6c36-404c-9443-c3d7a1473895 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0513175 Nov 05 15:13:08.799783 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fdf70e3a-e145-4fc5-b77b-ec6c174be409 req-f69c6000-49c8-4c16-ac79-c79dbe65d918 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411110 Nov 05 15:13:09.923418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f183c9d6-05f9-4217-8f43-46a91e17f35e req-595cc4aa-0543-4b8b-ba35-ca52045bb094 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:09.925263 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f183c9d6-05f9-4217-8f43-46a91e17f35e req-595cc4aa-0543-4b8b-ba35-ca52045bb094 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0517428 Nov 05 15:13:09.975817 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f183c9d6-05f9-4217-8f43-46a91e17f35e req-df271286-0c92-46b2-ba03-71ed4f89e669 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441365 Nov 05 15:13:11.101025 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a94e56-7d9e-4c68-9eaf-cddee28f0716 req-e5368f12-ed26-47ca-9ed9-e8addfaca0c6 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:11.102679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78a94e56-7d9e-4c68-9eaf-cddee28f0716 req-e5368f12-ed26-47ca-9ed9-e8addfaca0c6 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0564034 Nov 05 15:13:11.151870 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78a94e56-7d9e-4c68-9eaf-cddee28f0716 req-64dc9cbe-5f15-4419-9e8a-712d017fd7ad tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422640 Nov 05 15:13:12.273438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5cf19c-87f1-4d21-a369-1ac93d10e198 req-9d0fef3e-8d9b-47b2-8c98-22fc1996673c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:12.275685 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ce5cf19c-87f1-4d21-a369-1ac93d10e198 req-9d0fef3e-8d9b-47b2-8c98-22fc1996673c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0505223 Nov 05 15:13:12.331184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ce5cf19c-87f1-4d21-a369-1ac93d10e198 req-572e79aa-c5a9-49be-a6d0-edd5c73dda06 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476015 Nov 05 15:13:13.452939 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b1b4a4-8fa6-4cca-bbe8-05c2e157196c req-4b5e0d6f-02cf-4d33-a88e-dce32f72fb5f tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:13.454424 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-57b1b4a4-8fa6-4cca-bbe8-05c2e157196c req-4b5e0d6f-02cf-4d33-a88e-dce32f72fb5f tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0553892 Nov 05 15:13:13.526602 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-57b1b4a4-8fa6-4cca-bbe8-05c2e157196c req-2e0536cf-7ddd-43ac-94b9-ea8509934ded tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496352 Nov 05 15:13:14.623829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e8c6faa-5d1c-4df1-95b5-7dadb9ab994c req-5d0041e2-51ea-44c0-99a8-95b38c9d93fe tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:14.625357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4e8c6faa-5d1c-4df1-95b5-7dadb9ab994c req-5d0041e2-51ea-44c0-99a8-95b38c9d93fe tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 932 time: 0.0521331 Nov 05 15:13:14.676567 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4e8c6faa-5d1c-4df1-95b5-7dadb9ab994c req-af0eee50-9856-4198-b5d4-1225236b86d3 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426803 Nov 05 15:13:15.274584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Request body: {'port': {'device_id': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:15.330527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.585440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ccdd9609-3b05-43a7-a8cf-4dba86265ca2 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:13:15.593125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.605131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Transition to ACTIVE for port object ccdd9609-3b05-43a7-a8cf-4dba86265ca2 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:13:15.609482 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.655227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:15.739211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Attempting to bind port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:13:15.739864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Attempting to bind port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:13:15.740195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Attempting to bind port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 on network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:13:15.745357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 on network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:13:15.745674 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Attempting to bind port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 on network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:13:15.751815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 12, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:13:15.752161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Checking segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:13:15.752562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Bound using segment: {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:13:15.753094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Bound port: ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83bc0ae6-9055-474f-ba29-fcfe7c493940', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 621, 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:13:15.753449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.815666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8f870a-6f50-4674-b6f2-73d6d110e6e7 req-80cd74f7-cfce-4244-8a8a-c009e8e544d3 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:15.817708 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1f8f870a-6f50-4674-b6f2-73d6d110e6e7 req-80cd74f7-cfce-4244-8a8a-c009e8e544d3 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 944 time: 0.0552619 Nov 05 15:13:15.845698 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:13:15.850215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:13:15.856580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.875544 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1f8f870a-6f50-4674-b6f2-73d6d110e6e7 req-ddb44a76-2f6a-4dc1-8cdd-b742c2faebbc tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507116 Nov 05 15:13:15.898719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:15.899344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:15.900767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] 10.222.0.32 "PUT /v2.0/ports/ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1094 time: 0.6308539 Nov 05 15:13:15.901216 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:13:15.903570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8854fe3-e766-4281-b64c-2019c65f0cef" -d '{"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:13:15.950435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1fd7a7-2b22-4655-8577-c8113cd567e2 service neutron] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:15.974665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:13:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7278922-1366-44cf-b5da-92d54e91075b x-openstack-request-id: req-d7278922-1366-44cf-b5da-92d54e91075b {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:13:15.974938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:13:15.975190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d7278922-1366-44cf-b5da-92d54e91075b {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:13:15.975598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:13:15.997404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-922502b6-9c07-4e71-9a17-07c546077601 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.000073 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-922502b6-9c07-4e71-9a17-07c546077601 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1097 time: 0.0592272 Nov 05 15:13:16.047652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-42eecbac-f49a-46ef-95f8-4f804f9f1ecd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 217 time: 0.0391216 Nov 05 15:13:16.099248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-98b49e3f-5d63-4622-90a1-ab4ea72f633f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.100659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-98b49e3f-5d63-4622-90a1-ab4ea72f633f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0451274 Nov 05 15:13:16.148425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3967864-68a1-4212-a622-183a805e1932 req-f8a691c8-7bdb-4425-8d1c-5563e84f9e57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.149947 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-f8a691c8-7bdb-4425-8d1c-5563e84f9e57 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408027 Nov 05 15:13:16.244713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-6ab95b36-f0b4-4bc2-bc15-c3a8abaa3531 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857182 Nov 05 15:13:16.332420 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e3967864-68a1-4212-a622-183a805e1932 req-24f583f4-4f4e-43c8-9934-c37263b366b6 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788243 Nov 05 15:13:16.416208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-ef3236cd-0ac3-489f-a7ea-8ceff8579225 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.417696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-ef3236cd-0ac3-489f-a7ea-8ceff8579225 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1097 time: 0.0397010 Nov 05 15:13:16.509297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-51f94e2c-ee38-4ecd-ae66-58fe38a3461e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.510763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-51f94e2c-ee38-4ecd-ae66-58fe38a3461e service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.0849855 Nov 05 15:13:16.556944 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-460ef7c5-526d-4310-bb50-939d9ca6b6c5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 217 time: 0.0386200 Nov 05 15:13:16.610699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-e6e14fc7-1079-4ee5-a65a-406912811fae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.612128 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-e6e14fc7-1079-4ee5-a65a-406912811fae service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0470183 Nov 05 15:13:16.656925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-a6d864dd-caaf-466f-b55a-bd4e09bd48ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.658432 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-a6d864dd-caaf-466f-b55a-bd4e09bd48ae service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0387616 Nov 05 15:13:16.745150 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-1f753d0b-862a-4788-a65e-a3d8861fa9fb service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788958 Nov 05 15:13:16.836778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8854fe3-e766-4281-b64c-2019c65f0cef req-14fb631e-8888-494e-8eae-d1a936779d98 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834210 Nov 05 15:13:16.987164 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55607d83-b852-46c7-83c0-022460bdeab1 req-c589daea-6565-415e-b276-d3b137701d2e tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:16.988630 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-55607d83-b852-46c7-83c0-022460bdeab1 req-c589daea-6565-415e-b276-d3b137701d2e tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 944 time: 0.0470638 Nov 05 15:13:17.038183 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-55607d83-b852-46c7-83c0-022460bdeab1 req-2294742a-897a-4f62-acd7-56812c43e3b5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437031 Nov 05 15:13:17.800608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device ccdd9609-3b05-43a7-a8cf-4dba86265ca2 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:13:17.891161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:13:17.902224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'port_id': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'mac_address': 'fa:16:3e:5f:d3:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 621, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:13:17.942216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:17.954497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ccdd9609-3b05-43a7-a8cf-4dba86265ca2 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:13:17.973227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:13:17.977017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:18.023304 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:18.032450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.032995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.033500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.034002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.034492 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.034989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.035481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.035981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.036347 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.036700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.037031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.037355 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:18.156392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321ac714-4c2f-4a0d-81d5-ccf19cd2e8d8 req-2934d4b1-6514-4436-a4fb-c518de67d308 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:18.157916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-321ac714-4c2f-4a0d-81d5-ccf19cd2e8d8 req-2934d4b1-6514-4436-a4fb-c518de67d308 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 945 time: 0.0513048 Nov 05 15:13:18.184984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:13:18.204756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-321ac714-4c2f-4a0d-81d5-ccf19cd2e8d8 req-1b76505e-3cfc-4800-abaf-9192e6c0bf7b tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408044 Nov 05 15:13:18.437164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:19.316370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1dfa32-d242-47e7-b049-bee04ac5d038 req-169659b6-5b68-4db6-aef4-90d52497a852 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:19.317851 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b1dfa32-d242-47e7-b049-bee04ac5d038 req-169659b6-5b68-4db6-aef4-90d52497a852 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 945 time: 0.0480111 Nov 05 15:13:19.364776 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3b1dfa32-d242-47e7-b049-bee04ac5d038 req-79230963-fe16-42a5-8513-26bed41bc22d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411410 Nov 05 15:13:19.796831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device ccdd9609-3b05-43a7-a8cf-4dba86265ca2 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:13:19.845277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:13:19.848930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:13:19.849297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:19.925371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:19.946423 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:13:19.948639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8f26d67-57ad-472b-b6ad-dd338db8fc78" -d '{"events": [{"server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "name": "network-vif-plugged", "status": "completed", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:13:19.961649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:13:19.965833 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:20.012322 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:20.104869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:13:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c7d44c8-c7d6-4f96-b0b6-0679464bd93f x-openstack-request-id: req-0c7d44c8-c7d6-4f96-b0b6-0679464bd93f {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:13:20.105149 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "name": "network-vif-plugged", "status": "completed", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:13:20.105396 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0c7d44c8-c7d6-4f96-b0b6-0679464bd93f {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:13:20.105802 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'code': 200} Nov 05 15:13:20.118579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0a33600f-637e-457c-88e0-2fcc0adceac3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:20.270700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0282f1-b777-4dde-bd0f-d8093a634718 req-1710e6cf-3569-457c-8b52-023cd1d260d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:20.272156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0f0282f1-b777-4dde-bd0f-d8093a634718 req-1710e6cf-3569-457c-8b52-023cd1d260d7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1099 time: 0.0439610 Nov 05 15:13:20.315200 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0f0282f1-b777-4dde-bd0f-d8093a634718 req-b55f1245-12a5-4a38-aa37-4e7753f9f6ba service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360365 Nov 05 15:13:20.480928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d5546b-0936-40a8-a121-4127fe7201d1 req-a4672b1d-ad4b-4ede-b264-1c57a6a0a37c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:20.480928 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-57d5546b-0936-40a8-a121-4127fe7201d1 req-a4672b1d-ad4b-4ede-b264-1c57a6a0a37c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0479043 Nov 05 15:13:20.527248 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-57d5546b-0936-40a8-a121-4127fe7201d1 req-c5212cae-bebf-43ec-8a66-c8c9a4686383 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418682 Nov 05 15:13:21.642211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7cb1477-0203-4ecc-a096-d5dde3984356 req-1b9f6ede-7f00-4033-8f70-766c30adb532 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:21.643705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d7cb1477-0203-4ecc-a096-d5dde3984356 req-1b9f6ede-7f00-4033-8f70-766c30adb532 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0485864 Nov 05 15:13:21.690939 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d7cb1477-0203-4ecc-a096-d5dde3984356 req-0d61f9d0-fa3f-4097-a0e3-91cf9a78b383 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413465 Nov 05 15:13:21.804857 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32863f9c-8581-43de-a955-1423bb08cce6 req-0eed4f23-ad50-4b88-abb4-c7090016e567 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:21.806229 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-32863f9c-8581-43de-a955-1423bb08cce6 req-0eed4f23-ad50-4b88-abb4-c7090016e567 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0518327 Nov 05 15:13:21.852499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-32863f9c-8581-43de-a955-1423bb08cce6 req-61322482-a0ed-4980-bd31-02649c30aea4 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400007 Nov 05 15:13:22.167027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74293b96-310b-4c9f-b23e-a67b37065ca7 req-56ee75ca-aacf-4449-83a8-ebf7940f3250 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:22.168508 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74293b96-310b-4c9f-b23e-a67b37065ca7 req-56ee75ca-aacf-4449-83a8-ebf7940f3250 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0479841 Nov 05 15:13:22.215718 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74293b96-310b-4c9f-b23e-a67b37065ca7 req-ee8e1bfe-426a-40b1-a442-86c998ddf954 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404630 Nov 05 15:13:22.572254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-94a84155-861d-45c9-a965-75c7ee6cb818 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:23.499144 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:24.966220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:25.978125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:34.538712 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:13:35.726320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da0fd32-7926-4dc5-b75f-34377c2dfa29 req-33035984-11b4-4738-97c3-8e23c09d3fb5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:35.727782 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9da0fd32-7926-4dc5-b75f-34377c2dfa29 req-33035984-11b4-4738-97c3-8e23c09d3fb5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0520253 Nov 05 15:13:35.773563 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9da0fd32-7926-4dc5-b75f-34377c2dfa29 req-9a4707ee-6d12-471d-ae0b-11b9d9454ed3 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398428 Nov 05 15:13:35.795435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50522) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:35.875159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-907f6b66-cd1f-4a68-a8c2-5d2d5de54495 tempest-TestMinimumBasicScenario-1893724895 tempest-TestMinimumBasicScenario-1893724895-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:35.876702 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-907f6b66-cd1f-4a68-a8c2-5d2d5de54495 tempest-TestMinimumBasicScenario-1893724895 tempest-TestMinimumBasicScenario-1893724895-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1094 time: 0.0802927 Nov 05 15:13:35.879596 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50526) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:35.883965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'fixed_ip_address': '172.20.0.10'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:35.906836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.004521 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.104659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Allocated IP 172.26.5.164 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d8c037a4-4f4b-4f08-b1d2-45298ce463bf) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:13:36.208784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.242106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.277165 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:13:36.279878 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:13:36.285233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:13:36.308827 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'Port': ['ID=d8c037a4-4f4b-4f08-b1d2-45298ce463bf,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:36.640241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.705200 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.851266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.855677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:36.928919 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'Port': ['ID=d8c037a4-4f4b-4f08-b1d2-45298ce463bf,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:36.937151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.035259 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Floating IP 2520e7cd-fa38-448c-b3a9-270f0f93649d associated. External IP: 172.26.5.164, port: ccdd9609-3b05-43a7-a8cf-4dba86265ca2. Nov 05 15:13:37.241401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Router 88d7a766-db07-4a48-a658-81f5d212360b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:13:37.355232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:13:37.364959 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Sync routers for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:13:37.372303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.375286 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:13:37.375918 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:13:23Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:13:37.400579 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-387f4883-c50a-42ef-924f-7feb70e07558 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5199208 Nov 05 15:13:37.401260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:13:37.403474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50528) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:37.403978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11372b4f-11aa-46d0-8b67-7506bb23cce2" -d '{"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:13:37.409922 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1796372389', 'description': 'tempest-secgroup-smoke-1796372389 description', 'project_id': 'ec691eaac94e4150af738df6009495e2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:37.434161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.486960 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:13:37.500156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:13:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4661164a-c631-4a7e-9793-661ed81b853a x-openstack-request-id: req-4661164a-c631-4a7e-9793-661ed81b853a {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:13:37.500445 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:13:37.500720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4661164a-c631-4a7e-9793-661ed81b853a {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:13:37.501122 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:13:37.514926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.519203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.580070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.583981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1754584 Nov 05 15:13:37.583981 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0dc9038d-c24e-4579-8b87-54d050749e21,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:37.584361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50534) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:37.589217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:37.593879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.594222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.594812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.594946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.595189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.595512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.595842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.596157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.596485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.596813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.597133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.597451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6de18de3-eed6-40d2-90c3-d8420adad227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:13:37.604865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-be48b4b9-80c9-45fd-97ef-6ebe52340059 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:37.606365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-be48b4b9-80c9-45fd-97ef-6ebe52340059 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1099 time: 0.0808713 Nov 05 15:13:37.623993 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.675936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.680599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.696691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e07a193b-b8f9-44d0-9c10-0384209faea2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:37.701220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-b99d6457-2dc6-48aa-82d9-c285aa901bbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:37.703675 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-b99d6457-2dc6-48aa-82d9-c285aa901bbc service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.0885985 Nov 05 15:13:37.712597 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.713824 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da17ace9-2bf8-4034-8fa7-c06f1c874df8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1284180 Nov 05 15:13:37.716482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50536) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:37.721865 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:37.739711 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2520e7cd-fa38-448c-b3a9-270f0f93649d', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'floating_ip_address': '172.26.5.164', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'port_id': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'mac_address': 'fa:16:3e:5f:d3:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:13:36Z', 'updated_at': '2021-11-05T15:13:36Z', 'revision_number': 0, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:13:37.749114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.766890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Checking router: 88d7a766-db07-4a48-a658-81f5d212360b for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:13:37.775145 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:13:37.775589 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-cbb34924-a5de-4f28-9799-de0d0bc84409 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1000 time: 0.0643115 Nov 05 15:13:37.775725 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:13:23Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:13:37.816823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.822083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.825169 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-b9b423d3-6cf8-4f3c-b456-061efe87990e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:37.827233 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-b9b423d3-6cf8-4f3c-b456-061efe87990e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0442300 Nov 05 15:13:37.841091 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ff10b0e-0670-456c-96fd-3278c4511d7c,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:37.852405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.853821 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8c7de735-79c0-456b-8bca-848df0b7d861 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1363983 Nov 05 15:13:37.856518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50538) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:37.861479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:37.883718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-aee0e689-b19b-4f68-98b2-0fa0429cd7f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:37.885327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-aee0e689-b19b-4f68-98b2-0fa0429cd7f0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0514779 Nov 05 15:13:37.893451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.956964 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.962098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.980707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a6261366-a84d-4b53-88e0-5c41fa75e25a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:37.987812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-68fb80bd-cf9d-4c0d-924a-b8b8fad7ac77 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0941770 Nov 05 15:13:37.989758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:37.990948 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dd3a8abc-91a1-4a55-9cdd-d96c16f7bc91 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1332364 Nov 05 15:13:37.993684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50540) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:37.998009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:38.010470 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:13:38.028708 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.082983 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-11372b4f-11aa-46d0-8b67-7506bb23cce2 req-07c1b2f0-1ec2-4307-bbb7-5001dfed54bb service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867174 Nov 05 15:13:38.093159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.097848 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.115051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1c550e4-44aa-4833-b463-665854348849,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:38.124032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.125250 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-30617cac-66a7-437e-b1fe-0cbde71f4b87 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1306546 Nov 05 15:13:38.127822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50542) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:38.132130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:38.155277 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Project ec691eaac94e4150af738df6009495e2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:13:38.160173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.222259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.228530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.241851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=635b41a9-dcfd-44bd-b65c-19fed7fd960a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:38.253146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.254528 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da9841b3-a44d-4154-a604-5955362c7483 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1257470 Nov 05 15:13:38.257132 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50544) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:13:38.261823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'security_group_rule': {'security_group_id': '0dc9038d-c24e-4579-8b87-54d050749e21', 'project_id': 'ec691eaac94e4150af738df6009495e2', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:38.283639 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Project ec691eaac94e4150af738df6009495e2 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:13:38.289153 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.349525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.353627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.355591 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2520e7cd-fa38-448c-b3a9-270f0f93649d', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'floating_ip_address': '172.26.5.164', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'port_id': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'mac_address': 'fa:16:3e:5f:d3:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:13:36Z', 'updated_at': '2021-11-05T15:13:36Z', 'revision_number': 0, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:13:38.368287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4c314cc2-ffbc-46ae-a5f2-18b58edc83e9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:38.379298 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.380694 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-85dbeffc-dd8a-42d3-bf63-6b4426158a50 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1224558 Nov 05 15:13:38.382488 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8a885dc-d45f-4045-87d1-ba803c3ea104 None None] The sync data for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv is: [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2520e7cd-fa38-448c-b3a9-270f0f93649d', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'floating_ip_address': '172.26.5.164', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'port_id': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1649, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'mac_address': 'fa:16:3e:5f:d3:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:13:36Z', 'updated_at': '2021-11-05T15:13:36Z', 'revision_number': 0, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:13:38.475363 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-c3b5bbce-43be-49ca-86d2-b0c52915f0e9 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1796372389&fields=id&tenant_id=ec691eaac94e4150af738df6009495e2 HTTP/1.1" status: 200 len: 267 time: 0.0459251 Nov 05 15:13:38.532113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-8fdef930-8cf7-4077-b033-e263c1be008c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:38.533665 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-8fdef930-8cf7-4077-b033-e263c1be008c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0525630 Nov 05 15:13:38.545167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'port': {'security_groups': ['97977614-5703-4480-9ca8-4f0d61cd5b6c', '0dc9038d-c24e-4579-8b87-54d050749e21']}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:13:38.584440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2944afc-e98a-4a6f-9db7-5043c64930bd None None] New status for floating IP 2520e7cd-fa38-448c-b3a9-270f0f93649d: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:13:38.613576 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.805499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:13:38.834501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.838962 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.850419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:13:38.881784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:38.882409 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:38.883805 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-39100d5f-dd0d-43eb-bcbc-badf3d0a1933 req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "PUT /v2.0/ports/ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 982 time: 0.3435087 Nov 05 15:13:38.908484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a71682-3798-4626-862f-2547a175908d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=6']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:13:38.943055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:13:38.999578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a987f4d-0d5f-42a3-b0cc-9623cbb47d10 req-a3023697-5037-43ee-be6e-7cfcb6e5ff26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:39.001160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a987f4d-0d5f-42a3-b0cc-9623cbb47d10 req-a3023697-5037-43ee-be6e-7cfcb6e5ff26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0552254 Nov 05 15:13:39.069521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3a987f4d-0d5f-42a3-b0cc-9623cbb47d10 req-2c194032-8976-48d4-b3ae-3c039518d4ff tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0613000 Nov 05 15:13:39.223165 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a7d6726d-fd25-458f-a252-d510b76c8f90 None None] Provisioning complete for port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:13:39.223524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a7d6726d-fd25-458f-a252-d510b76c8f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:39.501797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:13:39.504736 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9b18aa5-1c38-4e2d-950c-14d3b736260d" -d '{"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:13:39.541106 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:13:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3911527f-43b0-48ad-8ad1-ab5ea9a0b441 x-openstack-request-id: req-3911527f-43b0-48ad-8ad1-ab5ea9a0b441 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:13:39.541401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:13:39.541651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3911527f-43b0-48ad-8ad1-ab5ea9a0b441 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:13:39.542080 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:13:39.605764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-6c41e6c4-ca44-4b9d-9e95-389db4a82cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:39.607261 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-6c41e6c4-ca44-4b9d-9e95-389db4a82cbc service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1138 time: 0.0414090 Nov 05 15:13:39.703772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-fd0a308d-150c-488d-b8e2-95556c41e249 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:39.705184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-fd0a308d-150c-488d-b8e2-95556c41e249 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.0869131 Nov 05 15:13:39.773284 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-7aabe106-0423-47f6-bbc9-4d8f1690fdb5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1002 time: 0.0605648 Nov 05 15:13:39.821366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-3273dcaf-31de-406c-8ab9-a22599940461 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:39.822744 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-3273dcaf-31de-406c-8ab9-a22599940461 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0416956 Nov 05 15:13:39.866714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-a2236dd2-96d9-4e55-8821-3d2b060bd9fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:39.868116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-a2236dd2-96d9-4e55-8821-3d2b060bd9fa service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0374360 Nov 05 15:13:39.964269 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-3c374b54-1114-4b5f-a432-3335e2912327 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823364 Nov 05 15:13:40.051084 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b9b18aa5-1c38-4e2d-950c-14d3b736260d req-19cd74fc-b5be-4507-9ebe-2c178e2b175b service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790422 Nov 05 15:13:48.450551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:50.119562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f8ab95e-cd2d-477e-9bcf-af36554f17df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:52.443854 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-57b5ea3a-9088-4d6a-b427-2ace41a5a99e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:53.502238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:54.222854 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499c336c-05eb-488b-87d3-97480dd51a2e req-327dc01a-4369-4a1c-bf8f-cc43c109e4ef tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:54.224374 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-499c336c-05eb-488b-87d3-97480dd51a2e req-327dc01a-4369-4a1c-bf8f-cc43c109e4ef tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0522685 Nov 05 15:13:54.224841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-3c1767e8-87ee-4b59-96ee-2bff3c7beb71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:54.226407 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-3c1767e8-87ee-4b59-96ee-2bff3c7beb71 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1138 time: 0.0433700 Nov 05 15:13:54.288885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-499c336c-05eb-488b-87d3-97480dd51a2e req-07380f1c-a51b-4e76-97a5-445ef4099fef tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0583148 Nov 05 15:13:54.321359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-f8ba1855-3fb0-413d-a8af-0805d1faef9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:54.322809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-f8ba1855-3fb0-413d-a8af-0805d1faef9e service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.0884156 Nov 05 15:13:54.387234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-0c84bb04-7994-4500-967b-f349d6ef28e0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1002 time: 0.0563576 Nov 05 15:13:54.439764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-a2321db2-30ad-45cc-830f-030cd52a2c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:54.441190 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-a2321db2-30ad-45cc-830f-030cd52a2c96 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0455673 Nov 05 15:13:54.484929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-68178397-a471-4ddf-a651-053a8e4bf666 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:54.486294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-68178397-a471-4ddf-a651-053a8e4bf666 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382657 Nov 05 15:13:54.573106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-965cd4a4-5ed0-4666-b80a-c58173e315c5 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792520 Nov 05 15:13:54.943633 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f7b5e63f-badd-49bc-93b7-1ba5670f8abc req-10a3cb76-127a-41fb-a784-852dfd2597dd service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3627884 Nov 05 15:13:54.964160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:55.408098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2a0131-e6a0-498f-b08c-6803b755f819 req-22928838-3bac-45ee-b523-c4572aa0ec25 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:55.409581 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7b2a0131-e6a0-498f-b08c-6803b755f819 req-22928838-3bac-45ee-b523-c4572aa0ec25 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0494728 Nov 05 15:13:55.467809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7b2a0131-e6a0-498f-b08c-6803b755f819 req-969b9a08-921f-4596-8048-8db982fba451 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0522656 Nov 05 15:13:55.970896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:13:56.580847 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-117dc2bb-b02d-4a73-bc20-fd322d3df162 req-ead8eec4-7958-4c77-af80-d81dda41d34d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:56.582315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-117dc2bb-b02d-4a73-bc20-fd322d3df162 req-ead8eec4-7958-4c77-af80-d81dda41d34d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0488303 Nov 05 15:13:56.642144 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-117dc2bb-b02d-4a73-bc20-fd322d3df162 req-8f47b0a7-6c82-400e-8bd4-ee529e984d00 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0538380 Nov 05 15:13:57.760694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b038fd-a0b2-4f0c-bae4-84b6a5bc94fe req-69d53c4f-7f37-4fe9-ad0c-8b81c64059a9 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:57.762068 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63b038fd-a0b2-4f0c-bae4-84b6a5bc94fe req-69d53c4f-7f37-4fe9-ad0c-8b81c64059a9 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0541008 Nov 05 15:13:57.821172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63b038fd-a0b2-4f0c-bae4-84b6a5bc94fe req-94244e2e-e9b9-4476-929d-49eb29437ce7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0529861 Nov 05 15:13:58.933907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de93dae7-e0de-4286-b874-c6aee28c9414 req-c3a10f69-811a-48cf-8fc8-490eaa06fb3c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:13:58.936024 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de93dae7-e0de-4286-b874-c6aee28c9414 req-c3a10f69-811a-48cf-8fc8-490eaa06fb3c tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0487354 Nov 05 15:13:58.996957 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-de93dae7-e0de-4286-b874-c6aee28c9414 req-499a8c62-790f-4dd3-8781-261f8bfb0e7b tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0548856 Nov 05 15:14:00.114143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7116a8a-9d69-4441-a4a0-5f9dd78d38d4 req-4edebdb0-27be-4c51-931c-0a1611f67f98 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:00.115598 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b7116a8a-9d69-4441-a4a0-5f9dd78d38d4 req-4edebdb0-27be-4c51-931c-0a1611f67f98 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0480511 Nov 05 15:14:00.174492 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b7116a8a-9d69-4441-a4a0-5f9dd78d38d4 req-11442596-bcde-49cc-9b85-df95284b1f9b tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528536 Nov 05 15:14:01.291464 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e644b640-2942-4121-8534-ddee9fdd36ac req-7b3ea3c9-2ffa-4d8d-922d-c7cd842af56a tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:01.292952 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e644b640-2942-4121-8534-ddee9fdd36ac req-7b3ea3c9-2ffa-4d8d-922d-c7cd842af56a tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0531123 Nov 05 15:14:01.352001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e644b640-2942-4121-8534-ddee9fdd36ac req-6a2ef400-fcf0-4b84-b004-f264d2cbc93a tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528250 Nov 05 15:14:02.468294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155c8450-4872-4a31-a5ac-29cd797770ab req-0596c35d-ca1e-4bd3-a7a7-afd9a7b244ef tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:02.469754 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-155c8450-4872-4a31-a5ac-29cd797770ab req-0596c35d-ca1e-4bd3-a7a7-afd9a7b244ef tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0517459 Nov 05 15:14:02.527946 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-155c8450-4872-4a31-a5ac-29cd797770ab req-8bbe8f1a-303b-4443-b084-27729443b7da tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523269 Nov 05 15:14:03.642241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1277bb-4040-45af-b745-7348903a5d39 req-d956e3b1-d63a-4ea5-9b5f-0296f51949a5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:03.643717 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-af1277bb-4040-45af-b745-7348903a5d39 req-d956e3b1-d63a-4ea5-9b5f-0296f51949a5 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0501428 Nov 05 15:14:03.707467 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-af1277bb-4040-45af-b745-7348903a5d39 req-4e5ec592-99f2-47aa-b5aa-1def3aabb613 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0576172 Nov 05 15:14:04.820930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35df1c92-73e5-4088-a5e7-0faf34fda372 req-7799e2da-e178-4038-a0ef-40787e68df71 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:04.822303 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-35df1c92-73e5-4088-a5e7-0faf34fda372 req-7799e2da-e178-4038-a0ef-40787e68df71 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0477378 Nov 05 15:14:04.881121 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-35df1c92-73e5-4088-a5e7-0faf34fda372 req-1852c122-93a5-4a0b-bc27-12cc3bdd7fbc tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0524626 Nov 05 15:14:05.999766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1ce0c1-8772-4b60-bc3a-997a7430e949 req-fd934286-1e5f-4d26-8a54-b216a5a9cd43 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:06.001273 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9c1ce0c1-8772-4b60-bc3a-997a7430e949 req-fd934286-1e5f-4d26-8a54-b216a5a9cd43 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0529130 Nov 05 15:14:06.060186 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9c1ce0c1-8772-4b60-bc3a-997a7430e949 req-a0186e18-9775-4474-88dc-a103a1e2e058 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=0dc9038d-c24e-4579-8b87-54d050749e21&id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0529678 Nov 05 15:14:11.537863 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:14:18.447661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:20.119784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6179bc41-2a5e-425e-be35-19151058e03f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:22.444335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b53e4171-6f64-4d77-b516-3524473e8dc8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:22.521613 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-05da94ba-fa67-434c-84a0-17b5bf41bb8a service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399933 Nov 05 15:14:22.607426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-16da9275-0c62-43df-a724-524733aec60d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:22.608968 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-16da9275-0c62-43df-a724-524733aec60d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1138 time: 0.0443778 Nov 05 15:14:22.709874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-3ad12780-e06f-4827-900b-211d52e30fa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:22.711302 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-3ad12780-e06f-4827-900b-211d52e30fa2 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.0821509 Nov 05 15:14:22.780042 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-574c4dea-fd17-4611-9142-e7906745f21b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1002 time: 0.0606158 Nov 05 15:14:22.836166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-41563faa-0c77-4713-a54a-6532d820f8b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:22.837754 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-41563faa-0c77-4713-a54a-6532d820f8b2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0511634 Nov 05 15:14:22.886296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-ad9b80fc-1ab3-41e7-97a5-aa1f5ab10e31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:22.887757 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-ad9b80fc-1ab3-41e7-97a5-aa1f5ab10e31 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0424113 Nov 05 15:14:22.977218 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-3a8ba042-6054-4c73-8c52-7cf1f181d98a service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823338 Nov 05 15:14:23.065489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a177d94e-2aaa-4dd4-9faa-abda640aabd1 req-e875916a-13cb-4876-b338-d4f57db5746f service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809679 Nov 05 15:14:23.502916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:24.966692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:25.972305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:38.542734 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-3dc2a624-c653-441c-8019-bddbec4433c8 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1796372389&fields=id&tenant_id=ec691eaac94e4150af738df6009495e2 HTTP/1.1" status: 200 len: 267 time: 0.0489748 Nov 05 15:14:38.601057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-05e946ff-c39d-49cb-afbf-de08726e9564 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:38.602549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-05e946ff-c39d-49cb-afbf-de08726e9564 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 985 time: 0.0537944 Nov 05 15:14:38.613500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Request body: {'port': {'security_groups': ['97977614-5703-4480-9ca8-4f0d61cd5b6c']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:14:38.676255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:38.847291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:38.878553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:38.882789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:38.896061 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:14:38.925077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:38.925702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:38.927100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e026faa4-edb9-43c2-87b8-dce8d6c78a6e req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "PUT /v2.0/ports/ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 943 time: 0.3181553 Nov 05 15:14:38.927556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:14:38.933041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cff637b5-0471-4b52-aeaa-58b0a37c7242" -d '{"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:14:38.934248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50592) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:38.967370 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event updated for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=7']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:38.974885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.975241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.975595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.975980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.976315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.976673 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.977006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.977334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.977763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.978100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.978827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.978827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77e01ebd-5d15-4abe-a74e-bc96b0b08e26 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:38.989639 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:14:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85ed222a-274b-4d90-9bb2-386c2230244f x-openstack-request-id: req-85ed222a-274b-4d90-9bb2-386c2230244f {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:14:38.989970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:14:38.990182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-85ed222a-274b-4d90-9bb2-386c2230244f {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:14:38.990593 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:14:39.010537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:14:39.027938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.055339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.073896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-1b38424a-f9b1-4b61-8e6e-c79df3db9fb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:39.075437 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-1b38424a-f9b1-4b61-8e6e-c79df3db9fb2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1099 time: 0.0566981 Nov 05 15:14:39.129959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.133289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.137595 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "DELETE /v2.0/security-groups/0dc9038d-c24e-4579-8b87-54d050749e21 HTTP/1.1" status: 204 len: 168 time: 0.2005060 Nov 05 15:14:39.138648 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:39.194732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-e1ff1b9d-8176-47f6-8324-01333b71ca42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:39.196210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-e1ff1b9d-8176-47f6-8324-01333b71ca42 service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.1130817 Nov 05 15:14:39.196652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0dc9038d-c24e-4579-8b87-54d050749e21,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:39.208689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.209038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.209379 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.209717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.210053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.210383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.210797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.211382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.211382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.211678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.212007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.212163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dbabccbd-bafd-4d9d-975b-a4b38eadb8b6 None None] Provisioning complete for port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:14:39.212328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fbe3f07-d482-415e-a4f3-3dc9a0179227 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:14:39.212676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dbabccbd-bafd-4d9d-975b-a4b38eadb8b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.283747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-4970d964-7d33-404f-b95b-2189ba561847 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 1002 time: 0.0782585 Nov 05 15:14:39.331851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Deleting port d8c037a4-4f4b-4f08-b1d2-45298ce463bf {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:39.332198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.335149 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-3bd8d68c-dfd9-4cfc-bba5-484cd0139d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:39.336652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-3bd8d68c-dfd9-4cfc-bba5-484cd0139d7b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0457916 Nov 05 15:14:39.382770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-a496341b-f064-4da2-bc68-c5d243587110 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:39.384173 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-a496341b-f064-4da2-bc68-c5d243587110 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396547 Nov 05 15:14:39.406698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.407064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.419272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Calling delete_port for d8c037a4-4f4b-4f08-b1d2-45298ce463bf owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:39.477242 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-5af02c26-3fb1-47a2-819c-c65d1d3f42e3 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846519 Nov 05 15:14:39.568801 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cff637b5-0471-4b52-aeaa-58b0a37c7242 req-ca2db684-f268-4150-acb1-a27c29c381f5 service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843353 Nov 05 15:14:39.572774 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.599769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event deleted for resources: {'Port': ['ID=d8c037a4-4f4b-4f08-b1d2-45298ce463bf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:39.667316 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.667689 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Floating IP 2520e7cd-fa38-448c-b3a9-270f0f93649d disassociated (deleted). External IP: 172.26.5.164, port: ccdd9609-3b05-43a7-a8cf-4dba86265ca2. Nov 05 15:14:39.869275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Router 88d7a766-db07-4a48-a658-81f5d212360b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:14:39.975102 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:14:39.979880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:39.984380 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Sync routers for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:14:39.993596 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:39.994185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:40.005570 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f1c73969-d044-4f60-bec1-dfa9050408a7 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "DELETE /v2.0/floatingips/2520e7cd-fa38-448c-b3a9-270f0f93649d HTTP/1.1" status: 204 len: 168 time: 0.8629789 Nov 05 15:14:40.006163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:14:40.008388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08ea6410-9256-40a5-860d-677ca8d8f8bf" -d '{"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:14:40.046245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:14:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00cb6e19-0f03-4bc6-9ed0-1bbcf79ff026 x-openstack-request-id: req-00cb6e19-0f03-4bc6-9ed0-1bbcf79ff026 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:14:40.046912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:14:40.047265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-00cb6e19-0f03-4bc6-9ed0-1bbcf79ff026 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:14:40.047772 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:14:40.099695 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:40.117008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-91a83fed-b1f6-4d0e-bb85-b82cbf496dab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:40.118607 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-91a83fed-b1f6-4d0e-bb85-b82cbf496dab service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ec691eaac94e4150af738df6009495e2&device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 1099 time: 0.0470910 Nov 05 15:14:40.248336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-8f3320f1-7a3b-4d0e-82a5-ac22e83b4a5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:40.250150 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-8f3320f1-7a3b-4d0e-82a5-ac22e83b4a5d service neutron] 10.222.0.32 "GET /v2.0/networks?id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 200 len: 916 time: 0.1247904 Nov 05 15:14:40.297712 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-2080e731-24ab-49cd-83d1-8292cf095133 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 200 len: 217 time: 0.0406971 Nov 05 15:14:40.320406 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:40.346479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-63bf4bcb-2d42-4cb8-b589-bf6d5a9d1231 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:40.346672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Checking router: 88d7a766-db07-4a48-a658-81f5d212360b for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:14:40.347931 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-63bf4bcb-2d42-4cb8-b589-bf6d5a9d1231 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 200 len: 854 time: 0.0435212 Nov 05 15:14:40.354968 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:40.355552 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:40.398970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-06a7d31b-9b75-4312-b579-9a018939506d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:40.400486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-06a7d31b-9b75-4312-b579-9a018939506d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0453534 Nov 05 15:14:40.459045 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:40.491571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-e030c991-e2b3-483f-93d1-b71e2c57e3ae service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822394 Nov 05 15:14:40.597191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-08ea6410-9256-40a5-860d-677ca8d8f8bf req-3bb37bce-927c-43f9-a082-a82a367b5a9b service neutron] 10.222.0.32 "GET /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870264 Nov 05 15:14:40.658008 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:40.687240 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac1d2554-ea4e-4403-857e-956826854a6a None None] The sync data for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv is: [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:12:47Z', 'revision_number': 4, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'd39450cc-6550-442b-943e-f1ff3492be0b', 'name': '', 'network_id': 'a2c2dfb3-6512-49cf-b141-1528a1cdbcf9', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'mac_address': 'fa:16:3e:03:45:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_interface', 'standard_attr_id': 1634, 'fixed_ips': [{'subnet_id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:46Z', 'updated_at': '2021-11-05T15:12:52Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'subnets': [{'id': 'edfe133f-f329-4d1d-974f-646d1ea42078', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:14:40.913383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c411873e-cc27-48aa-8142-6dc529484ddc None None] New status for floating IP 2520e7cd-fa38-448c-b3a9-270f0f93649d: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:14:48.468124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:48.537956 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:14:49.111921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15b9db0a-47a4-4bbf-b877-080750c21d80 req-bd9b5dc1-ace1-49f8-afef-b80b5d529d2d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:49.113693 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-15b9db0a-47a4-4bbf-b877-080750c21d80 req-bd9b5dc1-ace1-49f8-afef-b80b5d529d2d tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0552835 Nov 05 15:14:49.164514 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-15b9db0a-47a4-4bbf-b877-080750c21d80 req-ce13e21d-e614-47a6-85f0-21e78f0acdc0 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446825 Nov 05 15:14:50.121329 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45b58038-f4ff-47c0-a2af-dc696271fe83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:50.331583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a7a15e-8cc7-4892-94a1-6b2f2bb79693 req-ba619f5f-da82-42a6-8850-804a23825d6f tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:50.333101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-36a7a15e-8cc7-4892-94a1-6b2f2bb79693 req-ba619f5f-da82-42a6-8850-804a23825d6f tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.1000161 Nov 05 15:14:50.384869 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-36a7a15e-8cc7-4892-94a1-6b2f2bb79693 req-1fc4735f-e2dd-447f-8c29-c537ea63209b tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/security-groups?id=97977614-5703-4480-9ca8-4f0d61cd5b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455840 Nov 05 15:14:50.843532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-4006c67d-6a71-4514-9a6d-eaf2fcdd5685 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:14:50.845029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-4006c67d-6a71-4514-9a6d-eaf2fcdd5685 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.32 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 946 time: 0.0499070 Nov 05 15:14:50.942023 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Deleting port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:50.942364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:51.028114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] For port ccdd9609-3b05-43a7-a8cf-4dba86265ca2, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:51.028400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:51.042177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Calling delete_port for ccdd9609-3b05-43a7-a8cf-4dba86265ca2 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:51.169007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:51.180257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['ccdd9609-3b05-43a7-a8cf-4dba86265ca2'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:14:51.197096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Pushing event deleted for resources: {'Port': ['ID=ccdd9609-3b05-43a7-a8cf-4dba86265ca2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:51.252248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] No DVR routers for this DVR port ccdd9609-3b05-43a7-a8cf-4dba86265ca2 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:14:51.254789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:51.258182 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9fd725bc-10f6-4dc9-93fb-954f3f8c754d req-8f8554e0-67c0-4819-a97a-335d92fead03 tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.32 "DELETE /v2.0/ports/ccdd9609-3b05-43a7-a8cf-4dba86265ca2 HTTP/1.1" status: 204 len: 173 time: 0.4070818 Nov 05 15:14:51.258629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'name': 'network-vif-deleted', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:14:51.260900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81a5cb70-8819-4fc1-9cf9-f562d8d2ec1c" -d '{"events": [{"server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "name": "network-vif-deleted", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:14:51.303887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:14:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97f29bcf-9746-41f1-bee0-3bb5e3a56a05 x-openstack-request-id: req-97f29bcf-9746-41f1-bee0-3bb5e3a56a05 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:14:51.304185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4c1ae981-6769-4707-ba2d-e7a6fe817417", "name": "network-vif-deleted", "tag": "ccdd9609-3b05-43a7-a8cf-4dba86265ca2", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:14:51.304502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-97f29bcf-9746-41f1-bee0-3bb5e3a56a05 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:14:51.304926 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4c1ae981-6769-4707-ba2d-e7a6fe817417', 'name': 'network-vif-deleted', 'tag': 'ccdd9609-3b05-43a7-a8cf-4dba86265ca2', 'status': 'completed', 'code': 200} Nov 05 15:14:51.492167 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9aa3ed36-4491-4a48-b591-29209eb82218 req-20b338dd-3cea-49c0-a7e9-7830b44537cd tempest-TestMinimumBasicScenario-738805659 tempest-TestMinimumBasicScenario-738805659-project] 10.222.0.30 "GET /v2.0/ports?device_id=4c1ae981-6769-4707-ba2d-e7a6fe817417 HTTP/1.1" status: 200 len: 210 time: 0.0264752 Nov 05 15:14:52.444561 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dea919f3-06f3-4d96-957c-9ca39561163e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:53.081619 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50708) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:53.507512 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:53.731454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:53.971808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Deleting port d39450cc-6550-442b-943e-f1ff3492be0b {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:53.972144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.050969 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] For port d39450cc-6550-442b-943e-f1ff3492be0b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d39450cc-6550-442b-943e-f1ff3492be0b,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:54.051322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.063594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Calling delete_port for d39450cc-6550-442b-943e-f1ff3492be0b owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:54.240557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.266778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Pushing event deleted for resources: {'Port': ['ID=d39450cc-6550-442b-943e-f1ff3492be0b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:54.431996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.644959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Router 88d7a766-db07-4a48-a658-81f5d212360b has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:14:54.749657 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:14:54.755364 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3039ee55-7a74-4df0-bfb5-641e19007951 admin admin] 10.222.0.30 "PUT /v2.0/routers/88d7a766-db07-4a48-a658-81f5d212360b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6727309 Nov 05 15:14:54.758232 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50710) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:54.759582 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Sync routers for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:14:54.770379 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:54.770964 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:54.861861 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.962437 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:54.968418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:54.969087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.019473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Deleting port 23fe6a2b-3236-4300-b156-515efaeb1ac4 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:55.019711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.096057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] For port 23fe6a2b-3236-4300-b156-515efaeb1ac4, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=23fe6a2b-3236-4300-b156-515efaeb1ac4,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:55.096412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.113474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Calling delete_port for 23fe6a2b-3236-4300-b156-515efaeb1ac4 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:55.136931 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179'}], 'enable_snat': True}, 'gw_port_id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:14:54Z', 'revision_number': 5, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port': {'id': '23fe6a2b-3236-4300-b156-515efaeb1ac4', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:fe:90:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88d7a766-db07-4a48-a658-81f5d212360b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1633, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:45Z', 'updated_at': '2021-11-05T15:12:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:55.167185 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Checking router: 88d7a766-db07-4a48-a658-81f5d212360b for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:14:55.177262 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Routers {'88d7a766-db07-4a48-a658-81f5d212360b'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:55.177862 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['88d7a766-db07-4a48-a658-81f5d212360b'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:55.263680 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] Set router 88d7a766-db07-4a48-a658-81f5d212360b gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:55.272621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.300549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Pushing event deleted for resources: {'Port': ['ID=23fe6a2b-3236-4300-b156-515efaeb1ac4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:55.318888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:14:54Z', 'revision_number': 6, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:55.346856 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-842fe1f0-d80b-45c7-b0fa-21c9f96ca41d None None] The sync data for ids ['88d7a766-db07-4a48-a658-81f5d212360b'] in dv-neutron-816850-1-hyperv is: [{'id': '88d7a766-db07-4a48-a658-81f5d212360b', 'name': 'tempest-TestMinimumBasicScenario-1900869733-router', 'tenant_id': 'ec691eaac94e4150af738df6009495e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:44Z', 'updated_at': '2021-11-05T15:14:54Z', 'revision_number': 6, 'project_id': 'ec691eaac94e4150af738df6009495e2', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:14:55.363667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.455481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.457582 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.499920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.500445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 88d7a766-db07-4a48-a658-81f5d212360b {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:14:55.505087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.506214 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a58ae0eb-fa84-4606-8841-637db4cbe0d7 admin admin] 10.222.0.30 "DELETE /v2.0/routers/88d7a766-db07-4a48-a658-81f5d212360b HTTP/1.1" status: 204 len: 168 time: 0.7469709 Nov 05 15:14:55.508701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:55.556004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Deleting subnet edfe133f-f329-4d1d-974f-646d1ea42078 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:14:55.558879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.591810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.664782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.719795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.745729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=edfe133f-f329-4d1d-974f-646d1ea42078,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:55.749699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.755317 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a6247306-d895-40c8-9c3f-c42937c93345 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/edfe133f-f329-4d1d-974f-646d1ea42078 HTTP/1.1" status: 204 len: 168 time: 0.2433016 Nov 05 15:14:55.755411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50714) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:55.756331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ec5ec92-c912-4962-a651-5b8c3c8ad711 None None] Network a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:14:55.824671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.881393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Deleting port 08613e0f-27fd-40bb-be08-5aa9921ba1dc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:55.881731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.951064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] For port 08613e0f-27fd-40bb-be08-5aa9921ba1dc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=08613e0f-27fd-40bb-be08-5aa9921ba1dc,segment=NetworkSegment(83bc0ae6-9055-474f-ba29-fcfe7c493940),segment_id=83bc0ae6-9055-474f-ba29-fcfe7c493940)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:55.951421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:55.967034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Calling delete_port for 08613e0f-27fd-40bb-be08-5aa9921ba1dc owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:55.994857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.048422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.077083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Pushing event deleted for resources: {'Port': ['ID=08613e0f-27fd-40bb-be08-5aa9921ba1dc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:56.081843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] No DVR routers for this DVR port 08613e0f-27fd-40bb-be08-5aa9921ba1dc on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:14:56.130018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba0c9226-95de-4cd5-bd04-1b0e1037527a None None] DHCP port deletion for a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:14:56.167773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.182256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 08613e0f-27fd-40bb-be08-5aa9921ba1dc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:14:56.190487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a2c2dfb3-6512-49cf-b141-1528a1cdbcf9']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:56.200690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '83bc0ae6-9055-474f-ba29-fcfe7c493940') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:56.201082 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '83bc0ae6-9055-474f-ba29-fcfe7c493940') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:56.207052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 08613e0f-27fd-40bb-be08-5aa9921ba1dc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:14:56.207608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 08613e0f-27fd-40bb-be08-5aa9921ba1dc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:14:56.208027 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d39450cc-6550-442b-943e-f1ff3492be0b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:14:56.214990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.226944 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.227485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d39450cc-6550-442b-943e-f1ff3492be0b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:14:56.227875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d39450cc-6550-442b-943e-f1ff3492be0b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:14:56.228292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23fe6a2b-3236-4300-b156-515efaeb1ac4 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:14:56.233993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Releasing vlan 621 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:14:56.234433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:14:56.236540 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:14:56.247743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 23fe6a2b-3236-4300-b156-515efaeb1ac4 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:14:56.248089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 23fe6a2b-3236-4300-b156-515efaeb1ac4 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:14:56.294809 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.302471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.305640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] 10.222.0.30 "DELETE /v2.0/networks/a2c2dfb3-6512-49cf-b141-1528a1cdbcf9 HTTP/1.1" status: 204 len: 168 time: 0.5492923 Nov 05 15:14:56.308660 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50716) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:56.313718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device ccdd9609-3b05-43a7-a8cf-4dba86265ca2 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:14:56.315928 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3aadc63-9a83-44bc-8a60-54793fc48b5e admin admin] Pushing event deleted for resources: {'Network': ['ID=a2c2dfb3-6512-49cf-b141-1528a1cdbcf9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:56.342942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: ccdd9609-3b05-43a7-a8cf-4dba86265ca2 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:14:56.343343 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device ccdd9609-3b05-43a7-a8cf-4dba86265ca2 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:14:56.658287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.891779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Deleting port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:56.892707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.972229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] For port 6a73d2dc-ed82-44a8-ae5d-40de216d68a5, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:56.972525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:56.985048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Calling delete_port for 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:57.160055 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:57.187083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Pushing event deleted for resources: {'Port': ['ID=6a73d2dc-ed82-44a8-ae5d-40de216d68a5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:57.344265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:57.562510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Router a1b8770d-9cfc-4a9c-975b-948102cdae20 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:14:57.679035 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:14:57.684165 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b9d5d0da-dabc-4dae-a1f1-1b50cb3f3708 admin admin] 10.222.0.30 "PUT /v2.0/routers/a1b8770d-9cfc-4a9c-975b-948102cdae20/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3743007 Nov 05 15:14:57.686477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50718) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:57.687568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Sync routers for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:14:57.696937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:57.697555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:57.788156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:57.800122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:57.889428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:57.941138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Deleting port 4094f21a-0436-46d4-81f1-885e2944329c {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:57.941470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.024972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] For port 4094f21a-0436-46d4-81f1-885e2944329c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4094f21a-0436-46d4-81f1-885e2944329c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:58.025443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.039183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Calling delete_port for 4094f21a-0436-46d4-81f1-885e2944329c owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:58.077679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51'}], 'enable_snat': True}, 'gw_port_id': '4094f21a-0436-46d4-81f1-885e2944329c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:14:57Z', 'revision_number': 5, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port': {'id': '4094f21a-0436-46d4-81f1-885e2944329c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:c7:36:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1644, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:12:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:58.110111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Checking router: a1b8770d-9cfc-4a9c-975b-948102cdae20 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:14:58.123706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Routers {'a1b8770d-9cfc-4a9c-975b-948102cdae20'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:14:58.124308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['a1b8770d-9cfc-4a9c-975b-948102cdae20'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:58.203996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.221181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] Set router a1b8770d-9cfc-4a9c-975b-948102cdae20 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:14:58.231986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Pushing event deleted for resources: {'Port': ['ID=4094f21a-0436-46d4-81f1-885e2944329c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:58.272883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:14:57Z', 'revision_number': 6, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:58.290259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.303277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b40a15d-67ad-47d0-bc3c-78e07d818ee0 None None] The sync data for ids ['a1b8770d-9cfc-4a9c-975b-948102cdae20'] in dv-neutron-816850-1-hyperv is: [{'id': 'a1b8770d-9cfc-4a9c-975b-948102cdae20', 'name': 'tempest-TestMinimumBasicScenario-189714978-router', 'tenant_id': '61be67ac57904682ab75aaa1833edaff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:12:49Z', 'updated_at': '2021-11-05T15:14:57Z', 'revision_number': 6, 'project_id': '61be67ac57904682ab75aaa1833edaff', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:14:58.390589 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.393508 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.443435 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.444017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Fanout notify agent at l3_agent the message router_deleted on router a1b8770d-9cfc-4a9c-975b-948102cdae20 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:14:58.448569 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.449735 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4e1d2c44-4450-4c7a-83f6-b71a8e2ed31f admin admin] 10.222.0.30 "DELETE /v2.0/routers/a1b8770d-9cfc-4a9c-975b-948102cdae20 HTTP/1.1" status: 204 len: 168 time: 0.7623234 Nov 05 15:14:58.452223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50720) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:58.497073 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Deleting subnet fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:14:58.500184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.535509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.617249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.670087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.698862 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:58.700844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.704015 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-043e7ce8-4764-4c1e-8b4c-c80f9f43e79a admin admin] 10.222.0.30 "DELETE /v2.0/subnets/fcaba5ed-fb7d-45e3-9312-c4cbd88dedf5 HTTP/1.1" status: 204 len: 168 time: 0.2507298 Nov 05 15:14:58.705929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-184f7f1a-a68e-4159-8b58-5448fbaf2773 None None] Network fe758d2d-a046-4952-8f79-70a7d7a11abc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:14:58.706864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50722) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:58.778557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.835277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Deleting port 159b4807-022a-49af-87b5-981cf11ce483 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:14:58.835609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.895230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] For port 159b4807-022a-49af-87b5-981cf11ce483, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=159b4807-022a-49af-87b5-981cf11ce483,segment=NetworkSegment(0bf15b54-eca7-4dec-9526-3d314e990269),segment_id=0bf15b54-eca7-4dec-9526-3d314e990269)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:14:58.895598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:58.907817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Calling delete_port for 159b4807-022a-49af-87b5-981cf11ce483 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:14:58.984102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.013811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Pushing event deleted for resources: {'Port': ['ID=159b4807-022a-49af-87b5-981cf11ce483,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:59.015502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] No DVR routers for this DVR port 159b4807-022a-49af-87b5-981cf11ce483 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:14:59.083925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.105051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f854388-8827-406d-b7d2-6c79071772e3 None None] DHCP port deletion for fe758d2d-a046-4952-8f79-70a7d7a11abc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:14:59.107252 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fe758d2d-a046-4952-8f79-70a7d7a11abc']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:59.117823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0bf15b54-eca7-4dec-9526-3d314e990269') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:59.118044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0bf15b54-eca7-4dec-9526-3d314e990269') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:14:59.127753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.140761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.146659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:14:59.147034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:14:59.148693 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:14:59.208220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.214112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.217264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] 10.222.0.30 "DELETE /v2.0/networks/fe758d2d-a046-4952-8f79-70a7d7a11abc HTTP/1.1" status: 204 len: 168 time: 0.5093677 Nov 05 15:14:59.228630 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce5a600-2261-4c73-a3d5-659c6b885bbd admin admin] Pushing event deleted for resources: {'Network': ['ID=fe758d2d-a046-4952-8f79-70a7d7a11abc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:59.384521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50726) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:59.424793 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0847c5be-980b-4adc-8cfa-09cbffc34748 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ec691eaac94e4150af738df6009495e2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0389760 Nov 05 15:14:59.427141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:59.472231 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.492289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.538016 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.540533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.541729 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/97977614-5703-4480-9ca8-4f0d61cd5b6c HTTP/1.1" status: 204 len: 168 time: 0.1136849 Nov 05 15:14:59.549802 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ce4df3-f620-4c40-a930-f30c3bb3ca57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97977614-5703-4480-9ca8-4f0d61cd5b6c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:14:59.847882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:59.891596 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-18555248-4ab0-4cd6-a99f-205307605528 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=61be67ac57904682ab75aaa1833edaff&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0424988 Nov 05 15:14:59.894516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50736) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:14:59.939437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:14:59.966314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:00.020570 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:00.021595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:15:00.023166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:00.024340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6898da89-9e40-4a8f-985b-8d6b4d9f7226 HTTP/1.1" status: 204 len: 168 time: 0.1289363 Nov 05 15:15:00.032122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4bcb4a-6df3-4f31-9f95-b6fa6a142531 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6898da89-9e40-4a8f-985b-8d6b4d9f7226,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:00.048818 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:15:00.049161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6a73d2dc-ed82-44a8-ae5d-40de216d68a5 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:15:00.049572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4094f21a-0436-46d4-81f1-885e2944329c no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:15:00.073819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 4094f21a-0436-46d4-81f1-885e2944329c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:15:00.074060 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4094f21a-0436-46d4-81f1-885e2944329c not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:15:00.074644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 159b4807-022a-49af-87b5-981cf11ce483 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:15:00.094253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 159b4807-022a-49af-87b5-981cf11ce483 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:15:00.094602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 159b4807-022a-49af-87b5-981cf11ce483 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:15:01.778693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50776) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:01.783985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-99032725', 'description': 'tempest-secgroup-smoke-99032725 description', 'project_id': 'ef1d7839d356477e8151af4dc08baead'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:01.805761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:01.813260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:01.886699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:01.890700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:01.923105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be0b293d-8a91-4769-8dd0-a27f512c5d1c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:01.969397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:01.973882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.003123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.004330 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.2246323 Nov 05 15:15:02.006211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7302205-53e8-483b-bfb5-56c53eb624ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=057d63af-eb97-441c-8230-b8f1955c3396,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.007469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50778) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.013180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.041408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.086659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.090614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.108899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6363840e-e887-464e-8def-b039f6f3c1ea,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.113416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.116866 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6801eab0-44fe-4de3-abb6-a5b4e8ae5b79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1076066 Nov 05 15:15:02.117523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50780) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.122031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.148828 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.202483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.206793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.224775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75006f1d-ec05-4a26-8efa-36bc70ad2c8b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.231714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.232908 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a44eaa0a-93f2-4b17-a2c1-20ca4a9fdc36 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1143849 Nov 05 15:15:02.235803 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50782) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.240444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.265757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.324157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.327616 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.344325 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ef3ed89-d529-40a4-af13-3b9f44fd8675,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.351429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.352676 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-132515fe-94a9-4b34-9db9-65c9a0e736f0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1156731 Nov 05 15:15:02.355338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50784) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.359623 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.385771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.442355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.445869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.462846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2a8dd457-5ba7-43bf-a654-888c4df8cced,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.473668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.474849 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-de48e628-3cf2-435f-84ad-56fe85053056 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1185718 Nov 05 15:15:02.477551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50786) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.481897 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.503794 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:15:02.508707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.565417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.569060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.588308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d201de2-f2de-47e4-a78b-15066ad945b8,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.598694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.599885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-55714189-097f-41a0-98e2-4acdabd32b39 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1213956 Nov 05 15:15:02.602494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50788) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.606929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '057d63af-eb97-441c-8230-b8f1955c3396', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.628645 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:15:02.633402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.696374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.699858 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.716884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7c220518-3159-4e4f-9c94-d7f553034b29,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.724567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.725740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8164cb7f-a63b-4e5d-9efb-a9a4e38f6bcc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1222456 Nov 05 15:15:02.728714 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50790) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.733428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'network': {'name': 'tempest-network-smoke--248844903', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.753932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:15:02.757519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.780510 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:15:02.789312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.789633 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Added segment 2071fc9b-46ed-472d-bdef-fb44dfef6b7f of type vlan for network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f Nov 05 15:15:02.828728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.852499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.857954 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:02.858553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.917202 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1874766 Nov 05 15:15:02.920066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50792) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:02.924818 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'admin_state_up': True, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:02.945932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240e0868-3530-41d2-aeff-2c5d087315c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Network': ['ID=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:02.957651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:15:02.960530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:02.961608 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.010844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.463532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.651547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.670309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.771441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.94 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b1cb2f33-1577-4469-bec1-e157f0081280) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:15:03.869511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.902875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:03.941233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:03.945430 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:03.950978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:15:03.978087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b1cb2f33-1577-4469-bec1-e157f0081280,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:04.201410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:04.398268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:04.524209 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:15:04.629666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:15:04.640531 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Sync routers for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:15:04.650213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:04.650415 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:04.651025 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:04.651436 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ad2db216-1d41-44f3-83a2-96610eeabe0f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 1.7303991 Nov 05 15:15:04.654400 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50794) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:04.756447 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:04.772502 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-500d4056-a0b2-47b2-9f73-b99aeca53617 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=ef1d7839d356477e8151af4dc08baead&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1170022 Nov 05 15:15:04.775239 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50798) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:04.861220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb03976b-acbc-4d93-a97e-5b792aae806e tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:04.862740 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fb03976b-acbc-4d93-a97e-5b792aae806e tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0865726 Nov 05 15:15:04.865504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50800) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:04.893082 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-92bf4a7c-9f7a-42d4-88fc-83dccf4436da tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0265148 Nov 05 15:15:04.895519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:04.900093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-140202052', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:04.931946 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:04Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:04.958587 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Checking router: 1758122d-7941-4d7d-9e71-cb1d6ee32da3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:15:04.958932 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Updating router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 port b1cb2f33-1577-4469-bec1-e157f0081280 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:15:04.982734 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:04.996658 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:15:05.000099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.176940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.228586 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.233657 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.235652 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Subnet': ['ID=ec8e28f1-3fae-4871-b795-ab19d4734fc9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:05.245807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Checking segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:15:05.245807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network hostable DHCP agents. Network: ec687c9e-bd18-48a6-8d6f-3dcda6604f2f, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:15:05.262420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:15:05.271696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, ec687c9e-bd18-48a6-8d6f-3dcda6604f2f) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:05.275812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:05.276563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.281369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84fbcb8f-24e2-496c-a29c-4559df927c3f None None] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:15:05.289506 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Attempting to bind port b1cb2f33-1577-4469-bec1-e157f0081280 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:15:05.289907 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Attempting to bind port b1cb2f33-1577-4469-bec1-e157f0081280 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:15:05.290287 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Attempting to bind port b1cb2f33-1577-4469-bec1-e157f0081280 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:15:05.293225 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Pushing event updated for resources: {'Port': ['ID=b1cb2f33-1577-4469-bec1-e157f0081280,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:05.294745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2fa293db-53de-41ab-925a-b642149b12cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.3981419 Nov 05 15:15:05.297567 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:05.301860 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:15:05.302235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:15:05.302633 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.303016 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:15:05.303479 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Bound port: b1cb2f33-1577-4469-bec1-e157f0081280, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:15:05.303853 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.306771 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.307114 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.307449 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.307773 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.308096 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.308418 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.308765 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.309889 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.309889 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.309889 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.310178 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.310386 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:05.362349 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] For port b1cb2f33-1577-4469-bec1-e157f0081280, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-84fbcb8f-24e2-496c-a29c-4559df927c3f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:15:05.364541 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:15:05.365589 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] For port b1cb2f33-1577-4469-bec1-e157f0081280, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b1cb2f33-1577-4469-bec1-e157f0081280,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:15:05.372103 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.376104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e42b34f1-2ae2-4e06-8b54-c342463448de None None] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:15:05.428100 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:05.428650 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-e42b34f1-2ae2-4e06-8b54-c342463448de None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:15:05.453148 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:15:05.463748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5f77d48-30a8-4829-90f8-5f282db76760 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:15:05.510814 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be92ecc8-087a-4336-9561-efd7e56b9a9e None None] Pushing event updated for resources: {'Port': ['ID=b1cb2f33-1577-4469-bec1-e157f0081280,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:05.533048 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5f77d48-30a8-4829-90f8-5f282db76760 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:15:05.541988 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:05.723806 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:04Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:05.748284 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:15:05.749233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.751672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7108f5c2-7da8-43d8-acd3-0a10fab55aee None None] The sync data for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv is: [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:04Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:15:05.793134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:05.902227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Allocated IP 172.20.0.2 (ec687c9e-bd18-48a6-8d6f-3dcda6604f2f/ec8e28f1-3fae-4871-b795-ab19d4734fc9/44dd51a3-1558-4b05-91f9-236b9b20ed54) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:15:06.076584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.083591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.120139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:06.124778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:06.126791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b1cb2f33-1577-4469-bec1-e157f0081280 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:06.131489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:15:06.151794 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.1 (ec687c9e-bd18-48a6-8d6f-3dcda6604f2f/ec8e28f1-3fae-4871-b795-ab19d4734fc9/ef701360-ec3e-43e2-b900-9b1ec86e6509) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:15:06.203768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Pushing event updated for resources: {'Port': ['ID=44dd51a3-1558-4b05-91f9-236b9b20ed54,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:06.228029 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.228801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.229142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.229475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.229808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.230154 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.230473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.230805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.231131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.231518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.231783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.232088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:06.257189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Attempting to bind port 44dd51a3-1558-4b05-91f9-236b9b20ed54 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:15:06.257556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Attempting to bind port 44dd51a3-1558-4b05-91f9-236b9b20ed54 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:15:06.257919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Attempting to bind port 44dd51a3-1558-4b05-91f9-236b9b20ed54 on network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:15:06.264190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:15:06.264590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Checking segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:15:06.264997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.265393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Bound using segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:15:06.265988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Bound port: 44dd51a3-1558-4b05-91f9-236b9b20ed54, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:15:06.266250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.268798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b1cb2f33-1577-4469-bec1-e157f0081280 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:06.269156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.277188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.311849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.358309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:06.361707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:06.366303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:15:06.368781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] For port 44dd51a3-1558-4b05-91f9-236b9b20ed54, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:15:06.373489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] For port 44dd51a3-1558-4b05-91f9-236b9b20ed54, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=44dd51a3-1558-4b05-91f9-236b9b20ed54,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:15:06.403443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:06.429268 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.549142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.578444 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.594052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.631883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b1cb2f33-1577-4469-bec1-e157f0081280, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b1cb2f33-1577-4469-bec1-e157f0081280,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:06.637879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a45437-c2ff-420f-a953-f6afeedc48fe None None] Pushing event updated for resources: {'Port': ['ID=44dd51a3-1558-4b05-91f9-236b9b20ed54,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:06.641858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.699612 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b1cb2f33-1577-4469-bec1-e157f0081280,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:06.900764 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.906039 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:06.989530 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:06.993030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:07.084294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:07.085592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:07.199691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:15:07.308887 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:15:07.314742 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2a37aaea-0503-462b-a85d-6a1aa1024b5f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/1758122d-7941-4d7d-9e71-cb1d6ee32da3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0151958 Nov 05 15:15:07.468079 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-f18280af-8dd3-4d0f-9fa7-cb2429c0da6c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-99032725&fields=id&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 267 time: 0.0463402 Nov 05 15:15:07.569216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eff9fa9d-325a-4cbb-a5be-73fa71d8fe37 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:15:07.584594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-0651b64f-1737-472b-bc2b-c1890c593cee tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:07.586201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-0651b64f-1737-472b-bc2b-c1890c593cee tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 796 time: 0.1110513 Nov 05 15:15:07.602505 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-f3802e4e-a607-4079-8786-baa940504fbd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/quotas/ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 375 time: 0.0103579 Nov 05 15:15:07.649248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eff9fa9d-325a-4cbb-a5be-73fa71d8fe37 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:15:07.659472 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cafd4fb1-23b6-44c0-8da0-18ceb9c1e82b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0511861 Nov 05 15:15:07.663112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] Provisioning complete for port 44dd51a3-1558-4b05-91f9-236b9b20ed54 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:07.663486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:07.761652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-fcb6e438-3011-49e9-b0c3-509c14114aad service neutron] 10.222.0.30 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897558 Nov 05 15:15:07.826997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:07.860159 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-a8074a0d-e984-4728-b14f-49924fddfd33 service neutron] 10.222.0.30 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917282 Nov 05 15:15:07.883278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] For port 44dd51a3-1558-4b05-91f9-236b9b20ed54, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=44dd51a3-1558-4b05-91f9-236b9b20ed54,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:07.897000 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:07.956504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Sync routers for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:15:08.002719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dcc8f4-50dd-42a0-9b9c-0202fe4416ab None None] Pushing event updated for resources: {'Port': ['ID=44dd51a3-1558-4b05-91f9-236b9b20ed54,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:08.005805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:08.007277 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:08.042597 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-087eeb2c-7c1d-4dcd-8273-62a99e19ea0d req-acaa1117-f3c0-4324-819d-ccb549d3896b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 210 time: 0.0418119 Nov 05 15:15:08.165228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 44dd51a3-1558-4b05-91f9-236b9b20ed54 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:08.196292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:08.337340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 44dd51a3-1558-4b05-91f9-236b9b20ed54 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:08.337769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:08.493563 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b1cb2f33-1577-4469-bec1-e157f0081280 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:08.550431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 2, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:08.583254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Checking router: 1758122d-7941-4d7d-9e71-cb1d6ee32da3 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:15:08.583973 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Updating router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 port ef701360-ec3e-43e2-b900-9b1ec86e6509 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:15:08.625845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:08.627447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b1cb2f33-1577-4469-bec1-e157f0081280 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:08.627796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:08.677264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ba420f5-9279-4a16-a0a5-2684987f4ffb None None] Provisioning complete for port 44dd51a3-1558-4b05-91f9-236b9b20ed54 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:08.678136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ba420f5-9279-4a16-a0a5-2684987f4ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:08.983013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1ba420f5-9279-4a16-a0a5-2684987f4ffb None None] Provisioning complete for port ef701360-ec3e-43e2-b900-9b1ec86e6509 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:08.983013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1ba420f5-9279-4a16-a0a5-2684987f4ffb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.039791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1ba420f5-9279-4a16-a0a5-2684987f4ffb None None] Port ef701360-ec3e-43e2-b900-9b1ec86e6509 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:15:09.090832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.098539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.125690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-df5e3bcb-7027-4040-bc33-32bd6c1455ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:09.128027 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-df5e3bcb-7027-4040-bc33-32bd6c1455ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 796 time: 0.1274154 Nov 05 15:15:09.187113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bd09f7-43fa-4b9c-bcda-9811a005ed53 None None] Pushing event updated for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:09.231503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dca0977c-a366-4348-992e-9591bf0b4a95 None None] Provisioning complete for port ef701360-ec3e-43e2-b900-9b1ec86e6509 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:09.231933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dca0977c-a366-4348-992e-9591bf0b4a95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.234223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Attempting to bind port ef701360-ec3e-43e2-b900-9b1ec86e6509 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:15:09.234587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Attempting to bind port ef701360-ec3e-43e2-b900-9b1ec86e6509 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:15:09.234944 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Attempting to bind port ef701360-ec3e-43e2-b900-9b1ec86e6509 on network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:15:09.260225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:15:09.260679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Checking segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:15:09.261045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.261440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Bound using segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:15:09.261918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Bound port: ef701360-ec3e-43e2-b900-9b1ec86e6509, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:15:09.262298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.287859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dca0977c-a366-4348-992e-9591bf0b4a95 None None] Port ef701360-ec3e-43e2-b900-9b1ec86e6509 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:15:09.341937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] For port ef701360-ec3e-43e2-b900-9b1ec86e6509, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:15:09.345681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] For port ef701360-ec3e-43e2-b900-9b1ec86e6509, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ef701360-ec3e-43e2-b900-9b1ec86e6509,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:15:09.350114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.419078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:09.419716 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:09.461863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bd09f7-43fa-4b9c-bcda-9811a005ed53 None None] Pushing event updated for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:09.474520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] Provisioning complete for port ef701360-ec3e-43e2-b900-9b1ec86e6509 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:09.474892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.514791 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9b544135-dad1-4702-8a0e-9790531fa55e req-182b1ef9-7d0e-4a5d-9698-2115e07a624f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 210 time: 0.3856986 Nov 05 15:15:09.523799 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-60710afd-127d-4081-b231-2b77195d9775 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 378 time: 0.3850226 Nov 05 15:15:09.539469 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'port': {'device_id': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'admin_state_up': True, 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'security_groups': ['057d63af-eb97-441c-8230-b8f1955c3396']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:09.668359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:15:09.679471 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.739520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:09.824794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.12 (ec687c9e-bd18-48a6-8d6f-3dcda6604f2f/ec8e28f1-3fae-4871-b795-ab19d4734fc9/cf50c3c8-2641-4eb0-8103-3a738c72adf6) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:15:09.839191 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.930151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] For port ef701360-ec3e-43e2-b900-9b1ec86e6509, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ef701360-ec3e-43e2-b900-9b1ec86e6509,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:09.934805 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:09.967614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.004824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.019497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d3893c-3b49-4335-8be3-46589807ac96 None None] Pushing event updated for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:10.050133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:10.053657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:10.054772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:10.060220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:15:10.089628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 44dd51a3-1558-4b05-91f9-236b9b20ed54 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:10.096239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5803bce-cafe-4064-a891-e0cfc54bce26 None None] The sync data for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv is: [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:15:10.099562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:10.117537 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:10.118411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.140448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4720a9f9-b38c-4d7d-b74b-5cec54639d29 None None] Provisioning complete for port ef701360-ec3e-43e2-b900-9b1ec86e6509 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:10.140971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4720a9f9-b38c-4d7d-b74b-5cec54639d29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.142332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-86790326-ad98-420b-85bb-7f611112a5a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6103640 Nov 05 15:15:10.156012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Request body: {'port': {'device_id': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:10.202196 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 44dd51a3-1558-4b05-91f9-236b9b20ed54 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:10.202567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.259522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.406358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-eba1df33-8425-42e0-899f-3dd994d535f0 None None] Provisioning complete for port cf50c3c8-2641-4eb0-8103-3a738c72adf6 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:10.406729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eba1df33-8425-42e0-899f-3dd994d535f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.446830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-eba1df33-8425-42e0-899f-3dd994d535f0 None None] Port cf50c3c8-2641-4eb0-8103-3a738c72adf6 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:15:10.549983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cf50c3c8-2641-4eb0-8103-3a738c72adf6 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:15:10.559068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.572084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Transition to ACTIVE for port object cf50c3c8-2641-4eb0-8103-3a738c72adf6 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:15:10.576344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.644874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcaf77c-615d-4258-abec-2751b3488cd9 req-4f178e69-db9c-4624-8b3a-592f791a6199 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:10.652188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Pushing event updated for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:10.652958 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bbcaf77c-615d-4258-abec-2751b3488cd9 req-4f178e69-db9c-4624-8b3a-592f791a6199 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 944 time: 0.0617282 Nov 05 15:15:10.717030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Attempting to bind port cf50c3c8-2641-4eb0-8103-3a738c72adf6 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:15:10.717383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Attempting to bind port cf50c3c8-2641-4eb0-8103-3a738c72adf6 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:15:10.717853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Attempting to bind port cf50c3c8-2641-4eb0-8103-3a738c72adf6 on network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:15:10.723300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Port cf50c3c8-2641-4eb0-8103-3a738c72adf6 on network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:15:10.723641 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Attempting to bind port cf50c3c8-2641-4eb0-8103-3a738c72adf6 on network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:15:10.729058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 14, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:15:10.729404 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Checking segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:15:10.729796 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Bound using segment: {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:15:10.729923 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bbcaf77c-615d-4258-abec-2751b3488cd9 req-873de427-a0af-4d1d-beda-dce72f155280 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0616374 Nov 05 15:15:10.730239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Bound port: cf50c3c8-2641-4eb0-8103-3a738c72adf6, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2071fc9b-46ed-472d-bdef-fb44dfef6b7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:15:10.730601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.804659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:15:10.808209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:15:10.814544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.849627 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:10.850406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:10.851782 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] 10.222.0.32 "PUT /v2.0/ports/cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 1094 time: 0.7010727 Nov 05 15:15:10.852224 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:15:10.854588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4baaa996-8b8e-45db-89fd-ec6fd09ba755" -d '{"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:15:10.922321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:15:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d1bc5e8-d7a5-4d9a-aa86-588ab4a80c69 x-openstack-request-id: req-9d1bc5e8-d7a5-4d9a-aa86-588ab4a80c69 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:15:10.922321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:15:10.922321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9d1bc5e8-d7a5-4d9a-aa86-588ab4a80c69 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:15:10.923227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'status': 'completed', 'code': 200} Nov 05 15:15:10.952666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9584ae-261d-4a61-9f69-e4773a77d49f service neutron] Pushing event updated for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:10.967281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-b60b5e24-d9db-4815-96d4-e31600d8cf25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:10.968857 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-b60b5e24-d9db-4815-96d4-e31600d8cf25 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1097 time: 0.0641396 Nov 05 15:15:11.013234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-fba1d267-0830-4ec9-91b8-e871ff805a26 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 217 time: 0.0365984 Nov 05 15:15:11.065551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-ca6d0b56-9a93-40e3-9fb3-e10f0714f071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.067077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-ca6d0b56-9a93-40e3-9fb3-e10f0714f071 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 200 len: 834 time: 0.0472727 Nov 05 15:15:11.121030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-a1348c76-1a2c-4655-be1f-f4933f2ebdf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.123075 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-a1348c76-1a2c-4655-be1f-f4933f2ebdf3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0490830 Nov 05 15:15:11.133950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-4c1e00ec-7d59-43af-9c8b-266fde88113d service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:15:11.134999 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-4c1e00ec-7d59-43af-9c8b-266fde88113d service neutron] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049136 Nov 05 15:15:11.226959 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-e1b2590e-6863-4a10-a2f6-48c122487501 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837924 Nov 05 15:15:11.320373 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-967f4b91-5473-46b0-9e59-2a012e14bf20 req-dd39a191-770f-4e5f-8b60-6defd285e462 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866234 Nov 05 15:15:11.403803 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-0830f463-761e-4b07-a9ba-8d8afe32a527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.405329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-0830f463-761e-4b07-a9ba-8d8afe32a527 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1097 time: 0.0409353 Nov 05 15:15:11.496859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-09cdb33a-bc35-4d93-a4a0-41e3894bd5af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.498264 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-09cdb33a-bc35-4d93-a4a0-41e3894bd5af service neutron] 10.222.0.32 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 897 time: 0.0854254 Nov 05 15:15:11.540185 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-11b21f13-602e-45ce-81d5-30a4c33b853b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 217 time: 0.0349541 Nov 05 15:15:11.587318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-3adb617d-aae1-4f5e-b92d-58ee51d03c95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.588719 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-3adb617d-aae1-4f5e-b92d-58ee51d03c95 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 200 len: 834 time: 0.0414805 Nov 05 15:15:11.632911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-2a858c97-b03a-461a-870d-b8a3c0dd83e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.634425 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-2a858c97-b03a-461a-870d-b8a3c0dd83e8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385883 Nov 05 15:15:11.726232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-1a732477-bead-41e7-a417-ccf4be476b5f service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835171 Nov 05 15:15:11.820778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4baaa996-8b8e-45db-89fd-ec6fd09ba755 req-93d51e50-8987-4dc9-8d62-ae28ab080efb service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867195 Nov 05 15:15:11.824348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c02391a0-3fb4-499c-8721-6436f1eaf47e req-466855a6-6f6e-4e82-bc22-4d82185592f6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:11.825874 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c02391a0-3fb4-499c-8721-6436f1eaf47e req-466855a6-6f6e-4e82-bc22-4d82185592f6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 944 time: 0.0489373 Nov 05 15:15:11.876986 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c02391a0-3fb4-499c-8721-6436f1eaf47e req-60702b80-3a0a-497d-82a5-c1edcad0bca2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434244 Nov 05 15:15:12.064908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ef701360-ec3e-43e2-b900-9b1ec86e6509 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:12.111835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ef701360-ec3e-43e2-b900-9b1ec86e6509 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:12.112201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:12.358681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device cf50c3c8-2641-4eb0-8103-3a738c72adf6 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:15:12.454136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:12.465370 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'port_id': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'mac_address': 'fa:16:3e:a2:54:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:15:12.502670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:12.515185 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cf50c3c8-2641-4eb0-8103-3a738c72adf6 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:15:12.538148 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:12.542124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:12.590092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:12.748096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['cf50c3c8-2641-4eb0-8103-3a738c72adf6'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:15:12.994321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3231cc5f-c116-4ddc-b0dd-5e5d0896d4e4 req-02da5ed6-75f6-409a-af63-116afed8ac79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:12.995809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3231cc5f-c116-4ddc-b0dd-5e5d0896d4e4 req-02da5ed6-75f6-409a-af63-116afed8ac79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 945 time: 0.0497184 Nov 05 15:15:13.048134 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3231cc5f-c116-4ddc-b0dd-5e5d0896d4e4 req-f37cf151-a588-4f21-8e31-7a0455a1dbdf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418775 Nov 05 15:15:14.171323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-674b926f-4fcf-4a26-91d6-79411fb66b4d req-1915f7c2-6122-495d-b1a8-ffcf3c7ca2a6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:14.172816 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-674b926f-4fcf-4a26-91d6-79411fb66b4d req-1915f7c2-6122-495d-b1a8-ffcf3c7ca2a6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 945 time: 0.0526764 Nov 05 15:15:14.221653 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-674b926f-4fcf-4a26-91d6-79411fb66b4d req-d0547a76-5bf0-4e64-b58f-4a6ce3eba4b2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0430028 Nov 05 15:15:14.375620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device cf50c3c8-2641-4eb0-8103-3a738c72adf6 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:15:14.426848 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port cf50c3c8-2641-4eb0-8103-3a738c72adf6 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:15:14.431055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port cf50c3c8-2641-4eb0-8103-3a738c72adf6 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:15:14.431425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:14.506686 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:14.528065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:15:14.530320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6ea045c-b244-4561-8d0e-3097ecff3cc7" -d '{"events": [{"server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "name": "network-vif-plugged", "status": "completed", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:15:14.543269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:15:14.548145 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:14.571308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:15:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cdffae1-1f99-4741-acb0-fa5e1162fce6 x-openstack-request-id: req-1cdffae1-1f99-4741-acb0-fa5e1162fce6 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:15:14.571599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "name": "network-vif-plugged", "status": "completed", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:15:14.571858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1cdffae1-1f99-4741-acb0-fa5e1162fce6 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:15:14.572246 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'code': 200} Nov 05 15:15:14.597094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:14.731817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761c6b40-b8fa-424b-9a50-f1911f0f6c9c req-193f97cd-2403-450e-bafe-17e258f92f54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:14.733327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-761c6b40-b8fa-424b-9a50-f1911f0f6c9c req-193f97cd-2403-450e-bafe-17e258f92f54 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1099 time: 0.0396919 Nov 05 15:15:14.777852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-761c6b40-b8fa-424b-9a50-f1911f0f6c9c req-e579b4ee-87fa-4c7e-8565-486e6991f94a service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0376482 Nov 05 15:15:15.343920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff7c3c35-7d5b-431d-aebd-0859deeab958 req-ef632fbd-9c93-4bff-a128-506dc69f6823 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:15.345980 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff7c3c35-7d5b-431d-aebd-0859deeab958 req-ef632fbd-9c93-4bff-a128-506dc69f6823 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0501115 Nov 05 15:15:15.393853 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff7c3c35-7d5b-431d-aebd-0859deeab958 req-0f267048-88ba-4e44-b731-6056746c6fe3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419548 Nov 05 15:15:16.514324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388b1afc-3458-4637-8a69-9bee9739203f req-4c331de2-f0a2-4242-ba95-54b0b5b7e494 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:16.515731 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-388b1afc-3458-4637-8a69-9bee9739203f req-4c331de2-f0a2-4242-ba95-54b0b5b7e494 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0528634 Nov 05 15:15:16.565320 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-388b1afc-3458-4637-8a69-9bee9739203f req-8120c44e-9093-4da0-8930-e09e4eaa7a66 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0435762 Nov 05 15:15:16.676992 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7257fe-64e7-40c1-9c39-0f5b0e2f197b req-e1101a45-f3c4-487b-a1ef-54fa4f13797f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:16.678499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a7257fe-64e7-40c1-9c39-0f5b0e2f197b req-e1101a45-f3c4-487b-a1ef-54fa4f13797f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0492716 Nov 05 15:15:17.046975 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a7257fe-64e7-40c1-9c39-0f5b0e2f197b req-5319cf79-93c8-49bd-9944-dfd41b603c4d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3626106 Nov 05 15:15:17.068485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50854) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:17.106406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c551b08d-772f-43b7-9c95-2dfaaff062cf tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:17.107873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c551b08d-772f-43b7-9c95-2dfaaff062cf tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1094 time: 0.0384371 Nov 05 15:15:17.110640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50856) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:17.114752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address': '172.20.0.12'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:15:17.136166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:17.233885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:17.332475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.112 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/56e33b1b-e7d8-4111-9979-dc61ce757571) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:15:17.434198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:17.467620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:17.503941 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:15:17.506407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:15:17.512313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:15:17.534910 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=56e33b1b-e7d8-4111-9979-dc61ce757571,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:17.862551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:17.926454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.072532 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.076946 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.148694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=56e33b1b-e7d8-4111-9979-dc61ce757571,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:18.157504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.251143 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 1f115326-e2a6-494b-ba6f-e2f59da0c5ea associated. External IP: 172.26.5.112, port: cf50c3c8-2641-4eb0-8103-3a738c72adf6. Nov 05 15:15:18.455276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:15:18.468168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.569754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:15:18.580170 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Sync routers for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:15:18.587960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:18.592235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:18.592867 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:18.614341 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-705d577f-fb41-4e59-90f4-51af0128751e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5027232 Nov 05 15:15:18.614927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:15:18.617211 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdb487ff-4224-4b26-ae38-ba9b11a7232f" -d '{"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:15:18.661260 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:15:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9025111c-b3c1-4189-b30a-7a7f902c5123 x-openstack-request-id: req-9025111c-b3c1-4189-b30a-7a7f902c5123 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:15:18.661561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:15:18.662082 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9025111c-b3c1-4189-b30a-7a7f902c5123 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:15:18.662491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'status': 'completed', 'code': 200} Nov 05 15:15:18.707570 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:18.745349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569ee089-8067-4672-bb1f-87d3528a94c6 req-684eab8f-5141-4002-b8c2-4c69f2dc4452 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:18.746831 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-569ee089-8067-4672-bb1f-87d3528a94c6 req-684eab8f-5141-4002-b8c2-4c69f2dc4452 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0818312 Nov 05 15:15:18.753127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-8aaa3e3c-9312-4065-9d77-cd5609fa33f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:18.754545 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-8aaa3e3c-9312-4065-9d77-cd5609fa33f1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1099 time: 0.0627637 Nov 05 15:15:18.847842 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-569ee089-8067-4672-bb1f-87d3528a94c6 req-af8a8505-45df-42b0-b7b2-28e26b9c757a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0922856 Nov 05 15:15:18.872389 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50862) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:18.882408 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-c01c70a6-a1c3-46a1-acc8-39b3ef63953a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:18.883860 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-c01c70a6-a1c3-46a1-acc8-39b3ef63953a service neutron] 10.222.0.32 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 897 time: 0.1154661 Nov 05 15:15:18.941022 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c71be4bc-0d60-4d51-95d8-4d932f86cc95 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/1f115326-e2a6-494b-ba6f-e2f59da0c5ea HTTP/1.1" status: 200 len: 992 time: 0.0674093 Nov 05 15:15:18.962569 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-9b52f432-615f-4602-bb17-4590f3ffd642 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 1000 time: 0.0699294 Nov 05 15:15:19.011660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-a25e8d36-4fd9-49cf-aa1e-6d2efa6255a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:19.013155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-a25e8d36-4fd9-49cf-aa1e-6d2efa6255a0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 200 len: 834 time: 0.0441673 Nov 05 15:15:19.022950 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1f115326-e2a6-494b-ba6f-e2f59da0c5ea', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.112', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'port_id': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'mac_address': 'fa:16:3e:a2:54:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:15:17Z', 'updated_at': '2021-11-05T15:15:17Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:19.048937 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Checking router: 1758122d-7941-4d7d-9e71-cb1d6ee32da3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:15:19.057004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:19.057590 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:14:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:19.058433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-34f2a487-9e54-4115-9ec9-a73a3490bb5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:19.060049 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-34f2a487-9e54-4115-9ec9-a73a3490bb5a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0404043 Nov 05 15:15:19.150665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-523d9c98-2199-4307-a963-b0a8403d3edd service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838258 Nov 05 15:15:19.158915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:19.238671 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cdb487ff-4224-4b26-ae38-ba9b11a7232f req-61e5212e-18dc-4750-85f4-1a174cd43de9 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805168 Nov 05 15:15:19.379692 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1f115326-e2a6-494b-ba6f-e2f59da0c5ea', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.112', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'port_id': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'mac_address': 'fa:16:3e:a2:54:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:15:17Z', 'updated_at': '2021-11-05T15:15:17Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:19.405041 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fddbc7d-1bae-4928-ac4a-218bfb43d62f None None] The sync data for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv is: [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1f115326-e2a6-494b-ba6f-e2f59da0c5ea', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.112', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'port_id': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'mac_address': 'fa:16:3e:a2:54:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:15:17Z', 'updated_at': '2021-11-05T15:15:17Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:15:19.599856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87ba21ca-54d8-48ff-b844-ee9e75296cf4 None None] New status for floating IP 1f115326-e2a6-494b-ba6f-e2f59da0c5ea: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:15:19.943928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50864) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:20.004179 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c1829255-7d37-4459-a3b9-7919a67255ee tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/1f115326-e2a6-494b-ba6f-e2f59da0c5ea HTTP/1.1" status: 200 len: 994 time: 0.0590510 Nov 05 15:15:20.122187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-835fd0db-0668-4cab-9b71-0381d6f543d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:22.445452 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2d8e9ec3-d8d7-43fb-b98e-dc4919667f96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:23.507312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:24.517594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-d1b5f320-3b11-4dc2-97be-98d594bb4afc service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0444889 Nov 05 15:15:24.603926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-7e553927-22f8-41d3-9404-d32682660898 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:24.605418 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-7e553927-22f8-41d3-9404-d32682660898 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1099 time: 0.0436175 Nov 05 15:15:24.706362 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-26bb5b77-8c0b-482c-826f-6166d5913b91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:24.707817 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-26bb5b77-8c0b-482c-826f-6166d5913b91 service neutron] 10.222.0.32 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 897 time: 0.0825455 Nov 05 15:15:24.778920 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-534d27ba-0061-4606-aac2-2f5bfd6c8ad6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 1002 time: 0.0622451 Nov 05 15:15:24.826223 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-5e61be14-8e23-4327-8a19-8bf53459de1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:24.827673 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-5e61be14-8e23-4327-8a19-8bf53459de1d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 200 len: 834 time: 0.0422301 Nov 05 15:15:24.871449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-8bf3c628-6e08-4a43-85ec-ddd4092c0cd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:24.872933 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-8bf3c628-6e08-4a43-85ec-ddd4092c0cd7 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0386832 Nov 05 15:15:24.962390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-35a219e9-64d3-4985-a393-c00573c27355 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825980 Nov 05 15:15:24.976372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:25.051009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b6ee4aa-d35c-4462-b0d3-3edd16f60d8c req-98448642-55b5-4f41-a902-2331de9df489 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821159 Nov 05 15:15:25.538323 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:15:25.976766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:48.475408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:48.774892 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099e92dc-950c-4981-abd4-0c33a0dfcebf req-cc59d08a-6b04-40d4-b5c9-ac0f85296991 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:48.776275 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-099e92dc-950c-4981-abd4-0c33a0dfcebf req-cc59d08a-6b04-40d4-b5c9-ac0f85296991 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0525436 Nov 05 15:15:48.824418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-099e92dc-950c-4981-abd4-0c33a0dfcebf req-7e66b7ca-e607-4eeb-8350-11ea28655f30 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423930 Nov 05 15:15:49.944665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a90735-ef27-4a64-a96e-69325fd3cbe6 req-a3f951a2-c6f9-47ae-a838-1d60a44fd6f2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:49.946139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37a90735-ef27-4a64-a96e-69325fd3cbe6 req-a3f951a2-c6f9-47ae-a838-1d60a44fd6f2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0495090 Nov 05 15:15:49.993257 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37a90735-ef27-4a64-a96e-69325fd3cbe6 req-3376a38f-ba84-4211-a014-8e69c2017ceb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0412655 Nov 05 15:15:50.015403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50880) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:50.077255 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-28631346-161e-4b39-a07c-0ae83ac97b68 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/1f115326-e2a6-494b-ba6f-e2f59da0c5ea HTTP/1.1" status: 200 len: 994 time: 0.0607505 Nov 05 15:15:50.123485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ba22d907-339e-4414-85c5-e9b19cb85ec6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:51.367243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b320b04-831c-4b82-8739-571d4dfc5d8a req-2aa3004c-fb2e-4b0a-a955-5ed39d7d2d49 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:51.368822 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1b320b04-831c-4b82-8739-571d4dfc5d8a req-2aa3004c-fb2e-4b0a-a955-5ed39d7d2d49 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0489888 Nov 05 15:15:51.427125 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1b320b04-831c-4b82-8739-571d4dfc5d8a req-8c28cb80-e9f4-496c-b9dd-1a3e17f522b2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0520799 Nov 05 15:15:52.446349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4352cc70-f99d-4c0c-aeae-43fbae2600a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:52.543912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-badad2b9-bb79-43b0-ae70-61223741a77e req-eac6f7bd-d3c5-4579-a4da-d5688fe76b0e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:52.545788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-badad2b9-bb79-43b0-ae70-61223741a77e req-eac6f7bd-d3c5-4579-a4da-d5688fe76b0e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0493205 Nov 05 15:15:52.595069 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-badad2b9-bb79-43b0-ae70-61223741a77e req-cf467bd7-6c5e-4857-b6fb-bfab6d18f5d3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429630 Nov 05 15:15:53.511840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:53.711602 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1613e9-0e24-4916-b4ae-fc95ed906aa2 req-624f6389-3e15-41f6-b23b-920378d540a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:53.713088 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e1613e9-0e24-4916-b4ae-fc95ed906aa2 req-624f6389-3e15-41f6-b23b-920378d540a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0523965 Nov 05 15:15:53.762001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2e1613e9-0e24-4916-b4ae-fc95ed906aa2 req-10a27cc2-f3f3-46d1-b48c-a6e8c6ed8699 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428677 Nov 05 15:15:54.881416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323da94c-dbc0-43c7-a933-3cea3e10b9fe req-aa168d15-b573-4420-a638-32225657e0bc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:54.882871 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-323da94c-dbc0-43c7-a933-3cea3e10b9fe req-aa168d15-b573-4420-a638-32225657e0bc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0520971 Nov 05 15:15:54.930786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-323da94c-dbc0-43c7-a933-3cea3e10b9fe req-247d8c3e-5094-4309-93da-ee13240555bb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421598 Nov 05 15:15:54.975373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:55.978663 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:56.047666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ae8ce3-1494-41bc-994d-5809748c79ce req-22267c8d-7353-4bc4-9b21-ef4725a396e6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:56.049214 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-71ae8ce3-1494-41bc-994d-5809748c79ce req-22267c8d-7353-4bc4-9b21-ef4725a396e6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0494251 Nov 05 15:15:56.097822 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-71ae8ce3-1494-41bc-994d-5809748c79ce req-886413a4-98ff-4a88-b6bd-fb11245ca903 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0425990 Nov 05 15:15:57.209161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39edaa1b-3339-4445-bcb2-4d4350350191 req-41982384-b6b4-4ddd-9d48-042e610ea4ec tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:57.210615 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39edaa1b-3339-4445-bcb2-4d4350350191 req-41982384-b6b4-4ddd-9d48-042e610ea4ec tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0478206 Nov 05 15:15:57.258914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39edaa1b-3339-4445-bcb2-4d4350350191 req-2963356c-9a69-4df1-b86e-0c2fb5d58ff2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0424690 Nov 05 15:15:57.280064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50898) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:57.341372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ee10c8cb-6569-4aea-9a48-fe88b9b933e3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/1f115326-e2a6-494b-ba6f-e2f59da0c5ea HTTP/1.1" status: 200 len: 994 time: 0.0602055 Nov 05 15:15:57.583627 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50904) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:15:57.738234 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 56e33b1b-e7d8-4111-9979-dc61ce757571 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:15:57.738489 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:57.815029 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:57.815352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:57.826879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 56e33b1b-e7d8-4111-9979-dc61ce757571 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:15:57.976280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:58.002069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=56e33b1b-e7d8-4111-9979-dc61ce757571,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:15:58.024849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.025204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.025550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.025890 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.026224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.026560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.026893 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.027224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.027557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.027886 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.028216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.028571 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:15:58.070853 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:58.071180 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 1f115326-e2a6-494b-ba6f-e2f59da0c5ea disassociated (deleted). External IP: 172.26.5.112, port: cf50c3c8-2641-4eb0-8103-3a738c72adf6. Nov 05 15:15:58.276072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:15:58.381633 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:15:58.386388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:15:58.390920 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Sync routers for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:15:58.400362 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:58.400991 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:58.413181 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1f6ccc7d-7d19-442d-905a-a8b44dd55889 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/floatingips/1f115326-e2a6-494b-ba6f-e2f59da0c5ea HTTP/1.1" status: 204 len: 168 time: 0.8284972 Nov 05 15:15:58.413861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:15:58.416182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4605d03-3b41-4f91-b65c-54e005ac641d" -d '{"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:15:58.454033 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:15:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bd7a09b-375e-4fe0-9dff-8d5590fb58c2 x-openstack-request-id: req-3bd7a09b-375e-4fe0-9dff-8d5590fb58c2 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:15:58.454329 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:15:58.454582 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3bd7a09b-375e-4fe0-9dff-8d5590fb58c2 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:15:58.454984 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'status': 'completed', 'code': 200} Nov 05 15:15:58.514882 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:58.588974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-144fc241-12c6-4d83-9a4b-46cae2ac21eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:58.590586 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-144fc241-12c6-4d83-9a4b-46cae2ac21eb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 1099 time: 0.1141179 Nov 05 15:15:58.677614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9113c1-51c1-4981-b779-18f56e649e24 req-8c1cef31-9921-4e81-8fa1-9a5cb4b4f46a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:58.679244 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-af9113c1-51c1-4981-b779-18f56e649e24 req-8c1cef31-9921-4e81-8fa1-9a5cb4b4f46a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0638297 Nov 05 15:15:58.704491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-a8e23796-1f87-4924-8eb2-19b1fb0767c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:58.706746 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-a8e23796-1f87-4924-8eb2-19b1fb0767c3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 200 len: 897 time: 0.1071310 Nov 05 15:15:58.733917 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-af9113c1-51c1-4981-b779-18f56e649e24 req-def91dad-a70b-4e32-98e8-d656a331fc2b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0475924 Nov 05 15:15:58.767863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-7d049171-dfd1-4977-a815-7757358e8712 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 200 len: 217 time: 0.0503216 Nov 05 15:15:58.787392 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:58.816834 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Checking router: 1758122d-7941-4d7d-9e71-cb1d6ee32da3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:15:58.818138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-78eb43eb-3bf2-4b33-ac41-2aa10eaacc6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:58.819590 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-78eb43eb-3bf2-4b33-ac41-2aa10eaacc6e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 200 len: 834 time: 0.0449977 Nov 05 15:15:58.825226 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:15:58.825818 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:58.868235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-a46b9b2a-b5c4-49ac-be90-015cdc066f46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:58.870542 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-a46b9b2a-b5c4-49ac-be90-015cdc066f46 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423851 Nov 05 15:15:58.939914 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:15:58.969807 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-b9280ddc-a433-4a99-bb14-983953a74546 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904758 Nov 05 15:15:59.058580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e4605d03-3b41-4f91-b65c-54e005ac641d req-6c940a34-b8c9-4ac6-8135-c423103ffca5 service neutron] 10.222.0.32 "GET /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0808136 Nov 05 15:15:59.135549 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:15:59.164218 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a2c8188-703d-446f-9164-9fb1ce0248f3 None None] The sync data for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv is: [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'ef701360-ec3e-43e2-b900-9b1ec86e6509', 'name': '', 'network_id': 'ec687c9e-bd18-48a6-8d6f-3dcda6604f2f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:dd:0a:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_interface', 'standard_attr_id': 1679, 'fixed_ips': [{'subnet_id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:05Z', 'updated_at': '2021-11-05T15:15:09Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': 'ec8e28f1-3fae-4871-b795-ab19d4734fc9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:15:59.380758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bae268f-40c6-4353-a98e-10e7e4e47a35 None None] New status for floating IP 1f115326-e2a6-494b-ba6f-e2f59da0c5ea: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:15:59.855995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe50c43a-6983-4de5-aa3c-a18bc5f970d2 req-31af5587-d6dd-4201-a62f-eb13efb58c14 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:15:59.857483 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fe50c43a-6983-4de5-aa3c-a18bc5f970d2 req-31af5587-d6dd-4201-a62f-eb13efb58c14 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0531881 Nov 05 15:15:59.905751 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fe50c43a-6983-4de5-aa3c-a18bc5f970d2 req-4a4434ac-59b4-4eed-9001-d724e144ed56 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=057d63af-eb97-441c-8230-b8f1955c3396&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423763 Nov 05 15:16:00.202919 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-0690cf2e-809e-4fe4-9797-a1e43e609cf1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:00.204384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-0690cf2e-809e-4fe4-9797-a1e43e609cf1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 946 time: 0.0481114 Nov 05 15:16:00.291815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port cf50c3c8-2641-4eb0-8103-3a738c72adf6 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:16:00.292066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:00.376755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port cf50c3c8-2641-4eb0-8103-3a738c72adf6, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=cf50c3c8-2641-4eb0-8103-3a738c72adf6,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:00.377139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:00.389410 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for cf50c3c8-2641-4eb0-8103-3a738c72adf6 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:16:00.514387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:00.541049 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=cf50c3c8-2641-4eb0-8103-3a738c72adf6,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:00.555458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.555819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.556147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.556504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.556834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.557157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.557584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.557790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.558109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.558426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.558745 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.559061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:00.592715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] No DVR routers for this DVR port cf50c3c8-2641-4eb0-8103-3a738c72adf6 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:16:00.595413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:00.599485 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bd84e114-09c8-4875-92ae-cbdbcbd9caa1 req-843b07bf-5859-499b-9352-de32f28348ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "DELETE /v2.0/ports/cf50c3c8-2641-4eb0-8103-3a738c72adf6 HTTP/1.1" status: 204 len: 173 time: 0.3893719 Nov 05 15:16:00.599987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'name': 'network-vif-deleted', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:16:00.602312 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70a2bcf4-d468-42d5-b5df-210ed725c2cb" -d '{"events": [{"server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "name": "network-vif-deleted", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:16:00.641406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f40c3ba3-23c1-4d48-b4d1-dd9d6a65fff7 x-openstack-request-id: req-f40c3ba3-23c1-4d48-b4d1-dd9d6a65fff7 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:16:00.641749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ee64ec6-6112-479c-9f56-249823bbc2e9", "name": "network-vif-deleted", "tag": "cf50c3c8-2641-4eb0-8103-3a738c72adf6", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:16:00.642025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f40c3ba3-23c1-4d48-b4d1-dd9d6a65fff7 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:16:00.642503 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ee64ec6-6112-479c-9f56-249823bbc2e9', 'name': 'network-vif-deleted', 'tag': 'cf50c3c8-2641-4eb0-8103-3a738c72adf6', 'status': 'completed', 'code': 200} Nov 05 15:16:01.038812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bea16b98-6441-4e81-af2d-d032594fc3e9 req-d02ef896-f1f3-467e-a5ed-e69c934339b1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=1ee64ec6-6112-479c-9f56-249823bbc2e9 HTTP/1.1" status: 200 len: 210 time: 0.0503819 Nov 05 15:16:02.087735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50922) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:02.538106 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:16:02.712963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:02.970324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port ef701360-ec3e-43e2-b900-9b1ec86e6509 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:16:02.970664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.059918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port ef701360-ec3e-43e2-b900-9b1ec86e6509, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ef701360-ec3e-43e2-b900-9b1ec86e6509,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:03.060279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.073783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for ef701360-ec3e-43e2-b900-9b1ec86e6509 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:16:03.259868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.286086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=ef701360-ec3e-43e2-b900-9b1ec86e6509,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:03.450984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.668230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:16:03.774109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:16:03.779162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-9c6112fe-cd17-4380-b895-2deb5893f054 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/1758122d-7941-4d7d-9e71-cb1d6ee32da3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6904275 Nov 05 15:16:03.781865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50924) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:03.784736 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Sync routers for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:16:03.794083 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:03.794926 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:03.835208 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting subnet ec8e28f1-3fae-4871-b795-ab19d4734fc9 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:16:03.838313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.878937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.963935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:03.985029 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:04.029485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.056832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Subnet': ['ID=ec8e28f1-3fae-4871-b795-ab19d4734fc9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:04.062822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.066230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7a52458f-7c90-4718-8dc1-c12d8bc7b990 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/subnets/ec8e28f1-3fae-4871-b795-ab19d4734fc9 HTTP/1.1" status: 204 len: 168 time: 0.2834444 Nov 05 15:16:04.068783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50926) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:04.075184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4f6b3e1-0122-4f5f-91ab-9506653e0ab9 None None] Network ec687c9e-bd18-48a6-8d6f-3dcda6604f2f requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:16:04.165665 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:16:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:04.190459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.198469 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Checking router: 1758122d-7941-4d7d-9e71-cb1d6ee32da3 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:16:04.207429 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Routers {'1758122d-7941-4d7d-9e71-cb1d6ee32da3'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:04.208030 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:04.247155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] DHCP port deletion for ec687c9e-bd18-48a6-8d6f-3dcda6604f2f request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:16:04.295043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Deleting port 44dd51a3-1558-4b05-91f9-236b9b20ed54 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:16:04.295412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.317706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.319637 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] Set router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:04.361212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] For port 44dd51a3-1558-4b05-91f9-236b9b20ed54, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=44dd51a3-1558-4b05-91f9-236b9b20ed54,segment=NetworkSegment(2071fc9b-46ed-472d-bdef-fb44dfef6b7f),segment_id=2071fc9b-46ed-472d-bdef-fb44dfef6b7f)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:04.361640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.375224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Calling delete_port for 44dd51a3-1558-4b05-91f9-236b9b20ed54 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:16:04.377942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b1cb2f33-1577-4469-bec1-e157f0081280 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:16:04.378390 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.456162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.464601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port b1cb2f33-1577-4469-bec1-e157f0081280, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b1cb2f33-1577-4469-bec1-e157f0081280,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:04.464967 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.482020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b1cb2f33-1577-4469-bec1-e157f0081280 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:16:04.488502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device cf50c3c8-2641-4eb0-8103-3a738c72adf6 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:16:04.492871 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] Pushing event deleted for resources: {'Port': ['ID=44dd51a3-1558-4b05-91f9-236b9b20ed54,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:04.495023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6e488bb-4ff7-4e22-b418-379851bb8af2 None None] No DVR routers for this DVR port 44dd51a3-1558-4b05-91f9-236b9b20ed54 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:16:04.507395 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:16:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:04.514659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: cf50c3c8-2641-4eb0-8103-3a738c72adf6 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:16:04.514999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device cf50c3c8-2641-4eb0-8103-3a738c72adf6 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:16:04.535139 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f57de1e3-ff53-499e-aacb-1c11e60c5b1b None None] The sync data for ids ['1758122d-7941-4d7d-9e71-cb1d6ee32da3'] in dv-neutron-816850-1-hyperv is: [{'id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'name': 'tempest-TestNetworkAdvancedServerOps-router-700571696', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94'}], 'enable_snat': True}, 'gw_port_id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:15:02Z', 'updated_at': '2021-11-05T15:16:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b1cb2f33-1577-4469-bec1-e157f0081280', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:20:0f:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1758122d-7941-4d7d-9e71-cb1d6ee32da3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1676, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:15:03Z', 'updated_at': '2021-11-05T15:15:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:16:04.665665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.693988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b1cb2f33-1577-4469-bec1-e157f0081280,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:04.752675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.839868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.841875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.884634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.885185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Fanout notify agent at l3_agent the message router_deleted on router 1758122d-7941-4d7d-9e71-cb1d6ee32da3 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:16:04.892386 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:04.894088 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-053430f5-da0b-44a3-814f-573db6de1f9d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/routers/1758122d-7941-4d7d-9e71-cb1d6ee32da3 HTTP/1.1" status: 204 len: 168 time: 0.8243876 Nov 05 15:16:04.896820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50928) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:04.977671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.062661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.084198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ec687c9e-bd18-48a6-8d6f-3dcda6604f2f']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:05.093865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2071fc9b-46ed-472d-bdef-fb44dfef6b7f') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:05.094157 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2071fc9b-46ed-472d-bdef-fb44dfef6b7f') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:05.108544 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.122060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.129097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Releasing vlan 613 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:16:05.129493 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:16:05.133792 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:16:05.192764 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.199548 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.202580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/networks/ec687c9e-bd18-48a6-8d6f-3dcda6604f2f HTTP/1.1" status: 204 len: 168 time: 0.3047891 Nov 05 15:16:05.206002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50930) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:05.214243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8d7f409-3864-4d5e-bba9-115119f8871d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Network': ['ID=ec687c9e-bd18-48a6-8d6f-3dcda6604f2f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:05.262841 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.286799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.345010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.347511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.348665 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/security-groups/057d63af-eb97-441c-8230-b8f1955c3396 HTTP/1.1" status: 204 len: 168 time: 0.1416621 Nov 05 15:16:05.358938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22dfd3f-1071-4cc9-903f-d0ac44510c3d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=057d63af-eb97-441c-8230-b8f1955c3396,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:05.551092 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50936) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:05.555809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1740151831', 'description': 'tempest-secgroup-smoke-1740151831 description', 'project_id': 'ef1d7839d356477e8151af4dc08baead'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:05.577706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.643752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.647396 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.679497 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.680711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1285131 Nov 05 15:16:05.683710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50938) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:05.684690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-839eeef5-4481-48c4-bb1e-fdc3b99c91ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=18d62099-b0ec-454e-842b-5a268fe3082e,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:05.688272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:05.713485 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.766500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.770446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.788178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c96d4d12-1f27-4ff9-89a2-b469d9c6ea0b,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:05.797243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.798476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-aa3dd079-00e7-4762-a88d-80e121438db4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1137652 Nov 05 15:16:05.801161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50940) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:05.805441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:05.831676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.890865 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.894829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.913077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=74bec56a-ffe3-463b-a40d-b4c1dabbd24e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:05.917381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:05.918557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-306bfb36-1c2b-41f6-a9b0-820a5d2287f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1164770 Nov 05 15:16:05.921578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50942) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:05.925877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:05.954890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.010825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.014341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.031932 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5766822-05ac-4147-aadd-560b00600d4d,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:06.040108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.041624 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cb37dafe-3dd7-4945-be82-255a028762bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1190565 Nov 05 15:16:06.044346 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50944) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:06.049895 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:06.076687 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.077657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ef701360-ec3e-43e2-b900-9b1ec86e6509 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:16:06.096809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: ef701360-ec3e-43e2-b900-9b1ec86e6509 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:16:06.097153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ef701360-ec3e-43e2-b900-9b1ec86e6509 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:16:06.097566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 44dd51a3-1558-4b05-91f9-236b9b20ed54 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:16:06.116172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 44dd51a3-1558-4b05-91f9-236b9b20ed54 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:16:06.116537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 44dd51a3-1558-4b05-91f9-236b9b20ed54 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:16:06.116943 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b1cb2f33-1577-4469-bec1-e157f0081280 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:16:06.135201 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.136878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b1cb2f33-1577-4469-bec1-e157f0081280 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:16:06.137366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b1cb2f33-1577-4469-bec1-e157f0081280 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:16:06.139104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.159468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9439a79c-88a5-4744-ad10-ad83c4e2cb39,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:06.164970 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.166032 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-772b0689-cae4-4cb7-a151-a1bc4b431778 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1203539 Nov 05 15:16:06.168770 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50946) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:06.173414 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:06.194730 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:16:06.199420 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.257514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.261518 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.279437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a35ff630-c126-45c8-b128-d5811d208c9d,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:06.286959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.288124 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7b7247bf-b226-4fcc-ba8c-ed641be1e346 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1184227 Nov 05 15:16:06.290837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50948) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:06.295429 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '18d62099-b0ec-454e-842b-5a268fe3082e', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:06.316582 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:16:06.321228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.379174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.382671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.397383 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46d4fdf5-18ee-4b40-8f0c-8c5a1e011afd,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:06.407711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.411620 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dde7c118-3b3a-4371-bc98-f07dc10d701c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1171806 Nov 05 15:16:06.411789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50950) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:06.416556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'network': {'name': 'tempest-network-smoke--1493004464', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:06.436713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:16:06.440542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.465441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 634} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:16:06.474074 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.474404 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Added segment d92dc963-87eb-4b59-bada-f059f7aa1b1c of type vlan for network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 Nov 05 15:16:06.513063 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.537170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.542798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:06.543393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.601316 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1885235 Nov 05 15:16:06.604126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50952) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:06.608732 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'admin_state_up': True, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:06.612225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ddaf46-db86-4e2e-b3a9-29c1b7e445ff tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Network': ['ID=16fcd0ca-03b6-475b-aaf2-861d3ea5e923,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:06.623032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:16:06.631175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.632188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.684618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:06.815241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:07.272141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:07.290307 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:07.386306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.181 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/3fb7d8e2-2921-454b-8e4f-1aebdfbfe277) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:16:07.485806 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:07.518988 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:07.555652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:07.560293 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:07.563878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:16:07.570200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:07.806407 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.001508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.126303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 43f6c78a-e103-4676-8f08-1d99daf0ba6c is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:16:08.232549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:16:08.243469 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Sync routers for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:16:08.252531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:08.252702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.253147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:08.253920 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-10c61f4b-34a2-4a6a-b366-f359a45767a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.6487436 Nov 05 15:16:08.257184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50954) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:08.291543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-86b68328-4e46-4425-aed9-5943b7a55420 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=ef1d7839d356477e8151af4dc08baead&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0332749 Nov 05 15:16:08.294203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50956) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:08.356760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:08.439003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e31b073-9507-4e4e-b9e4-880d222cf279 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:08.440831 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5e31b073-9507-4e4e-b9e4-880d222cf279 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1454468 Nov 05 15:16:08.443606 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 50958) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:08.481279 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-63a46856-c930-4498-a75c-e666530bbf78 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0365219 Nov 05 15:16:08.484144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50960) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:08.489221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1960983263', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:08.532299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:07Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:08.562110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Checking router: 43f6c78a-e103-4676-8f08-1d99daf0ba6c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:16:08.562456 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Updating router 43f6c78a-e103-4676-8f08-1d99daf0ba6c port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:16:08.584341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:16:08.587040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.587852 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.765797 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.824680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Subnet': ['ID=138889b8-25b6-4a0c-bb26-fce73d215a72,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:08.831289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.833799 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Checking segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:16:08.834256 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network hostable DHCP agents. Network: 16fcd0ca-03b6-475b-aaf2-861d3ea5e923, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:16:08.837126 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.850581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:16:08.859057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 16fcd0ca-03b6-475b-aaf2-861d3ea5e923) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:08.864116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:08.865019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:08.883461 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-76e73247-7a59-4d89-b89f-87003c25541d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.3981192 Nov 05 15:16:08.886301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 50962) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:09.022401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa7eeca4-52e1-4247-b62e-4d1ea9a06c53 None None] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:16:09.087270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Pushing event updated for resources: {'Port': ['ID=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:09.092862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Attempting to bind port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:16:09.093251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Attempting to bind port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:16:09.093608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Attempting to bind port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:16:09.105305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.105649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.105984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.106316 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.106643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.106965 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.107281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.107606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.107930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.108245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.108589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.108905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:09.112504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:16:09.112877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:16:09.113273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:09.113650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:16:09.114104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Bound port: 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:16:09.114471 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-aa7eeca4-52e1-4247-b62e-4d1ea9a06c53 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:16:09.165692 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:16:09.178666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c9351a0-3d71-47ff-823b-3fdf2156d4f0 None None] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:16:09.187067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] For port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:16:09.230980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] For port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:16:09.243134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-2c9351a0-3d71-47ff-823b-3fdf2156d4f0 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:16:09.306508 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:16:09.316942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9defcc4-c527-4035-ada2-c447bfad4a4a None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:16:09.329287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:09.329964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:09.332872 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:09.351053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e9e4f50-a1ad-4fcb-9e4a-53aea209ea6d None None] Pushing event updated for resources: {'Port': ['ID=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:09.483736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9defcc4-c527-4035-ada2-c447bfad4a4a None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:16:09.496556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:09.822336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:07Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:09.853171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c94ed10e-e04e-4cbc-9abb-f4c632368015 None None] The sync data for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv is: [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:07Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:16:09.892922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:16:09.893784 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:09.935553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.1 (16fcd0ca-03b6-475b-aaf2-861d3ea5e923/138889b8-25b6-4a0c-bb26-fce73d215a72/8b49f59a-77b4-41cd-98ed-0504cc7042a7) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:16:10.072952 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.114002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.165699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:10.166941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Allocated IP 172.20.0.2 (16fcd0ca-03b6-475b-aaf2-861d3ea5e923/138889b8-25b6-4a0c-bb26-fce73d215a72/4de10915-3ae6-467a-8242-7783f6aabbaa) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:16:10.169059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:10.174129 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:16:10.178181 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:10.224573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.327954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.336051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.358448 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.379255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:10.384628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:10.388308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:16:10.396315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Pushing event updated for resources: {'Port': ['ID=4de10915-3ae6-467a-8242-7783f6aabbaa,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:10.448035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Attempting to bind port 4de10915-3ae6-467a-8242-7783f6aabbaa on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:16:10.448520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Attempting to bind port 4de10915-3ae6-467a-8242-7783f6aabbaa by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:16:10.448953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Attempting to bind port 4de10915-3ae6-467a-8242-7783f6aabbaa on network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:16:10.454729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:16:10.455793 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Checking segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:16:10.456269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.456747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Bound using segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:16:10.457285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Bound port: 4de10915-3ae6-467a-8242-7783f6aabbaa, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:16:10.457733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.524950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] For port 4de10915-3ae6-467a-8242-7783f6aabbaa, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:16:10.528303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] For port 4de10915-3ae6-467a-8242-7783f6aabbaa, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4de10915-3ae6-467a-8242-7783f6aabbaa,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:16:10.533392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.601067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d19c48-5009-412e-a8c0-50dcae91c59e None None] Pushing event updated for resources: {'Port': ['ID=4de10915-3ae6-467a-8242-7783f6aabbaa,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:10.677386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.681982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.757343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:10.783472 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:10.887120 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:10.890584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:11.006940 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 43f6c78a-e103-4676-8f08-1d99daf0ba6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:16:11.117404 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:16:11.122246 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-34a6e397-58a2-4dfd-b702-909d401f481a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/43f6c78a-e103-4676-8f08-1d99daf0ba6c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2349818 Nov 05 15:16:11.275550 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-5df05752-245a-4d76-95ab-51ab1161c993 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1740151831&fields=id&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 267 time: 0.0450723 Nov 05 15:16:11.378282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-f53e6117-5e5f-4487-992c-1e7ef4430f07 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:11.379756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-f53e6117-5e5f-4487-992c-1e7ef4430f07 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 797 time: 0.0975034 Nov 05 15:16:11.395282 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-d4ba1d36-62e2-4a12-a8f9-74d6831bdbcd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/quotas/ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 375 time: 0.0096145 Nov 05 15:16:11.450848 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-7fd29645-218c-4620-ab86-50065765da7e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0499136 Nov 05 15:16:11.467868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-b1ba0104-6ec9-4f71-b4b5-0163cd8f70d7 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:16:11.468868 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-b1ba0104-6ec9-4f71-b4b5-0163cd8f70d7 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053475 Nov 05 15:16:11.557266 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-64ac132d-3f5c-4dd5-aa6c-0b7182a5f025 service neutron] 10.222.0.30 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819716 Nov 05 15:16:11.569983 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Sync routers for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:16:11.580671 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:11.581266 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:11.650903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-9f207404-6ff8-48c5-839c-5d93274d6a4a service neutron] 10.222.0.30 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871413 Nov 05 15:16:11.686976 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:11.811711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dac0996f-0fc9-4a08-87cf-f01125705a93 req-852aaf96-5d5e-4cb5-a72f-0f023e36abfa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 210 time: 0.0286355 Nov 05 15:16:11.901945 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 2, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:11.928736 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Checking router: 43f6c78a-e103-4676-8f08-1d99daf0ba6c for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:16:11.929094 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Updating router 43f6c78a-e103-4676-8f08-1d99daf0ba6c port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:16:11.954600 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.107162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bba27e22-a917-4a04-ae21-37db0a46e0c7 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:16:12.143939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:12.224038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] Provisioning complete for port 4de10915-3ae6-467a-8242-7783f6aabbaa triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:12.224317 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.227749 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.232872 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.254066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bba27e22-a917-4a04-ae21-37db0a46e0c7 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:16:12.275994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:12.276358 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.283126 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Pushing event updated for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:12.305917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.305917 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.306230 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.306345 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.306655 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.306974 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.307292 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.307609 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.307925 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.308241 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.308574 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.308888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:16:12.339112 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Attempting to bind port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:16:12.339472 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Attempting to bind port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:16:12.339824 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Attempting to bind port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 on network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:16:12.344910 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:16:12.345207 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Checking segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:16:12.346139 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.347140 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Bound using segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:16:12.347600 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Bound port: 8b49f59a-77b4-41cd-98ed-0504cc7042a7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:16:12.347969 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.406130 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] For port 8b49f59a-77b4-41cd-98ed-0504cc7042a7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:16:12.409703 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] For port 8b49f59a-77b4-41cd-98ed-0504cc7042a7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b49f59a-77b4-41cd-98ed-0504cc7042a7,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:16:12.414013 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.424497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.471241 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:12.471842 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:15:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:12.476548 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5485de41-1fee-460e-80ba-93aa0b9a7fd9 None None] Pushing event updated for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:12.517862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.528624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] For port 4de10915-3ae6-467a-8242-7783f6aabbaa, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4de10915-3ae6-467a-8242-7783f6aabbaa,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:12.538589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.554111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:12.678188 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:12.720842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.721629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4de10915-3ae6-467a-8242-7783f6aabbaa up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:12.812363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-122e236a-a8e2-40d6-84a4-1fe57e8e8c03 None None] Pushing event updated for resources: {'Port': ['ID=4de10915-3ae6-467a-8242-7783f6aabbaa,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:12.885710 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:12.893504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:12.903975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4de10915-3ae6-467a-8242-7783f6aabbaa triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:12.904516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:12.917290 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0a2d2b-1c50-42c1-bed4-25dea3f9cf17 None None] The sync data for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv is: [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:16:12.926729 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04a7a360-b00f-4fba-acf5-92be05dbdfdd req-254f84e1-fb4a-4774-95be-56e945f19617 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 210 time: 0.0580435 Nov 05 15:16:13.467255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Provisioning complete for port 4de10915-3ae6-467a-8242-7783f6aabbaa triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:13.467726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:13.566192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Provisioning complete for port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:13.566455 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:13.649604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:13.684897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] For port 8b49f59a-77b4-41cd-98ed-0504cc7042a7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b49f59a-77b4-41cd-98ed-0504cc7042a7,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:13.689501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:13.742601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3479711e-1e5b-47df-bcff-246397b5fd1f None None] Pushing event updated for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:13.812482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8c15f92b-b1b5-4a43-8de3-3f36fdce35ed None None] Provisioning complete for port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:13.812891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8c15f92b-b1b5-4a43-8de3-3f36fdce35ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.012802 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f19178c0-0017-4a7d-959e-994926fa82c2 req-f53f1ae8-0f63-4017-933b-4c6d053f9df7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 210 time: 0.0305271 Nov 05 15:16:14.013281 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b5cfa361-af4a-4b80-880c-00ba28bd5139 None None] Provisioning complete for port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:14.013565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b5cfa361-af4a-4b80-880c-00ba28bd5139 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.157665 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:14.205857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:14.206230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.263525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1f1a8280-8827-4715-8b31-7e44e77d4b11 None None] Provisioning complete for port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:14.263918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1f1a8280-8827-4715-8b31-7e44e77d4b11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.350364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b49f59a-77b4-41cd-98ed-0504cc7042a7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:14.423528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:14.423904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.505200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4de10915-3ae6-467a-8242-7783f6aabbaa up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:14.550614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4de10915-3ae6-467a-8242-7783f6aabbaa triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:14.550986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:14.865847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-1601a592-3aa9-4ba1-9f82-370d7a953d9c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:14.867326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-1601a592-3aa9-4ba1-9f82-370d7a953d9c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 797 time: 0.1012769 Nov 05 15:16:14.935834 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-dd00d817-9c04-44a3-8276-7e6bb169dcc3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 380 time: 0.0593252 Nov 05 15:16:14.945388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'port': {'device_id': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'admin_state_up': True, 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'security_groups': ['18d62099-b0ec-454e-842b-5a268fe3082e']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:15.046566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:16:15.050973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.142001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6a6a56fe-4897-4bf5-af50-ed1017ee0923 req-1a90ddde-10b7-414a-b121-31d1932128ac tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 210 time: 0.0411220 Nov 05 15:16:15.198581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.11 (16fcd0ca-03b6-475b-aaf2-861d3ea5e923/138889b8-25b6-4a0c-bb26-fce73d215a72/b40bcd97-45c7-469f-844d-2ceaf8e85e0c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:16:15.336909 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.370758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.410807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:15.413700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:15.420051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:16:15.444947 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:15.474727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:15.475340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.491831 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-fc5433bf-8cb7-405b-9a96-19577152c97a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5503473 Nov 05 15:16:15.505851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Request body: {'port': {'device_id': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:15.563711 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.634405 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-4928d2ad-d4f5-499d-96e9-18e96abcd496 None None] Provisioning complete for port b40bcd97-45c7-469f-844d-2ceaf8e85e0c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:15.635037 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4928d2ad-d4f5-499d-96e9-18e96abcd496 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.668787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-4928d2ad-d4f5-499d-96e9-18e96abcd496 None None] Port b40bcd97-45c7-469f-844d-2ceaf8e85e0c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:16:15.814702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b40bcd97-45c7-469f-844d-2ceaf8e85e0c {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:16:15.821734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.833040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Transition to ACTIVE for port object b40bcd97-45c7-469f-844d-2ceaf8e85e0c will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:16:15.837100 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:15.903561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520863d6-f636-476e-8104-2779da082836 service neutron] Pushing event updated for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:15.958457 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Attempting to bind port b40bcd97-45c7-469f-844d-2ceaf8e85e0c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:16:15.958816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Attempting to bind port b40bcd97-45c7-469f-844d-2ceaf8e85e0c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:16:15.959123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Attempting to bind port b40bcd97-45c7-469f-844d-2ceaf8e85e0c on network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:16:15.963709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Port b40bcd97-45c7-469f-844d-2ceaf8e85e0c on network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:16:15.964031 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Attempting to bind port b40bcd97-45c7-469f-844d-2ceaf8e85e0c on network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:16:15.969055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 15, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:16:15.969392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Checking segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:16:15.969777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Bound using segment: {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:16:15.970330 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Bound port: b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd92dc963-87eb-4b59-bada-f059f7aa1b1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 634, 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:16:15.970576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:16.037036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:16:16.040137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:16:16.044271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:16.079116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.079737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:16.081159 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-520863d6-f636-476e-8104-2779da082836 service neutron] 10.222.0.32 "PUT /v2.0/ports/b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 1094 time: 0.5801871 Nov 05 15:16:16.081654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:16:16.083887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58d62c47-565b-49fd-9db0-3a9a6c48afee" -d '{"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:16:16.117868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-520863d6-f636-476e-8104-2779da082836 service neutron] Pushing event updated for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:16.128065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:16:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abedf32c-3790-46cc-8eb4-7c9df12ae8fd x-openstack-request-id: req-abedf32c-3790-46cc-8eb4-7c9df12ae8fd {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:16:16.128357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:16:16.128675 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-abedf32c-3790-46cc-8eb4-7c9df12ae8fd {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:16:16.129085 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'status': 'completed', 'code': 200} Nov 05 15:16:16.177970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-36bb1967-89b1-4d01-8350-acb431b96f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.179558 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-36bb1967-89b1-4d01-8350-acb431b96f05 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1097 time: 0.0465405 Nov 05 15:16:16.229783 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-cf7591b9-c511-4b0f-a0fd-96bd48a99907 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 217 time: 0.0410695 Nov 05 15:16:16.304788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-4e1e9b29-b8b1-4625-89be-ad2893258274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.306322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-4e1e9b29-b8b1-4625-89be-ad2893258274 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0671024 Nov 05 15:16:16.317716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9fd3b7b-b318-4a51-8685-0cf1f837e0a9 req-413f0047-3e4c-4b6b-b39f-a752bff2641e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.319215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9fd3b7b-b318-4a51-8685-0cf1f837e0a9 req-413f0047-3e4c-4b6b-b39f-a752bff2641e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 944 time: 0.0922630 Nov 05 15:16:16.393447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-453c5aff-e2c2-4807-99fd-a7bc965c5c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.394941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-453c5aff-e2c2-4807-99fd-a7bc965c5c2d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0748632 Nov 05 15:16:16.399880 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9fd3b7b-b318-4a51-8685-0cf1f837e0a9 req-09000d90-8b52-4df7-97a5-7119332e66eb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721886 Nov 05 15:16:16.483348 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-26507824-2411-46b2-acaf-d7a4604b15ed service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810266 Nov 05 15:16:16.573579 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1943204d-be0d-4c28-a589-ad8095d2dedc req-45d54524-645d-43b1-83a2-0b748a38eaa3 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833137 Nov 05 15:16:16.666750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-b0ad22f0-8379-4d4c-8d3e-5bd7fd79809b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.668236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-b0ad22f0-8379-4d4c-8d3e-5bd7fd79809b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1097 time: 0.0424104 Nov 05 15:16:16.757776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-527ea002-07bc-4ac9-ae16-88b799367e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.759105 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-527ea002-07bc-4ac9-ae16-88b799367e71 service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.0831170 Nov 05 15:16:16.801756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-46151830-a71f-42af-9ffa-55f011d83f92 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 217 time: 0.0336788 Nov 05 15:16:16.848995 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-227a9c34-6c27-4013-95da-b79bc723fb9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.850408 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-227a9c34-6c27-4013-95da-b79bc723fb9f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0419466 Nov 05 15:16:16.895531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-9fda76f7-0c98-4fea-8828-a48e2610b836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:16.896997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-9fda76f7-0c98-4fea-8828-a48e2610b836 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389321 Nov 05 15:16:16.992930 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-cf70dcd1-3f6b-4e05-b951-1e09940d9586 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866954 Nov 05 15:16:17.083010 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58d62c47-565b-49fd-9db0-3a9a6c48afee req-b43428c9-ea03-4356-87c2-df3c63294542 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800982 Nov 05 15:16:17.520245 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797ab4dc-f4c0-48ea-826a-545c7a6cdda9 req-fd197d78-82d7-4321-957f-02e86e2aaea6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:17.521736 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-797ab4dc-f4c0-48ea-826a-545c7a6cdda9 req-fd197d78-82d7-4321-957f-02e86e2aaea6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 944 time: 0.0521026 Nov 05 15:16:17.570407 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-797ab4dc-f4c0-48ea-826a-545c7a6cdda9 req-d0041b8b-e1c4-4633-addf-036361562b3b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428066 Nov 05 15:16:18.468812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:18.686605 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2625da-21fc-4ce9-87cb-be79e0488573 req-e226c552-0ecc-4800-9ece-68a704753239 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:18.688044 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f2625da-21fc-4ce9-87cb-be79e0488573 req-e226c552-0ecc-4800-9ece-68a704753239 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 944 time: 0.0525548 Nov 05 15:16:18.735229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f2625da-21fc-4ce9-87cb-be79e0488573 req-55ab2796-5ae7-4149-85a4-cfb25034bc82 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408764 Nov 05 15:16:19.846744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1f7cde-ba6d-4f2d-b59e-23ef3b092261 req-38c13d24-353d-48ec-9e15-278ac9b6e153 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:19.848212 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8a1f7cde-ba6d-4f2d-b59e-23ef3b092261 req-38c13d24-353d-48ec-9e15-278ac9b6e153 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 944 time: 0.0484872 Nov 05 15:16:19.896856 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8a1f7cde-ba6d-4f2d-b59e-23ef3b092261 req-5ec9849e-56f9-40c2-80ca-946fbecdbed1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427163 Nov 05 15:16:20.125016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-01337114-d14f-4be6-b46d-3cb629ca1946 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:20.486429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device b40bcd97-45c7-469f-844d-2ceaf8e85e0c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:16:20.581095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:20.591941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'port_id': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'mac_address': 'fa:16:3e:a1:e5:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 634, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:16:20.627819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:20.641321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b40bcd97-45c7-469f-844d-2ceaf8e85e0c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:16:20.661349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:20.664802 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:20.713690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:20.869264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['b40bcd97-45c7-469f-844d-2ceaf8e85e0c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:16:21.009083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa61e46-ea40-4870-99ae-d0d643732afa req-d5e0119c-e272-4835-9f57-43ff5173b883 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:21.010596 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0aa61e46-ea40-4870-99ae-d0d643732afa req-d5e0119c-e272-4835-9f57-43ff5173b883 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 945 time: 0.0485611 Nov 05 15:16:21.059422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0aa61e46-ea40-4870-99ae-d0d643732afa req-13a5f80c-97a7-48cd-b468-d15effb1f9f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428181 Nov 05 15:16:22.176911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2b1a83-6119-4c63-84c8-0f6a27cb6d11 req-02e4277d-1ed5-4e1e-8b7e-d65ac02cc310 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:22.178389 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d2b1a83-6119-4c63-84c8-0f6a27cb6d11 req-02e4277d-1ed5-4e1e-8b7e-d65ac02cc310 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 945 time: 0.0533442 Nov 05 15:16:22.226450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1d2b1a83-6119-4c63-84c8-0f6a27cb6d11 req-893d879a-2020-40e4-9654-1f9b01dd54b7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422301 Nov 05 15:16:22.448331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4c147ef8-68fe-427d-a8d4-119db63a2ef6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:22.486383 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device b40bcd97-45c7-469f-844d-2ceaf8e85e0c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:16:22.535031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port b40bcd97-45c7-469f-844d-2ceaf8e85e0c completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:16:22.538902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port b40bcd97-45c7-469f-844d-2ceaf8e85e0c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:16:22.539287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:22.623166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:22.646587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:16:22.648840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee9ac44f-1e1e-4527-a5b4-f6e42b5ffb85" -d '{"events": [{"server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "name": "network-vif-plugged", "status": "completed", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:16:22.661394 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:16:22.665624 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:22.692118 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:16:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-946fd904-3cab-46c2-addb-20e90ecd23a7 x-openstack-request-id: req-946fd904-3cab-46c2-addb-20e90ecd23a7 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:16:22.692402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "name": "network-vif-plugged", "status": "completed", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:16:22.692670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-946fd904-3cab-46c2-addb-20e90ecd23a7 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:16:22.693061 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'code': 200} Nov 05 15:16:22.719831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:22.850766 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255738db-5777-4ba6-af31-b6c8867fc105 req-1a39d34a-84ba-4261-ba1d-0f1ead75f4b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:22.852204 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-255738db-5777-4ba6-af31-b6c8867fc105 req-1a39d34a-84ba-4261-ba1d-0f1ead75f4b9 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0424204 Nov 05 15:16:22.898682 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-255738db-5777-4ba6-af31-b6c8867fc105 req-802b97ed-0f7e-4c65-ab97-fdba3ffdfb30 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379283 Nov 05 15:16:23.340067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92948aba-f470-4a73-b60c-15befcb2a9c7 req-4f525dfd-9388-446c-88b9-5ba268361bd9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:23.341600 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-92948aba-f470-4a73-b60c-15befcb2a9c7 req-4f525dfd-9388-446c-88b9-5ba268361bd9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0483429 Nov 05 15:16:23.389736 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-92948aba-f470-4a73-b60c-15befcb2a9c7 req-5d05a881-4976-4148-b989-239a6153b554 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417323 Nov 05 15:16:23.517113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:24.506032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0130ba-d99d-44a5-b441-ead8258f764d req-e4ff8f77-1da9-4625-a2b8-b17757f868ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:24.507525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9e0130ba-d99d-44a5-b441-ead8258f764d req-e4ff8f77-1da9-4625-a2b8-b17757f868ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0488799 Nov 05 15:16:24.556385 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9e0130ba-d99d-44a5-b441-ead8258f764d req-c06d6513-8e25-4928-8750-c7e19fe95110 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430467 Nov 05 15:16:24.668010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5988ccce-b894-42e7-84ad-49d8366147fb req-59847377-7bac-418c-b499-876a04dd085e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:24.669879 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5988ccce-b894-42e7-84ad-49d8366147fb req-59847377-7bac-418c-b499-876a04dd085e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0495274 Nov 05 15:16:24.723149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5988ccce-b894-42e7-84ad-49d8366147fb req-95c329f5-877c-4f5a-9726-6ec52afdea83 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467842 Nov 05 15:16:24.744023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51030) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:24.783056 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c70e00b-38eb-42dd-901b-830518c481d3 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:24.785177 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c70e00b-38eb-42dd-901b-830518c481d3 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1094 time: 0.0401781 Nov 05 15:16:24.787866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51032) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:24.792134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address': '172.20.0.11'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:16:24.812996 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:24.907520 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:24.977208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.012561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.111 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/9f8aadbe-cb21-4ef6-8595-52e9dc816433) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:16:25.111738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.149982 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.186888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:16:25.192207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:16:25.196167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:16:25.218504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=9f8aadbe-cb21-4ef6-8595-52e9dc816433,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:25.554526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.621985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.769903 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.774188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.842205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=9f8aadbe-cb21-4ef6-8595-52e9dc816433,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:16:25.850796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:25.951392 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 0caa5440-7e9e-4929-8a3c-8a4529c68aa5 associated. External IP: 172.26.5.111, port: b40bcd97-45c7-469f-844d-2ceaf8e85e0c. Nov 05 15:16:25.981506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:26.159353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 43f6c78a-e103-4676-8f08-1d99daf0ba6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:16:26.271189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:16:26.280657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Sync routers for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:16:26.288943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:26.294035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:26.294891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:16:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:26.315938 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a0eea48-bf51-45f0-9a1e-05f22b2e607a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5270188 Nov 05 15:16:26.316885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:16:26.319259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6cd174e9-8039-48e6-97f7-96ee54b91ec3" -d '{"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:16:26.357371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:16:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59b8bf28-7380-4d72-8659-ad197aec49f3 x-openstack-request-id: req-59b8bf28-7380-4d72-8659-ad197aec49f3 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:16:26.357671 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:16:26.358144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-59b8bf28-7380-4d72-8659-ad197aec49f3 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:16:26.358716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'status': 'completed', 'code': 200} Nov 05 15:16:26.401910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:26.445671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c18d4b-1ad1-43b3-a7b1-a256d729ba19 req-6aee42e8-ba0d-4ad5-b83d-3b93faec7cae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:26.447169 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6c18d4b-1ad1-43b3-a7b1-a256d729ba19 req-6aee42e8-ba0d-4ad5-b83d-3b93faec7cae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0798426 Nov 05 15:16:26.453518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-f89d998b-1503-4ed9-856c-a4a90b5541d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:26.455410 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-f89d998b-1503-4ed9-856c-a4a90b5541d8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0737054 Nov 05 15:16:26.524325 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-ae572c7e-b872-40ec-9f44-13f99082b032 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0420241 Nov 05 15:16:26.565409 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6c18d4b-1ad1-43b3-a7b1-a256d729ba19 req-12e4855d-78e2-4556-b9f6-152db6b77a66 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1089377 Nov 05 15:16:26.583204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-b930bcad-4aee-4ab5-b736-88620aec0733 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:26.585368 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-b930bcad-4aee-4ab5-b736-88620aec0733 service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.1161222 Nov 05 15:16:26.588122 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51038) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:26.633293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0caa5440-7e9e-4929-8a3c-8a4529c68aa5', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.111', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'port_id': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1701, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'mac_address': 'fa:16:3e:a1:e5:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:16:25Z', 'updated_at': '2021-11-05T15:16:25Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:26.660107 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Checking router: 43f6c78a-e103-4676-8f08-1d99daf0ba6c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:16:26.668776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:16:26.669641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:16:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:26.696697 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-938e8a4b-597f-4263-aa1c-c948c2502e65 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/0caa5440-7e9e-4929-8a3c-8a4529c68aa5 HTTP/1.1" status: 200 len: 992 time: 0.1073873 Nov 05 15:16:26.700549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-f38072b9-0c5b-4fcb-b234-022b8cb10da7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 1000 time: 0.1051130 Nov 05 15:16:26.778758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:16:27.011972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0caa5440-7e9e-4929-8a3c-8a4529c68aa5', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.111', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'port_id': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1701, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'mac_address': 'fa:16:3e:a1:e5:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:16:25Z', 'updated_at': '2021-11-05T15:16:25Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:16:27.035626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-10fa3d78-e015-47fa-9f2b-ddddb97d008f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.037104 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-10fa3d78-e015-47fa-9f2b-ddddb97d008f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.3301191 Nov 05 15:16:27.037225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-721f0d7b-9b96-48f0-88fb-b97a58e36b31 None None] The sync data for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv is: [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '0caa5440-7e9e-4929-8a3c-8a4529c68aa5', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.111', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'port_id': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 1701, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'mac_address': 'fa:16:3e:a1:e5:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:16:25Z', 'updated_at': '2021-11-05T15:16:25Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:16:27.085392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-796d34dc-42f9-4531-a133-f2cabfe861ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.086885 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-796d34dc-42f9-4531-a133-f2cabfe861ce service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0408306 Nov 05 15:16:27.181597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-6814a28d-d104-4180-a5df-8fe6e3200b92 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868268 Nov 05 15:16:27.273510 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6cd174e9-8039-48e6-97f7-96ee54b91ec3 req-e2fc041e-e7a0-453d-96da-927f043c188e service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846441 Nov 05 15:16:27.380578 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c6e3f5-38ed-4228-9811-81693626e157 req-794074a1-452f-4994-ba25-d600869a1a4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.382085 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-794074a1-452f-4994-ba25-d600869a1a4d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0426435 Nov 05 15:16:27.490379 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c6e3f5-38ed-4228-9811-81693626e157 req-09f976bd-e19d-481a-b409-f4b6b67d5dda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.491843 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-09f976bd-e19d-481a-b409-f4b6b67d5dda service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.0902731 Nov 05 15:16:27.559191 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-e131ce2c-e2de-4411-acf9-96af411b1cb5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 1000 time: 0.0603645 Nov 05 15:16:27.612276 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c6e3f5-38ed-4228-9811-81693626e157 req-c4272e7b-a327-44d0-babb-5d7ac9668452 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.613776 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-c4272e7b-a327-44d0-babb-5d7ac9668452 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0477691 Nov 05 15:16:27.658669 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-599eca2b-9bc7-4f83-9a24-3c8044f8a0b8 None None] New status for floating IP 0caa5440-7e9e-4929-8a3c-8a4529c68aa5: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:16:27.660656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c6e3f5-38ed-4228-9811-81693626e157 req-e7858fa6-3938-47b2-9229-b9ed1c5bc577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:16:27.662163 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-e7858fa6-3938-47b2-9229-b9ed1c5bc577 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0416462 Nov 05 15:16:27.700711 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51040) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:27.756940 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-5b63f037-bdc0-415e-8051-2bdc408a3016 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865991 Nov 05 15:16:27.767519 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-deb5101e-14d3-4536-8cf5-8b75e5c48628 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/0caa5440-7e9e-4929-8a3c-8a4529c68aa5 HTTP/1.1" status: 200 len: 992 time: 0.0645630 Nov 05 15:16:27.853489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-6ea37ab9-1b1d-409f-a060-b0bb73fe4c87 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898519 Nov 05 15:16:28.770305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51042) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:16:28.833274 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4511dc57-7742-428c-99a3-dcfeb88e0964 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/0caa5440-7e9e-4929-8a3c-8a4529c68aa5 HTTP/1.1" status: 200 len: 994 time: 0.0619214 Nov 05 15:16:39.537366 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:16:48.483926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:50.126106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-affcdfe1-a267-4956-ad1b-81cebac35c08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:52.449300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ef3cadc9-1036-4d4d-b08d-edb3cf3525b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:53.522862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:54.979138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:16:55.984760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:00.162978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739368d7-229a-48a8-b409-20286c982b3b req-6063e583-7576-40ef-9379-7c0290540a14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:00.164498 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-6063e583-7576-40ef-9379-7c0290540a14 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0431128 Nov 05 15:17:00.172527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394def8a-7ec6-4ed0-8ba1-c35e52de576a req-353bb87c-fc47-4afd-9f70-fa03ac56d99c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:00.174001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-394def8a-7ec6-4ed0-8ba1-c35e52de576a req-353bb87c-fc47-4afd-9f70-fa03ac56d99c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0543103 Nov 05 15:17:00.224122 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-394def8a-7ec6-4ed0-8ba1-c35e52de576a req-732e33b0-fb8a-4220-a124-c3ded09a9b17 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442231 Nov 05 15:17:00.271373 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739368d7-229a-48a8-b409-20286c982b3b req-293ad725-aa92-4e36-af7f-4baee6ca25a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:00.272785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-293ad725-aa92-4e36-af7f-4baee6ca25a5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.0908005 Nov 05 15:17:00.337943 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-31bd515e-b4ea-4d99-a119-9982c084e9e6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 1002 time: 0.0577552 Nov 05 15:17:00.386798 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739368d7-229a-48a8-b409-20286c982b3b req-450c6cfc-8ee1-4dbc-89c1-5041667e0415 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:00.388198 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-450c6cfc-8ee1-4dbc-89c1-5041667e0415 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0425730 Nov 05 15:17:00.436029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739368d7-229a-48a8-b409-20286c982b3b req-6659ed97-274f-42a4-85b5-2c90cf2df985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:00.437575 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-6659ed97-274f-42a4-85b5-2c90cf2df985 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0421584 Nov 05 15:17:00.524760 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-5bc9a41f-38a7-44c8-b5f6-179e699c163d service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795519 Nov 05 15:17:00.616516 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-739368d7-229a-48a8-b409-20286c982b3b req-5896d3c3-baf7-4500-9750-51d91a153db7 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840967 Nov 05 15:17:01.339263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f575227-a98c-43c0-bc64-0c45d6c2058c req-fa8640c3-6246-4947-b054-46a1adc252f8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:01.340756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9f575227-a98c-43c0-bc64-0c45d6c2058c req-fa8640c3-6246-4947-b054-46a1adc252f8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0486510 Nov 05 15:17:01.388429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9f575227-a98c-43c0-bc64-0c45d6c2058c req-fc9972a5-64fc-404b-80ee-5f5254a2a759 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413251 Nov 05 15:17:02.501166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8161ea72-2472-44e4-994f-3343e120b2e7 req-3796498a-3bf4-4c07-b132-72771638238a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:02.503427 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8161ea72-2472-44e4-994f-3343e120b2e7 req-3796498a-3bf4-4c07-b132-72771638238a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0485444 Nov 05 15:17:02.556745 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8161ea72-2472-44e4-994f-3343e120b2e7 req-390bae3e-fa16-410c-9bff-953ea18508af tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475686 Nov 05 15:17:03.674152 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b46152-ab7f-49e8-884d-d0992f7d63f8 req-5aacc601-27d4-449e-b721-547a1042043d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:03.675620 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b5b46152-ab7f-49e8-884d-d0992f7d63f8 req-5aacc601-27d4-449e-b721-547a1042043d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0513606 Nov 05 15:17:03.729034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b5b46152-ab7f-49e8-884d-d0992f7d63f8 req-2f91b8ff-c8f8-4a4b-a71a-ff6050616247 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474031 Nov 05 15:17:04.845507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee1e20b-f65e-4ce1-9379-a78c6857c939 req-ef57019b-e7f5-4401-b152-e9bd828afdd4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:04.846937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dee1e20b-f65e-4ce1-9379-a78c6857c939 req-ef57019b-e7f5-4401-b152-e9bd828afdd4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0522349 Nov 05 15:17:04.896660 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dee1e20b-f65e-4ce1-9379-a78c6857c939 req-fa6c0f5d-c91c-403e-a89d-13010daaa2e2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437989 Nov 05 15:17:06.010057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8aa4f5b-0bfb-47f3-b1b9-a188c0aac479 req-ca4d07e4-e5a9-46ec-86eb-4117991853d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:06.011540 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b8aa4f5b-0bfb-47f3-b1b9-a188c0aac479 req-ca4d07e4-e5a9-46ec-86eb-4117991853d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0486608 Nov 05 15:17:06.060006 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b8aa4f5b-0bfb-47f3-b1b9-a188c0aac479 req-0ed146d1-2c0b-4bc5-82d3-f15b4ad621da tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425997 Nov 05 15:17:07.173720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be04d8c-f6a3-47ec-adb4-4d61414440e9 req-c17a383d-26f5-4ad4-9eb1-679f1a4a2236 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:07.175185 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5be04d8c-f6a3-47ec-adb4-4d61414440e9 req-c17a383d-26f5-4ad4-9eb1-679f1a4a2236 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0489452 Nov 05 15:17:07.223164 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5be04d8c-f6a3-47ec-adb4-4d61414440e9 req-6c0fb251-1a3d-4187-b5ef-7a48f7e88b2f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422230 Nov 05 15:17:08.337716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1dad6-ca81-4bc7-a9e1-752d83997df4 req-96e36aad-2a79-4b67-951a-6e9f048f1ffc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:08.339143 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ce1dad6-ca81-4bc7-a9e1-752d83997df4 req-96e36aad-2a79-4b67-951a-6e9f048f1ffc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0489621 Nov 05 15:17:08.387386 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ce1dad6-ca81-4bc7-a9e1-752d83997df4 req-c6fba406-95c9-4057-aedd-e95dfe7e9f32 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424027 Nov 05 15:17:09.503945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d408b1c9-4436-46bc-ad26-652dea55aa66 req-b5330da9-7dd9-4a97-aeea-4760bdfa469f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:09.505569 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d408b1c9-4436-46bc-ad26-652dea55aa66 req-b5330da9-7dd9-4a97-aeea-4760bdfa469f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0541506 Nov 05 15:17:09.560388 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d408b1c9-4436-46bc-ad26-652dea55aa66 req-551dd393-8620-4ef0-8701-da993d1ebdfe tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490296 Nov 05 15:17:10.678529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef72e44d-e461-46bf-92ee-285632bf83d2 req-996d8feb-1008-48b9-a779-eb99cb9e156a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:10.680001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef72e44d-e461-46bf-92ee-285632bf83d2 req-996d8feb-1008-48b9-a779-eb99cb9e156a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0532100 Nov 05 15:17:10.729429 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ef72e44d-e461-46bf-92ee-285632bf83d2 req-bc822bc1-fe71-4de2-b9ee-3600ee299696 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435498 Nov 05 15:17:11.844341 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56cfd3a2-c456-42cf-b2a2-f96ab4b4e20d req-309ffeb9-49ec-4a53-a16e-f763bd72776f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:11.846462 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-56cfd3a2-c456-42cf-b2a2-f96ab4b4e20d req-309ffeb9-49ec-4a53-a16e-f763bd72776f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0517831 Nov 05 15:17:11.894499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-56cfd3a2-c456-42cf-b2a2-f96ab4b4e20d req-47738948-dd28-4056-a500-09dff9e67205 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421848 Nov 05 15:17:13.008694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ae452e-6b5d-4295-ac7c-de54c565bd47 req-325e1649-89dc-46f5-9884-cc9c53040fc2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:13.010160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41ae452e-6b5d-4295-ac7c-de54c565bd47 req-325e1649-89dc-46f5-9884-cc9c53040fc2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0482719 Nov 05 15:17:13.059669 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-41ae452e-6b5d-4295-ac7c-de54c565bd47 req-4f5ca907-ee17-49de-8ace-50723e231b90 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436525 Nov 05 15:17:14.174507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd6ebdc-0b85-402c-9c14-c043bacb934b req-5c7f46d5-c731-4786-a700-8a2a82d60486 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:14.175972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0fd6ebdc-0b85-402c-9c14-c043bacb934b req-5c7f46d5-c731-4786-a700-8a2a82d60486 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0489419 Nov 05 15:17:14.224273 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0fd6ebdc-0b85-402c-9c14-c043bacb934b req-9366be80-4473-4694-aadd-b6a76d691f53 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424652 Nov 05 15:17:15.341850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f12a6db-aa32-4312-bf9e-cf55ee186840 req-7bc4c9d7-3668-4cf9-822c-c4ead6a5a38c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:15.343334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f12a6db-aa32-4312-bf9e-cf55ee186840 req-7bc4c9d7-3668-4cf9-822c-c4ead6a5a38c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0488126 Nov 05 15:17:15.396927 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f12a6db-aa32-4312-bf9e-cf55ee186840 req-26d672f3-7968-41dc-bb83-5e281e53b774 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477426 Nov 05 15:17:16.513457 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f91912f-df18-4f86-99ca-c616bb48982f req-392dfbe9-fbc0-4e99-9eab-96af7634a8bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:16.514919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f91912f-df18-4f86-99ca-c616bb48982f req-392dfbe9-fbc0-4e99-9eab-96af7634a8bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0524900 Nov 05 15:17:16.536612 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:17:16.564230 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4f91912f-df18-4f86-99ca-c616bb48982f req-99f987f4-b65b-4542-bc05-17bb1adef88b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427637 Nov 05 15:17:16.585997 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51086) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:16.644561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f80a59bc-4d76-4425-ba83-f7ba41ecb128 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/0caa5440-7e9e-4929-8a3c-8a4529c68aa5 HTTP/1.1" status: 200 len: 994 time: 0.0574415 Nov 05 15:17:18.486055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:20.127697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a543a075-df85-4cbb-8781-93ad79cdd9d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:22.450063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-69d30b2e-b7e3-49d4-8be7-6030456be0f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:23.523485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:24.982570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:25.986143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:26.519307 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-b8535cfa-f66b-4601-a39f-7cfc0ffb5f84 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396395 Nov 05 15:17:26.600059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffff425-232e-4887-b206-31f9324540d3 req-74a47600-f856-4ae0-a72b-a123e60178e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:26.601606 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-74a47600-f856-4ae0-a72b-a123e60178e1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0423765 Nov 05 15:17:26.706292 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffff425-232e-4887-b206-31f9324540d3 req-d7b2bdca-f17d-404b-8b3b-367c707252b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:26.707756 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-d7b2bdca-f17d-404b-8b3b-367c707252b6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.0881171 Nov 05 15:17:26.772143 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-d72fce25-0d59-418d-906e-82476bc7b47d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 1002 time: 0.0576775 Nov 05 15:17:26.822189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffff425-232e-4887-b206-31f9324540d3 req-791e410b-42bf-4f6e-8d3f-b6911c965389 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:26.823606 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-791e410b-42bf-4f6e-8d3f-b6911c965389 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0420566 Nov 05 15:17:26.870590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffff425-232e-4887-b206-31f9324540d3 req-1a92b343-8194-4f47-be64-a7332774d7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:26.872058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-1a92b343-8194-4f47-be64-a7332774d7b3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0418944 Nov 05 15:17:26.959315 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-0d249d73-3422-4440-aff2-803448161dcc service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0794785 Nov 05 15:17:27.050955 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4ffff425-232e-4887-b206-31f9324540d3 req-ca5959c8-bf4a-4e59-9d49-81b26f165eba service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846457 Nov 05 15:17:47.153884 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51096) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:47.315638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 9f8aadbe-cb21-4ef6-8595-52e9dc816433 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:17:47.315968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:47.390311 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:47.390631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:47.402499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 9f8aadbe-cb21-4ef6-8595-52e9dc816433 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:17:47.550706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:47.580679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=9f8aadbe-cb21-4ef6-8595-52e9dc816433,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:47.605148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.605501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.605849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.606189 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.606528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.606864 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.607196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.607525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.607861 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.608188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.608539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.608867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:47.655167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:47.655494 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 0caa5440-7e9e-4929-8a3c-8a4529c68aa5 disassociated (deleted). External IP: 172.26.5.111, port: b40bcd97-45c7-469f-844d-2ceaf8e85e0c. Nov 05 15:17:48.190038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 43f6c78a-e103-4676-8f08-1d99daf0ba6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:17:48.298170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:17:48.303104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:48.307523 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Sync routers for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:17:48.320734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:48.321269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:48.332937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c3aa0d7d-3e9c-4696-bd57-26b122d48719 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/floatingips/0caa5440-7e9e-4929-8a3c-8a4529c68aa5 HTTP/1.1" status: 204 len: 168 time: 1.1779778 Nov 05 15:17:48.333512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:17:48.335730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c" -d '{"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:17:48.374501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:17:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9342d84-85f0-48f9-9ed8-d84e3b3256af x-openstack-request-id: req-c9342d84-85f0-48f9-9ed8-d84e3b3256af {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:17:48.374792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:17:48.375174 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c9342d84-85f0-48f9-9ed8-d84e3b3256af {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:17:48.375583 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'status': 'completed', 'code': 200} Nov 05 15:17:48.435961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:48.438723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-c8c6d457-2c68-4ac2-95aa-70f216bb1d08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:48.440986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-c8c6d457-2c68-4ac2-95aa-70f216bb1d08 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 1099 time: 0.0448916 Nov 05 15:17:48.562912 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:48.596562 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ebf5df-a5b0-499d-961f-6d6c73893fc9 req-7532c07b-42e4-439e-ab69-26e7d8120fe3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:48.597973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b0ebf5df-a5b0-499d-961f-6d6c73893fc9 req-7532c07b-42e4-439e-ab69-26e7d8120fe3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0787961 Nov 05 15:17:48.598962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-c78bad76-46ef-48f2-9dea-4ef000f1cf61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:48.600288 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-c78bad76-46ef-48f2-9dea-4ef000f1cf61 service neutron] 10.222.0.32 "GET /v2.0/networks?id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 200 len: 898 time: 0.1500967 Nov 05 15:17:48.654055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-b2e8c4fe-2675-4743-8483-215dcbd96a5c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 200 len: 217 time: 0.0428681 Nov 05 15:17:48.654353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:48.680379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Checking router: 43f6c78a-e103-4676-8f08-1d99daf0ba6c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:17:48.688168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:48.688798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:48.713411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b0ebf5df-a5b0-499d-961f-6d6c73893fc9 req-48d31e16-685c-4d01-acfa-6b9286f1b571 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1090524 Nov 05 15:17:48.725795 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-baf0ed77-0ad7-4557-aaf1-851d75f6e08f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:48.727239 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-baf0ed77-0ad7-4557-aaf1-851d75f6e08f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 200 len: 835 time: 0.0637264 Nov 05 15:17:48.776024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-846f8e1e-eae1-4bc7-af1c-dc1e1ffd1019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:48.777540 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-846f8e1e-eae1-4bc7-af1c-dc1e1ffd1019 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=16fcd0ca-03b6-475b-aaf2-861d3ea5e923&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403583 Nov 05 15:17:48.795346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:48.870327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-502402ec-6ccb-4907-8448-406ecd30dab7 service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834868 Nov 05 15:17:48.964686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-380a9d77-c92e-40f4-a2a4-8b6e8ad27d9c req-58cad01c-0659-406a-b4b5-a6f0040ed9ac service neutron] 10.222.0.32 "GET /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856147 Nov 05 15:17:48.995188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:49.021208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4acb197e-af8f-4078-90bc-062deba5bc34 None None] The sync data for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv is: [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:16:10Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '8b49f59a-77b4-41cd-98ed-0504cc7042a7', 'name': '', 'network_id': '16fcd0ca-03b6-475b-aaf2-861d3ea5e923', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:a1:b0:64', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1697, 'fixed_ips': [{'subnet_id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:09Z', 'updated_at': '2021-11-05T15:16:13Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '138889b8-25b6-4a0c-bb26-fce73d215a72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:17:49.244472 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e3f4614-4ae5-4862-91ee-7208b87c5803 None None] New status for floating IP 0caa5440-7e9e-4929-8a3c-8a4529c68aa5: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:17:49.832391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aee8b42-62d8-4c0a-8d76-266874acbd00 req-72a926a7-ae65-49c9-b71c-ffbe3489aa9f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:49.833873 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0aee8b42-62d8-4c0a-8d76-266874acbd00 req-72a926a7-ae65-49c9-b71c-ffbe3489aa9f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0487695 Nov 05 15:17:49.881272 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0aee8b42-62d8-4c0a-8d76-266874acbd00 req-241cd503-0740-4e76-9c28-012b08c0ab4c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=18d62099-b0ec-454e-842b-5a268fe3082e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416367 Nov 05 15:17:50.130255 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6c891f41-c183-44bc-9a02-c627782cc76b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:50.143310 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-8ce76a0b-1973-419d-81c4-67c9e710a143 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:50.144864 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-8ce76a0b-1973-419d-81c4-67c9e710a143 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 946 time: 0.0501695 Nov 05 15:17:50.237913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b40bcd97-45c7-469f-844d-2ceaf8e85e0c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:17:50.238399 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:50.325295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port b40bcd97-45c7-469f-844d-2ceaf8e85e0c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:17:50.325568 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:50.338847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b40bcd97-45c7-469f-844d-2ceaf8e85e0c owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:17:50.470748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:50.500271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b40bcd97-45c7-469f-844d-2ceaf8e85e0c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:50.514358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.514709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.515046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.515576 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.515912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.516235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.516587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.516915 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.517238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.517557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.517916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.518997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:50.554902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] No DVR routers for this DVR port b40bcd97-45c7-469f-844d-2ceaf8e85e0c on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:17:50.557592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:50.561163 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d4897ad2-8510-4f48-92db-ce9bb66f4a07 req-5478c183-c9f1-4e7c-b101-73aa8e8008ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "DELETE /v2.0/ports/b40bcd97-45c7-469f-844d-2ceaf8e85e0c HTTP/1.1" status: 204 len: 173 time: 0.4104898 Nov 05 15:17:50.561656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'name': 'network-vif-deleted', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:17:50.564045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c65dbb4-332c-46cb-8bf0-f2c24889d635" -d '{"events": [{"server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "name": "network-vif-deleted", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:17:50.670492 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:17:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4c4d971-a995-4f85-aa31-a3cff5db7995 x-openstack-request-id: req-e4c4d971-a995-4f85-aa31-a3cff5db7995 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:17:50.670783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96785148-8b51-4aa2-83e0-3a5ebdd5022d", "name": "network-vif-deleted", "tag": "b40bcd97-45c7-469f-844d-2ceaf8e85e0c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:17:50.671034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e4c4d971-a995-4f85-aa31-a3cff5db7995 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:17:50.671440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96785148-8b51-4aa2-83e0-3a5ebdd5022d', 'name': 'network-vif-deleted', 'tag': 'b40bcd97-45c7-469f-844d-2ceaf8e85e0c', 'status': 'completed', 'code': 200} Nov 05 15:17:51.013090 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d8deda71-0ab5-4abe-a169-afd88f99280e req-2effea2d-c852-4f95-bfd7-4295304131bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=96785148-8b51-4aa2-83e0-3a5ebdd5022d HTTP/1.1" status: 200 len: 210 time: 0.0296984 Nov 05 15:17:52.075188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51116) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:52.434590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:52.450729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-85da7686-2aea-4e02-a6ce-5d818fb8f01a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:52.686030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 8b49f59a-77b4-41cd-98ed-0504cc7042a7 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:17:52.686273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:52.772833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 8b49f59a-77b4-41cd-98ed-0504cc7042a7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b49f59a-77b4-41cd-98ed-0504cc7042a7,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:17:52.773190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:52.785885 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 8b49f59a-77b4-41cd-98ed-0504cc7042a7 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:17:52.965936 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:52.995785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=8b49f59a-77b4-41cd-98ed-0504cc7042a7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:53.160191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.376966 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 43f6c78a-e103-4676-8f08-1d99daf0ba6c has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:17:53.488787 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:17:53.493705 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fb4d0b23-680a-4883-bb3c-fabace3f5008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/43f6c78a-e103-4676-8f08-1d99daf0ba6c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4175115 Nov 05 15:17:53.496485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51118) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:53.499021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Sync routers for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:17:53.509543 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:53.510335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:53.535393 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:17:53.548251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting subnet 138889b8-25b6-4a0c-bb26-fce73d215a72 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:17:53.552036 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.564954 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.591624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.625224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:53.682116 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.741701 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.769458 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Subnet': ['ID=138889b8-25b6-4a0c-bb26-fce73d215a72,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:53.771622 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.775444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5d9f028e-afde-478c-a4cf-6f84fefadbb4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/subnets/138889b8-25b6-4a0c-bb26-fce73d215a72 HTTP/1.1" status: 204 len: 168 time: 0.2780209 Nov 05 15:17:53.778008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51120) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:53.782294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a992286-8a06-4049-a765-c438d701eae1 None None] Network 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:17:53.880687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:17:52Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:53.886314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:53.912955 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Checking router: 43f6c78a-e103-4676-8f08-1d99daf0ba6c for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:17:53.921865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Routers {'43f6c78a-e103-4676-8f08-1d99daf0ba6c'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:53.922470 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:53.959466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] DHCP port deletion for 16fcd0ca-03b6-475b-aaf2-861d3ea5e923 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:17:53.998173 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.050269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:17:54.050611 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.053853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] Set router 43f6c78a-e103-4676-8f08-1d99daf0ba6c gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:54.137044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:17:54.137403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.151728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Deleting port 4de10915-3ae6-467a-8242-7783f6aabbaa {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:17:54.152100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.153306 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:17:54.328113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.347328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4de10915-3ae6-467a-8242-7783f6aabbaa no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:17:54.352870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=3fb7d8e2-2921-454b-8e4f-1aebdfbfe277,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:54.415911 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.428682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] For port 4de10915-3ae6-467a-8242-7783f6aabbaa, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4de10915-3ae6-467a-8242-7783f6aabbaa,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:17:54.429079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.457832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Calling delete_port for 4de10915-3ae6-467a-8242-7783f6aabbaa owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:17:54.507706 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.509846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.555972 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.556593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Fanout notify agent at l3_agent the message router_deleted on router 43f6c78a-e103-4676-8f08-1d99daf0ba6c {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:17:54.563363 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.564481 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53a238de-4118-4542-8bee-8febc82ff8a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/routers/43f6c78a-e103-4676-8f08-1d99daf0ba6c HTTP/1.1" status: 204 len: 168 time: 0.7855377 Nov 05 15:17:54.565137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.567916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51122) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:54.623899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 4de10915-3ae6-467a-8242-7783f6aabbaa, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4de10915-3ae6-467a-8242-7783f6aabbaa,segment=NetworkSegment(d92dc963-87eb-4b59-bada-f059f7aa1b1c),segment_id=d92dc963-87eb-4b59-bada-f059f7aa1b1c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:17:54.626312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:17:52Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:54.630886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.651006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.678466 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.680240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-050ed2e7-24df-48da-8183-9e3fd699f1f8 None None] The sync data for ids ['43f6c78a-e103-4676-8f08-1d99daf0ba6c'] in dv-neutron-816850-1-hyperv is: [{'id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1271682145', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181'}], 'enable_snat': True}, 'gw_port_id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:16:06Z', 'updated_at': '2021-11-05T15:17:52Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '3fb7d8e2-2921-454b-8e4f-1aebdfbfe277', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f6c78a-e103-4676-8f08-1d99daf0ba6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1695, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:16:07Z', 'updated_at': '2021-11-05T15:16:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:17:54.683338 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event deleted for resources: {'Port': ['ID=4de10915-3ae6-467a-8242-7783f6aabbaa,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:54.695777 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.695985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.696293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.696658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.696992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.697325 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.697650 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.697969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.698298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.698621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.698941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.699258 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:54.702070 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] No DVR routers for this DVR port 4de10915-3ae6-467a-8242-7783f6aabbaa on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:17:54.730790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684fb6f8-4a04-4e3b-bfbd-bfa3404dc78e None None] Pushing event deleted for resources: {'Port': ['ID=4de10915-3ae6-467a-8242-7783f6aabbaa,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:54.744431 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.763805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16fcd0ca-03b6-475b-aaf2-861d3ea5e923']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:54.773114 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd92dc963-87eb-4b59-bada-f059f7aa1b1c') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:54.773405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd92dc963-87eb-4b59-bada-f059f7aa1b1c') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:54.787517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.801264 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.807966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Releasing vlan 634 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:17:54.808546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:17:54.811474 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:17:54.867656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.875822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.878915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/networks/16fcd0ca-03b6-475b-aaf2-861d3ea5e923 HTTP/1.1" status: 204 len: 168 time: 0.3098872 Nov 05 15:17:54.881856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51124) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:54.888358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce456d0-6bc8-4c8f-b48a-bfed5fca2e3f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Network': ['ID=16fcd0ca-03b6-475b-aaf2-861d3ea5e923,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:54.925111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device b40bcd97-45c7-469f-844d-2ceaf8e85e0c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:17:54.939177 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.945205 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: b40bcd97-45c7-469f-844d-2ceaf8e85e0c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:17:54.945551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device b40bcd97-45c7-469f-844d-2ceaf8e85e0c not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:17:54.964332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:54.984379 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.024147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.026837 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.027980 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/security-groups/18d62099-b0ec-454e-842b-5a268fe3082e HTTP/1.1" status: 204 len: 168 time: 0.1451464 Nov 05 15:17:55.040367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7237ce20-2430-47f9-a3f0-db690fb64ee9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=18d62099-b0ec-454e-842b-5a268fe3082e,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:55.468093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51130) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:55.472772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-631234082', 'description': 'tempest-secgroup-smoke-631234082 description', 'project_id': 'ef1d7839d356477e8151af4dc08baead'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:55.496640 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.562419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.566372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.593067 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.594290 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1251032 Nov 05 15:17:55.597384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51132) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:55.598162 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d55cb7f-8e7c-4a9c-b5b9-1b3d3528df4b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9945d72f-5715-4a4b-91df-341672dd2382,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:55.602642 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:55.630656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.692253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.695992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.712846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d345406-8b06-40e1-8109-80ad8c0e7c54,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:55.720592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.724488 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fa904b27-9f01-45b3-9af8-7ec6eb00c786 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1227803 Nov 05 15:17:55.724702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51134) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:55.729239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:55.754886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.812973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.816361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.833531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d53931ac-8283-4ca7-8c2f-f4276ddeec8c,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:55.841319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.844937 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5fd19e9c-f306-4ff4-b719-d699a35f36ce tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1168935 Nov 05 15:17:55.845387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51136) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:55.849966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:55.875295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.929879 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.933203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.949702 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c10c030c-b691-4c7f-af2a-f09301210484,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:55.957918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.959112 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-fbbe0ef3-42ab-4d13-a257-83be75ef2dd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1130025 Nov 05 15:17:55.961905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51138) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:55.966225 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:55.986286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:55.993150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.047903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.051652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.067966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9da34246-be71-4dd0-a67f-0801d6073800,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:56.075875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.077089 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6b76e2fa-076f-41c3-b48c-66ce03c717be tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1142638 Nov 05 15:17:56.079871 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51140) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:56.084196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:56.105203 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:17:56.110022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.129617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b49f59a-77b4-41cd-98ed-0504cc7042a7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:17:56.152743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 8b49f59a-77b4-41cd-98ed-0504cc7042a7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:17:56.153079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b49f59a-77b4-41cd-98ed-0504cc7042a7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:17:56.153491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:17:56.171526 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.173073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:17:56.173476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 3fb7d8e2-2921-454b-8e4f-1aebdfbfe277 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:17:56.175183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.192389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2cb84048-a2cf-4690-bc0a-f25fdf080916,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:56.199256 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.200443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e9944ec3-eb21-45e5-98d8-bb0f26a4b564 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1195986 Nov 05 15:17:56.203161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51142) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:56.207885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '9945d72f-5715-4a4b-91df-341672dd2382', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:56.228891 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:17:56.233705 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.289515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.293281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.310090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=70157b24-a713-4a2f-a3c2-fc90401a4ccf,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:56.317219 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.318393 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-c8907b2f-41d8-4ab6-85c8-b5f14466b331 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1143286 Nov 05 15:17:56.321227 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51144) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:56.326066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'network': {'name': 'tempest-network-smoke--1786170959', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:56.346398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:17:56.349744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.371870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 640} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:17:56.380108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.380451 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Added segment d449d795-2b48-487b-b30e-4a0ee8a31c97 of type vlan for network eb96527a-c633-4926-a9f7-5de3545cccf3 Nov 05 15:17:56.418968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.441429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.446970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:56.447549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.509764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1874318 Nov 05 15:17:56.512572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51146) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:56.517248 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'admin_state_up': True, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:56.521437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac347ead-b6ed-4bab-ab3f-35954bc1f347 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Network': ['ID=eb96527a-c633-4926-a9f7-5de3545cccf3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:56.532232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network eb96527a-c633-4926-a9f7-5de3545cccf3 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:17:56.541641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.543288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.601999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.738947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.925492 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:56.944204 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:57.045303 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.175 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b864fa1d-9fec-4fac-958e-5bf73b4f6eea) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:17:57.140668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:57.171948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:57.214107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:17:57.218712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:17:57.222257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:17:57.245317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:57.788398 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:57.981408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.104367 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:17:58.208190 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:17:58.217943 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Sync routers for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:17:58.228151 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:58.228855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.229021 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:58.230053 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-750d4184-332b-4948-89cc-e20dc80e08b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.7164919 Nov 05 15:17:58.233228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51148) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:58.265122 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4b07c5c9-71f9-40f9-bb98-a7a84a77d4a2 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=ef1d7839d356477e8151af4dc08baead&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0304847 Nov 05 15:17:58.267557 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51150) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:58.330119 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:58.353007 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25056880-54ab-47e4-a0ba-4ffd80dc4b54 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:58.354548 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-25056880-54ab-47e4-a0ba-4ffd80dc4b54 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0854592 Nov 05 15:17:58.357361 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51152) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:58.387372 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-835a48b6-d528-436c-8b0f-699d2a980fa3 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0273514 Nov 05 15:17:58.388141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51154) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:58.392809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1982172852', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:17:58.482484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:17:58.486013 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.511454 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:57Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:58.537870 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Checking router: cc73fabb-fe39-4f22-95fa-07d28eca2bc7 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:17:58.538307 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Updating router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 port b864fa1d-9fec-4fac-958e-5bf73b4f6eea binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:17:58.562890 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.671670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.731044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Subnet': ['ID=1db45c46-d4fc-4dee-ad1b-1e13c6f49647,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:58.740401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Checking segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:17:58.740866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network hostable DHCP agents. Network: eb96527a-c633-4926-a9f7-5de3545cccf3, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:17:58.757290 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network eb96527a-c633-4926-a9f7-5de3545cccf3 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:17:58.765921 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, eb96527a-c633-4926-a9f7-5de3545cccf3) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:17:58.771057 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:17:58.771833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.777778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9687618f-0f2d-49d0-bdfe-ef3240fe5528 None None] Network eb96527a-c633-4926-a9f7-5de3545cccf3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:17:58.790496 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-315f6319-5254-436a-bbf2-00e467a5b31e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4013281 Nov 05 15:17:58.793734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51156) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:17:58.819109 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.824587 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9687618f-0f2d-49d0-bdfe-ef3240fe5528 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:17:58.854969 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:17:58.864442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56f2947d-b62a-4d92-958f-aebd508ecd6e None None] Network eb96527a-c633-4926-a9f7-5de3545cccf3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:17:58.877741 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Attempting to bind port b864fa1d-9fec-4fac-958e-5bf73b4f6eea on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:17:58.878105 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Attempting to bind port b864fa1d-9fec-4fac-958e-5bf73b4f6eea by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:17:58.878468 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Attempting to bind port b864fa1d-9fec-4fac-958e-5bf73b4f6eea on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:17:58.881351 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Pushing event updated for resources: {'Port': ['ID=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:58.889045 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 17, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:17:58.889416 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:17:58.889810 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.890195 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:17:58.890649 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Bound port: b864fa1d-9fec-4fac-958e-5bf73b4f6eea, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:17:58.891021 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.893883 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.894214 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.894547 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.894872 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.895190 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.895512 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.895835 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.896186 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.896524 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.896847 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.897160 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.897474 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:17:58.950289 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] For port b864fa1d-9fec-4fac-958e-5bf73b4f6eea, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:17:58.953482 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] For port b864fa1d-9fec-4fac-958e-5bf73b4f6eea, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-56f2947d-b62a-4d92-958f-aebd508ecd6e None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:17:58.954388 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:17:58.958221 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:58.966023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-476c3ded-0a1d-49a5-89e3-069f7baea73d None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:17:59.010700 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:17:59.011311 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:59.043417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-476c3ded-0a1d-49a5-89e3-069f7baea73d None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:17:59.061302 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23965968-b3fb-4614-8bab-e9a104602af1 None None] Pushing event updated for resources: {'Port': ['ID=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:59.224203 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:17:59.291134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-eb96527a-c633-4926-a9f7-5de3545cccf3', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:17:59.293183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.297749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.421257 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:57Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:17:59.452643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Allocated IP 172.20.0.2 (eb96527a-c633-4926-a9f7-5de3545cccf3/1db45c46-d4fc-4dee-ad1b-1e13c6f49647/2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:17:59.452888 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eb31515-1743-4833-9fe9-1c3e00a1a693 None None] The sync data for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv is: [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:57Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:17:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:17:59.620446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.629046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.674947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Network eb96527a-c633-4926-a9f7-5de3545cccf3 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:17:59.682323 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:17:59.686269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:17:59.690638 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.1 (eb96527a-c633-4926-a9f7-5de3545cccf3/1db45c46-d4fc-4dee-ad1b-1e13c6f49647/6531e340-567b-443a-9460-439544d220a7) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:17:59.693878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Pushing event updated for resources: {'Port': ['ID=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:59.766167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Attempting to bind port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:17:59.766533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Attempting to bind port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:17:59.766919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Attempting to bind port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e on network eb96527a-c633-4926-a9f7-5de3545cccf3 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:17:59.771906 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 17, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:17:59.772272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Checking segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:17:59.777021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.777021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Bound using segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:17:59.777021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Bound port: 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:17:59.777442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.834304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.849878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] For port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:17:59.853426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] For port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:17:59.858313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.875888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:17:59.923101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network eb96527a-c633-4926-a9f7-5de3545cccf3 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:17:59.926823 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:17:59.929691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39291ddc-e33d-4180-b086-be4fe9deaf7c None None] Pushing event updated for resources: {'Port': ['ID=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:59.936808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:17:59.967272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:17:59.990940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.167958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.206758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b864fa1d-9fec-4fac-958e-5bf73b4f6eea up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:18:00.276754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b864fa1d-9fec-4fac-958e-5bf73b4f6eea triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:00.277122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.359584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.387311 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b864fa1d-9fec-4fac-958e-5bf73b4f6eea, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:00.392970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.451514 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:00.764329 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.770075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.846744 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:00.848589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:00.915981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b36c086-55c9-4f90-a195-e9f6397fc7d5 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:18:00.946182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network eb96527a-c633-4926-a9f7-5de3545cccf3 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:18:00.947554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:18:00.959845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] Provisioning complete for port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:00.960299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:01.026437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b36c086-55c9-4f90-a195-e9f6397fc7d5 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:18:01.055794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:18:01.113393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:01.167313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] For port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:01.171654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:01.171938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:18:01.178246 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b13c1443-80e7-44a2-a006-1dbcc7aff071 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/cc73fabb-fe39-4f22-95fa-07d28eca2bc7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3827643 Nov 05 15:18:01.253381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf62dc1-6dbc-456f-9d58-644e8834f252 None None] Pushing event updated for resources: {'Port': ['ID=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:01.372301 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a504a50b-45c8-4ded-964c-d35b7ff3453c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-631234082&fields=id&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 267 time: 0.0548897 Nov 05 15:18:01.435990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Sync routers for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:18:01.455025 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:18:01.455659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:01.494146 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-e2061884-106a-4387-ba31-e815e7cd3c25 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:01.495988 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-e2061884-106a-4387-ba31-e815e7cd3c25 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 797 time: 0.1161954 Nov 05 15:18:01.518110 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-0dcb1187-6592-4c4b-9234-0a712dee74eb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/quotas/ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 375 time: 0.0105557 Nov 05 15:18:01.571063 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:18:01.577009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a13aae65-464f-41e8-bdae-1f5636b9276b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0514288 Nov 05 15:18:01.755625 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-9f0e127c-90f4-4c36-be52-9d7331bfcf84 service neutron] 10.222.0.30 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1682944 Nov 05 15:18:01.797221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 2, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:01.826771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Checking router: cc73fabb-fe39-4f22-95fa-07d28eca2bc7 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:18:01.827473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Updating router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 port 6531e340-567b-443a-9460-439544d220a7 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:18:01.863190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:01.864240 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-d7d6eeba-134a-40bf-be85-cc419f62cc15 service neutron] 10.222.0.30 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1025364 Nov 05 15:18:01.980551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a5142d31-bd1c-4070-a7f2-de71883abdd1 None None] Provisioning complete for port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:01.981129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a5142d31-bd1c-4070-a7f2-de71883abdd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.043888 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-45994c82-ffa6-41e2-8064-7ec691e1f037 req-1d8d10d0-2ee9-4f24-a601-0da08c679da1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 210 time: 0.0326781 Nov 05 15:18:02.167491 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a5142d31-bd1c-4070-a7f2-de71883abdd1 None None] Provisioning complete for port 6531e340-567b-443a-9460-439544d220a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:02.167857 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a5142d31-bd1c-4070-a7f2-de71883abdd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.232110 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:18:02.243932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a5142d31-bd1c-4070-a7f2-de71883abdd1 None None] Port 6531e340-567b-443a-9460-439544d220a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:18:02.281411 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.291799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.344552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbf195b-0fdf-431b-8a27-d0f75896b84c None None] Pushing event updated for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:02.359357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:02.359731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.583088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-99f93225-15b1-4760-a1e7-52827b607cf5 None None] Provisioning complete for port 6531e340-567b-443a-9460-439544d220a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:02.583363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-99f93225-15b1-4760-a1e7-52827b607cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.612630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Attempting to bind port 6531e340-567b-443a-9460-439544d220a7 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:18:02.612946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Attempting to bind port 6531e340-567b-443a-9460-439544d220a7 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:18:02.613309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Attempting to bind port 6531e340-567b-443a-9460-439544d220a7 on network eb96527a-c633-4926-a9f7-5de3545cccf3 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:18:02.624497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 17, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:18:02.624875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Checking segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:18:02.625270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.625662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Bound using segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:18:02.626124 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Bound port: 6531e340-567b-443a-9460-439544d220a7, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:18:02.626499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.648415 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-99f93225-15b1-4760-a1e7-52827b607cf5 None None] Port 6531e340-567b-443a-9460-439544d220a7 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:18:02.710080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b864fa1d-9fec-4fac-958e-5bf73b4f6eea up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:18:02.753787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] For port 6531e340-567b-443a-9460-439544d220a7, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:18:02.761303 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] For port 6531e340-567b-443a-9460-439544d220a7, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6531e340-567b-443a-9460-439544d220a7,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:18:02.768731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.819629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] Provisioning complete for port 6531e340-567b-443a-9460-439544d220a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:02.819996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:02.876835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:18:02.877994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:02.879711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbf195b-0fdf-431b-8a27-d0f75896b84c None None] Pushing event updated for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:02.885021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b864fa1d-9fec-4fac-958e-5bf73b4f6eea triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:02.885398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:03.062611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:03.088174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:18:03.128997 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-01600dce-093b-4e64-943a-cbe91935ef05 req-836c0ea0-cd9b-4a4e-a4a1-173967756c05 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 210 time: 0.0309057 Nov 05 15:18:03.211392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] For port 6531e340-567b-443a-9460-439544d220a7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6531e340-567b-443a-9460-439544d220a7,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:03.240995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:03.328368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f565f697-5988-496d-a4a6-90bd0f382bab None None] Pushing event updated for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:03.390798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e8504a8e-8808-43e7-911e-c5bd8492b51b None None] Provisioning complete for port 6531e340-567b-443a-9460-439544d220a7 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:03.391167 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8504a8e-8808-43e7-911e-c5bd8492b51b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:03.444234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:02Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:03.476408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaa5881f-0c40-4b7e-b013-258030467440 None None] The sync data for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv is: [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:02Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:18:04.150651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6531e340-567b-443a-9460-439544d220a7 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:18:04.209958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 6531e340-567b-443a-9460-439544d220a7 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:04.209958 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:04.226506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-21c695dc-7775-476f-b19d-66c5c3a67ac9 req-4d099ea5-c34f-4aeb-bc11-14fe76a7003d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 210 time: 0.0282907 Nov 05 15:18:05.134658 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-e11fd521-77c8-4648-8d30-f276af27ece6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:05.136103 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-e11fd521-77c8-4648-8d30-f276af27ece6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 797 time: 0.1016490 Nov 05 15:18:05.199686 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-9548c248-d0b9-40f7-8399-01596763ef08 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 379 time: 0.0539618 Nov 05 15:18:05.209926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'port': {'device_id': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'admin_state_up': True, 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'security_groups': ['9945d72f-5715-4a4b-91df-341672dd2382']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:18:05.319365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:18:05.323141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.325059 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-dbb51785-9f93-4462-81aa-ca88f70df714 req-bf3a7192-8221-4f90-9fbd-b0a0630faf01 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 210 time: 0.0284710 Nov 05 15:18:05.455612 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.8 (eb96527a-c633-4926-a9f7-5de3545cccf3/1db45c46-d4fc-4dee-ad1b-1e13c6f49647/318b1830-5801-42fb-8ea0-a6660fc0e584) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:18:05.589899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.622475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.667451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network eb96527a-c633-4926-a9f7-5de3545cccf3 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:18:05.672397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:18:05.676718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:18:05.699321 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:05.727983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:05.728739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.745762 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-a439a6fe-97b5-46c8-9a2e-03bc068ffbf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5394576 Nov 05 15:18:05.758649 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Request body: {'port': {'device_id': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:18:05.815192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.869567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dcc973dd-7a8c-4a14-a7a8-cb3edaa8cc86 None None] Provisioning complete for port 318b1830-5801-42fb-8ea0-a6660fc0e584 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:05.870163 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dcc973dd-7a8c-4a14-a7a8-cb3edaa8cc86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:05.902815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dcc973dd-7a8c-4a14-a7a8-cb3edaa8cc86 None None] Port 318b1830-5801-42fb-8ea0-a6660fc0e584 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:18:06.080914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 318b1830-5801-42fb-8ea0-a6660fc0e584 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:18:06.088234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:06.100141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Transition to ACTIVE for port object 318b1830-5801-42fb-8ea0-a6660fc0e584 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:18:06.103913 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:06.150601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:06.222541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Attempting to bind port 318b1830-5801-42fb-8ea0-a6660fc0e584 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:18:06.222883 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Attempting to bind port 318b1830-5801-42fb-8ea0-a6660fc0e584 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:18:06.223234 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Attempting to bind port 318b1830-5801-42fb-8ea0-a6660fc0e584 on network eb96527a-c633-4926-a9f7-5de3545cccf3 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:18:06.228036 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Port 318b1830-5801-42fb-8ea0-a6660fc0e584 on network eb96527a-c633-4926-a9f7-5de3545cccf3 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:18:06.228358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Attempting to bind port 318b1830-5801-42fb-8ea0-a6660fc0e584 on network eb96527a-c633-4926-a9f7-5de3545cccf3 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:18:06.233319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 17, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:18:06.233659 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Checking segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:18:06.234041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Bound using segment: {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:18:06.234468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Bound port: 318b1830-5801-42fb-8ea0-a6660fc0e584, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd449d795-2b48-487b-b30e-4a0ee8a31c97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:18:06.234827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:06.304338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:18:06.307538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:18:06.312479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:06.349479 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.350096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:06.351480 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] 10.222.0.32 "PUT /v2.0/ports/318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 1093 time: 0.5973003 Nov 05 15:18:06.351937 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:18:06.354215 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd" -d '{"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:18:06.380820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1f6c36-737f-401a-bbbc-710b3e5bc62d service neutron] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:06.423474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:18:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-726ddd17-f814-4104-9f6c-03094ae47160 x-openstack-request-id: req-726ddd17-f814-4104-9f6c-03094ae47160 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:18:06.428282 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:18:06.428637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-726ddd17-f814-4104-9f6c-03094ae47160 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:18:06.429044 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'status': 'completed', 'code': 200} Nov 05 15:18:06.473807 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-3369773c-e8a7-4320-b1a5-1d0331269ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.475310 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-3369773c-e8a7-4320-b1a5-1d0331269ecb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1096 time: 0.0792434 Nov 05 15:18:06.500853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b35043f-f732-4b6e-94e0-7295bc93b411 req-87082b05-2797-4cfa-887b-3e43013c9938 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.502978 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b35043f-f732-4b6e-94e0-7295bc93b411 req-87082b05-2797-4cfa-887b-3e43013c9938 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0694790 Nov 05 15:18:06.540487 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-bc2b952b-1517-47ce-b0eb-9c6c97be917d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 217 time: 0.0560551 Nov 05 15:18:06.614809 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b35043f-f732-4b6e-94e0-7295bc93b411 req-dc5582ea-642c-47bc-8989-513b53227797 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811210 Nov 05 15:18:06.616203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-2692afad-13e4-484c-8568-0870dbdc63f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.617568 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-2692afad-13e4-484c-8568-0870dbdc63f7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0685289 Nov 05 15:18:06.664935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-9af18508-f054-4eac-b86a-46d5b92c3547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.666471 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-9af18508-f054-4eac-b86a-46d5b92c3547 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0412893 Nov 05 15:18:06.769101 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-ebe191dd-d9a5-4730-817a-f7eecebafab0 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952654 Nov 05 15:18:06.855994 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-88c0fa66-67ae-4351-bb2e-2dca05fcd1a9 req-8428c946-bb12-4450-9d05-c2df8443f8f3 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806532 Nov 05 15:18:06.942973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-1ca629ef-2ff0-4c76-b03e-445b4ec44c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:06.944449 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-1ca629ef-2ff0-4c76-b03e-445b4ec44c1f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1096 time: 0.0458498 Nov 05 15:18:07.036006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-5c618d85-ada2-4237-ac17-9e1db33170f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:07.037494 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-5c618d85-ada2-4237-ac17-9e1db33170f0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0844936 Nov 05 15:18:07.089314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-be557669-4822-4d1b-aa2c-81e404900f59 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 217 time: 0.0413830 Nov 05 15:18:07.137750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-aed0308b-ac6b-4351-a0c0-39890c27440b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:07.139347 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-aed0308b-ac6b-4351-a0c0-39890c27440b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0424392 Nov 05 15:18:07.184566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-db00983a-2dea-4c59-9555-6ffbf55aa218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:07.186013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-db00983a-2dea-4c59-9555-6ffbf55aa218 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398967 Nov 05 15:18:07.275193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-91fe2933-853f-458f-85fe-1fedff1fda8c service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817115 Nov 05 15:18:07.365451 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b6bfdf0-b2ba-4d7c-8377-af51d5e915fd req-330af7ed-2541-4007-82a1-c835ac67513b service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824850 Nov 05 15:18:07.734771 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c92d408-8435-4797-bbfb-3925665a32a8 req-ae72828b-39a8-4720-8df8-8e5167e0ab1c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:07.736228 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6c92d408-8435-4797-bbfb-3925665a32a8 req-ae72828b-39a8-4720-8df8-8e5167e0ab1c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0531843 Nov 05 15:18:07.784793 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6c92d408-8435-4797-bbfb-3925665a32a8 req-f6acea33-87c5-4266-ab92-d06bd103d724 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425506 Nov 05 15:18:08.897197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48710302-cfa4-44c0-8340-003d5782dc78 req-fe80c34a-cb23-47bc-9fe8-723b2d365efa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:08.898649 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48710302-cfa4-44c0-8340-003d5782dc78 req-fe80c34a-cb23-47bc-9fe8-723b2d365efa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0487382 Nov 05 15:18:08.946043 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48710302-cfa4-44c0-8340-003d5782dc78 req-8b5eeef7-9e9a-4fe3-819e-5ab52e1a2368 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416348 Nov 05 15:18:10.059461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b46c5b-583d-43fe-b52f-690c09162b55 req-0ef21b7c-a327-4a29-961a-a09c7801bfdd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:10.060974 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e4b46c5b-583d-43fe-b52f-690c09162b55 req-0ef21b7c-a327-4a29-961a-a09c7801bfdd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0494132 Nov 05 15:18:10.111454 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e4b46c5b-583d-43fe-b52f-690c09162b55 req-6306437c-b045-4eed-9071-b08023d3931e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446169 Nov 05 15:18:11.033919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 318b1830-5801-42fb-8ea0-a6660fc0e584 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:18:11.134418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:11.146448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'port_id': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'mac_address': 'fa:16:3e:c0:76:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 640, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:18:11.182870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:11.196353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 318b1830-5801-42fb-8ea0-a6660fc0e584 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:18:11.214989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:11.219103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:11.231140 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69f281a-76a8-4ab8-81a5-f194bae4b89d req-eae80492-b24f-4303-9252-aed9b0bd27c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:11.232725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a69f281a-76a8-4ab8-81a5-f194bae4b89d req-eae80492-b24f-4303-9252-aed9b0bd27c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0535774 Nov 05 15:18:11.268853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:11.282446 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a69f281a-76a8-4ab8-81a5-f194bae4b89d req-1240bb38-3b23-4d7d-9ecf-bae32377c749 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433238 Nov 05 15:18:11.427114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['318b1830-5801-42fb-8ea0-a6660fc0e584'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:18:12.394851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a1b173-fd76-467a-b2f4-e1aa7273c584 req-1e1176b0-ea22-4ca6-842e-c3bfcd93d343 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:12.396219 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9a1b173-fd76-467a-b2f4-e1aa7273c584 req-1e1176b0-ea22-4ca6-842e-c3bfcd93d343 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 944 time: 0.0479393 Nov 05 15:18:12.449571 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c9a1b173-fd76-467a-b2f4-e1aa7273c584 req-89c7672c-f2ba-49ae-82d3-41d9c038fc66 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475330 Nov 05 15:18:13.044506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 318b1830-5801-42fb-8ea0-a6660fc0e584 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:18:13.093245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 318b1830-5801-42fb-8ea0-a6660fc0e584 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:18:13.097479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 318b1830-5801-42fb-8ea0-a6660fc0e584 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:18:13.097846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:13.171137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:13.195418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:18:13.197639 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c971bcc-a2d6-404a-b3cd-0bf4706732c2" -d '{"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-plugged", "status": "completed", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:18:13.210031 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:18:13.213808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:13.241798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e47c2164-9788-4985-be51-36474a5271be x-openstack-request-id: req-e47c2164-9788-4985-be51-36474a5271be {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:18:13.242104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-plugged", "status": "completed", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:18:13.242359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e47c2164-9788-4985-be51-36474a5271be {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:18:13.242746 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'code': 200} Nov 05 15:18:13.275156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:13.411084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa17c2e6-fee3-458a-acae-c2c32344c26a req-70c23406-6aec-4d2a-ad30-6bd66544ed88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:13.412638 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa17c2e6-fee3-458a-acae-c2c32344c26a req-70c23406-6aec-4d2a-ad30-6bd66544ed88 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0401597 Nov 05 15:18:13.457550 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa17c2e6-fee3-458a-acae-c2c32344c26a req-4aa32d0c-e13c-4da2-b219-12ed61599a9c service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380118 Nov 05 15:18:13.563606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99333421-7756-49e4-b1db-c3598bd65660 req-3c0b52dc-d331-4287-8cb2-559bf1628af3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:13.565004 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-99333421-7756-49e4-b1db-c3598bd65660 req-3c0b52dc-d331-4287-8cb2-559bf1628af3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0493362 Nov 05 15:18:13.613563 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-99333421-7756-49e4-b1db-c3598bd65660 req-dc251776-f2fe-4394-a6e0-1a0c7d2c7184 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427670 Nov 05 15:18:14.731285 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb887f22-3d0b-4e7e-9c61-1bd17613bf21 req-c01fa9d3-5688-428f-b098-35bcfae8e07f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:14.732804 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bb887f22-3d0b-4e7e-9c61-1bd17613bf21 req-c01fa9d3-5688-428f-b098-35bcfae8e07f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0514197 Nov 05 15:18:14.780026 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bb887f22-3d0b-4e7e-9c61-1bd17613bf21 req-8a6b4575-4873-4252-a59a-236c67c6b0fb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407789 Nov 05 15:18:14.890590 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f394c0b-8220-4ae9-9555-cfb259b786c5 req-a35f3a41-9e83-4a54-ba63-1bec927b93c8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:14.892039 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f394c0b-8220-4ae9-9555-cfb259b786c5 req-a35f3a41-9e83-4a54-ba63-1bec927b93c8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0478523 Nov 05 15:18:14.940230 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f394c0b-8220-4ae9-9555-cfb259b786c5 req-d4d3865c-d18a-4817-ac30-146390c658a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418446 Nov 05 15:18:14.961385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51230) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:18:15.003742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2b86931-9261-42f5-992a-5bb91888db5f tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:15.005273 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a2b86931-9261-42f5-992a-5bb91888db5f tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1093 time: 0.0429492 Nov 05 15:18:15.008017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51232) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:18:15.012176 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address': '172.20.0.8'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:18:15.034155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.127907 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.232142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.165 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/8eaf0819-e3ad-49ca-9f2b-18e3c83ab941) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:18:15.334319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.366324 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.407501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:18:15.410309 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:18:15.417049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:18:15.442168 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=8eaf0819-e3ad-49ca-9f2b-18e3c83ab941,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:15.766466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.832561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.977224 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:15.981504 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:16.049104 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=8eaf0819-e3ad-49ca-9f2b-18e3c83ab941,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:18:16.058145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:16.155573 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP e6389d9e-55c4-46b4-98e8-422c2d6f4a57 associated. External IP: 172.26.5.165, port: 318b1830-5801-42fb-8ea0-a6660fc0e584. Nov 05 15:18:16.356387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:18:16.463003 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:18:16.473471 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Sync routers for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:18:16.480710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:16.483643 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:18:16.484367 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:16.508785 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-840a89fb-078b-4cef-998c-88cdd1bd5062 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.4995961 Nov 05 15:18:16.509579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:18:16.511958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d767769-9cca-4fa6-a33b-8641ab703b97" -d '{"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:18:16.552312 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:18:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8da991fb-f3d8-47ea-9fde-3e933ba1ad09 x-openstack-request-id: req-8da991fb-f3d8-47ea-9fde-3e933ba1ad09 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:18:16.552790 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:18:16.553041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8da991fb-f3d8-47ea-9fde-3e933ba1ad09 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:18:16.553444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'status': 'completed', 'code': 200} Nov 05 15:18:16.599137 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:18:16.641337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a84f0d-1eae-4d4c-b5ae-e14cca52e29a req-67eea25c-5d61-4632-b76a-23163b8f46cb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:16.643301 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b5a84f0d-1eae-4d4c-b5ae-e14cca52e29a req-67eea25c-5d61-4632-b76a-23163b8f46cb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0809457 Nov 05 15:18:16.646155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-2506362d-624c-4cf3-8d5c-19f3d4e27b47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:16.647766 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-2506362d-624c-4cf3-8d5c-19f3d4e27b47 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0735545 Nov 05 15:18:16.754186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b5a84f0d-1eae-4d4c-b5ae-e14cca52e29a req-98d0d321-46ac-425b-8c73-05885c3930c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1032574 Nov 05 15:18:16.774355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-5f83f7cf-2d4e-4af9-8a35-6092e1bbbdf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:16.775556 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-5f83f7cf-2d4e-4af9-8a35-6092e1bbbdf0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.1186998 Nov 05 15:18:16.776388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51238) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:18:16.818409 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e6389d9e-55c4-46b4-98e8-422c2d6f4a57', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.165', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'port_id': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1720, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'mac_address': 'fa:16:3e:c0:76:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:18:15Z', 'updated_at': '2021-11-05T15:18:15Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:16.844260 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Checking router: cc73fabb-fe39-4f22-95fa-07d28eca2bc7 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:18:16.852910 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:18:16.853517 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:17:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:16.884006 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f171b99f-b128-48ab-9713-b4e35d3a0da3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/e6389d9e-55c4-46b4-98e8-422c2d6f4a57 HTTP/1.1" status: 200 len: 991 time: 0.1054823 Nov 05 15:18:16.887229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-4d824171-b702-4176-8e84-ba43989ac7d4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 999 time: 0.1034734 Nov 05 15:18:16.934654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-92792ebf-ebbf-42c6-bcf6-686dbc91e80a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:16.936078 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-92792ebf-ebbf-42c6-bcf6-686dbc91e80a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0419390 Nov 05 15:18:16.957985 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:18:16.980940 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-723373c8-3dc4-4986-ba74-050e174e5b1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:16.982448 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-723373c8-3dc4-4986-ba74-050e174e5b1d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0395069 Nov 05 15:18:17.075409 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-89b0c89a-a305-46f3-b787-bd1854c89873 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859087 Nov 05 15:18:17.163975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5d767769-9cca-4fa6-a33b-8641ab703b97 req-1c800a4e-720f-4177-b7ed-1986ecff1c33 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805969 Nov 05 15:18:17.178760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e6389d9e-55c4-46b4-98e8-422c2d6f4a57', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.165', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'port_id': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1720, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'mac_address': 'fa:16:3e:c0:76:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:18:15Z', 'updated_at': '2021-11-05T15:18:15Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:18:17.206379 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e5ab225-f209-4a8d-be24-3ba7f2c793d9 None None] The sync data for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv is: [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'e6389d9e-55c4-46b4-98e8-422c2d6f4a57', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.165', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'port_id': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1720, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'mac_address': 'fa:16:3e:c0:76:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:18:15Z', 'updated_at': '2021-11-05T15:18:15Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:18:17.496656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f2de439-7b05-4cc4-a774-7a1fc1ec7dd5 None None] New status for floating IP e6389d9e-55c4-46b4-98e8-422c2d6f4a57: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:18:17.886842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51240) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:18:17.947231 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53234c18-8ddc-4d44-b1ad-4df21428b9eb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/e6389d9e-55c4-46b4-98e8-422c2d6f4a57 HTTP/1.1" status: 200 len: 993 time: 0.0593340 Nov 05 15:18:18.500435 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:20.134653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3baf01e0-d42a-43d6-81e9-a958fe1ddaf0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:22.451952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3ffef92d-2f72-44c3-8a91-938f081231d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:23.527282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:24.987753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:25.988565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:28.508646 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-5ea04cdb-0714-478e-806d-d2a30ea74874 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0445449 Nov 05 15:18:28.589183 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-3fa43fb3-d3e6-4a36-98c1-fd9ad66199e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:28.590693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-3fa43fb3-d3e6-4a36-98c1-fd9ad66199e0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0402606 Nov 05 15:18:28.697829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-09812bf3-326a-4054-960f-9e82eb8ead40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:28.699395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-09812bf3-326a-4054-960f-9e82eb8ead40 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0897713 Nov 05 15:18:28.769397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-3af21e12-22e6-4f9f-873b-648e52f9cfcd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 1001 time: 0.0630493 Nov 05 15:18:28.815453 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-2a33c5d8-21c1-43f8-ab7f-ee52eed5b038 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:28.816841 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-2a33c5d8-21c1-43f8-ab7f-ee52eed5b038 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0412903 Nov 05 15:18:28.859509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-ca8a6cbb-a0b1-4ca6-8c45-5549abfc42ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:28.860949 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-ca8a6cbb-a0b1-4ca6-8c45-5549abfc42ae service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0378516 Nov 05 15:18:28.950601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-7916943d-5e70-4b39-8ce7-8304c8da3623 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824914 Nov 05 15:18:29.035249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-04eff8c1-b95e-4672-851d-2115cf1fad16 req-57a5566c-90c5-4873-9fd6-89d308d6c592 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0781314 Nov 05 15:18:30.534191 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:18:46.619300 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-99de922c-c472-4ef2-9695-81188a7fd8fe req-a53bf760-e07f-4663-8076-859d41b3eb4a service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:18:46.620342 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-99de922c-c472-4ef2-9695-81188a7fd8fe req-a53bf760-e07f-4663-8076-859d41b3eb4a service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0461447 Nov 05 15:18:46.800808 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7180bc9-06ae-4267-a23c-35107a2f753a req-55a932c6-74d2-4fb9-9b4f-0e264df9351d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:46.802315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a7180bc9-06ae-4267-a23c-35107a2f753a req-55a932c6-74d2-4fb9-9b4f-0e264df9351d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0511081 Nov 05 15:18:46.816592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51260) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:18:46.852086 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a7180bc9-06ae-4267-a23c-35107a2f753a req-88de29df-ce21-46c0-813d-6ba1dd226d4e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439799 Nov 05 15:18:46.900738 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-6a231741-2a02-47b2-a016-06a6e408307d service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0829122 Nov 05 15:18:46.909442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-6e20671d-af59-4644-87f2-70aef8e58c23 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:18:46.910374 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-6e20671d-af59-4644-87f2-70aef8e58c23 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048354 Nov 05 15:18:47.964800 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32349b3-deb2-4c48-a0bd-79761b755c82 req-4103baa1-64c5-49c3-80a2-e3ee076fe313 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:47.966258 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f32349b3-deb2-4c48-a0bd-79761b755c82 req-4103baa1-64c5-49c3-80a2-e3ee076fe313 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0475917 Nov 05 15:18:48.015557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f32349b3-deb2-4c48-a0bd-79761b755c82 req-d2a9d92c-ecde-4b7f-912e-e4256fdac1cc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434346 Nov 05 15:18:48.204315 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-696cd52c-cdc6-4435-89c3-d5b98288f57a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:48.205861 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-696cd52c-cdc6-4435-89c3-d5b98288f57a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0412641 Nov 05 15:18:48.296901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-56813bad-a887-4878-8d99-25878b724f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:48.298463 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-56813bad-a887-4878-8d99-25878b724f38 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0858486 Nov 05 15:18:48.363372 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-70e27e70-fcdc-4c51-9396-8b7ba02e923a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 1001 time: 0.0579822 Nov 05 15:18:48.416719 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-a587c361-73d0-499d-b5b7-2e3b7989634b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:48.418148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-a587c361-73d0-499d-b5b7-2e3b7989634b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0477762 Nov 05 15:18:48.464171 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-45c9cb12-9f6b-404a-b248-b8e1faea1baf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:48.465753 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-45c9cb12-9f6b-404a-b248-b8e1faea1baf service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0396385 Nov 05 15:18:48.504778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:48.558593 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-0a636e34-e463-4016-b497-62cd6487a425 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840759 Nov 05 15:18:48.653332 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-a5390a35-d091-420a-8ee3-63e254d1dc21 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865500 Nov 05 15:18:49.129151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7b1125-b17c-403c-a20f-811108c76cd2 req-9e422cb1-5c80-4a14-b034-7a58ff4ca568 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:49.130609 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9d7b1125-b17c-403c-a20f-811108c76cd2 req-9e422cb1-5c80-4a14-b034-7a58ff4ca568 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0478504 Nov 05 15:18:49.182339 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9d7b1125-b17c-403c-a20f-811108c76cd2 req-c2855696-5a07-4c36-91a4-8c47810bd85c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458729 Nov 05 15:18:50.135524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34effe10-a913-4226-bf70-85664eb67dd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:50.296181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d89ccc2-b36b-4712-ae21-7857c69844a0 req-aca0bde1-f5c4-4574-b1db-87944ca90707 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:50.297602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d89ccc2-b36b-4712-ae21-7857c69844a0 req-aca0bde1-f5c4-4574-b1db-87944ca90707 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0492377 Nov 05 15:18:50.346614 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8d89ccc2-b36b-4712-ae21-7857c69844a0 req-8d9a8d52-a680-49d9-abe8-4b2945f1c93b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427220 Nov 05 15:18:51.465452 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d3ee65-ed08-4b2f-a82d-079179f0f4b6 req-e6faedbe-8ebb-4016-bfe2-b6172c80c36c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:51.466959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-07d3ee65-ed08-4b2f-a82d-079179f0f4b6 req-e6faedbe-8ebb-4016-bfe2-b6172c80c36c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0494630 Nov 05 15:18:51.515992 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-07d3ee65-ed08-4b2f-a82d-079179f0f4b6 req-67577171-10ac-44d4-8129-f7867c2b5cb0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431614 Nov 05 15:18:52.453227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b69f58eb-3136-4fb5-a779-26af7d841d15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:52.633507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97467a96-4f83-4f70-9cf6-c80d0af6a827 req-44c7b7b9-357a-40e8-9356-209fb9f26af9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:52.634962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97467a96-4f83-4f70-9cf6-c80d0af6a827 req-44c7b7b9-357a-40e8-9356-209fb9f26af9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0517132 Nov 05 15:18:52.683434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-97467a96-4f83-4f70-9cf6-c80d0af6a827 req-351f8499-5967-4509-9c6d-16428e43bf0e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426004 Nov 05 15:18:53.530979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:53.801959 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1825bd77-9a71-455a-a30e-8c1c97443e57 req-f1580f35-2714-4c85-b91d-cb4af23ad342 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:53.803350 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1825bd77-9a71-455a-a30e-8c1c97443e57 req-f1580f35-2714-4c85-b91d-cb4af23ad342 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0490229 Nov 05 15:18:53.850654 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1825bd77-9a71-455a-a30e-8c1c97443e57 req-e72053c3-a134-4854-a055-6972eeaa829d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413511 Nov 05 15:18:54.963863 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26779e38-a4e4-44b4-8e65-80de5082bb5d req-f090c488-73f0-47e0-b2ee-8d343833fcbb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:54.965344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-26779e38-a4e4-44b4-8e65-80de5082bb5d req-f090c488-73f0-47e0-b2ee-8d343833fcbb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0481079 Nov 05 15:18:54.990002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:55.013875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-26779e38-a4e4-44b4-8e65-80de5082bb5d req-080ba1d7-be98-4948-af73-dadb44e658c5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428052 Nov 05 15:18:55.993248 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:18:56.130722 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76b133a-1b09-47a7-904e-6ed925bf8f88 req-471fdd15-d484-4a7b-8ce7-d2d15802f8ca tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:56.132191 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c76b133a-1b09-47a7-904e-6ed925bf8f88 req-471fdd15-d484-4a7b-8ce7-d2d15802f8ca tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0522952 Nov 05 15:18:56.180409 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c76b133a-1b09-47a7-904e-6ed925bf8f88 req-3dd8205e-4bce-4bff-ba36-22669d1f4cdc tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423050 Nov 05 15:18:57.292359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ca248e-5b49-487f-b1a3-1cf38278c285 req-6b44d889-f8f8-4f25-8656-4c183aba2c17 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:57.293849 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58ca248e-5b49-487f-b1a3-1cf38278c285 req-6b44d889-f8f8-4f25-8656-4c183aba2c17 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0478923 Nov 05 15:18:57.345240 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-58ca248e-5b49-487f-b1a3-1cf38278c285 req-09416a13-f7e5-4b06-8ede-b387e7a5f3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455775 Nov 05 15:18:58.461046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fe0413b-cf34-40ef-98c0-ce958bcb0bd9 req-9c6167db-a67d-420c-8102-587ea326f87e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:58.462520 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8fe0413b-cf34-40ef-98c0-ce958bcb0bd9 req-9c6167db-a67d-420c-8102-587ea326f87e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0480566 Nov 05 15:18:58.510749 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8fe0413b-cf34-40ef-98c0-ce958bcb0bd9 req-043de3fb-b184-4256-8b36-a562ccbff504 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424490 Nov 05 15:18:59.627260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2563e0f5-eea2-4d10-ad45-407060bd7bda req-2eef1bfd-2343-4c01-b68f-e9f7a3d115b7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:18:59.633015 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2563e0f5-eea2-4d10-ad45-407060bd7bda req-2eef1bfd-2343-4c01-b68f-e9f7a3d115b7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0545778 Nov 05 15:18:59.681776 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2563e0f5-eea2-4d10-ad45-407060bd7bda req-935e36e9-bf7b-4f3d-8eaa-8410b89ac668 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469139 Nov 05 15:19:00.202031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-642248da-7f95-48e0-8f9c-634aafe42866 service neutron] 10.222.0.32 "GET /v2.0/ports/318b1830-5801-42fb-8ea0-a6660fc0e584/bindings/hv-neutron-8168 HTTP/1.1" status: 200 len: 384 time: 0.0521715 Nov 05 15:19:00.398498 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-d3ca68f6-7aaa-4c3f-9934-fd510f64d729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.399973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-d3ca68f6-7aaa-4c3f-9934-fd510f64d729 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 1098 time: 0.0408847 Nov 05 15:19:00.463335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-8057cbc8-e6d1-4eda-906d-0b1629950bfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.464823 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-8057cbc8-e6d1-4eda-906d-0b1629950bfd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0436873 Nov 05 15:19:00.551797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-7a390b15-6426-4c78-b6de-eaddcaf9c525 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.553294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-7a390b15-6426-4c78-b6de-eaddcaf9c525 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0821025 Nov 05 15:19:00.620716 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-c940a5a4-7dc8-448d-b7f8-f08848e01985 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 1001 time: 0.0599859 Nov 05 15:19:00.669836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-a4c4be8d-051b-4b85-bf5f-b2471b3835d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.671184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-a4c4be8d-051b-4b85-bf5f-b2471b3835d0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0425999 Nov 05 15:19:00.715878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-97f550cf-813a-4b9e-b1da-c141f969889c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.717428 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-97f550cf-813a-4b9e-b1da-c141f969889c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0393617 Nov 05 15:19:00.797766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bf4c7e-f2ff-4eb2-a1cb-ada3bf90115e req-6e1904f1-80b8-480c-9ec3-8b5dc5327886 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:00.799871 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-19bf4c7e-f2ff-4eb2-a1cb-ada3bf90115e req-6e1904f1-80b8-480c-9ec3-8b5dc5327886 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0511453 Nov 05 15:19:00.809616 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-ec789712-87a3-4a9f-a852-b269e62e5a9d service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851319 Nov 05 15:19:00.852075 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-19bf4c7e-f2ff-4eb2-a1cb-ada3bf90115e req-34d7585a-bfcc-49e6-8f11-d77f0f9e54ad tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463228 Nov 05 15:19:00.897839 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6312cfd8-48fc-4f04-8f85-ca406f022890 req-f05c9595-6a70-4ee8-bc58-e4193c97addb service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810356 Nov 05 15:19:01.967011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d9478f-392d-45a8-a1b3-0f321b14dd1f req-c19f77ef-4275-48a1-ac47-3204eaa8fbfb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:01.968476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-60d9478f-392d-45a8-a1b3-0f321b14dd1f req-c19f77ef-4275-48a1-ac47-3204eaa8fbfb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0488439 Nov 05 15:19:02.020324 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-60d9478f-392d-45a8-a1b3-0f321b14dd1f req-bf49dcc2-fba5-4817-a962-5901680f5a75 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460196 Nov 05 15:19:03.133920 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c1d1d8-23ba-46db-ad9f-6e9ff7984e0a req-ceae1cb0-c44f-4cc9-bd72-19009b90ca14 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.135378 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-23c1d1d8-23ba-46db-ad9f-6e9ff7984e0a req-ceae1cb0-c44f-4cc9-bd72-19009b90ca14 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0483432 Nov 05 15:19:03.184213 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-23c1d1d8-23ba-46db-ad9f-6e9ff7984e0a req-8a393f38-5129-4d40-80e3-ec299688bf0b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430024 Nov 05 15:19:03.379932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81cf2f6d-2f29-451e-b950-3ee2cc339c71 req-02003f64-bcd5-47e6-a66e-dd41fa80ed89 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.381457 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-81cf2f6d-2f29-451e-b950-3ee2cc339c71 req-02003f64-bcd5-47e6-a66e-dd41fa80ed89 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0497303 Nov 05 15:19:03.390714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-a480c788-0ed8-4c08-839d-cd52aa749873 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.392160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-a480c788-0ed8-4c08-839d-cd52aa749873 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8&tenant_id=ef1d7839d356477e8151af4dc08baead&binding%3Ahost_id=hv-neutron-8168 HTTP/1.1" status: 200 len: 945 time: 0.0501418 Nov 05 15:19:03.431953 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-81cf2f6d-2f29-451e-b950-3ee2cc339c71 req-d0a0aa5f-ed95-4f51-84b3-e98c19914c67 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444946 Nov 05 15:19:03.475283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-ebd34a77-4404-4a5e-9649-292adb460213 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.476820 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-ebd34a77-4404-4a5e-9649-292adb460213 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1098 time: 0.0405777 Nov 05 15:19:03.599004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922dcb34-9007-4fbf-8be4-f0551128dbc7 req-68be20b2-9976-41c3-bcfa-7d5bc480b4c2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.600378 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-922dcb34-9007-4fbf-8be4-f0551128dbc7 req-68be20b2-9976-41c3-bcfa-7d5bc480b4c2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0985913 Nov 05 15:19:03.615615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-f22062e4-0b36-4318-913e-256e40eca673 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.617003 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-f22062e4-0b36-4318-913e-256e40eca673 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.1339207 Nov 05 15:19:03.701392 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-922dcb34-9007-4fbf-8be4-f0551128dbc7 req-984bb55b-e1c4-4c1d-b464-1279bc14c125 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0939846 Nov 05 15:19:03.708092 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-39112926-1fed-4223-8ee2-6a6ed7c464cf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 1001 time: 0.0825930 Nov 05 15:19:03.756109 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-22552862-6ca9-4be5-a198-22a2aece0157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.757601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-22552862-6ca9-4be5-a198-22a2aece0157 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0429535 Nov 05 15:19:03.802376 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-c269af9b-9d0a-4a41-b0bd-13267de592ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:03.803813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-c269af9b-9d0a-4a41-b0bd-13267de592ee service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397105 Nov 05 15:19:03.891160 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-aee8e59a-310e-474a-a2a7-a1c7d5947b6c service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801384 Nov 05 15:19:03.978248 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5a4c822b-4f2a-4314-8d1c-c9e393a0137f req-eb405f2c-2adc-4119-ab72-952a10f1569b service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803151 Nov 05 15:19:04.821625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a4e6e-3cff-4035-82bc-1ab1d3a80f32 req-7d89c2c2-7fdd-4047-9795-31201df1bba3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:04.823087 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-357a4e6e-3cff-4035-82bc-1ab1d3a80f32 req-7d89c2c2-7fdd-4047-9795-31201df1bba3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 945 time: 0.0552673 Nov 05 15:19:04.871315 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-357a4e6e-3cff-4035-82bc-1ab1d3a80f32 req-e00a799f-a103-4264-b154-ceecd22ce93e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423517 Nov 05 15:19:04.892579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51328) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:04.951564 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c0306e41-102e-4ad2-a584-514ef8f294a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/e6389d9e-55c4-46b4-98e8-422c2d6f4a57 HTTP/1.1" status: 200 len: 993 time: 0.0578763 Nov 05 15:19:07.374711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 318b1830-5801-42fb-8ea0-a6660fc0e584 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:19:07.449177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:07.470373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:19:07.473113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec1645b8-b118-40ea-8212-c0d8dda65f4f" -d '{"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-unplugged", "status": "completed", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:19:07.485964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:07.490177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:07.532686 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:19:07.537350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:07.544889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.545239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.545575 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.546184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.546305 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.546542 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.546864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.547188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.547509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.547827 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.548143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.548472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:07.569801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:19:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2942334-33f0-4fff-b351-8286d7e0015c x-openstack-request-id: req-c2942334-33f0-4fff-b351-8286d7e0015c {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:19:07.570093 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-unplugged", "status": "completed", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:19:07.570345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c2942334-33f0-4fff-b351-8286d7e0015c {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:19:07.570737 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'code': 200} Nov 05 15:19:18.514293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:20.136521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d1f33476-7b5a-48fe-af72-7c48d444e3fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:22.454367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6ce3be30-3efb-433f-aae0-57fb8869ec05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:23.532565 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:24.995700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:25.994885 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:29.497258 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-d66d483b-d586-460c-b299-1c6a23679f0f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0400321 Nov 05 15:19:29.585332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-a3cded38-f7f3-47db-b089-615b9956e699 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:29.587224 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-a3cded38-f7f3-47db-b089-615b9956e699 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1096 time: 0.0483932 Nov 05 15:19:29.690239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-ba019375-7cb2-4aad-984c-a726d8e3d453 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:29.691792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-ba019375-7cb2-4aad-984c-a726d8e3d453 service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0846312 Nov 05 15:19:29.758485 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-9460318e-d95e-431e-8c98-77103be9c749 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 999 time: 0.0594153 Nov 05 15:19:30.098000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-972976cb-d8bc-434d-b4e6-46115a302bf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:30.099387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-972976cb-d8bc-434d-b4e6-46115a302bf8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.3336177 Nov 05 15:19:30.144951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-e5cf17ee-a1c4-4cd4-a6f0-bd9db0a185ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:30.146450 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-e5cf17ee-a1c4-4cd4-a6f0-bd9db0a185ac service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0389531 Nov 05 15:19:30.234808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-da2d990e-f4d2-43d4-b3f0-425b6e2d1fe8 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811059 Nov 05 15:19:30.321459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d1f250f3-6472-4dfa-bc33-c9c738159fe9 req-946602da-3201-4480-9b26-7fcac1461487 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788643 Nov 05 15:19:33.312038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51342) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:33.466922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 8eaf0819-e3ad-49ca-9f2b-18e3c83ab941 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:19:33.467261 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:33.541293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:33.541628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:33.553574 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 8eaf0819-e3ad-49ca-9f2b-18e3c83ab941 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:19:33.707060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:33.733556 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=8eaf0819-e3ad-49ca-9f2b-18e3c83ab941,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:33.744101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.744475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.744822 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.745163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.745498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.745828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.746157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.746484 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.746811 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.747137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.747461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.747782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:33.804357 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:33.804713 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP e6389d9e-55c4-46b4-98e8-422c2d6f4a57 disassociated (deleted). External IP: 172.26.5.165, port: 318b1830-5801-42fb-8ea0-a6660fc0e584. Nov 05 15:19:34.004721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:19:34.114178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:19:34.118410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:34.123955 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Sync routers for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:19:34.133915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:34.134518 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:34.145112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cdf909de-40f5-4cca-b8a2-cf18ac0a1384 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/floatingips/e6389d9e-55c4-46b4-98e8-422c2d6f4a57 HTTP/1.1" status: 204 len: 168 time: 0.8318591 Nov 05 15:19:34.145693 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:19:34.148167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-784bdb6b-e372-4887-b492-25cc2d819e48" -d '{"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:19:34.245395 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:34.255829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:19:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13d90d0d-135a-4ad5-8778-d7e44f3788a0 x-openstack-request-id: req-13d90d0d-135a-4ad5-8778-d7e44f3788a0 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:19:34.256192 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:19:34.256552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-13d90d0d-135a-4ad5-8778-d7e44f3788a0 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:19:34.257022 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'status': 'completed', 'code': 200} Nov 05 15:19:34.329322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-1e0708c9-21bc-4ed6-ad24-00f523f3af04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:34.332105 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-1e0708c9-21bc-4ed6-ad24-00f523f3af04 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 1096 time: 0.0528400 Nov 05 15:19:34.391198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef282e24-e351-471b-9015-5e764847cce3 req-4f423525-239b-4170-88f9-41bf4dd2fbaa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:34.393098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef282e24-e351-471b-9015-5e764847cce3 req-4f423525-239b-4170-88f9-41bf4dd2fbaa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0546770 Nov 05 15:19:34.435299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-15116490-8a81-436b-8ecf-78b5627d1c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:34.436906 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-15116490-8a81-436b-8ecf-78b5627d1c3b service neutron] 10.222.0.32 "GET /v2.0/networks?id=eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 200 len: 898 time: 0.0961430 Nov 05 15:19:34.443948 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ef282e24-e351-471b-9015-5e764847cce3 req-2e8f4f4a-16f0-4238-b0cd-69f2987361c5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443709 Nov 05 15:19:34.480399 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-a046028d-39a6-4884-8256-f741d30106d1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 200 len: 217 time: 0.0358644 Nov 05 15:19:34.534895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-94c57a9f-cb45-4801-a09f-3b244741c816 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:34.536326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-94c57a9f-cb45-4801-a09f-3b244741c816 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 200 len: 835 time: 0.0485120 Nov 05 15:19:34.544153 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:34.575081 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Checking router: cc73fabb-fe39-4f22-95fa-07d28eca2bc7 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:19:34.582118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-fde00531-3882-488e-a921-146d99e9348d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:34.583601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-fde00531-3882-488e-a921-146d99e9348d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=eb96527a-c633-4926-a9f7-5de3545cccf3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397375 Nov 05 15:19:34.590132 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:34.590717 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:34.672891 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-12f76c0c-8103-4392-bc71-6dc530378421 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814614 Nov 05 15:19:34.695751 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:34.764398 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-784bdb6b-e372-4887-b492-25cc2d819e48 req-9d372cdb-3da0-46b8-a26e-ddb2d68ac654 service neutron] 10.222.0.32 "GET /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837233 Nov 05 15:19:34.890339 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:34.915820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f10253-2ff6-42f6-93b7-b9d8736e39e8 None None] The sync data for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv is: [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '6531e340-567b-443a-9460-439544d220a7', 'name': '', 'network_id': 'eb96527a-c633-4926-a9f7-5de3545cccf3', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:ff:51:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1717, 'fixed_ips': [{'subnet_id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:59Z', 'updated_at': '2021-11-05T15:18:03Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '1db45c46-d4fc-4dee-ad1b-1e13c6f49647', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:19:35.118391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aaf54c8-ccfc-4d06-a7f7-8c2bc6fc2fd0 None None] New status for floating IP e6389d9e-55c4-46b4-98e8-422c2d6f4a57: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:19:35.564357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e38edf4-9c7d-4985-a708-98c16768607c req-ee682163-a6cd-4155-a6a5-a20ca87a6225 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:35.565830 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9e38edf4-9c7d-4985-a708-98c16768607c req-ee682163-a6cd-4155-a6a5-a20ca87a6225 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0487943 Nov 05 15:19:35.613201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9e38edf4-9c7d-4985-a708-98c16768607c req-c75db4c7-1b01-43fa-873e-d845e3f7c866 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=9945d72f-5715-4a4b-91df-341672dd2382&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415473 Nov 05 15:19:36.045970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-db7bf53f-409e-4496-8481-cb553b930581 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:36.047459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-db7bf53f-409e-4496-8481-cb553b930581 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 943 time: 0.0514944 Nov 05 15:19:36.132664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 318b1830-5801-42fb-8ea0-a6660fc0e584 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:19:36.133004 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:36.221024 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 318b1830-5801-42fb-8ea0-a6660fc0e584, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=318b1830-5801-42fb-8ea0-a6660fc0e584,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:36.221419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:36.233651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 318b1830-5801-42fb-8ea0-a6660fc0e584 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:19:36.363699 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:36.393921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=318b1830-5801-42fb-8ea0-a6660fc0e584,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:36.407029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.407380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.407715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.408044 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.408372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.408754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.409291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.409817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.410291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.410770 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.411253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.411572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:36.445552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] No DVR routers for this DVR port 318b1830-5801-42fb-8ea0-a6660fc0e584 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:19:36.447945 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:36.451172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a50fb0ab-b068-43eb-969f-c0c86736e3b5 req-9af3410a-45d2-423e-b53a-8bdbe868b20e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "DELETE /v2.0/ports/318b1830-5801-42fb-8ea0-a6660fc0e584 HTTP/1.1" status: 204 len: 173 time: 0.3978653 Nov 05 15:19:36.451601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-deleted', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:19:36.453830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac86446f-20c0-4a28-86f9-990549215a19" -d '{"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-deleted", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:19:36.491910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:19:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e5bc059-44e8-44ae-9408-c74d4e43efd0 x-openstack-request-id: req-2e5bc059-44e8-44ae-9408-c74d4e43efd0 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:19:36.492249 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "feea8281-1af6-4b7d-9cf1-ebd29fcb01a8", "name": "network-vif-deleted", "tag": "318b1830-5801-42fb-8ea0-a6660fc0e584", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:19:36.492530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2e5bc059-44e8-44ae-9408-c74d4e43efd0 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:19:36.492985 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'feea8281-1af6-4b7d-9cf1-ebd29fcb01a8', 'name': 'network-vif-deleted', 'tag': '318b1830-5801-42fb-8ea0-a6660fc0e584', 'status': 'completed', 'code': 200} Nov 05 15:19:36.726296 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7a67758f-433d-4885-b36b-0c031dea1532 req-dccd03fb-052c-40e3-8438-48e4c57ae4e1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=feea8281-1af6-4b7d-9cf1-ebd29fcb01a8 HTTP/1.1" status: 200 len: 210 time: 0.0256240 Nov 05 15:19:37.781500 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51362) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:38.450121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:38.703968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 6531e340-567b-443a-9460-439544d220a7 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:19:38.704221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:38.793825 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 6531e340-567b-443a-9460-439544d220a7, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=6531e340-567b-443a-9460-439544d220a7,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:38.794528 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:38.806531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 6531e340-567b-443a-9460-439544d220a7 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:19:38.993677 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.019863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=6531e340-567b-443a-9460-439544d220a7,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:39.189150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.411482 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:19:39.488956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 318b1830-5801-42fb-8ea0-a6660fc0e584 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:19:39.510076 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 318b1830-5801-42fb-8ea0-a6660fc0e584 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:19:39.510421 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 318b1830-5801-42fb-8ea0-a6660fc0e584 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:19:39.523625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:19:39.528893 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-35719b89-6307-4615-9a67-c1a395f3dc91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/cc73fabb-fe39-4f22-95fa-07d28eca2bc7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7462351 Nov 05 15:19:39.531499 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51364) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:39.533349 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Sync routers for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:19:39.543428 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:39.544030 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:39.586215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting subnet 1db45c46-d4fc-4dee-ad1b-1e13c6f49647 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:19:39.589243 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.631937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.648760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:39.713704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.774249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.801984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Subnet': ['ID=1db45c46-d4fc-4dee-ad1b-1e13c6f49647,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:39.805739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.808975 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a30c1c5b-955d-46e5-bd0f-5b3c80399126 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/subnets/1db45c46-d4fc-4dee-ad1b-1e13c6f49647 HTTP/1.1" status: 204 len: 168 time: 0.2765348 Nov 05 15:19:39.811491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51366) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:39.814617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-159974fd-5598-40bf-8778-ef69793fdc90 None None] Network eb96527a-c633-4926-a9f7-5de3545cccf3 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:19:39.828718 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:19:38Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:39.855324 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Checking router: cc73fabb-fe39-4f22-95fa-07d28eca2bc7 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:19:39.864486 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Routers {'cc73fabb-fe39-4f22-95fa-07d28eca2bc7'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:39.864915 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:39.927592 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:39.979960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] DHCP port deletion for eb96527a-c633-4926-a9f7-5de3545cccf3 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:19:39.980573 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] Set router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:40.026490 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Deleting port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:19:40.026976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.040006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.094905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] For port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,segment=NetworkSegment(d449d795-2b48-487b-b30e-4a0ee8a31c97),segment_id=d449d795-2b48-487b-b30e-4a0ee8a31c97)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:40.095301 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.104066 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b864fa1d-9fec-4fac-958e-5bf73b4f6eea {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:19:40.104402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.108807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Calling delete_port for 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:19:40.168866 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:19:38Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:40.187374 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port b864fa1d-9fec-4fac-958e-5bf73b4f6eea, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:40.188038 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.197159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.202032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b864fa1d-9fec-4fac-958e-5bf73b4f6eea owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:19:40.212346 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8761cc7-aa0c-4294-ac55-044f27f2fb91 None None] The sync data for ids ['cc73fabb-fe39-4f22-95fa-07d28eca2bc7'] in dv-neutron-816850-1-hyperv is: [{'id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1439637164', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175'}], 'enable_snat': True}, 'gw_port_id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:19:38Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'b864fa1d-9fec-4fac-958e-5bf73b4f6eea', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc73fabb-fe39-4f22-95fa-07d28eca2bc7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1714, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.175', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:17:56Z', 'updated_at': '2021-11-05T15:18:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:19:40.227055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] Pushing event deleted for resources: {'Port': ['ID=2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:40.230441 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad6be361-a3f6-4f31-ab8a-ce51657bc961 None None] No DVR routers for this DVR port 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:19:40.376544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.406149 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b864fa1d-9fec-4fac-958e-5bf73b4f6eea,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:40.466453 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.558559 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.560672 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.607526 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.608183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Fanout notify agent at l3_agent the message router_deleted on router cc73fabb-fe39-4f22-95fa-07d28eca2bc7 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:19:40.618168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:19:40.620296 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.621480 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3d0040e8-ad32-472c-8b16-fd4103618095 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/routers/cc73fabb-fe39-4f22-95fa-07d28eca2bc7 HTTP/1.1" status: 204 len: 168 time: 0.8090713 Nov 05 15:19:40.624226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51368) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:40.647171 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:19:40.647584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2ffd9d59-6b73-4c90-82b7-cf6286d6ca8e not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:19:40.706209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.792710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.813035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eb96527a-c633-4926-a9f7-5de3545cccf3']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:40.823340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd449d795-2b48-487b-b30e-4a0ee8a31c97') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:40.823636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd449d795-2b48-487b-b30e-4a0ee8a31c97') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:40.833799 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.847507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.853847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Releasing vlan 640 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:19:40.854238 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:19:40.857553 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:19:40.921320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.926700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:40.929857 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/networks/eb96527a-c633-4926-a9f7-5de3545cccf3 HTTP/1.1" status: 204 len: 168 time: 0.3046019 Nov 05 15:19:40.932673 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51370) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:40.944964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ab2a591-e7e0-4948-b126-cd8d5a5125b5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Network': ['ID=eb96527a-c633-4926-a9f7-5de3545cccf3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:40.993006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.017455 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.076583 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.079163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.080293 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/security-groups/9945d72f-5715-4a4b-91df-341672dd2382 HTTP/1.1" status: 204 len: 168 time: 0.1466434 Nov 05 15:19:41.089338 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47d75145-5696-4076-a92f-230448114253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9945d72f-5715-4a4b-91df-341672dd2382,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:41.617720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51376) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:41.622342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1317266684', 'description': 'tempest-secgroup-smoke-1317266684 description', 'project_id': 'ef1d7839d356477e8151af4dc08baead'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:41.644205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.708726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.712305 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.741842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.743063 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1243308 Nov 05 15:19:41.746068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51378) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:41.747322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0828914f-e605-4946-be43-dfc1479041ae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:41.750782 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:41.777161 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.831283 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.834868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.855245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3d8749d-2915-4ad7-ae92-05138e2c9faf,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:41.860632 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.861893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-61ebe2f7-c056-4a4b-a443-41377293613b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1147263 Nov 05 15:19:41.864722 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51380) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:41.868985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:41.894064 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.947820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.951313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.972393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6057d177-c5c2-4e40-ae06-9558c6712bfe,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:41.980403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:41.981621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1d32abcf-a5cd-4cb6-8214-8967725fd688 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1159792 Nov 05 15:19:41.984358 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51382) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:41.988747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.013233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.069158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.072509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.090405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=636e8f72-a41a-4e08-aa1b-d4ee74ad0774,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:42.095155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.096346 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cd3d7ff8-28e3-403a-bb7f-98c3830aad63 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1110506 Nov 05 15:19:42.099138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:42.103354 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.130855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.176580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b864fa1d-9fec-4fac-958e-5bf73b4f6eea no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:19:42.191534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.195014 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.197257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b864fa1d-9fec-4fac-958e-5bf73b4f6eea {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:19:42.197592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b864fa1d-9fec-4fac-958e-5bf73b4f6eea not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:19:42.198003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6531e340-567b-443a-9460-439544d220a7 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:19:42.214900 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c3d2c1d-cac6-4d90-b083-3476fcc1c87e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:42.216530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 6531e340-567b-443a-9460-439544d220a7 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:19:42.216841 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 6531e340-567b-443a-9460-439544d220a7 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:19:42.220810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.222642 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a8d8d9c9-72b3-462e-85a3-3d6fdbe11a1a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1225908 Nov 05 15:19:42.225402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51386) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:42.229712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.250196 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:19:42.254830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.310885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.314143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.332688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=97c87dab-ca18-4b8a-bfe4-dcbe2981c97e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:42.340105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.341314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f05912f4-8b8d-4a99-b5bd-defeb58e54a7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1150224 Nov 05 15:19:42.343949 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51388) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:42.348793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': '1a31e0b6-253c-47a7-b9b9-56c1205d1bf9', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.369144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.securitygroups_db [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:19:42.373683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.430783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.434145 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.448573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=061c938a-2fee-4bfe-b9fb-4c66455ff597,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:42.458854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.460050 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-eb3179c6-e8de-436d-8fbb-08c3d20b514e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1151242 Nov 05 15:19:42.462854 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51390) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:42.467579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'network': {'name': 'tempest-network-smoke--1579626269', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'port_security_enabled': True}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.487313 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:19:42.490707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.514106 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 606} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:19:42.523351 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.523813 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Added segment 42fdf3de-6050-42c2-832d-316340121ea7 of type vlan for network c48775d7-1836-4fb6-8bbc-cbc0177b18bc Nov 05 15:19:42.562902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.586625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.592147 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:42.592752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.649310 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1854589 Nov 05 15:19:42.651953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51392) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:42.659091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'admin_state_up': True, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:42.677564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4d0d0a-ba95-4a92-8ee4-e98c1145fa7d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Network': ['ID=c48775d7-1836-4fb6-8bbc-cbc0177b18bc,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:42.687601 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:19:42.690748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.691812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.742511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:42.879139 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.063243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.090481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.187620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.43 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/ee4d6bca-f483-4f27-a681-a0fdaaa1dc74) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:19:43.288146 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.321073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.356593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:43.361272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:43.365369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:19:43.370911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:43.607827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.807235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:43.929393 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:19:44.029916 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:19:44.040740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Sync routers for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:19:44.049971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:44.050163 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.050589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:44.051327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-69dcebad-61b5-4e84-9638-b36738b26700 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.3984334 Nov 05 15:19:44.054442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51394) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:44.084384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-72e0f0ef-1372-414b-a4ab-83119894ee46 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=ef1d7839d356477e8151af4dc08baead&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0265350 Nov 05 15:19:44.084589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51396) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:44.158030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:44.172680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7df8e8cb-e6f6-410f-bc36-11f263514513 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:44.174254 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7df8e8cb-e6f6-410f-bc36-11f263514513 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0887966 Nov 05 15:19:44.177041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51398) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:44.209267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-68a97267-49cc-4ccc-9679-ceff33576222 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0311568 Nov 05 15:19:44.211848 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51400) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:44.216547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-939893446', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:44.301994 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:19:44.305620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.334098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:43Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:44.364518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Checking router: d8dada49-9f4e-4a00-bdd2-7d51e0889af8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:19:44.364916 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Updating router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:19:44.389558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.483619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.533193 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:19:44.544205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Subnet': ['ID=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:44.555327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Checking segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:19:44.555688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network hostable DHCP agents. Network: c48775d7-1836-4fb6-8bbc-cbc0177b18bc, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:19:44.572099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:19:44.580070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, c48775d7-1836-4fb6-8bbc-cbc0177b18bc) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:44.583962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:44.584600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.592040 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6df87aec-005d-4f0a-84ce-cd8a4d9c48ba None None] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:19:44.600443 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-db3cca05-08b4-4c17-9fbd-07d866bcaaa4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.3876128 Nov 05 15:19:44.603191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51402) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:44.686331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.700483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-6df87aec-005d-4f0a-84ce-cd8a4d9c48ba None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:19:44.732571 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:19:44.746951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62881493-7285-4758-94ec-e9ae78f752c5 None None] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:19:44.806201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Attempting to bind port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:19:44.806569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Attempting to bind port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:19:44.806932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Attempting to bind port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:19:44.808900 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b907618-0d5e-4515-b573-02f66a857530 None None] Pushing event updated for resources: {'Port': ['ID=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:44.819597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 19, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:19:44.819971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:19:44.820377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.820995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:19:44.821483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Bound port: ee4d6bca-f483-4f27-a681-a0fdaaa1dc74, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:19:44.821875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-62881493-7285-4758-94ec-e9ae78f752c5 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:19:44.883751 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:19:44.894568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79d76677-69a6-4489-8624-04905beefee2 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:19:44.919295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] For port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:19:44.939478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] For port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:19:44.945776 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:45.035299 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79d76677-69a6-4489-8624-04905beefee2 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:19:45.041340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:45.042030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:45.045569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b907618-0d5e-4515-b573-02f66a857530 None None] Pushing event updated for resources: {'Port': ['ID=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:45.333150 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:45.361361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:45.605418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.1 (c48775d7-1836-4fb6-8bbc-cbc0177b18bc/13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3/b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:19:45.614256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:19:45.615125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:45.634250 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:43Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:45.672643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48f8ce40-c866-4404-b6f5-aaa66cd8f283 None None] The sync data for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:43Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:19:45.725126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:45.761651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:45.804992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:45.808989 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Allocated IP 172.20.0.2 (c48775d7-1836-4fb6-8bbc-cbc0177b18bc/13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3/4d0ce79a-e16d-458f-aede-735079fbddca) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:19:45.810345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:45.813289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:19:45.847701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:45.874397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.000094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.007666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.038581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.053282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:46.056451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:46.061146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:19:46.064426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Pushing event updated for resources: {'Port': ['ID=4d0ce79a-e16d-458f-aede-735079fbddca,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:46.121731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Attempting to bind port 4d0ce79a-e16d-458f-aede-735079fbddca on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:19:46.122265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Attempting to bind port 4d0ce79a-e16d-458f-aede-735079fbddca by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:19:46.122719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Attempting to bind port 4d0ce79a-e16d-458f-aede-735079fbddca on network c48775d7-1836-4fb6-8bbc-cbc0177b18bc {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:19:46.129710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 19, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:19:46.130296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Checking segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:19:46.130895 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.131336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Bound using segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:19:46.131994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Bound port: 4d0ce79a-e16d-458f-aede-735079fbddca, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:19:46.133534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.208825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] For port 4d0ce79a-e16d-458f-aede-735079fbddca, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:19:46.212174 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] For port 4d0ce79a-e16d-458f-aede-735079fbddca, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4d0ce79a-e16d-458f-aede-735079fbddca,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:19:46.221240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.250047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:46.324861 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ace58d9-d706-4b10-a526-931895c044d3 None None] Pushing event updated for resources: {'Port': ['ID=4d0ce79a-e16d-458f-aede-735079fbddca,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:46.346836 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:46.347300 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.365681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.373048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.444140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.454034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:46.459575 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.474603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:46.485934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:46.586801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:46.605361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:46.606894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:46.729811 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:19:46.835344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:19:46.840254 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-949a6bd6-5089-4314-8558-8eea5b1bab9b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/d8dada49-9f4e-4a00-bdd2-7d51e0889af8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2361019 Nov 05 15:19:46.988214 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-e9ce6d65-4e17-4989-a5ff-58f1c19ede95 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1317266684&fields=id&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 267 time: 0.0444605 Nov 05 15:19:47.099824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-7d5a8d5e-7d3c-4551-aa9b-75e1f88ab497 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:47.101304 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-7d5a8d5e-7d3c-4551-aa9b-75e1f88ab497 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 797 time: 0.1045315 Nov 05 15:19:47.115640 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-eaf8a0c6-189c-4c30-b1b1-d5712ea4b3c5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/quotas/ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 375 time: 0.0087543 Nov 05 15:19:47.166935 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-46ef5ffb-d828-4f65-8f86-10ef177e512a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0460083 Nov 05 15:19:47.262493 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-35c944bb-6de5-4393-a909-5df91aa0a5c1 service neutron] 10.222.0.30 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842385 Nov 05 15:19:47.350464 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-1650c1f5-6526-430c-8d78-dbdf97212e6a service neutron] 10.222.0.30 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813143 Nov 05 15:19:47.597784 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bf331ca6-42d7-439a-84c6-6fc1a7399bc2 req-136952a8-3e19-4b53-9a83-c3fe806ec0e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 210 time: 0.1077447 Nov 05 15:19:47.713271 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Sync routers for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:19:47.724664 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:47.725272 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:47.756357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d595ade2-8cf9-408e-8b54-ee685cceb219 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:19:47.826597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d595ade2-8cf9-408e-8b54-ee685cceb219 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:19:47.898681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] Provisioning complete for port 4d0ce79a-e16d-458f-aede-735079fbddca triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:47.899052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:47.935494 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:48.033909 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.107170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] For port 4d0ce79a-e16d-458f-aede-735079fbddca, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4d0ce79a-e16d-458f-aede-735079fbddca,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:48.112996 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.137752 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 2, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:48.168522 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Checking router: d8dada49-9f4e-4a00-bdd2-7d51e0889af8 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:19:48.168866 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Updating router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:19:48.180661 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0853426-e651-41a8-96cd-654eb3a9c8d8 None None] Pushing event updated for resources: {'Port': ['ID=4d0ce79a-e16d-458f-aede-735079fbddca,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:48.198357 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.274035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:48.343161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:48.343910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.453997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4d0ce79a-e16d-458f-aede-735079fbddca up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:48.517398 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.533863 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.545758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-edf21b11-a38e-4539-8c12-88f617308b2d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:48.552986 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-edf21b11-a38e-4539-8c12-88f617308b2d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 797 time: 0.1720371 Nov 05 15:19:48.569236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.580034 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Pushing event updated for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:48.590410 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.591619 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.592294 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.593209 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.593711 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.597078 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.597267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4d0ce79a-e16d-458f-aede-735079fbddca triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:48.597487 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.598974 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.599513 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.600034 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.600363 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.600956 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.601284 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:19:48.668034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-c2bd7ade-2bc9-424e-9fb5-c77006d38750 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 380 time: 0.1041560 Nov 05 15:19:48.679319 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Attempting to bind port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:19:48.680598 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Attempting to bind port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:19:48.680973 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Attempting to bind port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a on network c48775d7-1836-4fb6-8bbc-cbc0177b18bc {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:19:48.683323 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'port': {'device_id': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'admin_state_up': True, 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'security_groups': ['1a31e0b6-253c-47a7-b9b9-56c1205d1bf9']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:48.694056 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 19, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:19:48.694519 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Checking segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:19:48.694990 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.695451 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Bound using segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:19:48.696006 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Bound port: b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:19:48.696450 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.771607 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] For port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:19:48.776642 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] For port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:19:48.777357 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1b114c66-813b-4d58-8611-be4c05ae25b3 req-fae147e6-9ff1-4e34-b7e3-991a42155f91 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 210 time: 0.0440969 Nov 05 15:19:48.789773 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.833758 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:19:48.834377 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:48.845720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:19:48.849457 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.852134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Provisioning complete for port 4d0ce79a-e16d-458f-aede-735079fbddca triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:48.853059 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.950148 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:19:48.951822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:48.952357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:48.996087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.10 (c48775d7-1836-4fb6-8bbc-cbc0177b18bc/13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3/6874a502-1a14-42f7-ac76-ad1100d9c79f) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:19:49.049457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.089183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] For port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:49.091248 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b24851-a2e8-474e-a96f-173944046cf6 None None] Pushing event updated for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:49.095430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.152425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eee07ed-f4d9-4f1d-883d-013fcd8584d8 None None] Pushing event updated for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:49.180522 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.189435 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:48Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:19:49.216859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d3f18f5-9ba5-4a79-a5d4-3292bd087fe8 None None] The sync data for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:48Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:19:49.231708 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.235584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ed5d1dbc-a9ef-4cb0-8162-9c2b8b711797 None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:49.235893 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ed5d1dbc-a9ef-4cb0-8162-9c2b8b711797 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.312383 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:49.315755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:49.321098 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:19:49.325489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:49.386446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:49.387228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.408937 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-8e8a10da-a797-4c6b-bfb0-95cd8c2f773a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7327442 Nov 05 15:19:49.422250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Request body: {'port': {'device_id': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:49.487155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fae1f793-151f-46c6-bd7d-dbdea6fc6e56 None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:49.487620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fae1f793-151f-46c6-bd7d-dbdea6fc6e56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.493195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.710245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-e139457f-bcbb-4314-bf49-73d56097ea74 None None] Provisioning complete for port 6874a502-1a14-42f7-ac76-ad1100d9c79f triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:49.710620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e139457f-bcbb-4314-bf49-73d56097ea74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.761218 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-e139457f-bcbb-4314-bf49-73d56097ea74 None None] Port 6874a502-1a14-42f7-ac76-ad1100d9c79f cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:19:49.837963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6874a502-1a14-42f7-ac76-ad1100d9c79f {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:19:49.847409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.862075 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Transition to ACTIVE for port object 6874a502-1a14-42f7-ac76-ad1100d9c79f will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:19:49.867603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.896327 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6e0f89d7-ac7e-40c7-b9c9-a14de9b0a687 None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:49.896946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e0f89d7-ac7e-40c7-b9c9-a14de9b0a687 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:49.948805 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f704ff-425b-4a0c-b125-1b9330557a6b req-6ada3ebb-e561-49be-8ff2-8ef2cefe4541 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:49.959383 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-76f704ff-425b-4a0c-b125-1b9330557a6b req-6ada3ebb-e561-49be-8ff2-8ef2cefe4541 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 944 time: 0.0820458 Nov 05 15:19:49.996262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Pushing event updated for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:50.028773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Attempting to bind port 6874a502-1a14-42f7-ac76-ad1100d9c79f on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:19:50.029117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Attempting to bind port 6874a502-1a14-42f7-ac76-ad1100d9c79f by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:19:50.029436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Attempting to bind port 6874a502-1a14-42f7-ac76-ad1100d9c79f on network c48775d7-1836-4fb6-8bbc-cbc0177b18bc {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:19:50.041998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Port 6874a502-1a14-42f7-ac76-ad1100d9c79f on network c48775d7-1836-4fb6-8bbc-cbc0177b18bc not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:19:50.042328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Attempting to bind port 6874a502-1a14-42f7-ac76-ad1100d9c79f on network c48775d7-1836-4fb6-8bbc-cbc0177b18bc {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:19:50.045164 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-76f704ff-425b-4a0c-b125-1b9330557a6b req-5ea8088b-4a84-4ba1-aed3-b72034a53f69 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841165 Nov 05 15:19:50.054680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 19, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:19:50.055029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Checking segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:19:50.055418 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Bound using segment: {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:19:50.055858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Bound port: 6874a502-1a14-42f7-ac76-ad1100d9c79f, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '42fdf3de-6050-42c2-832d-316340121ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 606, 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:19:50.056218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.175927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-618eb4b0-579b-41e3-9751-062643574712 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.185062 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:19:50.190494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:19:50.201246 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.206516 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-79b9db2d-f66d-4a5a-a363-8e3da9b120d6 None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:50.207181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-79b9db2d-f66d-4a5a-a363-8e3da9b120d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.240327 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:50.241047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.242659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] 10.222.0.32 "PUT /v2.0/ports/6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 1094 time: 0.8257737 Nov 05 15:19:50.244884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:19:50.249359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48d27ab7-78f3-4289-bf37-617a36436d88" -d '{"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:19:50.365815 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:19:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1041cf10-5929-437d-a961-7926842c3a5c x-openstack-request-id: req-1041cf10-5929-437d-a961-7926842c3a5c {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:19:50.366118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:19:50.366381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1041cf10-5929-437d-a961-7926842c3a5c {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:19:50.366951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'status': 'completed', 'code': 200} Nov 05 15:19:50.369125 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b40a4c-80ca-4f42-a060-5110c57988cd service neutron] Pushing event updated for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:50.398666 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-b8a40045-243c-4287-859d-ebec7dde37d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:50.402165 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-b8a40045-243c-4287-859d-ebec7dde37d1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1097 time: 0.1137443 Nov 05 15:19:50.466618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-2b158512-87de-4632-a57f-93fa3f78d2cb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 217 time: 0.0526409 Nov 05 15:19:50.508669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:50.540396 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-b8582e6b-fb2b-4d25-87ee-f74fa193c303 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:50.542190 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-b8582e6b-fb2b-4d25-87ee-f74fa193c303 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0675597 Nov 05 15:19:50.567507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:50.568023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.600184 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-2734009e-0ade-4323-a67f-3ea3c5526b7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:50.602212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-2734009e-0ade-4323-a67f-3ea3c5526b7c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0520687 Nov 05 15:19:50.687079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4d0ce79a-e16d-458f-aede-735079fbddca up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:50.718100 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-1368dcd2-a06f-4f15-969a-9582fe674d35 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1076128 Nov 05 15:19:50.759569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 4d0ce79a-e16d-458f-aede-735079fbddca triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:50.759959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:50.840054 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d135d3-7d1f-4df9-8865-b6713dbcec02 req-d4f5fee5-cbd0-4346-a062-894c9c5b0576 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1151328 Nov 05 15:19:50.930661 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-e7aae3c2-8689-40a0-8174-129934e7ca1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:50.932137 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-e7aae3c2-8689-40a0-8174-129934e7ca1b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1097 time: 0.0406535 Nov 05 15:19:51.028545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-ec24e20f-c556-4191-834c-832a73a5f8c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:51.030038 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-ec24e20f-c556-4191-834c-832a73a5f8c6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 898 time: 0.0910673 Nov 05 15:19:51.073967 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-ea7c2cfe-0bcc-4eb9-a2c0-513043acce43 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 217 time: 0.0364268 Nov 05 15:19:51.124333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-d83791f2-e80c-47bb-b77b-f1a16f8ef123 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:51.125848 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-d83791f2-e80c-47bb-b77b-f1a16f8ef123 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0438483 Nov 05 15:19:51.159833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5114961e-a979-40b6-8254-318ad8a12f3c req-d41b1930-f590-4403-8279-9d4c679e5928 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:51.161505 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5114961e-a979-40b6-8254-318ad8a12f3c req-d41b1930-f590-4403-8279-9d4c679e5928 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 944 time: 0.0532386 Nov 05 15:19:51.177629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-6c9dc5ac-da74-4020-a512-bc4f42eb3797 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:51.179232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-6c9dc5ac-da74-4020-a512-bc4f42eb3797 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0460961 Nov 05 15:19:51.214583 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-5114961e-a979-40b6-8254-318ad8a12f3c req-3a17107a-93b7-43b5-a540-32348242d819 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455425 Nov 05 15:19:51.281407 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-075a8834-5a1a-4d1b-988d-0941cdcdc257 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929105 Nov 05 15:19:51.373553 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48d27ab7-78f3-4289-bf37-617a36436d88 req-c8a05093-6308-4fdc-9d38-35cf6f8320dc service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850394 Nov 05 15:19:52.379207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f625723-2101-4451-8589-82f63d653357 req-07d06050-6cff-4b2d-9f6a-dd6e9ddb1f8b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:52.380692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f625723-2101-4451-8589-82f63d653357 req-07d06050-6cff-4b2d-9f6a-dd6e9ddb1f8b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 944 time: 0.0978801 Nov 05 15:19:52.428405 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5f625723-2101-4451-8589-82f63d653357 req-38aacd77-df5a-40fa-b6d6-926793297052 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418518 Nov 05 15:19:52.457023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fb150881-c064-41ef-88fe-aba3ea2a7063 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:53.536132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:53.552889 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a72878b4-729e-405e-ba4c-10b3e77f8a0e req-91babaa1-a256-472b-b78b-7e19a17aa5ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:53.554369 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a72878b4-729e-405e-ba4c-10b3e77f8a0e req-91babaa1-a256-472b-b78b-7e19a17aa5ba tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 944 time: 0.0500646 Nov 05 15:19:53.594715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6874a502-1a14-42f7-ac76-ad1100d9c79f details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:19:53.607950 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a72878b4-729e-405e-ba4c-10b3e77f8a0e req-69a28b1f-f7af-4c88-9b0f-964c40c01edd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476017 Nov 05 15:19:53.688816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:53.700451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'port_id': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'mac_address': 'fa:16:3e:7e:2d:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 606, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:19:53.740066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:53.752853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6874a502-1a14-42f7-ac76-ad1100d9c79f {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:19:53.776099 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:53.780592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:53.826928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:54.013057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['6874a502-1a14-42f7-ac76-ad1100d9c79f'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:19:54.722458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6199f67-f8df-4d07-92cd-748f2349995b req-072171da-6343-4a6a-89b9-074074c2bfa3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:54.723906 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6199f67-f8df-4d07-92cd-748f2349995b req-072171da-6343-4a6a-89b9-074074c2bfa3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 945 time: 0.0484679 Nov 05 15:19:54.776314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b6199f67-f8df-4d07-92cd-748f2349995b req-98469213-6de9-45e7-a281-7fd1f7f66967 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464635 Nov 05 15:19:54.995539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:55.606623 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6874a502-1a14-42f7-ac76-ad1100d9c79f up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:19:55.654695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 6874a502-1a14-42f7-ac76-ad1100d9c79f completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:19:55.659712 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 6874a502-1a14-42f7-ac76-ad1100d9c79f triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:19:55.660080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:55.888439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:55.892072 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf755cb-0dfe-4f6e-b750-9e5bb4f9b443 req-bb2f676b-a804-49ef-a59d-217bfa8881b2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:55.893632 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fbf755cb-0dfe-4f6e-b750-9e5bb4f9b443 req-bb2f676b-a804-49ef-a59d-217bfa8881b2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 945 time: 0.0490446 Nov 05 15:19:55.911522 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:19:55.914404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6697559-27c4-4dde-8f0d-dd46bba161eb" -d '{"events": [{"server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "name": "network-vif-plugged", "status": "completed", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:19:55.927057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:19:55.931828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:55.954232 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fbf755cb-0dfe-4f6e-b750-9e5bb4f9b443 req-7c0acedc-cbc7-4e30-b582-c706986847bf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546699 Nov 05 15:19:55.956856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:19:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb56afdb-f3a8-40ca-916a-12008c831c92 x-openstack-request-id: req-cb56afdb-f3a8-40ca-916a-12008c831c92 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:19:55.957142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "name": "network-vif-plugged", "status": "completed", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:19:55.957390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cb56afdb-f3a8-40ca-916a-12008c831c92 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:19:55.957782 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'code': 200} Nov 05 15:19:55.995296 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:56.006035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:56.113334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1661182b-43ed-4f3a-855e-3880d8f1fb08 req-e1e1f304-08f0-4121-a83d-82ff65e6120d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:56.114678 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1661182b-43ed-4f3a-855e-3880d8f1fb08 req-e1e1f304-08f0-4121-a83d-82ff65e6120d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1099 time: 0.0386496 Nov 05 15:19:56.159559 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1661182b-43ed-4f3a-855e-3880d8f1fb08 req-27d5778a-fc6c-4c03-b10a-c050b6fe7081 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376914 Nov 05 15:19:57.078136 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d8cb11-c36a-4501-87d9-5b185aff4b47 req-d596c58a-2fe5-4cb1-9377-db8af8ad0fa1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:57.079612 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-23d8cb11-c36a-4501-87d9-5b185aff4b47 req-d596c58a-2fe5-4cb1-9377-db8af8ad0fa1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0485406 Nov 05 15:19:57.129735 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-23d8cb11-c36a-4501-87d9-5b185aff4b47 req-5d0b5cbe-4b4c-4c45-84ec-e5db5a98daf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435221 Nov 05 15:19:58.244680 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35807bfb-3dc1-44b8-b2e2-76808b9360e5 req-64de46d1-a3d2-401a-b35e-e9e54ab2e1fe tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:58.246126 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-35807bfb-3dc1-44b8-b2e2-76808b9360e5 req-64de46d1-a3d2-401a-b35e-e9e54ab2e1fe tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0487375 Nov 05 15:19:58.294711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-35807bfb-3dc1-44b8-b2e2-76808b9360e5 req-3fa5b6da-c304-4aab-afe4-f7da7e5ce83d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428209 Nov 05 15:19:58.408877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936db4ad-cf74-43f6-a0fe-bb8dcca7be44 req-819f03b8-b6be-4a1a-812e-bf0e26b3772e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:58.410237 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-936db4ad-cf74-43f6-a0fe-bb8dcca7be44 req-819f03b8-b6be-4a1a-812e-bf0e26b3772e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0508318 Nov 05 15:19:58.458194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-936db4ad-cf74-43f6-a0fe-bb8dcca7be44 req-b9978469-afeb-4556-8398-f9f3e0221644 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419376 Nov 05 15:19:58.479884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51458) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:58.519142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-652169ed-5be3-46ab-ac53-8006bb4267cd tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:19:58.520802 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-652169ed-5be3-46ab-ac53-8006bb4267cd tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1094 time: 0.0396724 Nov 05 15:19:58.523487 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51460) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:19:58.527779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address': '172.20.0.10'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:19:58.548905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:58.645538 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:58.743105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.46 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b2c0c22b-fe42-4a23-9cd7-a0689087d479) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:19:58.844066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:58.877306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:58.912018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:19:58.915026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:19:58.921028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:19:58.944118 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b2c0c22b-fe42-4a23-9cd7-a0689087d479,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:59.566087 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:59.629749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:59.774556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:59.779852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:59.854484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b2c0c22b-fe42-4a23-9cd7-a0689087d479,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:19:59.861124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:19:59.963417 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 2fd45bea-11c4-4e58-b3d9-d32555be099c associated. External IP: 172.26.5.46, port: 6874a502-1a14-42f7-ac76-ad1100d9c79f. Nov 05 15:20:00.174378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:20:00.276204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:20:00.285751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Sync routers for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:20:00.294010 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:00.300043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:20:00.300700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:20:00.324912 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-49d62fc9-b87b-4a41-8269-87287009c57b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8003461 Nov 05 15:20:00.325505 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:20:00.327759 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-503f0734-fb8a-435d-a0e7-048d90d1c2dd" -d '{"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:20:00.365599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:20:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbe9e58e-bf0c-439b-b2a1-f50cd1f07b33 x-openstack-request-id: req-dbe9e58e-bf0c-439b-b2a1-f50cd1f07b33 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:20:00.365894 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:20:00.366144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-dbe9e58e-bf0c-439b-b2a1-f50cd1f07b33 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:20:00.366641 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'status': 'completed', 'code': 200} Nov 05 15:20:00.418556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:20:00.432897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-d0b2cf0f-1642-4e4d-8994-3f3d272a16e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:00.433339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36083c5-5013-42d7-b868-cf5008ec2075 req-7175c792-6656-47e7-b5fa-ac5524123ce3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:00.434323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-d0b2cf0f-1642-4e4d-8994-3f3d272a16e8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1099 time: 0.0446782 Nov 05 15:20:00.434999 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b36083c5-5013-42d7-b868-cf5008ec2075 req-7175c792-6656-47e7-b5fa-ac5524123ce3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0609570 Nov 05 15:20:00.487381 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b36083c5-5013-42d7-b868-cf5008ec2075 req-43c26812-2943-4b41-b3a9-243bfcd21a96 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455284 Nov 05 15:20:00.509822 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51466) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:20:00.587657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-1dd7d31e-754e-43d5-99c0-eb02966fe1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:00.589225 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-1dd7d31e-754e-43d5-99c0-eb02966fe1a6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 898 time: 0.1478031 Nov 05 15:20:00.594458 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-672ef4e8-bc64-4cc8-b5d3-4046aa2ad519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/2fd45bea-11c4-4e58-b3d9-d32555be099c HTTP/1.1" status: 200 len: 991 time: 0.0836322 Nov 05 15:20:00.645005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2fd45bea-11c4-4e58-b3d9-d32555be099c', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.46', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'port_id': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1739, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'mac_address': 'fa:16:3e:7e:2d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:19:59Z', 'updated_at': '2021-11-05T15:19:59Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:20:00.652806 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-de468aff-19b3-4bb5-8792-055471d22d6f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 999 time: 0.0567448 Nov 05 15:20:00.671388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Checking router: d8dada49-9f4e-4a00-bdd2-7d51e0889af8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:20:00.682253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:20:00.682868 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:19:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:20:00.706738 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-62006aee-ce57-4032-9afa-4b255855992c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:00.708105 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-62006aee-ce57-4032-9afa-4b255855992c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0489459 Nov 05 15:20:00.753162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-1c45630b-f3f6-4549-8943-bace67cf9398 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:00.754633 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-1c45630b-f3f6-4549-8943-bace67cf9398 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0397360 Nov 05 15:20:00.788595 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:20:00.844181 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-9dd9a626-af7f-4ae0-be2c-232f93a42c09 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812001 Nov 05 15:20:00.938961 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-503f0734-fb8a-435d-a0e7-048d90d1c2dd req-04dfc544-7329-4c7b-b044-96fbf8be5083 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873985 Nov 05 15:20:01.012672 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2fd45bea-11c4-4e58-b3d9-d32555be099c', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.46', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'port_id': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1739, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'mac_address': 'fa:16:3e:7e:2d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:19:59Z', 'updated_at': '2021-11-05T15:19:59Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:20:01.043134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39241d3d-3be0-458d-924d-5ce989728b72 None None] The sync data for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '2fd45bea-11c4-4e58-b3d9-d32555be099c', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.46', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'port_id': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1739, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'mac_address': 'fa:16:3e:7e:2d:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:19:59Z', 'updated_at': '2021-11-05T15:19:59Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:20:01.218072 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cff60bf5-e5ae-4948-9844-bbf89d2faa48 None None] New status for floating IP 2fd45bea-11c4-4e58-b3d9-d32555be099c: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:20:01.598233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51468) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:20:01.698983 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0bd66dcc-9b39-4c0a-86af-325ded03288c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/2fd45bea-11c4-4e58-b3d9-d32555be099c HTTP/1.1" status: 200 len: 993 time: 0.0996168 Nov 05 15:20:18.518057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:20.136249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-88e7a0ba-f628-43b0-bbc9-504ceb590da8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:21.531743 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:20:22.458591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c28424ab-b996-464c-815c-26c1b26558ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:23.539190 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:25.000393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:25.999137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:31.502136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-f928b7e8-f706-4276-9da7-a52cb1fed890 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407169 Nov 05 15:20:31.584792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-d1be3130-255f-4b9d-a6f5-bf5be9c9c85f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:31.586245 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-d1be3130-255f-4b9d-a6f5-bf5be9c9c85f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1099 time: 0.0393398 Nov 05 15:20:31.690027 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-36cbd52c-4993-456c-affc-64affc006cf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:31.691476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-36cbd52c-4993-456c-affc-64affc006cf1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 898 time: 0.0863264 Nov 05 15:20:31.756077 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-a8c9b9ff-78d4-4d7b-86f6-e6989ab12bc7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 1001 time: 0.0568132 Nov 05 15:20:31.809265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-7b0a3085-c732-40f5-ac04-6ba167e86b01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:31.810665 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-7b0a3085-c732-40f5-ac04-6ba167e86b01 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0471575 Nov 05 15:20:31.855221 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-0731c2ad-b5e5-43aa-9648-601a27b45477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:31.856663 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-0731c2ad-b5e5-43aa-9648-601a27b45477 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385869 Nov 05 15:20:31.943193 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-6a9950b1-1ecf-4c90-8daf-a60ea20ea7a2 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788608 Nov 05 15:20:32.035293 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cea1c138-ea25-4363-a43c-a8d8c826dbcf req-d249f100-b287-4503-a4a5-74ad8c49d2f7 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846469 Nov 05 15:20:33.098415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3230c88c-082c-4a8a-a7d8-d2ab4f7abdc7 req-7c9b5d1d-1e6a-4a55-ba17-09b4ae3e1063 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:33.099915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3230c88c-082c-4a8a-a7d8-d2ab4f7abdc7 req-7c9b5d1d-1e6a-4a55-ba17-09b4ae3e1063 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0517087 Nov 05 15:20:33.149771 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3230c88c-082c-4a8a-a7d8-d2ab4f7abdc7 req-b5125aeb-c547-4ed6-b65c-1530625e15aa tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437896 Nov 05 15:20:34.265137 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce6b2752-6c8b-4638-995b-61293cf03f4e req-4eb2dae9-4c34-4f29-9e1c-afbf33f058d2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:34.266627 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce6b2752-6c8b-4638-995b-61293cf03f4e req-4eb2dae9-4c34-4f29-9e1c-afbf33f058d2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0494156 Nov 05 15:20:34.316857 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce6b2752-6c8b-4638-995b-61293cf03f4e req-3a2b6bd3-6abb-4d29-90c4-5afa751c6c28 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435350 Nov 05 15:20:35.437057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9cfb52-6dbb-4bfc-a289-1e8d4da063d2 req-a8bd6d63-26bd-4f56-a504-7c69253c9453 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:35.438546 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0d9cfb52-6dbb-4bfc-a289-1e8d4da063d2 req-a8bd6d63-26bd-4f56-a504-7c69253c9453 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0547163 Nov 05 15:20:35.491880 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0d9cfb52-6dbb-4bfc-a289-1e8d4da063d2 req-1ddedf33-e1e1-48cf-b544-4d9551b775fb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469415 Nov 05 15:20:36.603908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9828c3-abc6-4e54-a6be-242ed019e8d8 req-a68fe40b-db5a-4b88-99b9-aaed04a6e9c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:36.605309 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fb9828c3-abc6-4e54-a6be-242ed019e8d8 req-a68fe40b-db5a-4b88-99b9-aaed04a6e9c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0476999 Nov 05 15:20:36.653299 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-fb9828c3-abc6-4e54-a6be-242ed019e8d8 req-274801f0-05d5-4426-aa0c-0c733c4864c4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416493 Nov 05 15:20:37.766269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe3d357-499c-4ffa-81da-eb819fe30328 req-8778d42a-fe23-4fa0-800a-251d8b66462a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:37.767779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-efe3d357-499c-4ffa-81da-eb819fe30328 req-8778d42a-fe23-4fa0-800a-251d8b66462a tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0495102 Nov 05 15:20:37.816403 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-efe3d357-499c-4ffa-81da-eb819fe30328 req-195a7b33-0c91-4ab7-8e76-742f52a968d9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429156 Nov 05 15:20:38.932947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2739cfad-e984-4fb3-bc8b-d13881372e8d req-aa9a0092-c51a-4804-a1c3-62bfeb8c4984 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:38.934390 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2739cfad-e984-4fb3-bc8b-d13881372e8d req-aa9a0092-c51a-4804-a1c3-62bfeb8c4984 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0523450 Nov 05 15:20:38.981971 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2739cfad-e984-4fb3-bc8b-d13881372e8d req-35ae7698-5a78-427f-a38a-bfc5cfda140e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418189 Nov 05 15:20:40.097725 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ba9950-524c-43a1-bbdd-1f67c8c7c724 req-b01cd036-3915-4fe6-9e80-cc41fcdb3ce8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:40.099207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f1ba9950-524c-43a1-bbdd-1f67c8c7c724 req-b01cd036-3915-4fe6-9e80-cc41fcdb3ce8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0513918 Nov 05 15:20:40.152136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f1ba9950-524c-43a1-bbdd-1f67c8c7c724 req-538571f6-f7fe-4621-9bc1-13964ae3a47f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470846 Nov 05 15:20:41.264406 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9c639c-3343-4aae-b2b0-8a7bc46ac7ce req-c2ffb48a-ee94-4482-a31d-b9b11b4fa013 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:41.265899 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1f9c639c-3343-4aae-b2b0-8a7bc46ac7ce req-c2ffb48a-ee94-4482-a31d-b9b11b4fa013 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0484498 Nov 05 15:20:41.321149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1f9c639c-3343-4aae-b2b0-8a7bc46ac7ce req-31d7c720-7103-44fa-abeb-b5b15c0d1bcb tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494611 Nov 05 15:20:42.432275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda4dd02-1ee9-4a25-a6a7-8b4afd41f613 req-a5662806-1e36-4a10-a6b8-62624ed44cf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:42.433764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eda4dd02-1ee9-4a25-a6a7-8b4afd41f613 req-a5662806-1e36-4a10-a6b8-62624ed44cf6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0482724 Nov 05 15:20:42.486132 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-eda4dd02-1ee9-4a25-a6a7-8b4afd41f613 req-56fe97c4-efbb-424b-8a83-9a19dc3e7d84 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454462 Nov 05 15:20:43.603985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc23c7d-a516-4db5-bbcb-7bd64b8f48f8 req-45353da4-9c46-4720-97a7-1cfbc83d8c1f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:43.605553 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7bc23c7d-a516-4db5-bbcb-7bd64b8f48f8 req-45353da4-9c46-4720-97a7-1cfbc83d8c1f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0528214 Nov 05 15:20:43.653269 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7bc23c7d-a516-4db5-bbcb-7bd64b8f48f8 req-ff091df2-4c14-4d9b-8ce5-ad8ca817a65e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414345 Nov 05 15:20:44.770426 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1544237-1b96-4d16-95dc-fb03a7d73fca req-9e773195-1adc-483d-be7c-a017eb717f20 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:44.771908 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c1544237-1b96-4d16-95dc-fb03a7d73fca req-9e773195-1adc-483d-be7c-a017eb717f20 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0486848 Nov 05 15:20:44.821234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c1544237-1b96-4d16-95dc-fb03a7d73fca req-f4eaefdc-1644-4c7f-893b-ef2fa73d2cdf tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433724 Nov 05 15:20:45.937020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e1e2ac-2e26-495e-a141-68dec63f154f req-5ca3b1aa-d6cd-4009-94c0-192b40637263 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:45.938970 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-03e1e2ac-2e26-495e-a141-68dec63f154f req-5ca3b1aa-d6cd-4009-94c0-192b40637263 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0479643 Nov 05 15:20:45.986594 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-03e1e2ac-2e26-495e-a141-68dec63f154f req-98feced3-718e-4ad9-b0cf-cde9fc760be0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418344 Nov 05 15:20:47.103953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b3c8a02-1cfd-4a61-af76-28b6ff80c68c req-d3f94bc3-aa8d-4b65-a558-9f520df4e235 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:47.105421 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b3c8a02-1cfd-4a61-af76-28b6ff80c68c req-d3f94bc3-aa8d-4b65-a558-9f520df4e235 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0517654 Nov 05 15:20:47.153095 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0b3c8a02-1cfd-4a61-af76-28b6ff80c68c req-a630be7b-39dc-4d05-bef8-7ee38b1ff03b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413775 Nov 05 15:20:48.265121 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f47a3b-1b11-4148-8803-5d06b1c8169f req-ceec4a1f-64e4-4b21-95c1-9db7d4cc6dae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:48.266801 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48f47a3b-1b11-4148-8803-5d06b1c8169f req-ceec4a1f-64e4-4b21-95c1-9db7d4cc6dae tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0490789 Nov 05 15:20:48.321937 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48f47a3b-1b11-4148-8803-5d06b1c8169f req-baa8d7fa-ecac-4852-8efe-7e663f4d89a9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492432 Nov 05 15:20:48.523962 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:49.435347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d54db5ee-35d5-4a70-b036-3810114827af req-3703302d-796f-43e9-9d4d-29ddf7d7520d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:49.436867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d54db5ee-35d5-4a70-b036-3810114827af req-3703302d-796f-43e9-9d4d-29ddf7d7520d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0485461 Nov 05 15:20:49.486140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d54db5ee-35d5-4a70-b036-3810114827af req-3bd68df4-0571-4bf3-aaaf-161466ba6c79 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428207 Nov 05 15:20:49.508468 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51514) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:20:49.569816 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3897e919-f99d-4d8e-929f-710b036e3d48 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/2fd45bea-11c4-4e58-b3d9-d32555be099c HTTP/1.1" status: 200 len: 993 time: 0.0601494 Nov 05 15:20:50.137346 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5efd7faf-ad82-43c7-a10d-c25f365249d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:50.885272 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3049c4e4-e540-4339-b64d-738acb4ac38d req-b7dcb8f7-8189-4111-b1fc-69abf54818c0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:50.886849 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3049c4e4-e540-4339-b64d-738acb4ac38d req-b7dcb8f7-8189-4111-b1fc-69abf54818c0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0514772 Nov 05 15:20:50.898188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-4e34fe36-894b-46e3-9336-081f4d120abb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:50.899693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-4e34fe36-894b-46e3-9336-081f4d120abb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1099 time: 0.0473783 Nov 05 15:20:50.941068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3049c4e4-e540-4339-b64d-738acb4ac38d req-3885d290-c917-4201-be16-eb8f7ae11fd3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471644 Nov 05 15:20:50.990411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-492fa97b-9f8e-4e5c-845f-5511107f965c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:50.991874 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-492fa97b-9f8e-4e5c-845f-5511107f965c service neutron] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 898 time: 0.0856543 Nov 05 15:20:51.061339 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-02f828df-7602-4314-8b7e-dd10040e1743 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 1001 time: 0.0626357 Nov 05 15:20:51.108985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-365761e6-816a-4a89-b3ec-4be1763bb0a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:51.111419 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-365761e6-816a-4a89-b3ec-4be1763bb0a1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0436046 Nov 05 15:20:51.158277 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-9af7fb60-b7e6-4370-888b-99442b1de3e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:51.159812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-9af7fb60-b7e6-4370-888b-99442b1de3e9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0403230 Nov 05 15:20:51.251155 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-8a3e3b2c-274a-4d90-aa8b-3114ec25486b service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841534 Nov 05 15:20:51.339302 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6746be26-3e1b-4232-8dc3-0648d2c37db2 req-22c2226a-3678-4eb9-97c7-edbe39faf4bf service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811613 Nov 05 15:20:52.059518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b52a66-c345-447e-b4e4-e9eca33f7d27 req-63525626-ec96-4058-ada0-e7c3be6003ef tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:20:52.061020 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-73b52a66-c345-447e-b4e4-e9eca33f7d27 req-63525626-ec96-4058-ada0-e7c3be6003ef tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0501707 Nov 05 15:20:52.108343 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-73b52a66-c345-447e-b4e4-e9eca33f7d27 req-1480d621-14b6-4c35-bc82-4c34bd168657 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413113 Nov 05 15:20:52.131017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51524) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:20:52.194899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3cfc9843-022e-44b6-92fb-c7d05638de0e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/2fd45bea-11c4-4e58-b3d9-d32555be099c HTTP/1.1" status: 200 len: 993 time: 0.0626910 Nov 05 15:20:52.459597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9e961965-7003-432e-8110-aa975157505b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:53.541132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:55.000759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:56.001927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:20:58.530119 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:21:18.521502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:20.140547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0c28c2c0-0c7f-43df-b350-ba4856c000dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:22.460446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-96df01b1-5bc4-4c6f-bed6-d8c25a11b6e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:22.732138 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51540) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:22.882411 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b2c0c22b-fe42-4a23-9cd7-a0689087d479 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:21:22.882745 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:22.955227 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:22.955552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:22.966961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b2c0c22b-fe42-4a23-9cd7-a0689087d479 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:21:23.111995 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:23.137585 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b2c0c22b-fe42-4a23-9cd7-a0689087d479,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:23.164558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.164908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.165252 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.165586 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.165923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.166249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.166580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.166904 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.167228 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.167551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.167874 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.168196 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:23.208235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:23.208590 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP 2fd45bea-11c4-4e58-b3d9-d32555be099c disassociated (deleted). External IP: 172.26.5.46, port: 6874a502-1a14-42f7-ac76-ad1100d9c79f. Nov 05 15:21:23.418516 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:21:23.544200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:23.842385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:21:23.847186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:23.852967 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Sync routers for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:21:23.862758 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:23.863352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:23.873128 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-dbcada5f-f988-4454-9b1f-2af7c85c634c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/floatingips/2fd45bea-11c4-4e58-b3d9-d32555be099c HTTP/1.1" status: 204 len: 168 time: 1.1398916 Nov 05 15:21:23.873716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:21:23.876560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64c85578-0425-42f2-a740-c4e2dd4bf773" -d '{"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:21:23.914156 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:21:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-930201d9-ca08-4103-81c4-687871a5c982 x-openstack-request-id: req-930201d9-ca08-4103-81c4-687871a5c982 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:21:23.914515 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:21:23.914859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-930201d9-ca08-4103-81c4-687871a5c982 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:21:23.915384 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'status': 'completed', 'code': 200} Nov 05 15:21:23.974386 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:24.031757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-ff85c4f0-8fc5-40ce-b610-d0d8f57b8728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:24.033424 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-ff85c4f0-8fc5-40ce-b610-d0d8f57b8728 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 1099 time: 0.0942609 Nov 05 15:21:24.102511 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec2ed85-f202-41ca-9edd-349a52d1349a req-212f5006-0884-4958-9af9-f601e7cec3ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:24.103889 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7ec2ed85-f202-41ca-9edd-349a52d1349a req-212f5006-0884-4958-9af9-f601e7cec3ab tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0494425 Nov 05 15:21:24.133131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-1946359b-83c4-4e41-b3ee-efaa4b72925a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:24.134612 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-1946359b-83c4-4e41-b3ee-efaa4b72925a service neutron] 10.222.0.32 "GET /v2.0/networks?id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 200 len: 898 time: 0.0916975 Nov 05 15:21:24.155456 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7ec2ed85-f202-41ca-9edd-349a52d1349a req-02a1d078-79c8-4c74-b6aa-3a4b2cc309d8 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446951 Nov 05 15:21:24.182609 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-c8e91a9a-99d3-486f-a4b5-7f7569fa2181 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 200 len: 217 time: 0.0376134 Nov 05 15:21:24.204701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:24.232589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-6ba941d0-af2a-45d5-8a62-ba84d28cd00f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:24.233116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Checking router: d8dada49-9f4e-4a00-bdd2-7d51e0889af8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:21:24.234186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-6ba941d0-af2a-45d5-8a62-ba84d28cd00f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 200 len: 834 time: 0.0429094 Nov 05 15:21:24.241446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:24.242042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:24.285557 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-59175fe1-ed3e-4c89-953c-3a1a9c65c4a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:24.287306 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-59175fe1-ed3e-4c89-953c-3a1a9c65c4a8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c48775d7-1836-4fb6-8bbc-cbc0177b18bc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0448472 Nov 05 15:21:24.384597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-d1a45010-24ad-4d1c-92a1-772aa806d619 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891886 Nov 05 15:21:24.484207 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-64c85578-0425-42f2-a740-c4e2dd4bf773 req-a5135b0d-bd13-466e-873d-7f4f1b8215d0 service neutron] 10.222.0.32 "GET /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884101 Nov 05 15:21:24.493283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:24.684904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:24.710210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a8669d3-6935-49e5-90b9-40c05bcf79bf None None] The sync data for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:19:45Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a', 'name': '', 'network_id': 'c48775d7-1836-4fb6-8bbc-cbc0177b18bc', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:7c:72:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_interface', 'standard_attr_id': 1735, 'fixed_ips': [{'subnet_id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:45Z', 'updated_at': '2021-11-05T15:19:49Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:21:24.924483 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2142f25-e242-4b2f-bd1e-2edc5c38b28d None None] New status for floating IP 2fd45bea-11c4-4e58-b3d9-d32555be099c: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:21:25.003994 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:25.272037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b44cb3b-b9bd-4843-b969-74a40cbd1503 req-97321e65-29f1-4952-b1ad-d8f4898b0ffd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:25.273418 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6b44cb3b-b9bd-4843-b969-74a40cbd1503 req-97321e65-29f1-4952-b1ad-d8f4898b0ffd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0490568 Nov 05 15:21:25.321386 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6b44cb3b-b9bd-4843-b969-74a40cbd1503 req-5c2e6cb1-c743-4e08-8f16-ba5a987166f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422306 Nov 05 15:21:25.660748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-81a00b9c-1a2d-4f51-8a01-b8fb7c36b956 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:25.662693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-81a00b9c-1a2d-4f51-8a01-b8fb7c36b956 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 946 time: 0.0492747 Nov 05 15:21:25.752013 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 6874a502-1a14-42f7-ac76-ad1100d9c79f {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:21:25.752337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:25.836352 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 6874a502-1a14-42f7-ac76-ad1100d9c79f, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=6874a502-1a14-42f7-ac76-ad1100d9c79f,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:25.836730 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:25.849127 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 6874a502-1a14-42f7-ac76-ad1100d9c79f owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:21:25.978736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:26.007778 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:26.008422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=6874a502-1a14-42f7-ac76-ad1100d9c79f,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:26.020647 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.020999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.021338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.021670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.021998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.022326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.022652 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.022990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.023792 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.024126 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.024468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.024816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:26.062700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] No DVR routers for this DVR port 6874a502-1a14-42f7-ac76-ad1100d9c79f on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:21:26.065072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:26.068300 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b2172465-3808-4453-8e7b-34d875cb30b7 req-4cfea905-7fc0-4c16-a9b9-00c131d49519 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "DELETE /v2.0/ports/6874a502-1a14-42f7-ac76-ad1100d9c79f HTTP/1.1" status: 204 len: 173 time: 0.3995740 Nov 05 15:21:26.068769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'name': 'network-vif-deleted', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:21:26.070984 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78928727-f725-4850-836d-9bb156513766" -d '{"events": [{"server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "name": "network-vif-deleted", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:21:26.112637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f22e07a4-0189-475f-b10d-c158201f4a43 x-openstack-request-id: req-f22e07a4-0189-475f-b10d-c158201f4a43 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:21:26.113012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba", "name": "network-vif-deleted", "tag": "6874a502-1a14-42f7-ac76-ad1100d9c79f", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:21:26.113338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f22e07a4-0189-475f-b10d-c158201f4a43 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:21:26.113808 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6ecb36c-7cdd-4a74-8801-6e628bf2e0ba', 'name': 'network-vif-deleted', 'tag': '6874a502-1a14-42f7-ac76-ad1100d9c79f', 'status': 'completed', 'code': 200} Nov 05 15:21:26.438041 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-15f2bfc3-9e64-4f24-9553-69a1c0bd0954 req-83c8e365-a774-4834-8278-353f8001fbb5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=d6ecb36c-7cdd-4a74-8801-6e628bf2e0ba HTTP/1.1" status: 200 len: 210 time: 0.0278647 Nov 05 15:21:27.497140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51562) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:27.850621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:28.100912 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:21:28.101169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:28.188331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:28.188720 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:28.201352 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:21:28.391300 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:28.419902 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:28.590654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:28.808743 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:21:28.918110 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:21:28.926002 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-61623f77-d320-4034-a289-99d8d40fcbd0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/d8dada49-9f4e-4a00-bdd2-7d51e0889af8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4249518 Nov 05 15:21:28.926002 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51568) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:28.928825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Sync routers for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:21:28.939908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:28.940585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:28.976696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting subnet 13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:21:28.979625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.019610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.045447 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:29.105610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.163628 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.192266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Subnet': ['ID=13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:29.194270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.200018 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f8b85ed6-2cf5-48ef-b9af-34680910fad3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/subnets/13f3cf3c-5be9-447f-ad0a-c4b9ac6aaff3 HTTP/1.1" status: 204 len: 168 time: 0.2705581 Nov 05 15:21:29.200202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d329e46f-7865-414c-919f-74458d4265ae None None] Network c48775d7-1836-4fb6-8bbc-cbc0177b18bc requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:21:29.200314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51570) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:29.296937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:21:28Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:29.307782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.328177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Checking router: d8dada49-9f4e-4a00-bdd2-7d51e0889af8 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:21:29.337159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Routers {'d8dada49-9f4e-4a00-bdd2-7d51e0889af8'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:29.337772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:29.377279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] DHCP port deletion for c48775d7-1836-4fb6-8bbc-cbc0177b18bc request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:21:29.420737 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.474604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:21:29.474945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.483134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] Set router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:29.539505 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Deleting port 4d0ce79a-e16d-458f-aede-735079fbddca {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:21:29.539883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.557215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port ee4d6bca-f483-4f27-a681-a0fdaaa1dc74, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:29.557507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.569606 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:21:29.665520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] For port 4d0ce79a-e16d-458f-aede-735079fbddca, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=4d0ce79a-e16d-458f-aede-735079fbddca,segment=NetworkSegment(42fdf3de-6050-42c2-832d-316340121ea7),segment_id=42fdf3de-6050-42c2-832d-316340121ea7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:29.665927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.691442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Calling delete_port for 4d0ce79a-e16d-458f-aede-735079fbddca owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:21:29.732998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.758393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=ee4d6bca-f483-4f27-a681-a0fdaaa1dc74,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:29.807866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:21:28Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:29.819480 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.838199 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.840158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72c756e3-d036-462b-ac01-413dc8d72f49 None None] The sync data for ids ['d8dada49-9f4e-4a00-bdd2-7d51e0889af8'] in dv-neutron-816850-1-hyperv is: [{'id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1657268727', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43'}], 'enable_snat': True}, 'gw_port_id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:19:42Z', 'updated_at': '2021-11-05T15:21:28Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': 'ee4d6bca-f483-4f27-a681-a0fdaaa1dc74', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:99:ee:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8dada49-9f4e-4a00-bdd2-7d51e0889af8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1733, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:19:43Z', 'updated_at': '2021-11-05T15:19:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:21:29.868203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] No DVR routers for this DVR port 4d0ce79a-e16d-458f-aede-735079fbddca on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:21:29.872352 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Pushing event deleted for resources: {'Port': ['ID=4d0ce79a-e16d-458f-aede-735079fbddca,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:29.879970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.881150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.881500 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.886207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2cea0e93-8fa6-4934-9280-8497e0224c56 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:29.917163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.919343 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.961542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.962046 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Fanout notify agent at l3_agent the message router_deleted on router d8dada49-9f4e-4a00-bdd2-7d51e0889af8 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:21:29.969355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:29.970449 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5222a832-5487-493b-81c7-d032439c87f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/routers/d8dada49-9f4e-4a00-bdd2-7d51e0889af8 HTTP/1.1" status: 204 len: 168 time: 0.7693462 Nov 05 15:21:29.973263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51572) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:30.048686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.102203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6874a502-1a14-42f7-ac76-ad1100d9c79f no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:21:30.125577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 6874a502-1a14-42f7-ac76-ad1100d9c79f {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:21:30.125840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 6874a502-1a14-42f7-ac76-ad1100d9c79f not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:21:30.135928 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.156124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c48775d7-1836-4fb6-8bbc-cbc0177b18bc']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:30.165785 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '42fdf3de-6050-42c2-832d-316340121ea7') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:30.166090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '42fdf3de-6050-42c2-832d-316340121ea7') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:30.175769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.189725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.195908 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Releasing vlan 606 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:21:30.196318 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:21:30.199725 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:21:30.263160 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.270989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.274443 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/networks/c48775d7-1836-4fb6-8bbc-cbc0177b18bc HTTP/1.1" status: 204 len: 168 time: 0.3002603 Nov 05 15:21:30.277384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51574) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:30.291721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7c1bef-9a54-4c9e-881c-88dedb0f4d2e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Network': ['ID=c48775d7-1836-4fb6-8bbc-cbc0177b18bc,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:30.348808 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.376925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.442228 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.446441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.447654 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/security-groups/1a31e0b6-253c-47a7-b9b9-56c1205d1bf9 HTTP/1.1" status: 204 len: 168 time: 0.1686347 Nov 05 15:21:30.458095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d1dcfa-ad73-47c9-a855-ce4045ead253 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a31e0b6-253c-47a7-b9b9-56c1205d1bf9,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:30.471591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:21:30.509408 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:21:30.509952 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b7cf6ecd-4ff9-4a1d-9597-8e9dff3e1c7a not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:21:30.510546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4d0ce79a-e16d-458f-aede-735079fbddca no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:21:30.547473 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 4d0ce79a-e16d-458f-aede-735079fbddca {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:21:30.547891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 4d0ce79a-e16d-458f-aede-735079fbddca not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:21:30.678760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51580) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:30.683302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-36481693', 'description': 'tempest-secgroup-smoke-36481693 description', 'project_id': 'ef1d7839d356477e8151af4dc08baead'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:30.705143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.768891 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.772681 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.804943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.806136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1263704 Nov 05 15:21:30.807942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3e8020-aadb-4243-aa42-ce64fb423117 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bafcae2a-ab62-4d35-a884-2807e4582c5b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:30.809230 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51582) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:30.814348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:30.838869 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.893823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.897698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.918610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b625bce1-e56d-4161-bedc-0551d4c81380,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:30.926692 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:30.927936 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-417717ce-086d-4192-b474-e6efd0af49c9 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1176944 Nov 05 15:21:30.930573 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51584) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:30.934826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:30.960328 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.014943 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.019100 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.039241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1488af6-a2ac-4103-8f21-a6b7089e1e5b,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.045263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.047057 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-640c0238-700a-40d4-8353-680a3044a6b0 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1155655 Nov 05 15:21:31.049728 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51586) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.054401 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.079276 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.137178 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.140561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.158349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0fb4abcb-44bf-485a-9533-2daeaa67910e,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.163299 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.164499 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5b52a711-fb71-483b-a704-9f152f2e7b88 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1137393 Nov 05 15:21:31.167259 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51588) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.172286 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.197048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.253563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.257288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.275269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76bcd24c-6d67-48be-83a0-c4f72ac966d6,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.279564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.284344 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2d850820-ad61-4659-a950-a5835f6589f3 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1131804 Nov 05 15:21:31.284344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51590) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.288498 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.308834 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:21:31.313470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.370051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.374371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.391879 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11132a27-c2b4-4c12-9697-b9e0c06a66c2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.398855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.400009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-53e910f6-4564-4593-b8b8-ff583ff62f97 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1150227 Nov 05 15:21:31.402763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51592) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.407517 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'security_group_rule': {'security_group_id': 'bafcae2a-ab62-4d35-a884-2807e4582c5b', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.429006 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Project ef1d7839d356477e8151af4dc08baead added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:21:31.433635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.495040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.499386 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.517205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41ded4bd-3c0b-4741-8e7f-c6df7389975a,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.524742 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.525968 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8642eb76-f8ee-4c77-8b2d-a0e794cfa69c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1222746 Nov 05 15:21:31.528783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51594) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.534093 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'network': {'name': 'tempest-network-smoke--807755673', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'port_security_enabled': True}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.553130 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:21:31.556531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.579654 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 623} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:21:31.588981 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.589345 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Added segment 1724f052-d90e-4071-b667-e6c86d367ba9 of type vlan for network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 Nov 05 15:21:31.629531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.653700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.659170 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:31.659739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.719808 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1899555 Nov 05 15:21:31.722385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51596) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:31.726601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'admin_state_up': True, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:31.739501 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce553d0-012f-4173-9738-4a611cd262f1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Network': ['ID=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:31.750290 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:21:31.756923 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.757913 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:31.807563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.262668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.357588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:21:32.377302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:21:32.377644 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device ee4d6bca-f483-4f27-a681-a0fdaaa1dc74 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:21:32.451180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.469769 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.571899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.96 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/89563e0d-6644-4660-9c59-792528f8404c) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:21:32.672641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.708247 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:32.745159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:32.751030 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:32.754778 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:21:32.760291 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=89563e0d-6644-4660-9c59-792528f8404c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:32.998789 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.193738 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.318342 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 205c419c-ce1e-424f-80cb-21ec0eeaec43 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:21:33.422053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:21:33.431122 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Sync routers for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:21:33.441250 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:33.441432 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.441859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:33.445899 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51598) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:33.446419 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31c3df46-3adb-4b04-9dac-0110f3d96454 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.7227414 Nov 05 15:21:33.515397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bd801c8e-1725-487e-b611-48c4d43aa134 tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?project_id=ef1d7839d356477e8151af4dc08baead&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0676651 Nov 05 15:21:33.517980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51602) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:33.544866 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:33.601953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-698492d8-985a-445a-a5cb-bda392fe9b2f tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:33.603359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-698492d8-985a-445a-a5cb-bda392fe9b2f tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0843191 Nov 05 15:21:33.606083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51604) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:33.633112 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-56bbc62d-d855-4949-a927-4d09f11b8b2d tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/subnets?network_id=6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0259755 Nov 05 15:21:33.635521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51606) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:33.640731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-447586012', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:33.719486 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:32Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:33.730960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:21:33.734448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.748165 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Checking router: 205c419c-ce1e-424f-80cb-21ec0eeaec43 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:21:33.748525 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Updating router 205c419c-ce1e-424f-80cb-21ec0eeaec43 port 89563e0d-6644-4660-9c59-792528f8404c binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:21:33.772172 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.909549 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:33.969898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Subnet': ['ID=90055240-09d7-479b-8e48-29e4a8b4e18e,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:33.976905 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Checking segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:21:33.977260 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network hostable DHCP agents. Network: 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:21:33.993460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:21:34.002486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:34.006534 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:34.007120 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.012037 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.015687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37110355-0b71-4d2e-b28c-ee20157919fb None None] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:21:34.019534 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.027848 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2e1279cd-2ee7-4390-8ded-8567f01b35e5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.3912721 Nov 05 15:21:34.031935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51608) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:34.088673 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Pushing event updated for resources: {'Port': ['ID=89563e0d-6644-4660-9c59-792528f8404c,revision_number=2']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:34.091717 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Attempting to bind port 89563e0d-6644-4660-9c59-792528f8404c on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:21:34.092079 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Attempting to bind port 89563e0d-6644-4660-9c59-792528f8404c by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:21:34.092434 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Attempting to bind port 89563e0d-6644-4660-9c59-792528f8404c on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-37110355-0b71-4d2e-b28c-ee20157919fb None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:21:34.093461 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:21:34.101698 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.101698 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.101698 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.101698 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.101996 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.102653 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.102984 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.103312 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.103636 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.103953 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.104444 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.104788 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:21:34.105481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb18f8fb-dfc9-4389-9bd3-752d0486fd09 None None] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:21:34.111810 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 21, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:21:34.112169 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:21:34.112871 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.113412 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:21:34.114189 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Bound port: 89563e0d-6644-4660-9c59-792528f8404c, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:21:34.114850 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.171924 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] For port 89563e0d-6644-4660-9c59-792528f8404c, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:21:34.175155 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] For port 89563e0d-6644-4660-9c59-792528f8404c, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89563e0d-6644-4660-9c59-792528f8404c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-fb18f8fb-dfc9-4389-9bd3-752d0486fd09 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:21:34.179262 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:21:34.180948 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.193143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94ce3d38-873e-475c-80e5-eba756226e6b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:21:34.240695 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4771c3a9-c55e-4a16-a066-626b777f9672 None None] Pushing event updated for resources: {'Port': ['ID=89563e0d-6644-4660-9c59-792528f8404c,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:34.251325 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:34.251937 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:34.287700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94ce3d38-873e-475c-80e5-eba756226e6b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:21:34.366491 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:34.558708 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:32Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:34.589538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c88bd7c3-d613-4416-868c-7e0d71e10e32 None None] The sync data for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv is: [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:32Z', 'revision_number': 3, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:21:34.653446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:21:34.654643 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.797656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Allocated IP 172.20.0.2 (86cdc6fc-76d3-4c8d-a54b-7df8d7484f89/90055240-09d7-479b-8e48-29e4a8b4e18e/b92c3ccc-652f-481b-83b2-a74f7b4f6210) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:21:34.799262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.973825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:34.981890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.024708 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:35.027682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:35.033141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:21:35.036253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Pushing event updated for resources: {'Port': ['ID=b92c3ccc-652f-481b-83b2-a74f7b4f6210,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:35.094085 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Attempting to bind port b92c3ccc-652f-481b-83b2-a74f7b4f6210 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:21:35.094450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Attempting to bind port b92c3ccc-652f-481b-83b2-a74f7b4f6210 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:21:35.094815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Attempting to bind port b92c3ccc-652f-481b-83b2-a74f7b4f6210 on network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:21:35.099950 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 21, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:21:35.100318 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Checking segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:21:35.100877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.101272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Bound using segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:21:35.101738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Bound port: b92c3ccc-652f-481b-83b2-a74f7b4f6210, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:21:35.102113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.107412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.1 (86cdc6fc-76d3-4c8d-a54b-7df8d7484f89/90055240-09d7-479b-8e48-29e4a8b4e18e/0514b6ef-1442-440d-a521-7dd65f651c4b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:21:35.169646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] For port b92c3ccc-652f-481b-83b2-a74f7b4f6210, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:21:35.178611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] For port b92c3ccc-652f-481b-83b2-a74f7b4f6210, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b92c3ccc-652f-481b-83b2-a74f7b4f6210,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:21:35.184821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.233712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.254842 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478ed94e-ea0e-4a8f-801d-ee89eaf05593 None None] Pushing event updated for resources: {'Port': ['ID=b92c3ccc-652f-481b-83b2-a74f7b4f6210,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:35.272820 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.321200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:35.327000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:35.329539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:21:35.355946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:35.380921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.528663 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:21:35.551697 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.818511 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.823173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.897340 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:35.899797 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:35.995243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:35.996637 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:36.106093 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 205c419c-ce1e-424f-80cb-21ec0eeaec43 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:21:36.213242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:21:36.218271 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ba004624-cc0f-40f2-bda9-2e1eb1dba3d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/205c419c-ce1e-424f-80cb-21ec0eeaec43/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1853576 Nov 05 15:21:36.248055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Sync routers for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:21:36.258688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:36.259444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:36.371844 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-0bf4dd5c-d817-4c77-a578-c4e78a3bb9b4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-36481693&fields=id&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 267 time: 0.0499847 Nov 05 15:21:36.374901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:36.490008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b92c3ccc-652f-481b-83b2-a74f7b4f6210 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:36.490646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-b0a20a64-f5e3-472e-b261-23fa3376f003 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:36.492119 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-b0a20a64-f5e3-472e-b261-23fa3376f003 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/networks?id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 200 len: 796 time: 0.1113415 Nov 05 15:21:36.507908 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-63636dce-5dd0-489d-9386-90feec5a50f7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/quotas/ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 375 time: 0.0097506 Nov 05 15:21:36.562175 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-52ffe3ed-9c7c-4a1f-bfa8-bf74cc134dc7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0473950 Nov 05 15:21:36.593783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b92c3ccc-652f-481b-83b2-a74f7b4f6210 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:36.594069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:36.664030 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-c10a06dc-9d5d-44c8-b589-5e89010ab848 service neutron] 10.222.0.30 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879509 Nov 05 15:21:36.677035 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 2, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:36.706266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Checking router: 205c419c-ce1e-424f-80cb-21ec0eeaec43 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:21:36.706616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Updating router 205c419c-ce1e-424f-80cb-21ec0eeaec43 port 0514b6ef-1442-440d-a521-7dd65f651c4b binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:21:36.732220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:36.743537 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:36.753056 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-79ba701e-832e-4805-ad15-208055c7f4cf service neutron] 10.222.0.30 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829749 Nov 05 15:21:36.801680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port b92c3ccc-652f-481b-83b2-a74f7b4f6210, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b92c3ccc-652f-481b-83b2-a74f7b4f6210,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:36.811189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:36.812570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89563e0d-6644-4660-9c59-792528f8404c up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:36.937290 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ad3ecd10-d335-4c4f-b545-d642ba3daa2b req-05c868ad-4f62-43ac-b248-da64e1ef9027 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 210 time: 0.0343611 Nov 05 15:21:36.982680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=b92c3ccc-652f-481b-83b2-a74f7b4f6210,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:37.035603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 89563e0d-6644-4660-9c59-792528f8404c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:37.035980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.194417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.209788 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5760ba4f-7341-41f8-b0ba-d84064d42bcd None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:21:37.255138 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 89563e0d-6644-4660-9c59-792528f8404c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89563e0d-6644-4660-9c59-792528f8404c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:37.258489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.262606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.300072 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.365345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-8d171078-fedf-414b-ba28-a524f3dfa445 None None] Provisioning complete for port b92c3ccc-652f-481b-83b2-a74f7b4f6210 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:37.365628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8d171078-fedf-414b-ba28-a524f3dfa445 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.371292 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=89563e0d-6644-4660-9c59-792528f8404c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:37.423621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5760ba4f-7341-41f8-b0ba-d84064d42bcd None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:21:37.492353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-059f748c-089f-4b4e-8964-63b362d89df3 None None] Pushing event updated for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:37.521675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Attempting to bind port 0514b6ef-1442-440d-a521-7dd65f651c4b on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:21:37.522047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Attempting to bind port 0514b6ef-1442-440d-a521-7dd65f651c4b by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:21:37.522413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Attempting to bind port 0514b6ef-1442-440d-a521-7dd65f651c4b on network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:21:37.572901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 21, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:21:37.573275 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Checking segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:21:37.573679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.574091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Bound using segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:21:37.574544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Bound port: 0514b6ef-1442-440d-a521-7dd65f651c4b, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:21:37.574923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.859102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] For port 0514b6ef-1442-440d-a521-7dd65f651c4b, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:21:37.874664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] For port 0514b6ef-1442-440d-a521-7dd65f651c4b, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0514b6ef-1442-440d-a521-7dd65f651c4b,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:21:37.880700 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:37.912523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-dd93ef6b-7780-4f0f-8372-19bcc91c9796 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:37.914009 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-dd93ef6b-7780-4f0f-8372-19bcc91c9796 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/networks?id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 200 len: 796 time: 0.1162586 Nov 05 15:21:37.979858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-059f748c-089f-4b4e-8964-63b362d89df3 None None] Pushing event updated for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:37.985461 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:37.986104 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:37.992156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-53d1fcad-46a0-4b93-a949-7acbc06c6ce4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ef1d7839d356477e8151af4dc08baead HTTP/1.1" status: 200 len: 378 time: 0.0683501 Nov 05 15:21:38.002978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'port': {'device_id': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'admin_state_up': True, 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'security_groups': ['bafcae2a-ab62-4d35-a884-2807e4582c5b']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:38.078183 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f4d7727a-461f-4f39-acc5-f71731867d59 req-83733d1e-282d-46aa-b8ef-e9726a914750 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 210 time: 0.0594473 Nov 05 15:21:38.114534 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:38.150850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Made reservation on behalf of ef1d7839d356477e8151af4dc08baead for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:21:38.154749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.289657 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.20.0.8 (86cdc6fc-76d3-4c8d-a54b-7df8d7484f89/90055240-09d7-479b-8e48-29e4a8b4e18e/936e5cf2-d8c8-4551-bcd2-3e6b9be2db42) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:21:38.333637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:38.364919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3bc2ce-ca3f-4f3f-b2b9-42f9ddd058da None None] The sync data for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv is: [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:21:38.464276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b92c3ccc-652f-481b-83b2-a74f7b4f6210 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:38.477143 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.526117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.537668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port b92c3ccc-652f-481b-83b2-a74f7b4f6210 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:38.538128 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.578099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:38.579618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:38.582917 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:21:38.601925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:38.638406 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89563e0d-6644-4660-9c59-792528f8404c up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:38.677406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:38.678088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.705352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-1e9c173c-6117-4c65-9e72-dc665373600f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7064791 Nov 05 15:21:38.711140 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Provisioning complete for port b92c3ccc-652f-481b-83b2-a74f7b4f6210 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:38.711592 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.721241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Request body: {'port': {'device_id': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:38.770294 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 89563e0d-6644-4660-9c59-792528f8404c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:38.770673 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.787550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:38.899874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Provisioning complete for port 0514b6ef-1442-440d-a521-7dd65f651c4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:38.900244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.005239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.045598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] For port 0514b6ef-1442-440d-a521-7dd65f651c4b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0514b6ef-1442-440d-a521-7dd65f651c4b,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:39.052220 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.109257 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904bac1c-9763-4ae4-9655-da6ab39aab71 None None] Pushing event updated for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:39.128547 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:21:39.137095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.151237 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Transition to ACTIVE for port object 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:21:39.157299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.189556 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1847fdbe-70c6-49cd-a505-2184ed507efa None None] Provisioning complete for port 0514b6ef-1442-440d-a521-7dd65f651c4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:39.189941 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1847fdbe-70c6-49cd-a505-2184ed507efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.219488 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02dd81ae-2667-45e6-a358-e2ea30edf9e4 req-78d76d6c-67aa-442a-84df-0841a3a43865 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:39.222491 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02dd81ae-2667-45e6-a358-e2ea30edf9e4 req-78d76d6c-67aa-442a-84df-0841a3a43865 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 943 time: 0.0645216 Nov 05 15:21:39.252876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Pushing event updated for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:39.319069 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02dd81ae-2667-45e6-a358-e2ea30edf9e4 req-79bfa6d3-2a8d-4fbe-8cfa-08cf804fbbd4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0873141 Nov 05 15:21:39.364592 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Attempting to bind port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:21:39.365200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Attempting to bind port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:21:39.365533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Attempting to bind port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 on network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:21:39.370190 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 on network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:21:39.370521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Attempting to bind port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 on network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:21:39.376339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 21, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:21:39.376710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Checking segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:21:39.377090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Bound using segment: {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:21:39.377517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Bound port: 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1724f052-d90e-4071-b667-e6c86d367ba9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:21:39.377870 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.451005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:21:39.455486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:21:39.467177 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.506857 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:39.507488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.509144 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] 10.222.0.32 "PUT /v2.0/ports/936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 200 len: 1093 time: 0.7954113 Nov 05 15:21:39.509614 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:21:39.511893 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37517552-e5d9-4a34-b2f8-0c92082c2b02" -d '{"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:21:39.543750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbfd923-56e0-4712-84f7-eab002b83da1 service neutron] Pushing event updated for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:39.563700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:21:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5fcddbd2-29a7-4f16-bde6-4a351c8c970a x-openstack-request-id: req-5fcddbd2-29a7-4f16-bde6-4a351c8c970a {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:21:39.564050 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:21:39.564306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-5fcddbd2-29a7-4f16-bde6-4a351c8c970a {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:21:39.564737 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'status': 'completed', 'code': 200} Nov 05 15:21:39.691518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-3bde8abe-667d-4475-9ba1-2ae8ef459c69 None None] Provisioning complete for port 0514b6ef-1442-440d-a521-7dd65f651c4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:39.692141 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3bde8abe-667d-4475-9ba1-2ae8ef459c69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:39.719085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-988443c6-d0a0-4c0b-b66f-747f20105dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:39.721037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-988443c6-d0a0-4c0b-b66f-747f20105dfb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1096 time: 0.0510986 Nov 05 15:21:39.904654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-c3ea1e32-2572-4bab-ab98-77fc95faed34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:39.906794 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-c3ea1e32-2572-4bab-ab98-77fc95faed34 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=ef1d7839d356477e8151af4dc08baead&shared=False HTTP/1.1" status: 200 len: 897 time: 0.1780131 Nov 05 15:21:39.921181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bab45913-b81d-47d3-b042-87874ab65dcb None None] Provisioning complete for port 0514b6ef-1442-440d-a521-7dd65f651c4b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:39.921552 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bab45913-b81d-47d3-b042-87874ab65dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:40.082626 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-fd76cb09-e2fd-43b9-8e19-810bbefc0be9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:40.084229 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-37517552-e5d9-4a34-b2f8-0c92082c2b02 req-fd76cb09-e2fd-43b9-8e19-810bbefc0be9 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1700921 Nov 05 15:21:40.165532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-63753fb5-1135-4a8f-8951-4a55526fa0f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:40.167031 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-63753fb5-1135-4a8f-8951-4a55526fa0f1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1096 time: 0.0452120 Nov 05 15:21:40.207899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-b623d338-b7ad-4bad-ad36-79c578c3a965 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 200 len: 217 time: 0.0329137 Nov 05 15:21:40.256427 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-be406a2e-ea6d-4cad-af6a-47cd533bdabb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:40.257963 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-be406a2e-ea6d-4cad-af6a-47cd533bdabb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=90055240-09d7-479b-8e48-29e4a8b4e18e HTTP/1.1" status: 200 len: 834 time: 0.0433280 Nov 05 15:21:40.305448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-bb116d98-e855-454b-b4c3-111b18781419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:40.306875 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-bb116d98-e855-454b-b4c3-111b18781419 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0423865 Nov 05 15:21:40.407506 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-a34cf4b2-2977-4a6c-b7c0-bfa4d4d3464a service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0928984 Nov 05 15:21:40.427656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0514b6ef-1442-440d-a521-7dd65f651c4b up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:40.449060 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de175b6-1e1f-4763-a7f6-74d3692fdd74 req-548ec69b-1825-41f2-9e44-1e8fc6b0a2e7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:40.450722 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3de175b6-1e1f-4763-a7f6-74d3692fdd74 req-548ec69b-1825-41f2-9e44-1e8fc6b0a2e7 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 943 time: 0.0591867 Nov 05 15:21:40.483891 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0514b6ef-1442-440d-a521-7dd65f651c4b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:40.484286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:40.511146 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3de175b6-1e1f-4763-a7f6-74d3692fdd74 req-1374d413-851f-4086-9db9-7f2f7b3fa363 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0489225 Nov 05 15:21:40.513358 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1ab496ca-06ae-4d29-9cb6-3f1e5a03879c req-217f4882-f4a3-4f54-a5df-f8676699a081 service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991418 Nov 05 15:21:41.630337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7939e248-a319-46e3-9247-d39effa82483 req-ebbdb8ed-2e79-4cbd-83af-df8933c9a05f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:41.631788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7939e248-a319-46e3-9247-d39effa82483 req-ebbdb8ed-2e79-4cbd-83af-df8933c9a05f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 943 time: 0.0521500 Nov 05 15:21:41.679799 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7939e248-a319-46e3-9247-d39effa82483 req-e6494d0b-6dc9-4552-aef0-2b1bea5befa6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421188 Nov 05 15:21:42.791788 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b1faef1-6ac9-4127-b144-33d97d6cf2fc req-3fa53076-822e-4141-9238-437c95bac34e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:42.793284 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9b1faef1-6ac9-4127-b144-33d97d6cf2fc req-3fa53076-822e-4141-9238-437c95bac34e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 943 time: 0.0487695 Nov 05 15:21:42.844771 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9b1faef1-6ac9-4127-b144-33d97d6cf2fc req-ecf21b7a-a431-44a8-ae43-5fb2e87e6b1e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0449555 Nov 05 15:21:43.955397 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4106a327-ac11-4d73-b88f-75c259094686 req-2e27c78d-36b5-4ef8-90bb-0994cbd0d5f2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:43.956961 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4106a327-ac11-4d73-b88f-75c259094686 req-2e27c78d-36b5-4ef8-90bb-0994cbd0d5f2 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 943 time: 0.0477977 Nov 05 15:21:44.007951 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4106a327-ac11-4d73-b88f-75c259094686 req-54ff3a7d-b852-42d3-a2cb-a2271dff7f65 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451488 Nov 05 15:21:44.117654 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:21:44.211298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:44.222800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'port_id': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'mac_address': 'fa:16:3e:7e:79:61', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 623, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:21:44.258728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:44.271873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:21:44.291091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:44.294642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:44.339233 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:44.502664 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:21:45.120974 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cade9bb5-583b-4593-99d1-22e63faf14a1 req-bb77d060-f35a-491c-98c8-f3d3a74a6058 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:45.122428 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cade9bb5-583b-4593-99d1-22e63faf14a1 req-bb77d060-f35a-491c-98c8-f3d3a74a6058 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 944 time: 0.0485137 Nov 05 15:21:45.174591 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cade9bb5-583b-4593-99d1-22e63faf14a1 req-4e1f4044-5a3a-47b9-bcdb-25843149e181 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0463405 Nov 05 15:21:46.131374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:21:46.181283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:21:46.185504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:21:46.186384 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:46.263340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:46.286821 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:21:46.289176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1fd090e-8300-475d-8355-d4b8a2314ae7" -d '{"events": [{"server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "name": "network-vif-plugged", "status": "completed", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:21:46.290882 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfe57da-d30d-4cee-a535-f802d6a28b15 req-0c6ae20a-9748-4f8a-96c3-0eb7a7cf5677 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:46.292384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7cfe57da-d30d-4cee-a535-f802d6a28b15 req-0c6ae20a-9748-4f8a-96c3-0eb7a7cf5677 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 944 time: 0.0485623 Nov 05 15:21:46.302288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:21:46.307340 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:46.333095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:21:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e422f50f-a231-4e1f-8ee7-4f835bc65dc3 x-openstack-request-id: req-e422f50f-a231-4e1f-8ee7-4f835bc65dc3 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:21:46.333399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "name": "network-vif-plugged", "status": "completed", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:21:46.333651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e422f50f-a231-4e1f-8ee7-4f835bc65dc3 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:21:46.334038 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'code': 200} Nov 05 15:21:46.346768 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7cfe57da-d30d-4cee-a535-f802d6a28b15 req-1f5cde92-6b10-4d30-bdf8-575c7c164ad1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0470836 Nov 05 15:21:46.361412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:46.498135 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810f4e9c-9aa0-43cd-9188-b400bd96e662 req-5a67ce63-9932-45df-9634-9d3191ee37b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:46.500249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-810f4e9c-9aa0-43cd-9188-b400bd96e662 req-5a67ce63-9932-45df-9634-9d3191ee37b1 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1098 time: 0.0394065 Nov 05 15:21:46.546545 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-810f4e9c-9aa0-43cd-9188-b400bd96e662 req-01946767-a9d7-448e-9ed2-ed05674c7f30 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387528 Nov 05 15:21:47.468437 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-084b3a33-dd71-4f98-b351-8a14c66e1d91 req-9079aace-784e-4ef6-af82-2129130cd909 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:47.469994 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-084b3a33-dd71-4f98-b351-8a14c66e1d91 req-9079aace-784e-4ef6-af82-2129130cd909 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0516374 Nov 05 15:21:47.523359 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-084b3a33-dd71-4f98-b351-8a14c66e1d91 req-b4f67707-d22d-44f2-97c0-2b12cd5f94a4 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0468943 Nov 05 15:21:48.534184 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:48.641793 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b623475-42c9-46fa-a1dd-cb30d7dd5d75 req-f68f52ae-bef0-4015-9d94-7927ec040b6d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:48.643272 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6b623475-42c9-46fa-a1dd-cb30d7dd5d75 req-f68f52ae-bef0-4015-9d94-7927ec040b6d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0522933 Nov 05 15:21:48.691252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6b623475-42c9-46fa-a1dd-cb30d7dd5d75 req-9ea81004-71b3-4762-a353-4f8b330ed2ec tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421607 Nov 05 15:21:48.803399 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d61fcc-dfbd-49cb-81b5-7f5de032522b req-bff40b97-83ee-4579-b5ff-796d8f421d38 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:48.804911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-53d61fcc-dfbd-49cb-81b5-7f5de032522b req-bff40b97-83ee-4579-b5ff-796d8f421d38 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0493603 Nov 05 15:21:48.853655 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-53d61fcc-dfbd-49cb-81b5-7f5de032522b req-44178025-3092-43a0-92ea-740c7a0cdd40 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429308 Nov 05 15:21:48.875096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51666) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:48.913108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-052df49a-2be7-4ed0-904f-4e583076e75b tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:48.914546 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-052df49a-2be7-4ed0-904f-4e583076e75b tempest-TestNetworkAdvancedServerOps-1434905825 tempest-TestNetworkAdvancedServerOps-1434905825-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1093 time: 0.0385008 Nov 05 15:21:48.917336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51668) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:48.921504 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address': '172.20.0.8'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:21:48.941990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:49.329604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:49.425403 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Allocated IP 172.26.5.150 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:21:49.525755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:49.558349 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:49.593546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:21:49.596243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:21:49.601527 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:21:49.624084 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:49.947392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.015097 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.143240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d7ffc003-5101-4ff2-a219-e85320d65416 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.166295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.173218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.251559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event updated for resources: {'Port': ['ID=b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:21:50.269868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.367061 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP cbd8612f-c887-46b8-85e6-8234f5de9f21 associated. External IP: 172.26.5.150, port: 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42. Nov 05 15:21:50.586056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 205c419c-ce1e-424f-80cb-21ec0eeaec43 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:21:50.697113 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:21:50.706486 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Sync routers for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:21:50.714604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:50.716575 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:50.717667 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:50.742205 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dfa26891-736c-49f7-b868-2ca17e2728d5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8238850 Nov 05 15:21:50.743042 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:21:50.745623 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac" -d '{"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:21:50.793402 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:21:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a7c276f-4a73-4ff4-a73c-c58aca192d45 x-openstack-request-id: req-9a7c276f-4a73-4ff4-a73c-c58aca192d45 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:21:50.793700 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:21:50.793960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9a7c276f-4a73-4ff4-a73c-c58aca192d45 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:21:50.794383 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'status': 'completed', 'code': 200} Nov 05 15:21:50.854285 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:50.877753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-1bb478d0-5dc5-4c56-8061-add62253459d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:50.879470 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-1bb478d0-5dc5-4c56-8061-add62253459d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1098 time: 0.0601015 Nov 05 15:21:51.007422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-773d259e-3c2c-43dc-9470-d65c11a6df70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:51.009034 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-773d259e-3c2c-43dc-9470-d65c11a6df70 service neutron] 10.222.0.32 "GET /v2.0/networks?id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 200 len: 897 time: 0.1212080 Nov 05 15:21:51.103020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa703d2-338b-44ef-a715-97108551a75e req-4813c4e7-fae1-4c67-843a-27ffd27ab7a1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:51.104450 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fa703d2-338b-44ef-a715-97108551a75e req-4813c4e7-fae1-4c67-843a-27ffd27ab7a1 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.1112907 Nov 05 15:21:51.106621 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-9ebfbb5c-552f-4810-a13c-48cec4af4ca2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 200 len: 999 time: 0.0832362 Nov 05 15:21:51.188395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-0c746e95-bae8-4fc2-82b9-fbd818117d01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:51.188908 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'cbd8612f-c887-46b8-85e6-8234f5de9f21', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'port_id': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1758, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'mac_address': 'fa:16:3e:7e:79:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:21:49Z', 'updated_at': '2021-11-05T15:21:49Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:51.189914 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-0c746e95-bae8-4fc2-82b9-fbd818117d01 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=90055240-09d7-479b-8e48-29e4a8b4e18e HTTP/1.1" status: 200 len: 834 time: 0.0731633 Nov 05 15:21:51.193916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fa703d2-338b-44ef-a715-97108551a75e req-f566cd50-a61b-454e-bd23-41a9fa1dfab5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0830219 Nov 05 15:21:51.219410 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51674) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:51.222523 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Checking router: 205c419c-ce1e-424f-80cb-21ec0eeaec43 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:21:51.232859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:21:51.233605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:21:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:51.260060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-75e9a07f-255b-47ec-b63c-790efd2ff5f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:21:51.262120 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-75e9a07f-255b-47ec-b63c-790efd2ff5f0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0658212 Nov 05 15:21:51.299128 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ecf12f7a-8eed-4bef-a995-bf7a2a9ddcef tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/cbd8612f-c887-46b8-85e6-8234f5de9f21 HTTP/1.1" status: 200 len: 991 time: 0.0778241 Nov 05 15:21:51.339997 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:21:51.358294 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-c9518830-158b-4c49-8bb9-11ab0f13578f service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893426 Nov 05 15:21:51.457982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10528d7c-b478-4607-a8cb-d0d04ea5d8ac req-95f4583a-135e-4615-b9a0-05870c4b4fc7 service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923378 Nov 05 15:21:51.576336 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'cbd8612f-c887-46b8-85e6-8234f5de9f21', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'port_id': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1758, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'mac_address': 'fa:16:3e:7e:79:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:21:49Z', 'updated_at': '2021-11-05T15:21:49Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:21:51.605322 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05057246-9abc-4b19-a71f-765ee02011a4 None None] The sync data for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv is: [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'cbd8612f-c887-46b8-85e6-8234f5de9f21', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'floating_ip_address': '172.26.5.150', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'port_id': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1758, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'mac_address': 'fa:16:3e:7e:79:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:21:49Z', 'updated_at': '2021-11-05T15:21:49Z', 'revision_number': 0, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:21:51.790753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7456c0d8-ca36-4492-b881-898da7c3f4b7 None None] New status for floating IP cbd8612f-c887-46b8-85e6-8234f5de9f21: ACTIVE {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:21:52.301477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51676) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:21:52.361225 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8dd467e5-a82e-42d7-a0d6-44130e709753 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/cbd8612f-c887-46b8-85e6-8234f5de9f21 HTTP/1.1" status: 200 len: 993 time: 0.0587018 Nov 05 15:21:52.461153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e8f08166-3ad0-4115-9443-7cf7b6f37c2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:53.548131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:55.011206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:21:56.009547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:12.527316 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:22:18.534835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:20.146293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-35d175ff-294c-41ae-928f-3f1691096821 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:22.462602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db5988b9-0a59-46f1-9629-72b52af40c0b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:23.551087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:23.750103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7744c58-1bf0-4b94-b0c1-b3d32fa00530 req-7e2f8b4b-4a8d-483b-8857-26e3986ffd55 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:23.751570 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7744c58-1bf0-4b94-b0c1-b3d32fa00530 req-7e2f8b4b-4a8d-483b-8857-26e3986ffd55 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0502789 Nov 05 15:22:23.800725 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7744c58-1bf0-4b94-b0c1-b3d32fa00530 req-6accb26a-d2d2-4253-8987-4c8f5f1678a5 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431581 Nov 05 15:22:24.918429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efa36ff-41eb-46c3-83ab-c112d0a984ce req-b63db63a-0a31-4001-af19-20b6f9bcf38e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:24.920478 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5efa36ff-41eb-46c3-83ab-c112d0a984ce req-b63db63a-0a31-4001-af19-20b6f9bcf38e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0509274 Nov 05 15:22:24.968021 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5efa36ff-41eb-46c3-83ab-c112d0a984ce req-7aec7d24-584d-4ca6-91f8-119af4931f03 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0416777 Nov 05 15:22:24.990209 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51694) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:25.009176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:25.050745 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d15201ef-f57d-4d8b-b331-23b3fab09c8b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/cbd8612f-c887-46b8-85e6-8234f5de9f21 HTTP/1.1" status: 200 len: 993 time: 0.0594268 Nov 05 15:22:26.011725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:26.335566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48532cf8-d215-47d1-8c60-4ce16cbe868d req-2218c064-e70a-48ec-92b2-8c98bf148c47 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:26.337094 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48532cf8-d215-47d1-8c60-4ce16cbe868d req-2218c064-e70a-48ec-92b2-8c98bf148c47 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0500088 Nov 05 15:22:26.351372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-cbfd1cbc-0349-409d-b495-75c317817107 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:26.352976 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-cbfd1cbc-0349-409d-b495-75c317817107 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1098 time: 0.0453486 Nov 05 15:22:26.391704 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48532cf8-d215-47d1-8c60-4ce16cbe868d req-d005bc88-a12c-458f-8e37-baff23b82385 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0479264 Nov 05 15:22:26.442784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-c0d1fd0e-798f-4163-b095-22f9cc1ff4e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:26.444262 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-c0d1fd0e-798f-4163-b095-22f9cc1ff4e0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 200 len: 897 time: 0.0843353 Nov 05 15:22:26.512106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-e13d2ebe-bffb-4cfe-958b-545a052641b0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 200 len: 1001 time: 0.0611124 Nov 05 15:22:26.561251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-003916d6-f67f-4581-a246-627cc5d3f63f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:26.562668 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-003916d6-f67f-4581-a246-627cc5d3f63f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=90055240-09d7-479b-8e48-29e4a8b4e18e HTTP/1.1" status: 200 len: 834 time: 0.0430863 Nov 05 15:22:26.607074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-9692aec8-4b5b-45e8-8271-30dfbc3c4cda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:26.608434 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-9692aec8-4b5b-45e8-8271-30dfbc3c4cda service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388212 Nov 05 15:22:26.701028 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-f2b96089-1d9e-43fc-b99d-fd2a8782d0f0 service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843985 Nov 05 15:22:26.787778 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-d8356a6b-8128-4ae5-8cf3-5a07ed7dc287 req-31d0cfb6-87f9-4bcd-b522-3c21d338d0de service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798953 Nov 05 15:22:27.509220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2945557b-02ff-4891-92ed-22888fde10ff req-3c71033a-7841-4210-a3d5-95f4f384d8bd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:27.510764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2945557b-02ff-4891-92ed-22888fde10ff req-3c71033a-7841-4210-a3d5-95f4f384d8bd tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0494668 Nov 05 15:22:27.570458 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2945557b-02ff-4891-92ed-22888fde10ff req-27fb7417-842e-4cd6-abbd-317324590b12 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0522683 Nov 05 15:22:28.686005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0433788-fbab-4413-b7ea-103f26cd27d2 req-6af8e08f-8ae5-4cfd-947b-667bb0521f13 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:28.687504 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d0433788-fbab-4413-b7ea-103f26cd27d2 req-6af8e08f-8ae5-4cfd-947b-667bb0521f13 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0504589 Nov 05 15:22:28.735711 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-d0433788-fbab-4413-b7ea-103f26cd27d2 req-e67724f9-8d5f-4b3b-b0b7-f9abad157934 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423038 Nov 05 15:22:28.757856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51706) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:28.815884 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8be35978-126a-4bec-92b0-aec096cf874e tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/floatingips/cbd8612f-c887-46b8-85e6-8234f5de9f21 HTTP/1.1" status: 200 len: 993 time: 0.0569100 Nov 05 15:22:29.060017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51712) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:29.211484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:22:29.211812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.282299 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.282620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.294444 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0 owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:22:29.436133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.462108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=b02a0c1c-7f9a-4630-bf1c-b632deb9bfa0,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:29.486070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.486414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.486755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.487090 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.487419 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.487741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.488096 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.488392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.488825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.489189 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.489553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.489890 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:29.533034 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.533352 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Floating IP cbd8612f-c887-46b8-85e6-8234f5de9f21 disassociated (deleted). External IP: 172.26.5.150, port: 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42. Nov 05 15:22:29.731603 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 205c419c-ce1e-424f-80cb-21ec0eeaec43 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:22:29.834696 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:29.839500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:29.844682 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Sync routers for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:29.853713 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:29.854295 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:29.868691 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-ff0ff139-9634-4805-ac9b-13cb0ba64593 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/floatingips/cbd8612f-c887-46b8-85e6-8234f5de9f21 HTTP/1.1" status: 204 len: 168 time: 0.8072448 Nov 05 15:22:29.869275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:22:29.871566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8" -d '{"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:22:29.909897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:22:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c22345e-9140-4bdc-a60b-34fa5b14ffd4 x-openstack-request-id: req-0c22345e-9140-4bdc-a60b-34fa5b14ffd4 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:22:29.910205 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:22:29.910929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-0c22345e-9140-4bdc-a60b-34fa5b14ffd4 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:22:29.911184 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'status': 'completed', 'code': 200} Nov 05 15:22:29.961892 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:29.974737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-b1145336-e023-4d4e-a790-e4c5c6170404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:29.976405 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-b1145336-e023-4d4e-a790-e4c5c6170404 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=ef1d7839d356477e8151af4dc08baead&device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 1098 time: 0.0440474 Nov 05 15:22:30.088035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-1a92cbff-a39d-4a29-ab93-6da8d5769622 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:30.089722 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-1a92cbff-a39d-4a29-ab93-6da8d5769622 service neutron] 10.222.0.32 "GET /v2.0/networks?id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 200 len: 897 time: 0.1041832 Nov 05 15:22:30.149397 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-8fff435a-f3a6-4e4d-be8f-0f7c353d9ac0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 200 len: 217 time: 0.0414321 Nov 05 15:22:30.163070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b0875f-708a-46fe-9552-53daec0043c8 req-ef81bec0-7c45-47b7-8e59-861f8a0754f6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:30.164575 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-74b0875f-708a-46fe-9552-53daec0043c8 req-ef81bec0-7c45-47b7-8e59-861f8a0754f6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0904584 Nov 05 15:22:30.179820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:30.205220 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Checking router: 205c419c-ce1e-424f-80cb-21ec0eeaec43 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:30.213005 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:30.213591 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:30.229946 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-4fa78fd8-32fa-45fa-a4b8-a43db88ea85c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:30.231489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-4fa78fd8-32fa-45fa-a4b8-a43db88ea85c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=90055240-09d7-479b-8e48-29e4a8b4e18e HTTP/1.1" status: 200 len: 834 time: 0.0660667 Nov 05 15:22:30.256957 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-74b0875f-708a-46fe-9552-53daec0043c8 req-4553afa1-8d5e-46fb-a597-6d478c97562f tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0825486 Nov 05 15:22:30.291271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-7ac88b73-e36a-417e-ae1b-a8f41274a4b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:30.293265 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-7ac88b73-e36a-417e-ae1b-a8f41274a4b6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0501850 Nov 05 15:22:30.318293 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:30.386360 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-40cbe0f6-bc2b-4488-a79e-dbea6fd4d2e7 service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840666 Nov 05 15:22:30.479125 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-76b0515a-bf9f-4ead-a518-ed7caf1b0bf8 req-df7c9531-70c5-489d-b4d7-bc311a76736d service neutron] 10.222.0.32 "GET /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836542 Nov 05 15:22:30.511561 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:30.628224 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9adeee22-2851-4980-898d-43296fc5a442 None None] The sync data for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv is: [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:21:35Z', 'revision_number': 4, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '0514b6ef-1442-440d-a521-7dd65f651c4b', 'name': '', 'network_id': '86cdc6fc-76d3-4c8d-a54b-7df8d7484f89', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'mac_address': 'fa:16:3e:0b:88:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_interface', 'standard_attr_id': 1755, 'fixed_ips': [{'subnet_id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:34Z', 'updated_at': '2021-11-05T15:21:39Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'subnets': [{'id': '90055240-09d7-479b-8e48-29e4a8b4e18e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:30.832160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fbe29d9-a57a-429c-b8bd-02da280233aa None None] New status for floating IP cbd8612f-c887-46b8-85e6-8234f5de9f21: DOWN {{(pid=113582) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:22:31.379823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330692be-b310-4ce4-8703-e2e09288ce8f req-806ed243-db91-426f-ac4f-5c2524e34a60 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:31.381305 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-330692be-b310-4ce4-8703-e2e09288ce8f req-806ed243-db91-426f-ac4f-5c2524e34a60 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0517125 Nov 05 15:22:31.430527 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-330692be-b310-4ce4-8703-e2e09288ce8f req-418fd9ba-3618-41e1-8693-8b0cb7531471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/security-groups?id=bafcae2a-ab62-4d35-a884-2807e4582c5b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0433342 Nov 05 15:22:31.641438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-eeb8fa48-0f0f-492e-bbd6-e4f87004fcca tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:31.642771 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-eeb8fa48-0f0f-492e-bbd6-e4f87004fcca tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 945 time: 0.0476899 Nov 05 15:22:31.730187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:22:31.730518 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:31.818226 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:31.818584 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:31.831248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:22:31.958594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:31.992532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=936e5cf2-d8c8-4551-bcd2-3e6b9be2db42,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:32.026441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] No DVR routers for this DVR port 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:22:32.029436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:32.032981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-44b85075-1d75-4605-821e-c5c0a07ba6f8 req-236f4a0f-5f23-4c85-b654-b12fb6045479 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.32 "DELETE /v2.0/ports/936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 HTTP/1.1" status: 204 len: 173 time: 0.3840885 Nov 05 15:22:32.033442 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'name': 'network-vif-deleted', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:22:32.036958 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-414657c7-872a-4859-96a3-bbca5b068ac4" -d '{"events": [{"server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "name": "network-vif-deleted", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:22:32.074239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:22:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f03c456-80c1-4bd1-8a78-8bcd57a910e9 x-openstack-request-id: req-9f03c456-80c1-4bd1-8a78-8bcd57a910e9 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:22:32.074530 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4925f140-5876-4a6f-ac5d-1b70470a96b0", "name": "network-vif-deleted", "tag": "936e5cf2-d8c8-4551-bcd2-3e6b9be2db42", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:22:32.074816 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9f03c456-80c1-4bd1-8a78-8bcd57a910e9 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:22:32.075215 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4925f140-5876-4a6f-ac5d-1b70470a96b0', 'name': 'network-vif-deleted', 'tag': '936e5cf2-d8c8-4551-bcd2-3e6b9be2db42', 'status': 'completed', 'code': 200} Nov 05 15:22:32.542351 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b49c10af-765a-4252-8068-013a6e44f83b req-609b11d6-a03c-4d8c-acdc-47ac5025bb1c tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "GET /v2.0/ports?device_id=4925f140-5876-4a6f-ac5d-1b70470a96b0 HTTP/1.1" status: 200 len: 210 time: 0.0275657 Nov 05 15:22:33.597129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51728) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:34.256536 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:34.501671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 0514b6ef-1442-440d-a521-7dd65f651c4b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:22:34.502005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:34.586466 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 0514b6ef-1442-440d-a521-7dd65f651c4b, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0514b6ef-1442-440d-a521-7dd65f651c4b,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:34.586742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:34.599506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 0514b6ef-1442-440d-a521-7dd65f651c4b owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:22:34.774559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:34.804715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=0514b6ef-1442-440d-a521-7dd65f651c4b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:34.962904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.175046 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Router 205c419c-ce1e-424f-80cb-21ec0eeaec43 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:22:35.283772 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:35.289136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8c8d2e9f-3bb3-4a04-a0eb-067a036ec89d tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "PUT /v2.0/routers/205c419c-ce1e-424f-80cb-21ec0eeaec43/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6910100 Nov 05 15:22:35.291888 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51730) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:35.294927 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Sync routers for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:35.305298 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:35.305885 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:35.341911 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting subnet 90055240-09d7-479b-8e48-29e4a8b4e18e {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:22:35.344943 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.383375 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.414118 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:35.473539 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.533078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.560825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Subnet': ['ID=90055240-09d7-479b-8e48-29e4a8b4e18e,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:35.562760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.565948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cde5e310-1b46-4606-a271-ea486209c008 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/subnets/90055240-09d7-479b-8e48-29e4a8b4e18e HTTP/1.1" status: 204 len: 168 time: 0.2731085 Nov 05 15:22:35.568541 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51732) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:35.568855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7e1f71e-2e01-4fc2-817e-c25239890886 None None] Network 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:22:35.596820 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:22:34Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:35.629076 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Checking router: 205c419c-ce1e-424f-80cb-21ec0eeaec43 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:35.638812 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Routers {'205c419c-ce1e-424f-80cb-21ec0eeaec43'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:35.639538 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['205c419c-ce1e-424f-80cb-21ec0eeaec43'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:35.678391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.739887 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] DHCP port deletion for 86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:22:35.750128 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] Set router 205c419c-ce1e-424f-80cb-21ec0eeaec43 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:35.788068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.793877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Deleting port b92c3ccc-652f-481b-83b2-a74f7b4f6210 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:22:35.794254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.845599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Deleting port 89563e0d-6644-4660-9c59-792528f8404c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:22:35.845969 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.933335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] For port 89563e0d-6644-4660-9c59-792528f8404c, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=89563e0d-6644-4660-9c59-792528f8404c,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:35.933912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:35.937900 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:22:34Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:35.948436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Calling delete_port for 89563e0d-6644-4660-9c59-792528f8404c owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:22:35.964382 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66969b1-91c6-41fc-9cad-bfc5312e96e5 None None] The sync data for ids ['205c419c-ce1e-424f-80cb-21ec0eeaec43'] in dv-neutron-816850-1-hyperv is: [{'id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1441206168', 'tenant_id': 'ef1d7839d356477e8151af4dc08baead', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96'}], 'enable_snat': True}, 'gw_port_id': '89563e0d-6644-4660-9c59-792528f8404c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:21:31Z', 'updated_at': '2021-11-05T15:22:34Z', 'revision_number': 5, 'project_id': 'ef1d7839d356477e8151af4dc08baead', 'gw_port': {'id': '89563e0d-6644-4660-9c59-792528f8404c', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:33:c8:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '205c419c-ce1e-424f-80cb-21ec0eeaec43', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1752, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:21:32Z', 'updated_at': '2021-11-05T15:21:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:36.014326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] For port b92c3ccc-652f-481b-83b2-a74f7b4f6210, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=b92c3ccc-652f-481b-83b2-a74f7b4f6210,segment=NetworkSegment(1724f052-d90e-4071-b667-e6c86d367ba9),segment_id=1724f052-d90e-4071-b667-e6c86d367ba9)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:36.014808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.027404 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Calling delete_port for b92c3ccc-652f-481b-83b2-a74f7b4f6210 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:22:36.109208 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.121133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.135600 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Pushing event deleted for resources: {'Port': ['ID=b92c3ccc-652f-481b-83b2-a74f7b4f6210,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:36.137181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] No DVR routers for this DVR port b92c3ccc-652f-481b-83b2-a74f7b4f6210 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:22:36.149345 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.149883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.150235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.150571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.150951 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.151288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.151625 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.151933 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.152276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.153103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.153463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.153732 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5c39bbd-8add-47ef-824b-63d2eb21cdb6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.170733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Port': ['ID=89563e0d-6644-4660-9c59-792528f8404c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:36.207129 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.306148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.308384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.360335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.360832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Fanout notify agent at l3_agent the message router_deleted on router 205c419c-ce1e-424f-80cb-21ec0eeaec43 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:22:36.367897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.369068 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-5c7ff8d2-44ec-48e6-8ddd-22a9b89c4471 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/routers/205c419c-ce1e-424f-80cb-21ec0eeaec43 HTTP/1.1" status: 204 len: 168 time: 0.7994001 Nov 05 15:22:36.371869 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51734) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:36.427694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:22:36.455353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:22:36.455699 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 936e5cf2-d8c8-4551-bcd2-3e6b9be2db42 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:22:36.458964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.507817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b92c3ccc-652f-481b-83b2-a74f7b4f6210 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:22:36.529223 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: b92c3ccc-652f-481b-83b2-a74f7b4f6210 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:22:36.529648 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device b92c3ccc-652f-481b-83b2-a74f7b4f6210 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:22:36.530286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0514b6ef-1442-440d-a521-7dd65f651c4b no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:22:36.552873 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0514b6ef-1442-440d-a521-7dd65f651c4b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:22:36.553215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0514b6ef-1442-440d-a521-7dd65f651c4b not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:22:36.555844 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.579615 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86cdc6fc-76d3-4c8d-a54b-7df8d7484f89']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:36.589727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1724f052-d90e-4071-b667-e6c86d367ba9') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:36.590078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1724f052-d90e-4071-b667-e6c86d367ba9') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:36.600604 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.613948 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.619925 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Releasing vlan 623 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:22:36.620326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:22:36.623419 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:22:36.683052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.689884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.692996 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/networks/86cdc6fc-76d3-4c8d-a54b-7df8d7484f89 HTTP/1.1" status: 204 len: 168 time: 0.3201449 Nov 05 15:22:36.695856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51736) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:36.704951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3037ac-882f-4161-8052-611fc8a180d6 tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'Network': ['ID=86cdc6fc-76d3-4c8d-a54b-7df8d7484f89,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:36.752882 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.777562 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.838613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.841838 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:36.842956 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] 10.222.0.30 "DELETE /v2.0/security-groups/bafcae2a-ab62-4d35-a884-2807e4582c5b HTTP/1.1" status: 204 len: 168 time: 0.1460881 Nov 05 15:22:36.852434 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bafcae2a-ab62-4d35-a884-2807e4582c5b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:36.859322 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.859667 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.860006 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.860344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.860696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.861028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.861353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.861676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.861999 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.862326 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.862643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:36.862960 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ff1b0da-66e3-463f-a647-829459b0ea6b tempest-TestNetworkAdvancedServerOps-2105015487 tempest-TestNetworkAdvancedServerOps-2105015487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:37.161107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51744) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:37.303116 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7c9c0ad4-9d78-4620-8f48-1982989951d8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ef1d7839d356477e8151af4dc08baead&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1408038 Nov 05 15:22:37.305696 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51748) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:37.351875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.372846 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.421221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.423772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.424972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/be0b293d-8a91-4769-8dd0-a27f512c5d1c HTTP/1.1" status: 204 len: 168 time: 0.1183894 Nov 05 15:22:37.433753 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5cc1f6e-3535-469d-9a49-4fdeb307bccb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be0b293d-8a91-4769-8dd0-a27f512c5d1c,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:37.678221 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51754) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:37.691763 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6de900a9-6cb6-4770-a091-cd7cccf49c7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.763560 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6de900a9-6cb6-4770-a091-cd7cccf49c7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.767273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6de900a9-6cb6-4770-a091-cd7cccf49c7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.808260 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6de900a9-6cb6-4770-a091-cd7cccf49c7a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=39679f37fc2140d2bea529de71d3ad29&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1289597 Nov 05 15:22:37.809144 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de900a9-6cb6-4770-a091-cd7cccf49c7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2600214-cd82-462b-9099-67e13689f349,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:37.811158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51756) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:37.862992 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.882953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.929489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.932058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:37.933243 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e2600214-cd82-462b-9099-67e13689f349 HTTP/1.1" status: 204 len: 168 time: 0.1210446 Nov 05 15:22:37.940551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b811c14-3ff8-4da3-93b2-7291d7d753c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2600214-cd82-462b-9099-67e13689f349,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:38.392231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89563e0d-6644-4660-9c59-792528f8404c no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:22:38.412618 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 89563e0d-6644-4660-9c59-792528f8404c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:22:38.412976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 89563e0d-6644-4660-9c59-792528f8404c not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:22:38.583160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51778) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:38.677178 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1157734057-network', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:38.698088 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Made reservation on behalf of 0c7efefc4d474bc2882d41e4cb713041 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:22:38.700855 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.709195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.783515 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.787430 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.812043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 642} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:22:38.821821 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fb4a5fb-774b-4964-b307-95af11af4776,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:38.828978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.829321 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Added segment 76bcfb05-f136-42d2-8142-74886a796859 of type vlan for network e8655efd-122a-4437-a816-c84a823b1b31 Nov 05 15:22:38.869509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.894279 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.895253 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:38.895832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:38.961042 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3765781 Nov 05 15:22:38.963925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51782) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:38.969513 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Request body: {'subnet': {'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1157734057-subnet', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:38.969716 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818cbf92-eb0a-487c-af38-b8e7d1442a12 admin admin] Pushing event updated for resources: {'Network': ['ID=e8655efd-122a-4437-a816-c84a823b1b31,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:38.979915 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network e8655efd-122a-4437-a816-c84a823b1b31 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:22:38.989978 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Made reservation on behalf of 0c7efefc4d474bc2882d41e4cb713041 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:22:38.992407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.161550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.216826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=f1d2935c-89f4-4fbe-af92-79b9341cb914,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:39.226183 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Checking segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:39.226539 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Network hostable DHCP agents. Network: e8655efd-122a-4437-a816-c84a823b1b31, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:22:39.242351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Network e8655efd-122a-4437-a816-c84a823b1b31 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:22:39.251393 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, e8655efd-122a-4437-a816-c84a823b1b31) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:39.255271 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:39.255851 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.260106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30baed56-81b1-42dc-a81d-3e919d11dd65 None None] Network e8655efd-122a-4437-a816-c84a823b1b31 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:22:39.271747 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-31b1e42f-20c8-402e-9651-b7bc779d0b4c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3066468 Nov 05 15:22:39.274753 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51784) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:39.279155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:39.299496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.300579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-30baed56-81b1-42dc-a81d-3e919d11dd65 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:22:39.334149 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:22:39.343616 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-095fe8c8-7ed9-4830-a76d-3eb60ea8707f None None] Network e8655efd-122a-4437-a816-c84a823b1b31 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:22:39.352364 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-095fe8c8-7ed9-4830-a76d-3eb60ea8707f None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:22:39.421911 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:22:39.430528 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6f4d25e-6301-43cb-9ddd-06c9cd4577f4 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:22:39.494628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6f4d25e-6301-43cb-9ddd-06c9cd4577f4 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:22:39.496904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.694757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.697695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-e8655efd-122a-4437-a816-c84a823b1b31', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:22:39.698588 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.713574 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.811489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Allocated IP 172.26.5.171 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/8b12da63-493f-48dd-b9a5-133c81b0dca1) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:39.834564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Allocated IP 172.20.0.2 (e8655efd-122a-4437-a816-c84a823b1b31/f1d2935c-89f4-4fbe-af92-79b9341cb914/601f8a77-6dd5-433b-bc9a-2d3f36941adf) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:39.915924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.951185 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.979558 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.987947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:39.989733 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:39.994829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:39.998580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:40.004287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Pushing event updated for resources: {'Port': ['ID=8b12da63-493f-48dd-b9a5-133c81b0dca1,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:40.031510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Network e8655efd-122a-4437-a816-c84a823b1b31 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:40.036659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:40.040230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:40.048222 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Pushing event updated for resources: {'Port': ['ID=601f8a77-6dd5-433b-bc9a-2d3f36941adf,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:40.098007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Attempting to bind port 601f8a77-6dd5-433b-bc9a-2d3f36941adf on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:40.098288 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Attempting to bind port 601f8a77-6dd5-433b-bc9a-2d3f36941adf by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:40.098658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Attempting to bind port 601f8a77-6dd5-433b-bc9a-2d3f36941adf on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:40.103525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:40.103898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Checking segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:40.104298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.104718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Bound using segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:40.105193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Bound port: 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:40.105570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.170511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] For port 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:40.173583 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] For port 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=601f8a77-6dd5-433b-bc9a-2d3f36941adf,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:40.179117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.237213 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ca0c36-93a8-4d92-8998-9f771ff79378 None None] Pushing event updated for resources: {'Port': ['ID=601f8a77-6dd5-433b-bc9a-2d3f36941adf,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:40.265059 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.487168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.508416 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 601f8a77-6dd5-433b-bc9a-2d3f36941adf up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:40.560113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 601f8a77-6dd5-433b-bc9a-2d3f36941adf triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:40.560509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.646810 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.682475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=601f8a77-6dd5-433b-bc9a-2d3f36941adf,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:40.688065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:40.755632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=601f8a77-6dd5-433b-bc9a-2d3f36941adf,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:40.946132 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:22:41.061459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:41.070364 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:41.081063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.081765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:41.082388 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:41.082764 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bc491f0d-23fc-42b0-ad2e-7aceed4dfdb6 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.8067293 Nov 05 15:22:41.085395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51786) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:41.191380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:41.221582 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7347d1df-cde4-4048-a143-9cebda069d64 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:22:41.384899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-fece9fad-aa1b-4808-8337-409e21166bcf None None] Provisioning complete for port 601f8a77-6dd5-433b-bc9a-2d3f36941adf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:41.385267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fece9fad-aa1b-4808-8337-409e21166bcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.395291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7347d1df-cde4-4048-a143-9cebda069d64 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:22:41.506579 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.596926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:40Z', 'revision_number': 3, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:41.634156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:41.634156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Updating router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 port 8b12da63-493f-48dd-b9a5-133c81b0dca1 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:22:41.668874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Allocated IP 172.20.0.1 (e8655efd-122a-4437-a816-c84a823b1b31/f1d2935c-89f4-4fbe-af92-79b9341cb914/e8a5571b-afe6-4517-9b2c-9cc70dcfc378) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:41.675591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.775690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.811620 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:41.850245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Network e8655efd-122a-4437-a816-c84a823b1b31 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:41.856740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:41.860545 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:41.882956 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Pushing event updated for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:41.902672 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.037222 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.127945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.133753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.186711 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ece129d-76ed-49c9-a5a5-b93ded463dc8 None None] Pushing event updated for resources: {'Port': ['ID=8b12da63-493f-48dd-b9a5-133c81b0dca1,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:42.190960 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Attempting to bind port 8b12da63-493f-48dd-b9a5-133c81b0dca1 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:42.191331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Attempting to bind port 8b12da63-493f-48dd-b9a5-133c81b0dca1 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:42.191694 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Attempting to bind port 8b12da63-493f-48dd-b9a5-133c81b0dca1 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:42.197212 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:42.197835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:42.197972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.198361 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:42.198830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Bound port: 8b12da63-493f-48dd-b9a5-133c81b0dca1, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:42.199210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.216786 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.221715 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.253671 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] For port 8b12da63-493f-48dd-b9a5-133c81b0dca1, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:42.257251 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] For port 8b12da63-493f-48dd-b9a5-133c81b0dca1, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b12da63-493f-48dd-b9a5-133c81b0dca1,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:42.265263 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.293939 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.295650 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Pushing event updated for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:42.328320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:42.328993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:42.365108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ece129d-76ed-49c9-a5a5-b93ded463dc8 None None] Pushing event updated for resources: {'Port': ['ID=8b12da63-493f-48dd-b9a5-133c81b0dca1,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:42.414533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Network e8655efd-122a-4437-a816-c84a823b1b31 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:42.416026 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:42.449273 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:42.477901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 601f8a77-6dd5-433b-bc9a-2d3f36941adf up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:42.562248 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:22:42.623675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-cfdbf8cd-5ee4-4717-ad2c-c7a127cb3913 None None] Provisioning complete for port 601f8a77-6dd5-433b-bc9a-2d3f36941adf triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:42.624276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfdbf8cd-5ee4-4717-ad2c-c7a127cb3913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.679726 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:42.685899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4e01580e-0dbc-4596-8335-bab89026d910 admin admin] 10.222.0.30 "PUT /v2.0/routers/9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5989130 Nov 05 15:22:42.723179 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 601f8a77-6dd5-433b-bc9a-2d3f36941adf triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:42.723566 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.843949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 2, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:42.897828 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9de965f5-f5f8-4c19-acdd-140f4565bfa8 None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 2, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:42.948426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-9b1f17b1-09f2-4f9c-b32c-7704de4ad3da None None] Provisioning complete for port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:42.949082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-9b1f17b1-09f2-4f9c-b32c-7704de4ad3da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:42.986715 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-9b1f17b1-09f2-4f9c-b32c-7704de4ad3da None None] Port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:22:43.124640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1a3a9fbe-ba9e-4d78-a927-ba76b64b411d None None] Provisioning complete for port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:43.125783 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1a3a9fbe-ba9e-4d78-a927-ba76b64b411d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.180496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-1a3a9fbe-ba9e-4d78-a927-ba76b64b411d None None] Port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:22:43.241514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51802) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:43.246553 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1958868172-network', 'tenant_id': '6c72b827433245b98606074803b01137'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:43.269529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Made reservation on behalf of 6c72b827433245b98606074803b01137 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:22:43.271898 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.280985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.367385 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.371450 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.403107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:22:43.413514 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9d6e723-cb8e-4672-9089-10849e95c66b,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:43.417998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.418880 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Added segment 465ea47e-602e-4d26-b936-1df3ebd1f611 of type vlan for network 4fcde5bb-96d4-4e7f-9291-98f23e14158c Nov 05 15:22:43.462188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.488323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.489370 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:43.489983 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.568009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3253033 Nov 05 15:22:43.570694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51804) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:43.575421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Request body: {'subnet': {'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1958868172-subnet', 'tenant_id': '6c72b827433245b98606074803b01137', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:43.585421 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcae20e-6c45-48eb-b62f-1675d94219f7 admin admin] Pushing event updated for resources: {'Network': ['ID=4fcde5bb-96d4-4e7f-9291-98f23e14158c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:43.595889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:22:43.608829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Made reservation on behalf of 6c72b827433245b98606074803b01137 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:22:43.610836 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.798512 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.858538 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Pushing event updated for resources: {'Subnet': ['ID=daeef1de-5085-4b46-b000-fc1d590abca4,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:43.867451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Checking segment: {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:43.867896 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Network hostable DHCP agents. Network: 4fcde5bb-96d4-4e7f-9291-98f23e14158c, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:22:43.885783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:22:43.895755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 4fcde5bb-96d4-4e7f-9291-98f23e14158c) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:43.900188 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:43.900844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.906987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de984e70-0c52-4b8b-a0a5-8a877ce40f7d None None] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:22:43.916990 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3c2e9868-9235-4c93-9d3d-c751cef672dc admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3451962 Nov 05 15:22:43.919921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51806) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:43.926508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:43.953864 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.955580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-de984e70-0c52-4b8b-a0a5-8a877ce40f7d None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:22:43.996270 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:22:44.007498 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0903822-b4c4-4078-9f60-ef26c6fc770c None None] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:22:44.008761 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-d0903822-b4c4-4078-9f60-ef26c6fc770c None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:22:44.083917 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:22:44.092132 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb3b12e1-1bce-44a4-b26b-617d1c9877d9 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:22:44.158413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.174740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb3b12e1-1bce-44a4-b26b-617d1c9877d9 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:22:44.362693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.385692 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.387011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:22:44.387898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.500556 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Allocated IP 172.26.5.143 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:44.517244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b12da63-493f-48dd-b9a5-133c81b0dca1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:44.575808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Allocated IP 172.20.0.2 (4fcde5bb-96d4-4e7f-9291-98f23e14158c/daeef1de-5085-4b46-b000-fc1d590abca4/bfca1588-f6a2-426a-ac59-a0883537a059) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:44.609416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.636235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 8b12da63-493f-48dd-b9a5-133c81b0dca1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:44.636640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.646901 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.687047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:44.693961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:44.698542 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:44.702322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Pushing event updated for resources: {'Port': ['ID=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:44.794701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.799549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.808713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.844065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 8b12da63-493f-48dd-b9a5-133c81b0dca1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b12da63-493f-48dd-b9a5-133c81b0dca1,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:44.850659 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.867690 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:44.872283 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:44.874791 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:44.877051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Pushing event updated for resources: {'Port': ['ID=bfca1588-f6a2-426a-ac59-a0883537a059,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:44.962460 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.969723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=8b12da63-493f-48dd-b9a5-133c81b0dca1,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:44.973539 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Attempting to bind port bfca1588-f6a2-426a-ac59-a0883537a059 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:44.975984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Attempting to bind port bfca1588-f6a2-426a-ac59-a0883537a059 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:44.975984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Attempting to bind port bfca1588-f6a2-426a-ac59-a0883537a059 on network 4fcde5bb-96d4-4e7f-9291-98f23e14158c {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:44.980395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:44.981319 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Checking segment: {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:44.981727 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:44.982122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Bound using segment: {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:44.982589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Bound port: bfca1588-f6a2-426a-ac59-a0883537a059, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:44.982975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.011056 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:45.020996 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:45.021277 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:45.048387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8811d215-8072-4ce9-99db-b599905e396a None None] For port bfca1588-f6a2-426a-ac59-a0883537a059, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:45.051781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8811d215-8072-4ce9-99db-b599905e396a None None] For port bfca1588-f6a2-426a-ac59-a0883537a059, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bfca1588-f6a2-426a-ac59-a0883537a059,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:45.056314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.115100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8811d215-8072-4ce9-99db-b599905e396a None None] Pushing event updated for resources: {'Port': ['ID=bfca1588-f6a2-426a-ac59-a0883537a059,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:45.135792 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:45.177896 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.374302 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 2, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:45.403207 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:45.403561 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Updating router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:22:45.445977 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.646972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:22:45.723836 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.730475 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.763510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:45.775594 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Sync routers for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:45.783406 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Pushing event updated for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:45.788729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:45.789363 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:45.794789 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.795035 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.795277 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.795679 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.798858 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.798999 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-cedaba59-bac1-4c31-9438-56a99d6bc8c2 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.8746159 Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799099 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:22:45.799766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51808) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:45.856698 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Attempting to bind port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:45.857211 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Attempting to bind port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:45.857674 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Attempting to bind port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:45.863247 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:45.863778 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Checking segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:45.865288 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.865288 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Bound using segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:45.865288 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Bound port: e8a5571b-afe6-4517-9b2c-9cc70dcfc378, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:45.865777 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:45.927390 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:45.954825 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] For port e8a5571b-afe6-4517-9b2c-9cc70dcfc378, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:45.958449 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] For port e8a5571b-afe6-4517-9b2c-9cc70dcfc378, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:45.963221 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.009485 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:46.010369 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:46.202086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0416f43f-f10d-4b4d-8a91-3c3cef9041bc None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:22:46.258526 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccc5ee55-3939-4268-9cc1-f89bfa55617b None None] Pushing event updated for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:46.268850 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:46.282735 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] Provisioning complete for port bfca1588-f6a2-426a-ac59-a0883537a059 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:46.283116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.288647 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.381402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0416f43f-f10d-4b4d-8a91-3c3cef9041bc None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:22:46.461249 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Allocated IP 172.20.0.1 (4fcde5bb-96d4-4e7f-9291-98f23e14158c/daeef1de-5085-4b46-b000-fc1d590abca4/48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:46.500511 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.527219 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:45Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:46.530979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 3, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:46.574972 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42b5b1cd-4ff5-4546-8d27-a3f6ccacf827 None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:45Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:46.575825 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Checking router: dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:46.576186 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Updating router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:22:46.586439 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.625892 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bfca1588-f6a2-426a-ac59-a0883537a059 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:46.629843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] For port bfca1588-f6a2-426a-ac59-a0883537a059, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bfca1588-f6a2-426a-ac59-a0883537a059,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:46.634355 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.674562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.678755 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:46.684762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:46.686446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.688491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:46.712387 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Pushing event updated for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:46.730594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.840863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a38978fb-e766-4236-a85c-783ddb310efa None None] Pushing event updated for resources: {'Port': ['ID=bfca1588-f6a2-426a-ac59-a0883537a059,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:46.874842 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:46.910799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bfca1588-f6a2-426a-ac59-a0883537a059 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:46.911172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.046313 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.055215 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.106188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e8a5571b-afe6-4517-9b2c-9cc70dcfc378 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:47.133577 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.135332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Pushing event updated for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:47.187910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.197569 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.237991 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:47.239598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:47.261395 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:47.261997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.287204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e450e2c9-f41e-413f-ace9-db12d6a3bfac None None] Pushing event updated for resources: {'Port': ['ID=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:47.299946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Attempting to bind port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:47.300313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Attempting to bind port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:47.300703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Attempting to bind port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:47.311203 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:47.311572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:47.311976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.312366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:47.312872 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Bound port: d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:47.313249 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.383727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:22:47.404326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] For port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:47.425769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] For port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:47.427209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.441658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.492913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port e8a5571b-afe6-4517-9b2c-9cc70dcfc378, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:47.507028 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.507794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b12da63-493f-48dd-b9a5-133c81b0dca1 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:47.525288 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:22:47.533005 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1c6ff778-5abd-4665-aeb3-960292083084 admin admin] 10.222.0.30 "PUT /v2.0/routers/dd188e6d-d7e0-484f-8a36-c001f7c3e0b0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7326660 Nov 05 15:22:47.553046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:47.553948 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:47.603953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e450e2c9-f41e-413f-ace9-db12d6a3bfac None None] Pushing event updated for resources: {'Port': ['ID=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:47.736733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:47.740081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 8b12da63-493f-48dd-b9a5-133c81b0dca1 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:47.740598 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:47.774476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:47.778765 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-099040e8-fcd4-457c-a8d4-c657c3cefbc4 None None] Provisioning complete for port bfca1588-f6a2-426a-ac59-a0883537a059 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:47.779131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-099040e8-fcd4-457c-a8d4-c657c3cefbc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.163686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51816) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.169825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1030272515', 'description': 'tempest-secgroup-smoke-1030272515 description', 'project_id': '0c7efefc4d474bc2882d41e4cb713041'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.200859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.238113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-099040e8-fcd4-457c-a8d4-c657c3cefbc4 None None] Provisioning complete for port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:48.238493 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-099040e8-fcd4-457c-a8d4-c657c3cefbc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.276553 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.279851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-099040e8-fcd4-457c-a8d4-c657c3cefbc4 None None] Port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:22:48.281760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.300413 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc', 'name': '', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'mac_address': 'fa:16:3e:23:72:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1787, 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:46Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 2, 'project_id': '6c72b827433245b98606074803b01137', 'subnets': [{'id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:48.312441 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.316672 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1516824 Nov 05 15:22:48.316938 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51818) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.317401 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf116909-25a9-46c9-b7e1-53782d81f884 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ea793308-b85b-4314-96d4-fe3eaa2fe639,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:48.322282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.329312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c034a-d93c-4163-b7e0-aeadbee2443b None None] The sync data for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv is: [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc', 'name': '', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'mac_address': 'fa:16:3e:23:72:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1787, 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:46Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 2, 'project_id': '6c72b827433245b98606074803b01137', 'subnets': [{'id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:48.354541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.399133 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dee9552b-11b9-4189-8b8c-932e9edc3608 None None] Provisioning complete for port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:48.404194 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dee9552b-11b9-4189-8b8c-932e9edc3608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.421327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.426522 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.447099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f70102fa-a7cd-432f-8d42-0f255b9345dd,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:48.467615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.469729 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-63074bc2-3ae3-41c9-b1ca-046a2483fdff tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1508527 Nov 05 15:22:48.472566 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51820) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.478744 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.500975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bfca1588-f6a2-426a-ac59-a0883537a059 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:48.532529 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.573775 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.587878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-dee9552b-11b9-4189-8b8c-932e9edc3608 None None] Provisioning complete for port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:48.588265 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-dee9552b-11b9-4189-8b8c-932e9edc3608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.623935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port bfca1588-f6a2-426a-ac59-a0883537a059 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:48.624936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.626629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.634295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.655008 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b63ad87a-a377-44db-a8ca-bbe58f0811fe,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:48.656925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-dee9552b-11b9-4189-8b8c-932e9edc3608 None None] Port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:22:48.668965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.670529 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-67c0ccf8-345a-4de6-adaf-77f3857f5b48 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1967189 Nov 05 15:22:48.673053 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51822) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.677926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.707924 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.724538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e8a5571b-afe6-4517-9b2c-9cc70dcfc378 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:48.774944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.779717 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:48.780095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.780217 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.800225 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=45684cfb-5efb-4a73-b640-3392701e8c20,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:48.814664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.819519 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5a8afe63-020d-4aac-b52e-64f56cd2d9be tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1419611 Nov 05 15:22:48.819519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51824) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.824151 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.853617 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.915536 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.919354 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.938157 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff5cae90-e2ce-4bef-af01-f481b8fd19ef,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:48.945554 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:48.946787 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-da353401-4e07-4877-8f9c-d15e2195e838 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1265275 Nov 05 15:22:48.950202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51826) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:48.954739 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:48.977113 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Project 0c7efefc4d474bc2882d41e4cb713041 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:22:48.982327 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.043926 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.047332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.065733 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6875e041-45db-4225-ae43-686a5bd31d30,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:49.073463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.075192 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6f1ff18d-136f-45fa-ac8d-3c12f448db63 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1235311 Nov 05 15:22:49.077918 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 51828) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:22:49.082233 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'ea793308-b85b-4314-96d4-fe3eaa2fe639', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:49.102991 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Project 0c7efefc4d474bc2882d41e4cb713041 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:22:49.107979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.165391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.168867 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.185698 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df45860a-bb31-4bf5-909d-904b2490f8aa,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:49.193856 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:49.195208 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-780ff762-ec87-41e0-a847-604beec24d5e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1163607 Nov 05 15:22:49.359563 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-6c6597cb-cc9c-4238-b208-3af72d0a0c0f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1030272515&fields=id&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 267 time: 0.0506828 Nov 05 15:22:49.474624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-4adc1e68-8194-4f4d-8de6-969824be99f5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:49.476107 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-4adc1e68-8194-4f4d-8de6-969824be99f5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 809 time: 0.1076920 Nov 05 15:22:49.492448 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-6166143b-250c-46c5-8e2c-6f79d896f61b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/quotas/0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 375 time: 0.0096569 Nov 05 15:22:49.526176 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:22:49.548608 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-a19f250d-b441-4e4c-860d-087cf22ce808 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0493867 Nov 05 15:22:49.564754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-b1762da1-08da-4d8f-bad7-09735f75934c service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:22:49.565818 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-b1762da1-08da-4d8f-bad7-09735f75934c service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053995 Nov 05 15:22:49.660390 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-3d6ff99d-25e7-4e18-8a66-cc8490df66cc service neutron] 10.222.0.30 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880675 Nov 05 15:22:50.075059 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-c37c805c-1df1-46db-9a0a-e7de36f7038f service neutron] 10.222.0.30 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4076798 Nov 05 15:22:50.148658 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d8260c32-0458-41a8-93d4-25e3908d5325 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:50.252558 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4c5377ad-1244-47b5-9942-7b10e8d04853 req-be3a3f56-bad4-44f8-bdde-36e81d7de425 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 210 time: 0.0333838 Nov 05 15:22:50.492652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:50.543448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:50.543902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:50.595628 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Sync routers for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:22:50.606254 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:50.607035 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:50.626935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:50.647746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:50.652483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:50.704508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:50.718128 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:50.916313 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc', 'name': '', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'mac_address': 'fa:16:3e:23:72:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1787, 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:46Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 2, 'project_id': '6c72b827433245b98606074803b01137', 'subnets': [{'id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:50.945824 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Checking router: dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:22:50.946169 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Updating router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:22:50.969495 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.220974 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.226535 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.268253 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d680f8dc-afdc-42b7-947a-e2b5426b42b2 None None] Pushing event updated for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:51.340911 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Attempting to bind port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:51.341502 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Attempting to bind port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:51.342242 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Attempting to bind port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc on network 4fcde5bb-96d4-4e7f-9291-98f23e14158c {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:51.349445 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:51.350090 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Checking segment: {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:51.350722 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.351439 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Bound using segment: {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:51.352270 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Bound port: 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '465ea47e-602e-4d26-b936-1df3ebd1f611', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:51.352899 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.367531 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-26ecf2e5-b3b9-4230-997f-8769d9aa9c2d req-d609bd79-97e9-47ac-a784-bdebfb56b7d1 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 210 time: 0.0413899 Nov 05 15:22:51.422342 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] For port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:51.425976 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] For port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:51.434628 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.526130 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d680f8dc-afdc-42b7-947a-e2b5426b42b2 None None] Pushing event updated for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:51.531061 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:22:51.531656 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:51.599622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] Provisioning complete for port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:51.600206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.646273 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:22:51.683731 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.721018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] For port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:51.725679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.774979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365809d6-54c5-47de-b7b3-93e39d769a92 None None] Pushing event updated for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:51.845611 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc', 'name': '', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'mac_address': 'fa:16:3e:23:72:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1787, 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:46Z', 'updated_at': '2021-11-05T15:22:51Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'subnets': [{'id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:22:51.845896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-a15c80bf-77de-4845-872b-1ef5922c722a None None] Provisioning complete for port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:51.846010 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a15c80bf-77de-4845-872b-1ef5922c722a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:51.872840 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a4ca515-09e4-41bc-9e1b-f4e37fa31b0b None None] The sync data for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv is: [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:22:46Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc', 'name': '', 'network_id': '4fcde5bb-96d4-4e7f-9291-98f23e14158c', 'tenant_id': '6c72b827433245b98606074803b01137', 'mac_address': 'fa:16:3e:23:72:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1787, 'fixed_ips': [{'subnet_id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:46Z', 'updated_at': '2021-11-05T15:22:51Z', 'revision_number': 4, 'project_id': '6c72b827433245b98606074803b01137', 'subnets': [{'id': 'daeef1de-5085-4b46-b000-fc1d590abca4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:22:52.455635 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-28919ab1-fff4-4efe-9bc6-8f411fb96a77 req-360cf770-8867-4f1f-9efa-b4b9e98bd060 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 210 time: 0.0272329 Nov 05 15:22:52.482902 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fbba6e2e-6b9d-4b4d-8b70-84b1b7889639 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:52.490703 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:52.547886 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:52.548402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:52.630150 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:22:52.680350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:52.680657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.266586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-175cff0d-fd5c-4271-8200-099c2062ccc4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:53.268047 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-175cff0d-fd5c-4271-8200-099c2062ccc4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 809 time: 0.1065054 Nov 05 15:22:53.332327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-1972c2fa-46da-4a48-b068-6dea48a40bb0 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 380 time: 0.0554769 Nov 05 15:22:53.342756 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'port': {'device_id': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'admin_state_up': True, 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'security_groups': ['ea793308-b85b-4314-96d4-fe3eaa2fe639']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:53.450951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Made reservation on behalf of 0c7efefc4d474bc2882d41e4cb713041 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:22:53.459011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.554835 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.557493 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-73b5655c-cdd1-4563-a084-783b99c6a103 req-4e48ef21-514c-4a55-a979-56a3d72551f0 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 210 time: 0.0334530 Nov 05 15:22:53.589935 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Allocated IP 172.20.0.3 (e8655efd-122a-4437-a816-c84a823b1b31/f1d2935c-89f4-4fbe-af92-79b9341cb914/60490396-8832-400d-8303-04a234bb1b05) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:22:53.728195 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.763483 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.805335 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Network e8655efd-122a-4437-a816-c84a823b1b31 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:22:53.810801 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:22:53.814532 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:22:53.837598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:53.866736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:53.867357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:53.883926 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-7619f9fb-735d-4ff8-afb0-57b5ec2e9354 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5455291 Nov 05 15:22:53.896651 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Request body: {'port': {'device_id': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:22:53.957703 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.058285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-5e4763c7-8718-4ec2-889b-fb0a3870ffa2 None None] Provisioning complete for port 60490396-8832-400d-8303-04a234bb1b05 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:22:54.059637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5e4763c7-8718-4ec2-889b-fb0a3870ffa2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.092911 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-5e4763c7-8718-4ec2-889b-fb0a3870ffa2 None None] Port 60490396-8832-400d-8303-04a234bb1b05 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:22:54.212302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:22:54.219977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.232134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Transition to ACTIVE for port object 60490396-8832-400d-8303-04a234bb1b05 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:22:54.235512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.308111 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:54.360003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Attempting to bind port 60490396-8832-400d-8303-04a234bb1b05 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:22:54.360707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Attempting to bind port 60490396-8832-400d-8303-04a234bb1b05 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:22:54.361047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Attempting to bind port 60490396-8832-400d-8303-04a234bb1b05 on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:54.365747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Port 60490396-8832-400d-8303-04a234bb1b05 on network e8655efd-122a-4437-a816-c84a823b1b31 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:22:54.366065 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Attempting to bind port 60490396-8832-400d-8303-04a234bb1b05 on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:22:54.370974 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 22, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:22:54.371314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Checking segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:22:54.371693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Bound using segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:22:54.372112 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Bound port: 60490396-8832-400d-8303-04a234bb1b05, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:22:54.372567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.439095 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:22:54.442131 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:22:54.446454 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.479155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:54.479777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:54.481420 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] 10.222.0.32 "PUT /v2.0/ports/60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1093 time: 0.5889115 Nov 05 15:22:54.481765 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:22:54.484025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d" -d '{"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:22:54.562748 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e064e9-d23e-41ca-889b-f5ab65a50977 service neutron] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:54.586566 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-f01b7d8c-4f7d-4d97-88b8-ce990bcd4610 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:54.588430 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-f01b7d8c-4f7d-4d97-88b8-ce990bcd4610 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1096 time: 0.0631266 Nov 05 15:22:54.605200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:22:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d83f6b9d-8690-4ebd-9af2-3e53e4b08ca2 x-openstack-request-id: req-d83f6b9d-8690-4ebd-9af2-3e53e4b08ca2 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:22:54.605523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:22:54.605774 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d83f6b9d-8690-4ebd-9af2-3e53e4b08ca2 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:22:54.606203 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'status': 'completed', 'code': 200} Nov 05 15:22:54.636063 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-d02b3356-2346-45f8-b8d7-12a8f0db6795 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 217 time: 0.0383465 Nov 05 15:22:54.684391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ec1e41-23a3-42ef-855c-40a6a6f68024 req-3b1feb2f-73a2-410e-ba2e-8bb2101ff274 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:54.685919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ec1e41-23a3-42ef-855c-40a6a6f68024 req-3b1feb2f-73a2-410e-ba2e-8bb2101ff274 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0524664 Nov 05 15:22:54.690416 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-7757dc84-8e98-42c9-aea5-e02f85b82180 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:54.691856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-7757dc84-8e98-42c9-aea5-e02f85b82180 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0476401 Nov 05 15:22:54.735604 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b7ec1e41-23a3-42ef-855c-40a6a6f68024 req-f6985e0e-26e4-418c-bab2-b8bdc5ce18ef tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435009 Nov 05 15:22:54.742636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86313838-8075-4613-aff8-f868e26e417e req-772f62d1-edd9-4bbe-80e5-c2cdfe7f61b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:54.744140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-772f62d1-edd9-4bbe-80e5-c2cdfe7f61b5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0442281 Nov 05 15:22:54.831717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-f08ad161-0233-499b-b12f-6c46da674916 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801415 Nov 05 15:22:54.922859 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86313838-8075-4613-aff8-f868e26e417e req-21d06839-1e76-4da4-809a-7940217a57c3 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845318 Nov 05 15:22:55.006838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-c3e76568-3423-4953-a95c-76e0552b9702 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:55.008379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-c3e76568-3423-4953-a95c-76e0552b9702 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1096 time: 0.0418091 Nov 05 15:22:55.012993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:55.098862 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-8f50f8db-10c5-4f8e-b377-4425ce8da865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:55.100231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-8f50f8db-10c5-4f8e-b377-4425ce8da865 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0821948 Nov 05 15:22:55.144845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-f2da35c1-09f6-4c3b-95e3-a59eb416f8c4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 217 time: 0.0375431 Nov 05 15:22:55.194242 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-028100d6-6c60-4c6b-b146-6f3a8626b8ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:55.195654 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-028100d6-6c60-4c6b-b146-6f3a8626b8ad service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0444908 Nov 05 15:22:55.244361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-88e0aecf-154d-45c8-bcdb-03fb148b7121 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:55.245917 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-88e0aecf-154d-45c8-bcdb-03fb148b7121 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0416338 Nov 05 15:22:55.337856 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-fb272bca-115f-4f11-9591-574e06ee406a service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839405 Nov 05 15:22:55.430217 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ddeb796e-0874-4dac-bd30-7724c1cd7a3d req-3b4eae35-32a8-4985-9541-287b201087b4 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824742 Nov 05 15:22:55.858481 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943fce1c-1b92-46b0-9ded-612fc855ee0d req-67ae833d-5056-43c1-8f7a-a98f8231cbfa tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:55.861696 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-943fce1c-1b92-46b0-9ded-612fc855ee0d req-67ae833d-5056-43c1-8f7a-a98f8231cbfa tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0544224 Nov 05 15:22:55.918521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-943fce1c-1b92-46b0-9ded-612fc855ee0d req-78ab69bc-af4d-4e00-ac9d-63bbee249b1e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517197 Nov 05 15:22:56.013702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:57.031519 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5add5ee-5c47-43d9-90ed-d20d7cf4937c req-9161680d-3052-4ff0-b582-048b00a2c5f2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:57.033011 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5add5ee-5c47-43d9-90ed-d20d7cf4937c req-9161680d-3052-4ff0-b582-048b00a2c5f2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0477645 Nov 05 15:22:57.081238 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c5add5ee-5c47-43d9-90ed-d20d7cf4937c req-0519c806-87f9-4d1f-bdf3-7f47ca69911b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422099 Nov 05 15:22:58.208411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eab633b-8f01-46f5-bb8f-05fd0c1fa98d req-b9d12c38-be7a-4b1d-a291-5c34a9ad70f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:58.209902 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6eab633b-8f01-46f5-bb8f-05fd0c1fa98d req-b9d12c38-be7a-4b1d-a291-5c34a9ad70f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0619917 Nov 05 15:22:58.258367 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6eab633b-8f01-46f5-bb8f-05fd0c1fa98d req-a717c033-5875-4370-860b-0a9b63fc862f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425706 Nov 05 15:22:58.520216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:22:58.611016 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:58.622013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '60490396-8832-400d-8303-04a234bb1b05', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:22:58.660443 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:58.672759 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:22:58.691231 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:22:58.694945 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:22:58.739008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:22:58.922245 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['60490396-8832-400d-8303-04a234bb1b05'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:22:59.373549 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a1a45b-4812-4bf7-9dd8-0e15db1d96fe req-eda88527-750f-44b8-adf7-9d7fbd324431 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:22:59.374990 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-93a1a45b-4812-4bf7-9dd8-0e15db1d96fe req-eda88527-750f-44b8-adf7-9d7fbd324431 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0521178 Nov 05 15:22:59.422885 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-93a1a45b-4812-4bf7-9dd8-0e15db1d96fe req-2e75c951-2f2c-4690-80f2-8b6a9ecd66d3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418789 Nov 05 15:23:00.536157 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:23:00.545489 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa180f37-821e-4ad5-a3a7-07451b1cc850 req-573b721a-f5d1-410b-a4c7-7759db2fbf12 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:00.547153 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa180f37-821e-4ad5-a3a7-07451b1cc850 req-573b721a-f5d1-410b-a4c7-7759db2fbf12 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0507450 Nov 05 15:23:00.588206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port 60490396-8832-400d-8303-04a234bb1b05 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:23:00.593597 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 60490396-8832-400d-8303-04a234bb1b05 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:23:00.593976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:00.613379 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fa180f37-821e-4ad5-a3a7-07451b1cc850 req-144af3e5-60bf-4612-8313-9467718b816c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604153 Nov 05 15:23:00.680360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:00.702695 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:23:00.705058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b6a70cc8-8b28-4c38-a9c1-1f385af04f76" -d '{"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:23:00.718811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:23:00.724216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:00.748192 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:23:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-300e03f3-76c3-414a-b38a-3024dbabaa9b x-openstack-request-id: req-300e03f3-76c3-414a-b38a-3024dbabaa9b {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:23:00.748506 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:23:00.748753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-300e03f3-76c3-414a-b38a-3024dbabaa9b {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:23:00.749147 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'code': 200} Nov 05 15:23:00.774050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:23:00.920695 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6258b692-04af-45eb-9cf0-d97f14f9bc67 req-447d8946-3b5f-4c04-913d-f4e280d96e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:00.922136 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6258b692-04af-45eb-9cf0-d97f14f9bc67 req-447d8946-3b5f-4c04-913d-f4e280d96e1d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1098 time: 0.0442505 Nov 05 15:23:00.966845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6258b692-04af-45eb-9cf0-d97f14f9bc67 req-7b11a44a-a2cb-4273-bb64-c06261c75519 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377452 Nov 05 15:23:01.727832 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f90ea017-3e82-493c-9828-abef8518de18 req-c1d98004-4a10-419d-9829-813cb3699dc3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:01.729333 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f90ea017-3e82-493c-9828-abef8518de18 req-c1d98004-4a10-419d-9829-813cb3699dc3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0481398 Nov 05 15:23:01.779167 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f90ea017-3e82-493c-9828-abef8518de18 req-fe5671b1-f7e0-4851-a9a6-3ff5bec20c75 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438023 Nov 05 15:23:02.893171 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04266cd-46f7-4a6f-8e10-99bd488ec18d req-4242a324-4658-44c9-baa7-03bf2f7230bc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:02.894633 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e04266cd-46f7-4a6f-8e10-99bd488ec18d req-4242a324-4658-44c9-baa7-03bf2f7230bc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0480289 Nov 05 15:23:02.943172 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e04266cd-46f7-4a6f-8e10-99bd488ec18d req-f465f8da-b20d-4d69-b59d-8bd0e6f52c33 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425096 Nov 05 15:23:03.058910 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2c9592-1a24-4bed-ad00-86717cddfce6 req-4a73e5d7-0270-4ac2-baee-5246d4aef0cd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:03.060296 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e2c9592-1a24-4bed-ad00-86717cddfce6 req-4a73e5d7-0270-4ac2-baee-5246d4aef0cd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0523431 Nov 05 15:23:03.108701 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3e2c9592-1a24-4bed-ad00-86717cddfce6 req-29bc45f7-4d22-4b7d-a813-75cbbf2d6bbf tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420310 Nov 05 15:23:03.129990 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51896) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:23:03.252778 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a82c3e7d-fc05-4ec2-b508-249d11eb0c96 tempest-TestShelveInstance-446280515 tempest-TestShelveInstance-446280515-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:03.254271 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a82c3e7d-fc05-4ec2-b508-249d11eb0c96 tempest-TestShelveInstance-446280515 tempest-TestShelveInstance-446280515-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1093 time: 0.1233373 Nov 05 15:23:03.257187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 51900) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:23:03.261966 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address': '172.20.0.3'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:23:03.281690 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:03.378788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:03.476554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Allocated IP 172.26.5.121 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/2530acd0-2205-43ad-8ac4-d1b71e059d27) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:23:03.578608 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:03.611105 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:03.647103 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:23:03.649927 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:23:03.655325 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:23:03.681015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=2530acd0-2205-43ad-8ac4-d1b71e059d27,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:23:04.008750 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.072038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.218546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.222964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.288091 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=2530acd0-2205-43ad-8ac4-d1b71e059d27,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:23:04.302618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.395186 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Floating IP 844ca339-3611-439b-8c8f-0c997bff43c0 associated. External IP: 172.26.5.121, port: 60490396-8832-400d-8303-04a234bb1b05. Nov 05 15:23:04.599391 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:23:04.703930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:23:04.713402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:23:04.722204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:04.727730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:23:04.728349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:23:04.750718 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b72ee3a6-695b-4d5a-9e1c-347027ea488c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.4925318 Nov 05 15:23:04.751291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:23:04.753552 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed738eb1-384f-4fe1-8593-54eb33692ea1" -d '{"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:23:04.789895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:23:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-499190fb-2b94-4e34-8c9e-cc53792f4ef5 x-openstack-request-id: req-499190fb-2b94-4e34-8c9e-cc53792f4ef5 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:23:04.790197 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:23:04.790451 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-499190fb-2b94-4e34-8c9e-cc53792f4ef5 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:23:04.790863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'status': 'completed', 'code': 200} Nov 05 15:23:04.839739 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:23:04.864398 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-77c284c2-ff91-4114-9945-72484cff7bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:04.865862 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-77c284c2-ff91-4114-9945-72484cff7bf1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1098 time: 0.0401468 Nov 05 15:23:04.958724 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-4636a829-8638-4062-b04b-92080d89833c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:04.960255 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-4636a829-8638-4062-b04b-92080d89833c service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0867748 Nov 05 15:23:05.024553 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-6615ff18-6618-4b7b-935e-dcd14d4c0e64 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 999 time: 0.0574815 Nov 05 15:23:05.056227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '844ca339-3611-439b-8c8f-0c997bff43c0', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1799, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:23:03Z', 'updated_at': '2021-11-05T15:23:03Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:23:05.078028 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-12f9b3d0-5b3f-4230-9c32-abb66859279d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:05.079480 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-12f9b3d0-5b3f-4230-9c32-abb66859279d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0476456 Nov 05 15:23:05.082155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:23:05.090488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:23:05.091087 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:22:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:23:05.125038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-ba9e01fb-72d7-410a-9967-0bf4b58b1170 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:05.126501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-ba9e01fb-72d7-410a-9967-0bf4b58b1170 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0401895 Nov 05 15:23:05.218534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-29d0b7d3-16d2-428b-a6f9-2e09e07429c0 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850697 Nov 05 15:23:05.314538 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ed738eb1-384f-4fe1-8593-54eb33692ea1 req-2cf1a2b4-e1cf-4544-a66c-29d941e95483 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890861 Nov 05 15:23:05.345581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:23:05.567851 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '844ca339-3611-439b-8c8f-0c997bff43c0', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1799, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:23:03Z', 'updated_at': '2021-11-05T15:23:03Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:23:05.593518 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bbae3663-c44d-447c-978e-f0ae74af89df None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '844ca339-3611-439b-8c8f-0c997bff43c0', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.121', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1799, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:23:03Z', 'updated_at': '2021-11-05T15:23:03Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:23:05.777658 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-655220a9-21ef-43b9-9573-b05c8773e694 None None] New status for floating IP 844ca339-3611-439b-8c8f-0c997bff43c0: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:23:18.549368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:20.151584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-92007bbc-8951-4310-9cac-057ddc5bf5ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:22.464341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-34db1ef3-11ab-4f90-865c-943e50d1ceb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:23.556334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:25.014533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:26.015564 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:26.525466 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:23:36.676567 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-d8bd1b1b-129e-4527-9f8d-de9330d05966 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0413940 Nov 05 15:23:36.757144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-060fc73e-f1f0-47b6-ae53-416234e4e598 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:36.758633 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-060fc73e-f1f0-47b6-ae53-416234e4e598 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1098 time: 0.0395784 Nov 05 15:23:36.870884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-5386f9e4-393f-4617-9f5b-e7638ec3493c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:36.872399 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-5386f9e4-393f-4617-9f5b-e7638ec3493c service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0932560 Nov 05 15:23:36.943084 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-1508595c-b796-45b7-b726-4c6aa22ef7bc service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1001 time: 0.0615120 Nov 05 15:23:36.994583 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-6f7d0576-78ec-4a53-9c69-0c4ecc051fa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:36.995997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-6f7d0576-78ec-4a53-9c69-0c4ecc051fa2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0461495 Nov 05 15:23:37.041977 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-ed273a23-d92a-48d0-8c0d-c9ca8f36dc3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:23:37.043440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-ed273a23-d92a-48d0-8c0d-c9ca8f36dc3f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398591 Nov 05 15:23:37.133710 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-366a3920-b284-4db6-b5fb-66b52420033d service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788567 Nov 05 15:23:37.531073 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77c226b8-4ea6-409c-a966-cbd4c938366b req-d83b2841-c7be-42da-96ef-62b57a24c049 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3894372 Nov 05 15:23:48.549030 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:50.153084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cb80d404-40ca-469a-ba0d-066b5de4e8fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:52.465812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a46be492-6f32-432d-b628-88000b00d46d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:53.559053 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:55.016901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:23:56.017225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:03.524095 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:24:18.576155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:20.154889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6137c291-e4ae-4061-87e5-a392e10b3de9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:22.466204 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e81d67b8-8db8-4784-a1d5-9644e25d74f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:23.563069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:24.870491 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-5deddb82-a1c9-4417-b926-2c15afa3160d req-150a6d60-c87f-49ea-85df-1e0b5b8ced69 service neutron] (113580) timed out ('10.222.0.30', 47968) {{(pid=113580) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 05 15:24:25.020102 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:26.019106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:38.522939 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-08c51e00-d992-4cb4-986d-10b2c6e8045c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411534 Nov 05 15:24:38.605130 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-e77a7040-424e-4464-85f7-b23e28e2f2f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:38.606719 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-e77a7040-424e-4464-85f7-b23e28e2f2f8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1098 time: 0.0411518 Nov 05 15:24:38.715646 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-b2507916-053a-403b-beed-dc29f6f5c63f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:38.717040 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-b2507916-053a-403b-beed-dc29f6f5c63f service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0887604 Nov 05 15:24:38.785912 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-d791c940-812a-4c8d-b718-2c7a4269e4fe service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1001 time: 0.0568068 Nov 05 15:24:38.835962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-c6e7bc21-0962-479e-9a25-47e2bed29c13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:38.837459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-c6e7bc21-0962-479e-9a25-47e2bed29c13 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0453544 Nov 05 15:24:38.882332 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-ee7b277f-661e-4ed1-bb19-efbc6b64b463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:38.883786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-ee7b277f-661e-4ed1-bb19-efbc6b64b463 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0382192 Nov 05 15:24:38.970212 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-5a85261b-3e39-47b9-8a01-eea5ab0e373a service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789816 Nov 05 15:24:39.059457 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-29b9ee78-587a-4ba2-873a-25cf3af0e1da req-432ae8ef-95e9-4ee2-8caa-537e5041308f service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822916 Nov 05 15:24:40.523838 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:24:48.574611 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:50.156628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ab2e2b51-0fce-47d8-a51f-537afe2757c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:52.468655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6871d65-b374-4006-a51c-cfe71aaa773e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:53.563748 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:55.021862 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:56.020309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:24:57.374479 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d199679-8858-42d8-bd59-c3f7def310cb req-2de0e275-1cd1-4155-8a4c-f59f24223f0f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:57.375959 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0d199679-8858-42d8-bd59-c3f7def310cb req-2de0e275-1cd1-4155-8a4c-f59f24223f0f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.1020346 Nov 05 15:24:57.425265 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0d199679-8858-42d8-bd59-c3f7def310cb req-c1aefb53-0764-4284-bc2d-de1bc6be3a4c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428033 Nov 05 15:24:58.557319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3a1218-f849-4982-8ba2-a6c56203876d req-eba8a091-51c8-4695-be88-16707d7e60c7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:58.558786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f3a1218-f849-4982-8ba2-a6c56203876d req-eba8a091-51c8-4695-be88-16707d7e60c7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0492063 Nov 05 15:24:58.606791 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1f3a1218-f849-4982-8ba2-a6c56203876d req-a0f94d1d-4dfc-4fce-a082-a653d74eddee tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415149 Nov 05 15:24:59.743505 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04049308-c751-4462-8aab-7f31434dadc7 req-082f5189-477c-405d-941d-2dc590e273ce tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:24:59.745013 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-04049308-c751-4462-8aab-7f31434dadc7 req-082f5189-477c-405d-941d-2dc590e273ce tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0505528 Nov 05 15:24:59.794234 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-04049308-c751-4462-8aab-7f31434dadc7 req-ef4c2c12-c6f7-4c9a-b7c3-3302dd660e66 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432177 Nov 05 15:25:00.909365 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39490557-e225-4b70-91ce-de0fb97c455c req-f779830b-cb79-483b-bced-f46993ec84f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:00.910815 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39490557-e225-4b70-91ce-de0fb97c455c req-f779830b-cb79-483b-bced-f46993ec84f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0521796 Nov 05 15:25:00.958348 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-39490557-e225-4b70-91ce-de0fb97c455c req-2a611822-1e50-47af-a206-a371f9b3a523 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417221 Nov 05 15:25:02.074454 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93289f3-09c4-4d60-8a39-a4efef6dbc09 req-52e2c94b-0cb8-4da7-b949-e7df6f54a4b2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:02.075925 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e93289f3-09c4-4d60-8a39-a4efef6dbc09 req-52e2c94b-0cb8-4da7-b949-e7df6f54a4b2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0491357 Nov 05 15:25:02.124132 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e93289f3-09c4-4d60-8a39-a4efef6dbc09 req-c47bd164-bd9d-4be4-8c4f-8e0a7979f760 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423522 Nov 05 15:25:03.238781 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af76671-bd9f-4bba-8f1d-5a900af57724 req-c5412228-db20-48e0-8b05-d386630fd200 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:03.240236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5af76671-bd9f-4bba-8f1d-5a900af57724 req-c5412228-db20-48e0-8b05-d386630fd200 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0486529 Nov 05 15:25:03.287493 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5af76671-bd9f-4bba-8f1d-5a900af57724 req-f979aae2-1bd8-4614-8486-1988b01dc14a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414419 Nov 05 15:25:04.404625 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f32173-d849-4cc5-97b3-55195bc6e9b4 req-f643f30f-703c-4659-ba1e-8774b4dca43e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:04.406119 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e3f32173-d849-4cc5-97b3-55195bc6e9b4 req-f643f30f-703c-4659-ba1e-8774b4dca43e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0518806 Nov 05 15:25:04.455781 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e3f32173-d849-4cc5-97b3-55195bc6e9b4 req-091c36c5-b9fe-41a7-958b-3dcb9c39bf17 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431540 Nov 05 15:25:05.568287 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd0fff4-b7da-4a41-9c4e-b9091b4e9a25 req-fd74dabf-84da-4845-8916-57a82de8c214 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:05.569810 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5bd0fff4-b7da-4a41-9c4e-b9091b4e9a25 req-fd74dabf-84da-4845-8916-57a82de8c214 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0482693 Nov 05 15:25:05.621956 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-5bd0fff4-b7da-4a41-9c4e-b9091b4e9a25 req-386fe0d9-9a86-4956-9599-6c2e8e91147e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463791 Nov 05 15:25:06.736041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20d3596-9bfc-4e81-b4ac-ce2906ed052d req-6214a61d-e66e-444e-bea2-03c5caea8b09 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:06.737436 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b20d3596-9bfc-4e81-b4ac-ce2906ed052d req-6214a61d-e66e-444e-bea2-03c5caea8b09 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0488653 Nov 05 15:25:06.785368 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b20d3596-9bfc-4e81-b4ac-ce2906ed052d req-99df7cd8-96bf-4b1d-9f49-dafa25cfde97 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421195 Nov 05 15:25:07.900055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83be8292-30c3-4401-b962-2c0e17985488 req-4827d32a-748f-4f41-a580-3c1bd8ad8a8a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:07.901562 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83be8292-30c3-4401-b962-2c0e17985488 req-4827d32a-748f-4f41-a580-3c1bd8ad8a8a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0494421 Nov 05 15:25:07.955309 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-83be8292-30c3-4401-b962-2c0e17985488 req-de0634eb-5c21-41e3-8f90-8da1e83228aa tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454755 Nov 05 15:25:09.068424 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48faa954-6a37-4a97-bacc-f1dd10cb51c0 req-0207d954-f478-44c0-9ab4-db142cb39600 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:09.069919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48faa954-6a37-4a97-bacc-f1dd10cb51c0 req-0207d954-f478-44c0-9ab4-db142cb39600 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0479250 Nov 05 15:25:09.121561 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-48faa954-6a37-4a97-bacc-f1dd10cb51c0 req-2d7032ea-01e7-4b15-a3e7-e5ca0fece3fa tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458300 Nov 05 15:25:09.200863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:25:09.299001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:09.309901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '60490396-8832-400d-8303-04a234bb1b05', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:25:09.345796 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:09.358723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:25:09.379622 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:09.382651 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:09.439701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:25:09.447123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.447488 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.447939 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.448195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.448577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.448910 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.449236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.449576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.449898 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.450216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.450535 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.450843 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:25:09.458858 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['60490396-8832-400d-8303-04a234bb1b05'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:25:10.241804 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a1cc27-435b-4e35-9f42-270422cbdc36 req-4023a974-47ff-4e43-9c4b-c3206149d2f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:10.243344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3a1cc27-435b-4e35-9f42-270422cbdc36 req-4023a974-47ff-4e43-9c4b-c3206149d2f4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0524752 Nov 05 15:25:10.295911 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3a1cc27-435b-4e35-9f42-270422cbdc36 req-e919a0dc-5439-4cfb-902b-f7b40b0bb341 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463045 Nov 05 15:25:11.223399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:25:11.274047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 60490396-8832-400d-8303-04a234bb1b05 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:25:11.274426 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:11.367545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:11.393517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:25:11.395754 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9f332d2-2e58-4c0e-b956-6c1e6c7c1fa8" -d '{"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:25:11.427410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:11.435337 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:11.479594 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6fd9fd-9915-496d-bb91-a65f748cc2d7 req-df446da1-c22a-455c-b99c-df65be7f0cbc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:11.492112 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b6fd9fd-9915-496d-bb91-a65f748cc2d7 req-df446da1-c22a-455c-b99c-df65be7f0cbc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0962648 Nov 05 15:25:11.525417 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:25:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09568d59-60bf-4124-b399-e114568c4713 x-openstack-request-id: req-09568d59-60bf-4124-b399-e114568c4713 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:25:11.525792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:25:11.525990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-09568d59-60bf-4124-b399-e114568c4713 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:25:11.526326 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'code': 200} Nov 05 15:25:11.542705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:25:11.574503 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4b6fd9fd-9915-496d-bb91-a65f748cc2d7 req-d1a39e19-dff3-4281-9eb7-0c106f4b993c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803807 Nov 05 15:25:12.709461 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ceca53-bb89-4119-adf4-d76848edc610 req-8e0d896e-0f6b-4789-bb7b-5f324564e4f8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:12.711005 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31ceca53-bb89-4119-adf4-d76848edc610 req-8e0d896e-0f6b-4789-bb7b-5f324564e4f8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0605879 Nov 05 15:25:12.769075 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31ceca53-bb89-4119-adf4-d76848edc610 req-db093012-cbca-4806-b9e8-2484b395834d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499673 Nov 05 15:25:13.912752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a6ca24-1a0a-458f-b93b-b83578760d57 req-c42a4c0d-6742-40e8-b74b-9c72d4dded7f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:13.919880 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f8a6ca24-1a0a-458f-b93b-b83578760d57 req-c42a4c0d-6742-40e8-b74b-9c72d4dded7f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0645311 Nov 05 15:25:13.973046 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f8a6ca24-1a0a-458f-b93b-b83578760d57 req-de6ad4fd-98d8-49aa-8d7c-1b9e137dc3a2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517628 Nov 05 15:25:15.103245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0976cbc-a3be-4c64-9f3e-432cb45fd2ef req-20c4e196-21c2-49a0-a96f-11af1a74d911 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:15.104924 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a0976cbc-a3be-4c64-9f3e-432cb45fd2ef req-20c4e196-21c2-49a0-a96f-11af1a74d911 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0568631 Nov 05 15:25:15.159616 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-a0976cbc-a3be-4c64-9f3e-432cb45fd2ef req-42c4eba9-6f31-4798-ab39-49559885df6f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487139 Nov 05 15:25:16.285232 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b32c4e-5cb0-48af-a24a-3de53ef8b7cc req-ae10d054-8975-4971-97a3-2d521b154ba9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:16.286778 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78b32c4e-5cb0-48af-a24a-3de53ef8b7cc req-ae10d054-8975-4971-97a3-2d521b154ba9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0564549 Nov 05 15:25:16.351833 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-78b32c4e-5cb0-48af-a24a-3de53ef8b7cc req-aad4b089-87b0-4f72-b042-0b84ab3e4734 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569618 Nov 05 15:25:17.476281 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c508cd2a-b72d-4499-9c8f-025240db3e6c req-6bf893d3-0a89-408b-ab78-559b74531ece tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:17.485140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c508cd2a-b72d-4499-9c8f-025240db3e6c req-6bf893d3-0a89-408b-ab78-559b74531ece tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0594797 Nov 05 15:25:17.523839 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:25:17.548021 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c508cd2a-b72d-4499-9c8f-025240db3e6c req-db6204c1-7b5b-4776-912f-114454e14f60 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558436 Nov 05 15:25:18.575866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:18.670664 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bb5673-1c5d-41d1-b535-abdc06392cdc req-cb29701b-20cf-41f6-8f42-25ae8eae1b64 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:18.672314 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-25bb5673-1c5d-41d1-b535-abdc06392cdc req-cb29701b-20cf-41f6-8f42-25ae8eae1b64 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0501378 Nov 05 15:25:18.730299 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-25bb5673-1c5d-41d1-b535-abdc06392cdc req-41518462-9185-4455-af19-3b16f80c3302 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454106 Nov 05 15:25:19.281767 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-19d1e667-fa5a-4f21-bfed-bf1659dfbd10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:19.283287 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-19d1e667-fa5a-4f21-bfed-bf1659dfbd10 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1098 time: 0.0401537 Nov 05 15:25:19.372258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-c8c4896e-0216-48e7-a460-8720a9ce2c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:19.373747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-c8c4896e-0216-48e7-a460-8720a9ce2c1f service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0827279 Nov 05 15:25:19.441344 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-5ef6f68c-226d-4d7d-b018-da826a2cb0d7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1001 time: 0.0611007 Nov 05 15:25:19.490448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-2f3067dc-571f-40d5-9f79-699a1642208f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:19.491891 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-2f3067dc-571f-40d5-9f79-699a1642208f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0436015 Nov 05 15:25:19.537099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-8df87e70-bf8c-47c6-8041-9475e0865418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:19.538489 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-8df87e70-bf8c-47c6-8041-9475e0865418 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398691 Nov 05 15:25:19.549629 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-651b3e81-50f9-4254-94b0-ad2800c3c319 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:25:19.550620 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-651b3e81-50f9-4254-94b0-ad2800c3c319 service neutron] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053997 Nov 05 15:25:19.641693 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-0eaf74a7-1a42-4d7c-8ee8-27745022265b service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832498 Nov 05 15:25:19.731135 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8fabd9f9-9e1d-42f6-b921-40fa2db53d2b req-25965a7d-0c20-4c1b-85e1-8d8223cdcafa service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819728 Nov 05 15:25:19.858174 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ba489d-b25e-4448-b0a5-efe9634e2ffe req-0ebba740-ad4b-4ac9-88d2-9f23622ba19c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:19.859662 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ba489d-b25e-4448-b0a5-efe9634e2ffe req-0ebba740-ad4b-4ac9-88d2-9f23622ba19c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0597236 Nov 05 15:25:19.909305 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86ba489d-b25e-4448-b0a5-efe9634e2ffe req-2898bbe4-1d4f-45c8-ac78-2a779e0c1531 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437403 Nov 05 15:25:20.163481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-565c9a1b-c539-4eb0-9c13-af2c0c8fabf4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:21.021451 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9b5cd2-249f-45af-9972-59268bf9880b req-df47a2a7-f4db-4512-84d1-f1c1d7843d00 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:21.022910 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0d9b5cd2-249f-45af-9972-59268bf9880b req-df47a2a7-f4db-4512-84d1-f1c1d7843d00 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0489588 Nov 05 15:25:21.075571 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-0d9b5cd2-249f-45af-9972-59268bf9880b req-855567d7-6a83-4e2b-bb78-11224998748b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466557 Nov 05 15:25:22.193771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483ef49f-d6e4-46c3-a285-eeac4096799b req-1e3ef5fb-c174-4218-84b6-11def63416c5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:22.195249 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-483ef49f-d6e4-46c3-a285-eeac4096799b req-1e3ef5fb-c174-4218-84b6-11def63416c5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0489266 Nov 05 15:25:22.243442 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-483ef49f-d6e4-46c3-a285-eeac4096799b req-b445ad74-9c77-47fc-9a7d-6c67d7f61f82 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423310 Nov 05 15:25:22.351644 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-8d760470-5276-424e-b077-d77ed254433f req-6d387761-c91b-42b5-b01a-4212dd49fe16 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:25:22.352646 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8d760470-5276-424e-b077-d77ed254433f req-6d387761-c91b-42b5-b01a-4212dd49fe16 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0471439 Nov 05 15:25:22.470474 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-66066dfd-52b1-48f1-bdd4-52f3b88e9561 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:22.522707 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40882a84-8d70-4c9c-8c02-55e09d7a907e req-c3ad87bf-fe93-4d69-a3e1-77c702cb7a40 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:22.524194 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40882a84-8d70-4c9c-8c02-55e09d7a907e req-c3ad87bf-fe93-4d69-a3e1-77c702cb7a40 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 945 time: 0.0599964 Nov 05 15:25:22.576962 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40882a84-8d70-4c9c-8c02-55e09d7a907e req-ba0f4111-3423-416e-827f-56032c03d720 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468123 Nov 05 15:25:22.699278 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-df95c3af-99da-4514-a921-348757aebbec service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0806873 Nov 05 15:25:23.276014 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:25:23.349226 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:23.371187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:25:23.373422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d40381b9-b6cf-4f66-a0df-53ff66b71599" -d '{"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-unplugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:25:23.386193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:23.390339 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:23.416324 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:25:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83ace268-bd6f-434d-98a3-fb93e00f6ac2 x-openstack-request-id: req-83ace268-bd6f-434d-98a3-fb93e00f6ac2 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:25:23.416638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-unplugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:25:23.416888 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-83ace268-bd6f-434d-98a3-fb93e00f6ac2 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:25:23.417271 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'code': 200} Nov 05 15:25:23.444669 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:25:23.514867 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9353e452-1783-40e6-a16d-da980459a4a1 req-ab927195-4209-4454-8d80-139114c51dfe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.516882 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-ab927195-4209-4454-8d80-139114c51dfe service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 1096 time: 0.0416296 Nov 05 15:25:23.567412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:23.577387 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9353e452-1783-40e6-a16d-da980459a4a1 req-39c8d3ce-bba6-4a4b-907e-fbed54218098 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.579370 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-39c8d3ce-bba6-4a4b-907e-fbed54218098 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1096 time: 0.0397646 Nov 05 15:25:23.697814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9353e452-1783-40e6-a16d-da980459a4a1 req-a60cb305-bade-4d9f-8e44-cc8e66c7f052 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.699252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-a60cb305-bade-4d9f-8e44-cc8e66c7f052 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.1125226 Nov 05 15:25:23.720070 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa2cf3e-2e2b-450d-b6b5-32af7aacde61 req-8ac4b89c-826d-45c1-89ab-ef2394f6b046 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.721477 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bfa2cf3e-2e2b-450d-b6b5-32af7aacde61 req-8ac4b89c-826d-45c1-89ab-ef2394f6b046 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0746706 Nov 05 15:25:23.799557 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-0ec20b11-261b-41d2-b476-41bc99c079e2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 999 time: 0.0933888 Nov 05 15:25:23.820971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bfa2cf3e-2e2b-450d-b6b5-32af7aacde61 req-82b22ba5-bc28-4c12-952d-6881682ab8f5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680149 Nov 05 15:25:23.854731 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9353e452-1783-40e6-a16d-da980459a4a1 req-2fa4ef89-a145-4573-8d33-ed4f61e98af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.856163 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-2fa4ef89-a145-4573-8d33-ed4f61e98af6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0482035 Nov 05 15:25:23.900859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9353e452-1783-40e6-a16d-da980459a4a1 req-41d2d57d-0a51-4bef-a312-e499004a534b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:23.902319 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-41d2d57d-0a51-4bef-a312-e499004a534b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0390716 Nov 05 15:25:23.991629 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-809c7586-f48b-4340-9265-732e210afccd service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821176 Nov 05 15:25:24.077422 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9353e452-1783-40e6-a16d-da980459a4a1 req-ce4e9e24-9c6b-4253-9bd7-988dfb4c5498 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789921 Nov 05 15:25:24.949167 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8999d4f4-fd9d-4d83-9c27-3a31a832f137 req-3b83d2d6-1a06-40a6-aa63-293678e64bfe tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:24.950716 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8999d4f4-fd9d-4d83-9c27-3a31a832f137 req-3b83d2d6-1a06-40a6-aa63-293678e64bfe tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0563064 Nov 05 15:25:25.013996 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8999d4f4-fd9d-4d83-9c27-3a31a832f137 req-93e1146f-f78c-4572-a87b-c0d6d7d0e57f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567153 Nov 05 15:25:25.034812 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:26.021681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:26.155154 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42248470-3890-4bac-80be-471ffed8bca9 req-a2de1476-c471-4e6c-b431-b4d730035360 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:26.157267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42248470-3890-4bac-80be-471ffed8bca9 req-a2de1476-c471-4e6c-b431-b4d730035360 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0568690 Nov 05 15:25:26.206934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42248470-3890-4bac-80be-471ffed8bca9 req-e788296b-2942-4475-82cb-9d5412244ce5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432284 Nov 05 15:25:27.343832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f6be1b-7196-4335-8ba7-a82a259aa221 req-8229be1a-c4c0-469c-8f51-411ebc406a9e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:27.346709 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02f6be1b-7196-4335-8ba7-a82a259aa221 req-8229be1a-c4c0-469c-8f51-411ebc406a9e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0590322 Nov 05 15:25:27.398809 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02f6be1b-7196-4335-8ba7-a82a259aa221 req-6f98cd79-328a-41c9-a4d2-436692cd6c65 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459585 Nov 05 15:25:28.529294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcf5ecf-c349-467d-9db3-eb065b7f3056 req-36a0f3f2-ea1b-4292-879b-11c225a88e69 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:28.531650 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1fcf5ecf-c349-467d-9db3-eb065b7f3056 req-36a0f3f2-ea1b-4292-879b-11c225a88e69 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0524802 Nov 05 15:25:28.590688 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1fcf5ecf-c349-467d-9db3-eb065b7f3056 req-c7cc3a74-9216-42f3-ab6f-6d11254d3ee4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439951 Nov 05 15:25:29.718639 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a10be-cf66-4230-8a4e-4b7fccb5b80f req-7f45f80e-3901-4926-84cb-28c51253af18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:29.720158 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-849a10be-cf66-4230-8a4e-4b7fccb5b80f req-7f45f80e-3901-4926-84cb-28c51253af18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0549879 Nov 05 15:25:29.773919 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-849a10be-cf66-4230-8a4e-4b7fccb5b80f req-c62b57f0-9401-4d7b-8264-eecb9b005afc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461845 Nov 05 15:25:30.909081 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60854f72-51c8-4ac3-92b1-9e1a9156bfe3 req-b6229df0-aef9-4512-9635-7c038c0727fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:30.910759 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-60854f72-51c8-4ac3-92b1-9e1a9156bfe3 req-b6229df0-aef9-4512-9635-7c038c0727fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0563202 Nov 05 15:25:30.971893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-60854f72-51c8-4ac3-92b1-9e1a9156bfe3 req-b2b6647b-4a8d-444e-91db-d4d42410d4e3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530615 Nov 05 15:25:32.103257 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe230a0-2b86-41d7-bfd4-4f69214d839c req-27ef31db-6a7c-4d58-a58e-208f8c1bfbc4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:32.104792 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2fe230a0-2b86-41d7-bfd4-4f69214d839c req-27ef31db-6a7c-4d58-a58e-208f8c1bfbc4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0562780 Nov 05 15:25:32.159665 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2fe230a0-2b86-41d7-bfd4-4f69214d839c req-f5a3066c-7c57-4f6e-bad0-71bf92fef7ea tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488641 Nov 05 15:25:33.279168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5db2ac4-9c7a-4f5e-b342-d4796c6862dd req-a8829c01-8d1a-4712-ab0f-1ed916db5368 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:33.281162 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5db2ac4-9c7a-4f5e-b342-d4796c6862dd req-a8829c01-8d1a-4712-ab0f-1ed916db5368 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0493391 Nov 05 15:25:33.333948 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e5db2ac4-9c7a-4f5e-b342-d4796c6862dd req-f96e94c7-50b8-43a0-87e4-2a0df4ef51b9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467834 Nov 05 15:25:34.455578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99958660-f6fa-4194-8a22-d0a92740f160 req-3adcbbcb-8105-4ae4-8a46-976814c9e1f5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:34.457063 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-99958660-f6fa-4194-8a22-d0a92740f160 req-3adcbbcb-8105-4ae4-8a46-976814c9e1f5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0539167 Nov 05 15:25:34.507138 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-99958660-f6fa-4194-8a22-d0a92740f160 req-6da5e546-eb26-4f3d-83bd-8185173bc531 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442278 Nov 05 15:25:35.623686 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684d0009-2f89-4f8a-8867-4a4fda4cb9a6 req-dc5d48eb-b437-41ab-8504-1c6da6af7dbe tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:35.625164 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-684d0009-2f89-4f8a-8867-4a4fda4cb9a6 req-dc5d48eb-b437-41ab-8504-1c6da6af7dbe tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0479860 Nov 05 15:25:35.677894 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-684d0009-2f89-4f8a-8867-4a4fda4cb9a6 req-e43b0850-bb5d-4f95-af96-ee9447bc9164 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469141 Nov 05 15:25:36.791757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-956c06e4-722c-4dab-b2c1-29fc38018daa req-f7d8c639-f31f-426b-84c7-32ef4da1432c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:36.793188 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-956c06e4-722c-4dab-b2c1-29fc38018daa req-f7d8c639-f31f-426b-84c7-32ef4da1432c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 943 time: 0.0493193 Nov 05 15:25:36.842229 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-956c06e4-722c-4dab-b2c1-29fc38018daa req-a8bbf392-5465-4539-80f5-ef5548449e1a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431993 Nov 05 15:25:37.355590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:25:37.448143 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:37.459039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': '60490396-8832-400d-8303-04a234bb1b05', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'port_id': '60490396-8832-400d-8303-04a234bb1b05', 'mac_address': 'fa:16:3e:b3:ae:a1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:25:37.495147 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:37.508479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:25:37.527478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:37.531709 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:37.579656 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=9']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:25:37.784306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['60490396-8832-400d-8303-04a234bb1b05'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:25:37.954851 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d7f578-cad2-4afd-9ab6-5962275862a9 req-bee9f17d-f188-4038-bdc6-880ca986e306 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:37.956336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e2d7f578-cad2-4afd-9ab6-5962275862a9 req-bee9f17d-f188-4038-bdc6-880ca986e306 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0481968 Nov 05 15:25:38.005682 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e2d7f578-cad2-4afd-9ab6-5962275862a9 req-67e0353a-5d48-4338-8094-15b6dab45647 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428863 Nov 05 15:25:39.117730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21a99195-2dd8-4e0d-84b9-865b3b057199 req-95afe30c-3dd0-44b6-aa24-297ca1314235 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:39.119154 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-21a99195-2dd8-4e0d-84b9-865b3b057199 req-95afe30c-3dd0-44b6-aa24-297ca1314235 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 944 time: 0.0475190 Nov 05 15:25:39.171509 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-21a99195-2dd8-4e0d-84b9-865b3b057199 req-89b90b2d-f088-46df-bc98-e77fdbc1db3e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459807 Nov 05 15:25:39.369852 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:25:39.415970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port 60490396-8832-400d-8303-04a234bb1b05 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:25:39.416330 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:39.491922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:39.513550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:25:39.515816 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccf77377-5338-4e95-81b7-3c94d0732bf3" -d '{"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:25:39.527458 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:25:39.531920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:39.556243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:25:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f80db544-2d6b-48cc-a0b9-8e36bec0ed76 x-openstack-request-id: req-f80db544-2d6b-48cc-a0b9-8e36bec0ed76 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:25:39.556559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-plugged", "status": "completed", "tag": "60490396-8832-400d-8303-04a234bb1b05", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:25:39.556800 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f80db544-2d6b-48cc-a0b9-8e36bec0ed76 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:25:39.557180 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'code': 200} Nov 05 15:25:39.580610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=10']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:25:39.775874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e828551a-25ee-4002-9cef-df60c7e260f2 req-e8d6cecb-b4f1-412b-b678-0c16c425a9f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:39.777359 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e828551a-25ee-4002-9cef-df60c7e260f2 req-e8d6cecb-b4f1-412b-b678-0c16c425a9f3 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1099 time: 0.0385418 Nov 05 15:25:39.822234 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e828551a-25ee-4002-9cef-df60c7e260f2 req-db6f5a25-9865-446c-af45-506dbbd7edef service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379961 Nov 05 15:25:40.283676 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9dc6b2-b799-4bfc-9679-e79cdc6c9359 req-ea9b91aa-8daf-47ed-ad3f-c4c76c2be307 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:40.285199 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf9dc6b2-b799-4bfc-9679-e79cdc6c9359 req-ea9b91aa-8daf-47ed-ad3f-c4c76c2be307 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0483534 Nov 05 15:25:40.338243 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-cf9dc6b2-b799-4bfc-9679-e79cdc6c9359 req-07de1e4d-69b6-43a7-b8c4-51ff480afd7d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468094 Nov 05 15:25:40.547859 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-f2b5e777-157b-43e5-b2a3-21a2064bd109 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:40.549360 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-f2b5e777-157b-43e5-b2a3-21a2064bd109 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1099 time: 0.0443511 Nov 05 15:25:40.655017 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-023eee01-ae33-4c85-9ec8-d368c4b72af1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:40.656767 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-023eee01-ae33-4c85-9ec8-d368c4b72af1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0832944 Nov 05 15:25:40.727106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-74428928-a3c0-4149-a5be-72051718ea64 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1001 time: 0.0623212 Nov 05 15:25:40.777267 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-82053fa4-bcea-487b-ae8d-2e04727d4247 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:40.778658 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-82053fa4-bcea-487b-ae8d-2e04727d4247 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0418701 Nov 05 15:25:40.826790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-fc7dc55b-0f12-4a43-a472-9e9687c87f94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:40.828387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-fc7dc55b-0f12-4a43-a472-9e9687c87f94 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0398228 Nov 05 15:25:40.923329 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-6cd0cfbc-1122-4bc3-b11b-6d005c8d667d service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869465 Nov 05 15:25:41.016924 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f3e09996-e0a3-4edc-b7e4-e3d8c276f890 req-7c068e05-bb7f-4d57-a54e-7a7b2a80b4fd service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840142 Nov 05 15:25:41.456243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42245646-da3f-4cf2-8e37-6effa575e80a req-bb96d537-5233-48d5-9406-1a25272cdad4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:41.457763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42245646-da3f-4cf2-8e37-6effa575e80a req-bb96d537-5233-48d5-9406-1a25272cdad4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0504539 Nov 05 15:25:41.507486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-42245646-da3f-4cf2-8e37-6effa575e80a req-8628cfa6-a40d-4d8e-943b-c6924e70af1b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438476 Nov 05 15:25:42.623059 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce3893f5-5f28-412a-b996-1539c39d5f24 req-1aa73361-cfb7-4ffa-b2af-6b723153ce0b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:25:42.624558 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce3893f5-5f28-412a-b996-1539c39d5f24 req-1aa73361-cfb7-4ffa-b2af-6b723153ce0b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0493016 Nov 05 15:25:42.673489 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce3893f5-5f28-412a-b996-1539c39d5f24 req-7286fa3d-ce5e-441f-b557-9f3a1c4a0e6f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430257 Nov 05 15:25:48.578389 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:50.156054 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfb309ec-47b4-4834-8c9b-38561dcde2e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:52.472971 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d54f0a93-2400-448d-b9e2-127a4f2e57a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:53.569653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:54.523716 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:25:55.028387 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:25:56.023172 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:18.569269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:20.158573 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6e02ee95-30fe-41f0-9c24-0ef10898846d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:22.477382 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4aa7b16c-d285-445a-9026-38c2d38dc1b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:23.573993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:25.031136 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:26.025414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:31.523004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:26:40.521220 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-6e8b5422-1bbc-4219-a31e-6513f7aa607b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0861239 Nov 05 15:26:40.600843 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-b7af45ee-68a8-4283-afbc-a138007ed5c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:40.602285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-b7af45ee-68a8-4283-afbc-a138007ed5c9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1099 time: 0.0395832 Nov 05 15:26:40.705077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-eb8ad82e-1991-4534-8c3f-b83136c85096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:40.706440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-eb8ad82e-1991-4534-8c3f-b83136c85096 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0852456 Nov 05 15:26:40.771358 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-126d60fb-e6ca-4f0b-9913-aa5c64e282a6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 1001 time: 0.0573084 Nov 05 15:26:40.818972 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-6fe4e7ff-a70a-4be7-a6de-3e09c5ff873d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:40.820340 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-6fe4e7ff-a70a-4be7-a6de-3e09c5ff873d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0420613 Nov 05 15:26:40.871005 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-212a8be2-0898-4d94-819d-eaa55e92f237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:40.872507 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-212a8be2-0898-4d94-819d-eaa55e92f237 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0456314 Nov 05 15:26:40.963411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-f0d25476-c3de-4e92-b0a5-9fb779c4ae91 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832143 Nov 05 15:26:41.054274 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f899cdbd-42d2-446e-8c51-2a48c61fac61 req-f9bb06a4-2fcb-4f7d-8138-aa00e25b3482 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837963 Nov 05 15:26:48.583366 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:50.162425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-619c989b-4519-44f6-8f4b-dabb182f6881 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:51.583930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52212) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:51.739642 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Deleting port 2530acd0-2205-43ad-8ac4-d1b71e059d27 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:26:51.739870 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:51.818717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:51.819040 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:51.830894 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Calling delete_port for 2530acd0-2205-43ad-8ac4-d1b71e059d27 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:26:51.972843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:52.001253 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'Port': ['ID=2530acd0-2205-43ad-8ac4-d1b71e059d27,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:52.012251 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.012635 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.012976 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.013308 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.013638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.013968 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.014294 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.014618 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.014942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.015262 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.015579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.015899 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:52.070147 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:52.070471 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Floating IP 844ca339-3611-439b-8c8f-0c997bff43c0 disassociated (deleted). External IP: 172.26.5.121, port: 60490396-8832-400d-8303-04a234bb1b05. Nov 05 15:26:52.277670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:26:52.383203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:26:52.387942 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:52.392719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:26:52.402084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:26:52.402687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:26:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:26:52.415999 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-3a97f444-9e66-4c73-8774-6905fabc7949 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "DELETE /v2.0/floatingips/844ca339-3611-439b-8c8f-0c997bff43c0 HTTP/1.1" status: 204 len: 168 time: 0.8309028 Nov 05 15:26:52.416721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:26:52.419081 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5ec2c34-a51f-456c-998e-229ff42e29d1" -d '{"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:26:52.520890 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-638d876f-ef3f-4950-8a11-bf3ed05770f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:52.525433 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:26:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4377978-a784-4f5c-a9a6-510b1f4231b8 x-openstack-request-id: req-f4377978-a784-4f5c-a9a6-510b1f4231b8 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:26:52.526042 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "tag": "60490396-8832-400d-8303-04a234bb1b05", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:26:52.527019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f4377978-a784-4f5c-a9a6-510b1f4231b8 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:26:52.529814 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'status': 'completed', 'code': 200} Nov 05 15:26:52.538020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:26:52.598124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-402ace03-1123-4ab0-8d7b-843ad9c53e0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:52.599690 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-402ace03-1123-4ab0-8d7b-843ad9c53e0e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 1099 time: 0.0461783 Nov 05 15:26:52.653320 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da6ef2a-a2a5-4bec-a80a-7b4ad72788ad req-fbf76ccc-c955-4dcc-993a-2a0985a1bda8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:52.655104 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6da6ef2a-a2a5-4bec-a80a-7b4ad72788ad req-fbf76ccc-c955-4dcc-993a-2a0985a1bda8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0499725 Nov 05 15:26:52.694667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-da40713f-01f5-4839-80eb-33024e84c1cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:52.696165 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-da40713f-01f5-4839-80eb-33024e84c1cf service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0891669 Nov 05 15:26:52.716360 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-6da6ef2a-a2a5-4bec-a80a-7b4ad72788ad req-93c9ff68-6f04-46c8-a5fd-2a70533fb7f8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525200 Nov 05 15:26:52.745387 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-518c6b45-bdba-4f0d-a805-9368fba4c899 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 200 len: 217 time: 0.0409100 Nov 05 15:26:52.797021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-81598b01-85f1-4b65-bc21-9147bfc6cdb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:52.798408 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-81598b01-85f1-4b65-bc21-9147bfc6cdb3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0448287 Nov 05 15:26:52.848040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-87060815-39f6-4836-a582-068bb1b4a4ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:52.849652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-87060815-39f6-4836-a582-068bb1b4a4ca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0428765 Nov 05 15:26:52.901773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:26:52.927837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:26:52.935930 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:26:52.936576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:26:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:26:52.943548 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-f94390af-c3da-46a6-aae6-adf379d76015 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858731 Nov 05 15:26:53.030889 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f5ec2c34-a51f-456c-998e-229ff42e29d1 req-d3644988-45be-40ff-abdc-ac081db684fc service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803938 Nov 05 15:26:53.043285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:26:53.237502 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:26:53.262267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f848dad-a357-48ac-a109-5026b6cefdb8 None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:26:53.485136 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25b7da99-eb5e-478d-859c-9596631170e6 None None] New status for floating IP 844ca339-3611-439b-8c8f-0c997bff43c0: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:26:53.575867 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:53.832339 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648bee49-9ab3-4078-b8fc-6664a7cec56b req-7d8bce94-e849-491c-a9c8-8298bf6cf3c6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:53.833770 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-648bee49-9ab3-4078-b8fc-6664a7cec56b req-7d8bce94-e849-491c-a9c8-8298bf6cf3c6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0488575 Nov 05 15:26:53.885334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-648bee49-9ab3-4078-b8fc-6664a7cec56b req-577d5fff-337c-4132-a224-4fa64b788fb5 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=ea793308-b85b-4314-96d4-fe3eaa2fe639&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457489 Nov 05 15:26:53.943561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c446825a-7251-41a7-b2b7-df147f764a81 req-aadcfb74-3550-46f7-a65f-40d1f475c5dd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:26:53.945055 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c446825a-7251-41a7-b2b7-df147f764a81 req-aadcfb74-3550-46f7-a65f-40d1f475c5dd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/ports?device_id=8c4dd49c-a004-4b4d-90bb-8c753e0570c0 HTTP/1.1" status: 200 len: 946 time: 0.0469925 Nov 05 15:26:54.032415 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Deleting port 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:26:54.032771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:54.127914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] For port 60490396-8832-400d-8303-04a234bb1b05, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=60490396-8832-400d-8303-04a234bb1b05,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:26:54.128160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:54.141052 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Calling delete_port for 60490396-8832-400d-8303-04a234bb1b05 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:26:54.285018 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:54.314856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'Port': ['ID=60490396-8832-400d-8303-04a234bb1b05,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:54.340201 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.340569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.340904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.341230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.341550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.341874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.342192 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.342508 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.342824 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.343138 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.343447 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.343757 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:26:54.366294 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] No DVR routers for this DVR port 60490396-8832-400d-8303-04a234bb1b05 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:26:54.368760 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:54.372120 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c446825a-7251-41a7-b2b7-df147f764a81 req-9d73cd46-c6fd-482b-b7f3-891cdb24a126 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "DELETE /v2.0/ports/60490396-8832-400d-8303-04a234bb1b05 HTTP/1.1" status: 204 len: 173 time: 0.4212708 Nov 05 15:26:54.372585 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-deleted', 'tag': '60490396-8832-400d-8303-04a234bb1b05'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:26:54.374810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f9fc31b-c688-4867-ad5b-f5dcf3da96b3" -d '{"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-deleted", "tag": "60490396-8832-400d-8303-04a234bb1b05"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:26:54.586435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:26:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb7cd4e5-def0-42c4-8371-7cd6cf66089f x-openstack-request-id: req-fb7cd4e5-def0-42c4-8371-7cd6cf66089f {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:26:54.586727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c4dd49c-a004-4b4d-90bb-8c753e0570c0", "name": "network-vif-deleted", "tag": "60490396-8832-400d-8303-04a234bb1b05", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:26:54.586976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fb7cd4e5-def0-42c4-8371-7cd6cf66089f {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:26:54.587376 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c4dd49c-a004-4b4d-90bb-8c753e0570c0', 'name': 'network-vif-deleted', 'tag': '60490396-8832-400d-8303-04a234bb1b05', 'status': 'completed', 'code': 200} Nov 05 15:26:54.942823 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52236) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.002134 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.027651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.036991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.088314 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.090866 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.092001 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "DELETE /v2.0/security-groups/ea793308-b85b-4314-96d4-fe3eaa2fe639 HTTP/1.1" status: 204 len: 168 time: 0.1482112 Nov 05 15:26:55.102185 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a8a5ac-61a5-439d-bd49-f01fa82ad3fd tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea793308-b85b-4314-96d4-fe3eaa2fe639,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.405048 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52242) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.409617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-819224054', 'description': 'tempest-secgroup-smoke-819224054 description', 'project_id': '0c7efefc4d474bc2882d41e4cb713041'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:55.431338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.496438 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.500265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.533664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.534867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1288173 Nov 05 15:26:55.537871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52244) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.538045 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f879c1aa-f456-4e48-940e-c8ec55f89642 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.543901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:55.571419 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.616551 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.619877 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.638238 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ac793d9c-a42e-4c26-959c-1e9f7fd2b242,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.643206 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.644483 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-8ddac146-377f-46b9-8ef2-86688a729693 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1054924 Nov 05 15:26:55.647111 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52246) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.651317 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:55.677443 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.731044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.734270 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.748927 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6420c8e-6043-471d-a8b2-b071e909e3ca,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.759961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.761172 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-940b75bc-5c24-41cb-aaae-bc455bb18ef8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1131523 Nov 05 15:26:55.763800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52248) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.768140 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:55.792351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.849849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.853085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.869965 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=513fccbb-8509-4dd1-80a9-dfbae764ddc2,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.878780 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.879976 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-6a512149-8ef5-4758-9810-f16a71e02f37 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1152697 Nov 05 15:26:55.882699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52250) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:55.887097 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:55.911980 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.971441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.975186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.993621 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ecd86ee-d4f4-4e17-8a59-48e4d1c5b448,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:55.998269 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:55.999443 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-f48d49ae-64cc-48fc-ae45-3d58fbe5f9f3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1157622 Nov 05 15:26:56.002118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52252) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:56.006351 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:56.026023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.027282 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Project 0c7efefc4d474bc2882d41e4cb713041 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:26:56.032446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.089226 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.092552 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.109604 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6afb641-3b01-4d8d-a9af-f8b05f0aecd1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:56.118014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.119190 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-cfdb7aa9-18bd-4a8a-b9c2-05dce0ccfdd2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1161549 Nov 05 15:26:56.121850 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52254) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:26:56.126141 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'security_group_rule': {'security_group_id': 'a7dcaa00-ab02-49c0-974b-6a2fe7a13bca', 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:26:56.150049 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Project 0c7efefc4d474bc2882d41e4cb713041 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:26:56.155469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.216087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.219724 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.239989 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7f56ab6b-7738-49f5-99c4-b65fbd753ce0,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:26:56.248333 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:26:56.249530 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-c662a0ef-4f02-43f0-aca2-e55e9d3fc47e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1267796 Nov 05 15:26:57.727403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:26:57.752984 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: 60490396-8832-400d-8303-04a234bb1b05 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:26:57.753380 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device 60490396-8832-400d-8303-04a234bb1b05 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:27:08.522145 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:27:11.517142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-587aa575-9615-470e-a347-868febe42e9b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-819224054&fields=id&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 267 time: 0.0509057 Nov 05 15:27:11.632694 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-acc7a845-a271-4853-809e-1030da58f9bc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:11.634089 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-acc7a845-a271-4853-809e-1030da58f9bc tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 809 time: 0.1072865 Nov 05 15:27:11.648674 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-ea5d7746-12a5-4b3c-8232-4c75732b8427 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/quotas/0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 375 time: 0.0088208 Nov 05 15:27:11.702706 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-5acbce58-e8e7-4e6f-9e0b-2cadb2557820 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0484464 Nov 05 15:27:11.795375 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-6ab7f8c7-99be-4faa-8d99-fe4baab46bf4 service neutron] 10.222.0.30 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816100 Nov 05 15:27:11.898944 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-fb5c378c-cbdf-4efe-a09b-c3b572c1efd8 service neutron] 10.222.0.30 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0943170 Nov 05 15:27:12.183241 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-242953f4-aa91-4941-b13a-c52b8f64feae req-fa5578ba-43f6-4359-93ca-0151cc182bed tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0269208 Nov 05 15:27:13.259728 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-61f6a995-33f6-4dce-b03f-633e69486385 req-4cbca71c-521d-4274-8b27-23da57f0631b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0265558 Nov 05 15:27:14.339899 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6bae1dcb-fecb-489a-99db-923876c12de4 req-444b1fcb-20f2-4ea0-b115-a42f9ed7a647 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0280201 Nov 05 15:27:15.416686 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bbdfdcd0-be36-4b12-8e3e-abe6f1fe17c0 req-0a08ca43-f4ac-48e1-bb01-5d9198d0091e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0274925 Nov 05 15:27:16.508384 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9adea9c7-cb12-48ab-ac98-b316cb30ec34 req-efeda5fb-655d-4adc-9609-9d18fd552716 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0261228 Nov 05 15:27:17.155115 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-614c4176-95c4-467c-a679-c19a7d4777bf tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:17.156595 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-614c4176-95c4-467c-a679-c19a7d4777bf tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 809 time: 0.1150126 Nov 05 15:27:17.221336 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-027f6f5f-8ed9-4f08-b7bf-86d106724467 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 379 time: 0.0560048 Nov 05 15:27:17.230805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'port': {'device_id': 'a9303778-b3c7-4312-b953-32118159570c', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'admin_state_up': True, 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'security_groups': ['a7dcaa00-ab02-49c0-974b-6a2fe7a13bca']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:27:17.338204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Made reservation on behalf of 0c7efefc4d474bc2882d41e4cb713041 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:27:17.341671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.466737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Allocated IP 172.20.0.8 (e8655efd-122a-4437-a816-c84a823b1b31/f1d2935c-89f4-4fbe-af92-79b9341cb914/e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:27:17.603796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9b077a55-8454-4c07-9c6a-2f0a9454dc67 req-6d7f1443-7864-46fe-ac6e-35df459d3096 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0286672 Nov 05 15:27:17.611124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.644588 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.688923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Network e8655efd-122a-4437-a816-c84a823b1b31 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:27:17.694595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:27:17.697128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:27:17.726455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:17.752551 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:17.753406 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.773615 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-33056c00-6bdc-44ba-a39b-f83b6ea4a081 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5462813 Nov 05 15:27:17.785594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Request body: {'port': {'device_id': 'a9303778-b3c7-4312-b953-32118159570c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:27:17.844847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.958741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-efdaa4df-0537-4cee-b307-5c979123e49b None None] Provisioning complete for port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:27:17.959371 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-efdaa4df-0537-4cee-b307-5c979123e49b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:17.992636 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-efdaa4df-0537-4cee-b307-5c979123e49b None None] Port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:27:18.111000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:27:18.118443 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.130810 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Transition to ACTIVE for port object e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:27:18.135128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.187038 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:18.257255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Attempting to bind port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:27:18.257587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Attempting to bind port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:27:18.257978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Attempting to bind port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:27:18.263422 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b on network e8655efd-122a-4437-a816-c84a823b1b31 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:27:18.263740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Attempting to bind port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b on network e8655efd-122a-4437-a816-c84a823b1b31 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:27:18.269520 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 26, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:27:18.269858 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Checking segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:27:18.270241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Bound using segment: {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:27:18.270813 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Bound port: e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '76bcfb05-f136-42d2-8142-74886a796859', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:27:18.271236 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.342517 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:27:18.345684 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:27:18.350902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.384617 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:18.385303 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.386796 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] 10.222.0.32 "PUT /v2.0/ports/e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 1093 time: 0.6055396 Nov 05 15:27:18.387233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:27:18.389464 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9" -d '{"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:27:18.454602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:27:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66c557e3-6052-48f0-b403-9980fb644cfa x-openstack-request-id: req-66c557e3-6052-48f0-b403-9980fb644cfa {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:27:18.454602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:27:18.454602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-66c557e3-6052-48f0-b403-9980fb644cfa {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:27:18.455050 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'status': 'completed', 'code': 200} Nov 05 15:27:18.472009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f088982d-b195-4c11-9733-a57eaa3c85e6 service neutron] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:18.490341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-78ea5894-72fc-4db0-aa70-260229298f8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:18.492210 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-78ea5894-72fc-4db0-aa70-260229298f8a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1096 time: 0.0493133 Nov 05 15:27:18.557069 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-8dbd0b6d-f166-4160-b0eb-5a8801d8aa41 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 217 time: 0.0571339 Nov 05 15:27:18.609201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:18.612371 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-9f2852a5-223b-484d-93fe-c1763db589bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:18.614176 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-9f2852a5-223b-484d-93fe-c1763db589bf service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0507488 Nov 05 15:27:18.686999 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-41230e8e-544a-4b4e-8689-f9a181217541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:18.689276 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-41230e8e-544a-4b4e-8689-f9a181217541 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0682874 Nov 05 15:27:18.754544 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d301d6-21e1-4c2d-8a4c-f912c9a3f314 req-806314b6-cdd7-4065-9367-2cfc1811ad6c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:18.756844 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-63d301d6-21e1-4c2d-8a4c-f912c9a3f314 req-806314b6-cdd7-4065-9367-2cfc1811ad6c tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0601900 Nov 05 15:27:18.812934 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-63d301d6-21e1-4c2d-8a4c-f912c9a3f314 req-72308bd8-7df8-4339-a545-18f779d06ad6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491414 Nov 05 15:27:19.105971 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-7bc5c075-a64a-4ffa-a0b7-80cec528213e service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4096651 Nov 05 15:27:19.198334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ff9e67cc-b5a2-4ba9-b865-92ca623cf237 req-c087a495-cee8-483b-87be-0c6e019f3b9f service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845838 Nov 05 15:27:19.286622 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-e7f5369b-8852-4eaf-9efc-fbad08f337d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:19.288128 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-e7f5369b-8852-4eaf-9efc-fbad08f337d2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1096 time: 0.0451612 Nov 05 15:27:19.377472 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-6aa1dd44-1316-4c0a-9bfd-9319b8338aff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:19.378887 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-6aa1dd44-1316-4c0a-9bfd-9319b8338aff service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0839663 Nov 05 15:27:19.420526 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-4e554508-e306-49a0-8faf-60259cca6296 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 217 time: 0.0349591 Nov 05 15:27:19.479475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-30113fd8-f39d-4f5b-8d8f-657802e211e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:19.481140 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-30113fd8-f39d-4f5b-8d8f-657802e211e2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0508454 Nov 05 15:27:19.536881 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-e8b24808-2b9a-4167-8daf-460a48e6eb45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:19.538414 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-e8b24808-2b9a-4167-8daf-460a48e6eb45 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0489635 Nov 05 15:27:19.630618 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-04680faa-5eaf-4c6c-b22a-03f6e278f9ed service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834248 Nov 05 15:27:19.727024 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-442a04ec-7cc1-4e8e-beff-d6b585f7ecb9 req-0939b6a1-28cb-4bf8-b64e-86bdbd6d7d95 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886970 Nov 05 15:27:19.931512 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905ff79d-c74e-4cb8-b869-ac8d6ce61690 req-4df2015d-c193-4755-95d0-00f2bdb49db6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:19.933288 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-905ff79d-c74e-4cb8-b869-ac8d6ce61690 req-4df2015d-c193-4755-95d0-00f2bdb49db6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0500801 Nov 05 15:27:19.983544 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-905ff79d-c74e-4cb8-b869-ac8d6ce61690 req-a68ac740-031b-43cc-8788-77e2308da202 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436339 Nov 05 15:27:20.164270 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c2fc6218-94a5-46ff-980c-0e2635dece6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:21.104295 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093c97b4-f367-4050-96e2-5fbe62c5d056 req-41cb4828-5f11-4399-8b87-fa9407f44c28 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:21.105911 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-093c97b4-f367-4050-96e2-5fbe62c5d056 req-41cb4828-5f11-4399-8b87-fa9407f44c28 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0545213 Nov 05 15:27:21.165097 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-093c97b4-f367-4050-96e2-5fbe62c5d056 req-db823b8d-4a98-4cfb-b4e3-9bb7ebc8771f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523126 Nov 05 15:27:22.283251 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5aecc2d-f8a3-4b52-8ba3-2ab800a217b1 req-6c09d556-735d-43c6-b99a-f21b6ee66d9b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:22.284738 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c5aecc2d-f8a3-4b52-8ba3-2ab800a217b1 req-6c09d556-735d-43c6-b99a-f21b6ee66d9b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0528319 Nov 05 15:27:22.332705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c5aecc2d-f8a3-4b52-8ba3-2ab800a217b1 req-099521ce-9f91-4d9c-97fb-88b819e8f29f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419960 Nov 05 15:27:22.475652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5563f4af-f586-4ddb-88f4-24276be82c50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:23.447107 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a564e9c5-66f8-4492-bd57-43f10fdec7de req-748a60b2-39e9-4ed7-8cc1-5582016028f9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:23.448590 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a564e9c5-66f8-4492-bd57-43f10fdec7de req-748a60b2-39e9-4ed7-8cc1-5582016028f9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0513337 Nov 05 15:27:23.496929 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a564e9c5-66f8-4492-bd57-43f10fdec7de req-cb755b00-56d4-450b-8767-22585c8aa4c6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419402 Nov 05 15:27:23.577809 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:24.610768 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687cc79b-e067-49a0-9f90-0797a0763528 req-1f8b6d71-5f8a-48c2-b21b-9acf1f265cf2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:24.612230 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-687cc79b-e067-49a0-9f90-0797a0763528 req-1f8b6d71-5f8a-48c2-b21b-9acf1f265cf2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0485311 Nov 05 15:27:24.660001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-687cc79b-e067-49a0-9f90-0797a0763528 req-b4de3fb1-1e28-4375-bada-30681b626277 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418491 Nov 05 15:27:25.036308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:25.773179 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce697065-c38f-4236-b3fb-0bd7b9a2fa4e req-7eb45b31-dfeb-48ac-bcb6-c0ff22c2acb2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:25.774528 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce697065-c38f-4236-b3fb-0bd7b9a2fa4e req-7eb45b31-dfeb-48ac-bcb6-c0ff22c2acb2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0481791 Nov 05 15:27:25.823681 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ce697065-c38f-4236-b3fb-0bd7b9a2fa4e req-c944cdb9-0ca3-41d6-a2a7-2cb03ccc4d09 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429769 Nov 05 15:27:26.028743 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:26.954602 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6779295d-30fa-4bd1-addf-e0aa3a1a3289 req-4c2ef1d0-8c6b-4451-9c2c-07bb2ed99841 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:26.956057 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6779295d-30fa-4bd1-addf-e0aa3a1a3289 req-4c2ef1d0-8c6b-4451-9c2c-07bb2ed99841 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0477369 Nov 05 15:27:27.007523 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-6779295d-30fa-4bd1-addf-e0aa3a1a3289 req-b7664b02-846f-437a-9dd1-e05a2f1bf820 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456069 Nov 05 15:27:28.117737 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8f5a8a-0cbc-45a3-ba80-6c9159f4ca1e req-4f2d9466-ecec-440a-928d-ad1d492db27d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:28.119165 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c8f5a8a-0cbc-45a3-ba80-6c9159f4ca1e req-4f2d9466-ecec-440a-928d-ad1d492db27d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0467923 Nov 05 15:27:28.170621 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2c8f5a8a-0cbc-45a3-ba80-6c9159f4ca1e req-cb78c9a2-f3ee-4e79-9e92-2bac5096aa15 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457098 Nov 05 15:27:29.282914 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94def84c-0a2c-4944-91f5-f93c9c978de1 req-100c11a4-416d-4511-871a-7fcbf88387f2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:29.284341 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-94def84c-0a2c-4944-91f5-f93c9c978de1 req-100c11a4-416d-4511-871a-7fcbf88387f2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0477045 Nov 05 15:27:29.333111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-94def84c-0a2c-4944-91f5-f93c9c978de1 req-2d052b06-5f1b-46ed-b6f4-306c7a4d65f8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426545 Nov 05 15:27:29.881407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:27:29.971681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:27:29.985947 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'mac_address': 'fa:16:3e:60:30:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:27:30.021913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:30.034314 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:27:30.054115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:27:30.058936 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:30.103728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:30.111023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.111378 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.111718 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.112050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.112381 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.112744 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.113074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.113399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.113725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.114045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.114368 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.114684 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:27:30.267633 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:27:30.449263 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7779f407-8783-471e-814a-fd6e8f5f080a req-6a3af50c-b157-4eab-a388-2087066aa658 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:30.450752 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7779f407-8783-471e-814a-fd6e8f5f080a req-6a3af50c-b157-4eab-a388-2087066aa658 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 944 time: 0.0519180 Nov 05 15:27:30.502667 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-7779f407-8783-471e-814a-fd6e8f5f080a req-4d738190-c077-47e5-a03a-fa71d224b837 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458612 Nov 05 15:27:31.614769 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4423d3d7-74e9-4a43-88c6-0960cbccba77 req-49ec07b0-c164-40c4-8e19-1b68cea7e626 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:31.616267 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4423d3d7-74e9-4a43-88c6-0960cbccba77 req-49ec07b0-c164-40c4-8e19-1b68cea7e626 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 944 time: 0.0472817 Nov 05 15:27:31.663589 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4423d3d7-74e9-4a43-88c6-0960cbccba77 req-5255e954-0916-446e-b249-03131ef701c2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415106 Nov 05 15:27:31.897430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:27:31.947228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:27:31.951108 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:27:31.951478 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:32.024901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:32.046628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:27:32.049420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5614acad-0726-4d62-bc7f-e924ebe7bda9" -d '{"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:27:32.062354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:27:32.066485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:32.089052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:27:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b792e7de-4999-4183-80b1-cbb769353b95 x-openstack-request-id: req-b792e7de-4999-4183-80b1-cbb769353b95 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:27:32.089341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:27:32.089657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b792e7de-4999-4183-80b1-cbb769353b95 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:27:32.090051 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'code': 200} Nov 05 15:27:32.115632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:32.266263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe404a7-e156-4e96-aa96-59aae009b192 req-2b358cf5-721f-4255-b015-00cdd111ab9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:32.267656 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0fe404a7-e156-4e96-aa96-59aae009b192 req-2b358cf5-721f-4255-b015-00cdd111ab9a service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0423307 Nov 05 15:27:32.312683 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0fe404a7-e156-4e96-aa96-59aae009b192 req-42fbcceb-1768-45e4-ae3e-59af913b142a service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383000 Nov 05 15:27:32.776856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1624c2f-5712-4602-883b-d0acf5fb1ae9 req-482caa4b-6fe8-4448-9401-1b8c58e32ff7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:32.778592 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f1624c2f-5712-4602-883b-d0acf5fb1ae9 req-482caa4b-6fe8-4448-9401-1b8c58e32ff7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0486896 Nov 05 15:27:32.826576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-f1624c2f-5712-4602-883b-d0acf5fb1ae9 req-4ee16814-22f0-41bf-ab11-829d96e622a0 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416019 Nov 05 15:27:33.949380 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d9d5d5-cdc8-4bcf-bd32-6a788b3b3f32 req-65d3d0ff-4a1b-4c7e-97ba-851b4446450d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:33.950865 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c2d9d5d5-cdc8-4bcf-bd32-6a788b3b3f32 req-65d3d0ff-4a1b-4c7e-97ba-851b4446450d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0492990 Nov 05 15:27:33.998256 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c2d9d5d5-cdc8-4bcf-bd32-6a788b3b3f32 req-c3c1e24a-3ca3-4667-89b1-b3162ee08fa8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416217 Nov 05 15:27:34.113955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5f67bf-b75d-4d4c-8db0-71ba23c26ecf req-db5ff0c3-0efb-4615-90c7-f0bdf0a07e1f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:34.115322 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc5f67bf-b75d-4d4c-8db0-71ba23c26ecf req-db5ff0c3-0efb-4615-90c7-f0bdf0a07e1f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0517771 Nov 05 15:27:34.163592 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bc5f67bf-b75d-4d4c-8db0-71ba23c26ecf req-2844aca7-4217-42af-97d9-fd59d4c239a9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424731 Nov 05 15:27:34.186180 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52458) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:27:34.229186 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1761fb53-3dda-4ba7-bbad-5d1580ef2a9b tempest-TestShelveInstance-446280515 tempest-TestShelveInstance-446280515-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:34.230671 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1761fb53-3dda-4ba7-bbad-5d1580ef2a9b tempest-TestShelveInstance-446280515 tempest-TestShelveInstance-446280515-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1093 time: 0.0434391 Nov 05 15:27:34.233441 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52460) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:27:34.237572 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address': '172.20.0.8'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:27:34.259011 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:34.351283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:34.454109 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Allocated IP 172.26.5.184 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/805cb9ab-ada5-45ab-8930-5dd3b671d7c1) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:27:34.560118 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:34.592347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:34.632537 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:27:34.637202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:27:34.640686 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:27:34.646495 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=805cb9ab-ada5-45ab-8930-5dd3b671d7c1,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:34.985028 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:35.052783 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:35.197735 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:35.202207 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:35.267241 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event updated for resources: {'Port': ['ID=805cb9ab-ada5-45ab-8930-5dd3b671d7c1,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:27:35.278678 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:35.377314 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Floating IP 1ac7462b-57da-41ba-a04b-664f658a0fb1 associated. External IP: 172.26.5.184, port: e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b. Nov 05 15:27:35.581446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:27:36.006117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:27:36.015567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:27:36.023651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:36.026439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:27:36.027050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:27:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:27:36.050366 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-475081ac-a0ee-409b-b6f6-ab60c0a548a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8159587 Nov 05 15:27:36.050944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:27:36.053203 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18db49fb-2a4c-41a9-b316-2b93b94e7555" -d '{"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:27:36.092255 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:27:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fc93a62-8c8a-4a7c-b58a-72c26c8b0b2f x-openstack-request-id: req-3fc93a62-8c8a-4a7c-b58a-72c26c8b0b2f {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:27:36.092579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:27:36.092833 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3fc93a62-8c8a-4a7c-b58a-72c26c8b0b2f {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:27:36.093235 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'status': 'completed', 'code': 200} Nov 05 15:27:36.135069 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:27:36.156595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-f8edae1a-720b-4a30-a5bb-04c783939056 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:36.158109 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-f8edae1a-720b-4a30-a5bb-04c783939056 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0414515 Nov 05 15:27:36.253229 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-9eb1efde-48ca-40c5-a212-6eb1dcfd3d27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:36.254704 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-9eb1efde-48ca-40c5-a212-6eb1dcfd3d27 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0891750 Nov 05 15:27:36.319183 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-c0e6a6f7-5ce9-4963-9fbf-e31bc5fee274 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 999 time: 0.0575736 Nov 05 15:27:36.357751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1ac7462b-57da-41ba-a04b-664f658a0fb1', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.184', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1811, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:60:30:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9303778-b3c7-4312-b953-32118159570c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:27:34Z', 'updated_at': '2021-11-05T15:27:34Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:27:36.367133 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-124609a3-e2f1-4e97-9339-264fda146a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:36.368630 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-124609a3-e2f1-4e97-9339-264fda146a0e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0427482 Nov 05 15:27:36.387603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:27:36.395961 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:27:36.396602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:27:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:27:36.419108 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-feac772e-4220-4803-a9ef-5260c2e6fd4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:36.420705 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-feac772e-4220-4803-a9ef-5260c2e6fd4f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0455368 Nov 05 15:27:36.507228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:27:36.533840 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-25ff6544-7dd2-434f-a8ab-8cc562712e91 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050494 Nov 05 15:27:36.629211 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-18db49fb-2a4c-41a9-b316-2b93b94e7555 req-6b2f27c6-03b8-4233-9f00-bd2c66991003 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888398 Nov 05 15:27:36.727750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1ac7462b-57da-41ba-a04b-664f658a0fb1', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.184', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1811, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:60:30:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9303778-b3c7-4312-b953-32118159570c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:27:34Z', 'updated_at': '2021-11-05T15:27:34Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:27:36.752875 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a218b929-a752-40de-a0dd-23cb3dc323b5 None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '1ac7462b-57da-41ba-a04b-664f658a0fb1', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'floating_ip_address': '172.26.5.184', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 1811, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'mac_address': 'fa:16:3e:60:30:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9303778-b3c7-4312-b953-32118159570c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:27:34Z', 'updated_at': '2021-11-05T15:27:34Z', 'revision_number': 0, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:27:36.947445 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c95c870-b06f-49ba-ae19-18cfd6bf0bce None None] New status for floating IP 1ac7462b-57da-41ba-a04b-664f658a0fb1: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:27:41.494061 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-d909e443-38d6-4843-bb55-a12fad5bd8b2 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0406888 Nov 05 15:27:41.576791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-cc7a2bfb-ef21-41fb-9a82-bbf2f39344a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:41.578301 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-cc7a2bfb-ef21-41fb-9a82-bbf2f39344a6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0406246 Nov 05 15:27:41.681203 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-d8ddb450-6617-47ae-b745-64fb5b446ab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:41.682659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-d8ddb450-6617-47ae-b745-64fb5b446ab0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0860107 Nov 05 15:27:41.767148 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-a33df427-b735-4bce-a664-5115642cf8cb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 1001 time: 0.0772679 Nov 05 15:27:41.816328 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-8ef4a229-014b-4db7-a936-910ca3167cd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:41.817773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-8ef4a229-014b-4db7-a936-910ca3167cd4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0444849 Nov 05 15:27:41.867072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-f8fc7a68-9bb9-4a44-a12a-5c0aa29c7718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:27:41.868594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-f8fc7a68-9bb9-4a44-a12a-5c0aa29c7718 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0437057 Nov 05 15:27:41.956020 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-e4a45d5e-6cba-4605-980c-b1b9cd562069 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799270 Nov 05 15:27:42.048840 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-db3f32be-50ea-46b8-9510-f5f31ead875d req-20b4808b-7637-4328-977c-2e84a06f1ec0 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857673 Nov 05 15:27:45.520829 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:27:48.597091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:50.166042 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1288109f-529e-41e1-90b0-25cb11b0a5aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:52.477801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-075ea296-347e-4a0d-bbc3-69d4b63a56b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:53.581692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:55.038657 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:27:56.030162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:18.626721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:20.323377 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5d2aad84-f02f-4ea2-b678-337c35a2dfef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:22.481119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-3817c376-8ab8-45ef-950b-81de91671d29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:22.520899 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:28:23.583725 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:25.040050 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:26.032164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:43.538502 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-8392e68e-678f-4cb5-9f35-927ed324788b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407791 Nov 05 15:28:43.619210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-f2d59d30-b8b1-4554-9051-9fccf6fdb2f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:28:43.620733 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-f2d59d30-b8b1-4554-9051-9fccf6fdb2f0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0402434 Nov 05 15:28:43.723597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-0d0180ac-6ee1-479f-bc39-018900d99252 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:28:43.725094 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-0d0180ac-6ee1-479f-bc39-018900d99252 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0859656 Nov 05 15:28:43.796227 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-5869d8e7-25ed-41ae-a44b-f8110ddc9d42 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 1001 time: 0.0636282 Nov 05 15:28:43.847212 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-943c4804-f537-4a9c-a813-bd98563e6120 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:28:43.849024 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-943c4804-f537-4a9c-a813-bd98563e6120 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0461252 Nov 05 15:28:43.901887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-e77a84a6-ae1e-448b-b69a-54d5b5cdae5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:28:43.903335 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-e77a84a6-ae1e-448b-b69a-54d5b5cdae5e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0471694 Nov 05 15:28:43.991792 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-ff3314bc-80bd-4003-819b-92406e0d4450 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808480 Nov 05 15:28:44.083745 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-e43a53fe-52e3-404b-b3ee-9c08104c3d7d req-007e0a75-ef92-47cc-917e-872ef8e56050 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854671 Nov 05 15:28:48.657219 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:50.164430 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a1eabfc9-a3d2-4291-bc27-70e0f406088a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:52.485065 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-e473c64b-fa00-41b4-bff6-69a27fda436f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:53.587540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:55.043332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:56.034156 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:28:59.519760 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:29:18.692397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:20.165999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-acb52c77-98db-4362-ba1c-a69dd5079825 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:22.486740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-87873bcc-639a-41ab-80ce-8a6344164ae4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:23.589926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:25.047357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:26.036161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:28.589461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ae63ad-ab46-4b8f-bf0f-5bd4f74e6de0 req-43266930-40f0-45ca-a4da-0fbffd0d93c2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:28.590852 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2ae63ad-ab46-4b8f-bf0f-5bd4f74e6de0 req-43266930-40f0-45ca-a4da-0fbffd0d93c2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0523016 Nov 05 15:29:28.639712 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a2ae63ad-ab46-4b8f-bf0f-5bd4f74e6de0 req-3627bfc2-9686-4d14-bf01-7d2583dc9cda tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427449 Nov 05 15:29:29.772336 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f97245-c64c-47fd-a18d-c7dfc15366fa req-0f488433-60bc-4a6a-b244-c8fcb3501a6b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:29.774296 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-69f97245-c64c-47fd-a18d-c7dfc15366fa req-0f488433-60bc-4a6a-b244-c8fcb3501a6b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0502329 Nov 05 15:29:29.823688 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-69f97245-c64c-47fd-a18d-c7dfc15366fa req-080414da-26d8-49e0-b425-fff680d47da3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433366 Nov 05 15:29:30.947614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8069532-73f7-4ad7-ad35-3d6dc537df1d req-130afe50-2be9-4bdf-b064-9ab6d4851b2a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:30.949086 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f8069532-73f7-4ad7-ad35-3d6dc537df1d req-130afe50-2be9-4bdf-b064-9ab6d4851b2a tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0475655 Nov 05 15:29:30.999706 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f8069532-73f7-4ad7-ad35-3d6dc537df1d req-caf35a9c-eb0e-4be1-a6bd-52bcdbd38561 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448613 Nov 05 15:29:32.113101 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b8f973c-3687-4a37-8214-73eeec8c51c3 req-8e624b4b-0ecb-4a27-b17a-036a071595a3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:32.114577 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b8f973c-3687-4a37-8214-73eeec8c51c3 req-8e624b4b-0ecb-4a27-b17a-036a071595a3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0482764 Nov 05 15:29:32.163151 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3b8f973c-3687-4a37-8214-73eeec8c51c3 req-b57d6daa-b481-455b-9fed-9d627f2c39ad tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420973 Nov 05 15:29:33.277334 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74293937-c9be-4f98-8f34-a59f33e195da req-7e90bf43-8610-48ba-8c02-fbcd46cacb36 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:33.278761 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74293937-c9be-4f98-8f34-a59f33e195da req-7e90bf43-8610-48ba-8c02-fbcd46cacb36 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0475965 Nov 05 15:29:33.325950 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74293937-c9be-4f98-8f34-a59f33e195da req-903ec36f-ecc3-405c-b8f7-f86811815cd7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413592 Nov 05 15:29:34.441729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9764536-db84-4d18-b024-07989abd0fc3 req-e5cc0556-8901-4da4-b46b-6e0ae4734513 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:34.443218 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9764536-db84-4d18-b024-07989abd0fc3 req-e5cc0556-8901-4da4-b46b-6e0ae4734513 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0518270 Nov 05 15:29:34.492763 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9764536-db84-4d18-b024-07989abd0fc3 req-42958dcc-548d-423a-81d7-1e95be438245 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424917 Nov 05 15:29:35.606124 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a40757-7ded-45e1-9545-9c9fc8d774bd req-8257e0ab-e396-4ba1-b00c-f140a0fe3da8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:35.607613 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18a40757-7ded-45e1-9545-9c9fc8d774bd req-8257e0ab-e396-4ba1-b00c-f140a0fe3da8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0485873 Nov 05 15:29:35.657393 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18a40757-7ded-45e1-9545-9c9fc8d774bd req-f53d5d65-b4cd-43c9-b9b9-1c6ae91fbdf7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438151 Nov 05 15:29:36.518598 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:29:36.768166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb55a9b5-0247-48a6-b694-d984a1d0ab18 req-b72a2c44-e959-4e30-9038-85807d79be97 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:36.769624 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cb55a9b5-0247-48a6-b694-d984a1d0ab18 req-b72a2c44-e959-4e30-9038-85807d79be97 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0472465 Nov 05 15:29:36.818516 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-cb55a9b5-0247-48a6-b694-d984a1d0ab18 req-160e67ab-dd63-4f84-b359-d788dbb7d86e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422885 Nov 05 15:29:37.933707 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c17480-3ab5-4a27-af2d-d6bd4495fbac req-980a0b37-2888-4cd8-b0b8-50905e2569ea tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:37.935140 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-76c17480-3ab5-4a27-af2d-d6bd4495fbac req-980a0b37-2888-4cd8-b0b8-50905e2569ea tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0514181 Nov 05 15:29:37.983000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-76c17480-3ab5-4a27-af2d-d6bd4495fbac req-c42dd941-3a09-40b1-8916-234b12a3e0e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420375 Nov 05 15:29:38.733230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-e92c8dba-e8c4-4c99-8690-2235e08c54a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:38.734717 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-e92c8dba-e8c4-4c99-8690-2235e08c54a4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0401578 Nov 05 15:29:38.828445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-a21f6586-380f-4265-8f08-4a4e581257ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:38.829829 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-a21f6586-380f-4265-8f08-4a4e581257ab service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0869064 Nov 05 15:29:38.892782 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-64da5987-12dc-4c48-a118-7600cb6990e8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 1001 time: 0.0556319 Nov 05 15:29:38.947665 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-e94821f1-d22a-4ee1-8b7d-bd485c75cc65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:38.949113 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-e94821f1-d22a-4ee1-8b7d-bd485c75cc65 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0496869 Nov 05 15:29:38.994445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-4eecd9d3-7fb3-4889-a35e-621f22f70701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:38.995874 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-4eecd9d3-7fb3-4889-a35e-621f22f70701 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0388582 Nov 05 15:29:39.118714 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-ec29c79d-0032-4bea-a4db-289732fe8ff2 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1152515 Nov 05 15:29:39.130015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23bd506-a99d-4e81-927b-c2105a2330f5 req-10d90727-9037-4ba7-9cab-50f00c843e6e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:39.131383 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b23bd506-a99d-4e81-927b-c2105a2330f5 req-10d90727-9037-4ba7-9cab-50f00c843e6e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0728395 Nov 05 15:29:39.235425 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b23bd506-a99d-4e81-927b-c2105a2330f5 req-e78cfc1e-7a1f-4f91-9bdb-11f399926d7b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0957556 Nov 05 15:29:39.250512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8bd85c22-2d68-4c53-a0e4-ae90a0e183e7 req-fb6f884c-e5ec-496e-b21a-ab4dded2569c service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1182401 Nov 05 15:29:40.346656 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e62f9f-b0eb-4592-b556-61045c96483f req-ffeee21c-2358-42c1-b81b-ba8cabe25a11 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:40.348092 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e5e62f9f-b0eb-4592-b556-61045c96483f req-ffeee21c-2358-42c1-b81b-ba8cabe25a11 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0470479 Nov 05 15:29:40.395971 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e5e62f9f-b0eb-4592-b556-61045c96483f req-7018b394-4ca9-4402-8793-0222f3d951ac tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414069 Nov 05 15:29:41.516124 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b75efe7-4d5f-4bc2-869c-729ff232d699 req-792a147e-ede3-48d5-a56b-882cb4a1286f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:41.517677 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9b75efe7-4d5f-4bc2-869c-729ff232d699 req-792a147e-ede3-48d5-a56b-882cb4a1286f tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0533862 Nov 05 15:29:41.567780 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-9b75efe7-4d5f-4bc2-869c-729ff232d699 req-620d4103-c1f9-445c-8c39-feb03dc96fd6 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442305 Nov 05 15:29:42.687051 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a135aa-2163-4738-8779-799ddb711257 req-a235ef2b-2072-47ed-a4ed-8d3fa407c1af tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:42.688488 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52a135aa-2163-4738-8779-799ddb711257 req-a235ef2b-2072-47ed-a4ed-8d3fa407c1af tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0511749 Nov 05 15:29:42.742950 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-52a135aa-2163-4738-8779-799ddb711257 req-220930c1-86e0-456f-af4e-f8f6037908ec tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483403 Nov 05 15:29:42.872204 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-fdccfa27-1719-4588-bc9e-d0bad04c77ea req-4fff7c79-3e85-46a2-b4d2-5701b2385db0 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:29:42.874571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fdccfa27-1719-4588-bc9e-d0bad04c77ea req-4fff7c79-3e85-46a2-b4d2-5701b2385db0 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0674067 Nov 05 15:29:43.011712 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-bb647c67-fc9f-4552-8612-c3130824107a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0398495 Nov 05 15:29:43.020558 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-76a7d228-6cb0-434d-bfb2-5816bc426333 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:29:43.021492 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-76a7d228-6cb0-434d-bfb2-5816bc426333 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048659 Nov 05 15:29:43.045366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffd7eda-1a18-4fb0-a872-4a4c58cbd37b req-11468653-fa5e-440b-a2a1-b7d22c60d4b4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:43.046538 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1ffd7eda-1a18-4fb0-a872-4a4c58cbd37b req-11468653-fa5e-440b-a2a1-b7d22c60d4b4 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0524566 Nov 05 15:29:43.100503 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1ffd7eda-1a18-4fb0-a872-4a4c58cbd37b req-66c53899-bb05-4750-b976-f2cc8ea0a6a8 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468838 Nov 05 15:29:44.219936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee02de9-2f8c-4dd4-9516-ca6db09e0e8b req-2d87e534-8fcc-4cad-bd45-f58b128b5145 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:44.221459 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2ee02de9-2f8c-4dd4-9516-ca6db09e0e8b req-2d87e534-8fcc-4cad-bd45-f58b128b5145 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0529697 Nov 05 15:29:44.278602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-2ee02de9-2f8c-4dd4-9516-ca6db09e0e8b req-8b57317a-e7aa-433d-94a3-ce6a9799217b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0510063 Nov 05 15:29:44.585428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:29:44.660019 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:44.683391 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:29:44.685668 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3542af33-bc1c-421d-9596-d234facdef9e" -d '{"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-unplugged", "status": "completed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:29:44.699442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:29:44.704451 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:44.735988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 05 Nov 2021 15:29:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aea152ac-5e38-40e9-b698-5fe4faa8c8fc x-openstack-request-id: req-aea152ac-5e38-40e9-b698-5fe4faa8c8fc {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:29:44.736397 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-unplugged", "status": "failed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "code": 422}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:29:44.736736 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-aea152ac-5e38-40e9-b698-5fe4faa8c8fc {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:29:44.737235 dv-neutron-816850-1-hyperv neutron-server[113582]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'code': 422} returned with failed status Nov 05 15:29:44.760877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:29:44.768038 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.768410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.768762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.769098 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.769446 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.769766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.770096 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.770428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.770756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.771078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.771401 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:44.771719 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:29:45.393968 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387eeba5-954f-4652-a399-e004c9207345 req-418ac741-dd1e-48df-ab1d-af0191c23d80 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:45.395481 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-387eeba5-954f-4652-a399-e004c9207345 req-418ac741-dd1e-48df-ab1d-af0191c23d80 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0481386 Nov 05 15:29:45.446143 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-387eeba5-954f-4652-a399-e004c9207345 req-56729059-e312-4c18-b9e0-bc8a23e9b5d2 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438540 Nov 05 15:29:46.561690 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd46bfe-367b-4c55-9f15-c9de1b7d0d92 req-e2b821e8-2f8e-4bfd-ab67-59bc89c41f42 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:46.563160 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3dd46bfe-367b-4c55-9f15-c9de1b7d0d92 req-e2b821e8-2f8e-4bfd-ab67-59bc89c41f42 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0495887 Nov 05 15:29:46.611775 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3dd46bfe-367b-4c55-9f15-c9de1b7d0d92 req-a6372e6b-0955-4191-92af-5baee79aad40 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425496 Nov 05 15:29:47.728435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b434afd9-6902-4777-8f05-13ea44ededda req-f573a8ba-9790-42b4-ab5a-d1a615c15e78 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:47.729915 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b434afd9-6902-4777-8f05-13ea44ededda req-f573a8ba-9790-42b4-ab5a-d1a615c15e78 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0476930 Nov 05 15:29:47.783554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b434afd9-6902-4777-8f05-13ea44ededda req-f51c8d2b-c4ad-4fc5-a403-70cb644e6223 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476542 Nov 05 15:29:48.597061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-e551bedd-7b04-4b73-9dfc-e50473d2be01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.598576 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-e551bedd-7b04-4b73-9dfc-e50473d2be01 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c&tenant_id=0c7efefc4d474bc2882d41e4cb713041 HTTP/1.1" status: 200 len: 1096 time: 0.0397561 Nov 05 15:29:48.658334 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-19110fe2-2a78-436d-ac5c-7b5d15f71253 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.659799 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-19110fe2-2a78-436d-ac5c-7b5d15f71253 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1096 time: 0.0401208 Nov 05 15:29:48.689642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:48.750930 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-e633fbbf-e1fb-4c11-b7e1-1d153ed5bd02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.752511 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-e633fbbf-e1fb-4c11-b7e1-1d153ed5bd02 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0864305 Nov 05 15:29:48.816327 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-1fa2498d-103f-4bc0-a215-e36aea1f4e93 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 999 time: 0.0572393 Nov 05 15:29:48.864721 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-5372a56e-88c6-44f1-b5e4-f031a28860db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.866222 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-5372a56e-88c6-44f1-b5e4-f031a28860db service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0430279 Nov 05 15:29:48.900666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da02fee-aecc-4dfa-b352-f234e9c3899c req-0c613f18-f4ca-4d75-a9c4-8290cd64f17b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.902162 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4da02fee-aecc-4dfa-b352-f234e9c3899c req-0c613f18-f4ca-4d75-a9c4-8290cd64f17b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0524566 Nov 05 15:29:48.915207 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-53a8ca53-3b7b-4d4e-a43a-8c04d3a6ac0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:48.916786 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-53a8ca53-3b7b-4d4e-a43a-8c04d3a6ac0d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0438704 Nov 05 15:29:48.951622 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4da02fee-aecc-4dfa-b352-f234e9c3899c req-c5587f35-eaee-4d82-a3d4-3153cfa8a941 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434635 Nov 05 15:29:49.006221 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-abd3ce65-9e7f-4ae1-9802-8e2740302c1c service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817482 Nov 05 15:29:49.095549 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca45b42d-0ffa-4e39-adaf-d8c912c4b4c1 req-b8941176-423b-48bf-a34a-c254d4910ebb service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823267 Nov 05 15:29:50.069564 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee0bc7d-b99f-4460-84eb-b6e10a5cebda req-d894be8e-a4a4-48d6-a0fb-e5e18b218e1d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:50.071019 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bee0bc7d-b99f-4460-84eb-b6e10a5cebda req-d894be8e-a4a4-48d6-a0fb-e5e18b218e1d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0490620 Nov 05 15:29:50.122390 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bee0bc7d-b99f-4460-84eb-b6e10a5cebda req-5d2d9e25-9544-42f0-a584-a25c1d37918b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422175 Nov 05 15:29:50.168033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a9d73ae9-3d67-45d9-8628-9a37e3c7d35e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:51.245565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18143996-b5c8-45a4-a1ed-4e94f0935fb5 req-7feda6b3-7dc7-4319-8b95-3e339dbf8a93 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:51.247055 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18143996-b5c8-45a4-a1ed-4e94f0935fb5 req-7feda6b3-7dc7-4319-8b95-3e339dbf8a93 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0492928 Nov 05 15:29:51.296943 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-18143996-b5c8-45a4-a1ed-4e94f0935fb5 req-bd7b07d8-504b-4b64-8048-46a27a4d96e9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438318 Nov 05 15:29:52.410784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f7c615-8de7-46bf-94f1-01156296b737 req-b3f1fa63-4bd7-4f75-8103-5b5a93b663ef tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:52.412252 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-67f7c615-8de7-46bf-94f1-01156296b737 req-b3f1fa63-4bd7-4f75-8103-5b5a93b663ef tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0485971 Nov 05 15:29:52.460543 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-67f7c615-8de7-46bf-94f1-01156296b737 req-66eb6de3-4d9e-40b7-8768-7b82f3f12905 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419238 Nov 05 15:29:52.498018 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-18ffc9b0-39e9-4e27-a338-b386fe8765b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:53.578069 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a905039a-2d84-4a13-9269-6402b4b261f7 req-f612b356-e0c9-4a6e-830e-af0325804633 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:53.579525 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a905039a-2d84-4a13-9269-6402b4b261f7 req-f612b356-e0c9-4a6e-830e-af0325804633 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0521951 Nov 05 15:29:53.593206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:53.628979 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a905039a-2d84-4a13-9269-6402b4b261f7 req-9a7b9ee2-68fa-4740-9458-bf37dd1035b7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435536 Nov 05 15:29:54.750413 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3463d9e2-9e5a-4086-a055-043fe6a686e1 req-a49d7cb7-c035-4eb2-914a-2f1aceb27b4b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:54.752016 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3463d9e2-9e5a-4086-a055-043fe6a686e1 req-a49d7cb7-c035-4eb2-914a-2f1aceb27b4b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0569346 Nov 05 15:29:54.800883 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-3463d9e2-9e5a-4086-a055-043fe6a686e1 req-ada0275f-06ac-4fd4-8483-7f4346a96f4e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423069 Nov 05 15:29:55.050617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:55.915624 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03a9324-b674-451d-86b8-5376ef48d55d req-a8aa23a4-bb6a-4453-a979-e8eac0950402 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:55.917130 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c03a9324-b674-451d-86b8-5376ef48d55d req-a8aa23a4-bb6a-4453-a979-e8eac0950402 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 943 time: 0.0499203 Nov 05 15:29:55.965898 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c03a9324-b674-451d-86b8-5376ef48d55d req-9cdef6b6-637a-4b61-8164-74fbc2b14fb3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430028 Nov 05 15:29:56.038675 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:56.599870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:29:56.690302 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:29:56.701742 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'port_id': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'mac_address': 'fa:16:3e:60:30:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:29:56.740356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:56.753580 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:29:56.772176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:29:56.776247 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:56.820738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:29:57.022440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:29:57.140342 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31930974-1f7b-4f23-a7b9-48135e9df8b6 req-979d331d-b487-4797-9000-e8d39c283d7b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:57.141863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31930974-1f7b-4f23-a7b9-48135e9df8b6 req-979d331d-b487-4797-9000-e8d39c283d7b tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 944 time: 0.1092241 Nov 05 15:29:57.191538 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-31930974-1f7b-4f23-a7b9-48135e9df8b6 req-d30b304b-a189-494a-b0a7-46ab0e87b99d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435894 Nov 05 15:29:58.354491 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0698274-8965-4904-8c84-cb0b7da7113a req-2c2d1dc1-51e4-438f-9cb7-f8f4359a8131 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:58.355955 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0698274-8965-4904-8c84-cb0b7da7113a req-2c2d1dc1-51e4-438f-9cb7-f8f4359a8131 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 944 time: 0.0963137 Nov 05 15:29:58.410340 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e0698274-8965-4904-8c84-cb0b7da7113a req-d4c1f9ec-50ce-42c2-a745-cf63609d58fa tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484977 Nov 05 15:29:58.719637 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:29:58.767089 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:29:58.767356 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:58.842298 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:58.864510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:29:58.866737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55745301-6e56-4f4a-8390-7e81bef6fe7e" -d '{"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:29:58.879928 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:29:58.884541 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:29:58.909685 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:29:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc77f7fa-41c3-43c4-a5c9-4c39c6ce6595 x-openstack-request-id: req-bc77f7fa-41c3-43c4-a5c9-4c39c6ce6595 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:29:58.910082 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-plugged", "status": "completed", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:29:58.910341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bc77f7fa-41c3-43c4-a5c9-4c39c6ce6595 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:29:58.910736 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'code': 200} Nov 05 15:29:58.939376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:29:59.114198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77515ea7-caca-4b20-a500-3c205ca400fc req-df7d5a8e-13fa-4284-baa5-64abf7915bff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:59.115571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77515ea7-caca-4b20-a500-3c205ca400fc req-df7d5a8e-13fa-4284-baa5-64abf7915bff service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0394292 Nov 05 15:29:59.169967 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-77515ea7-caca-4b20-a500-3c205ca400fc req-f4526fb9-5496-4039-818f-64a9d0d6074a service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473361 Nov 05 15:29:59.525620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fc80c9-9e52-423e-9705-38decc2a981a req-f5c19595-24ee-4216-a0a5-9915b5ec4fbf tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:29:59.527103 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02fc80c9-9e52-423e-9705-38decc2a981a req-f5c19595-24ee-4216-a0a5-9915b5ec4fbf tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0490677 Nov 05 15:29:59.578101 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-02fc80c9-9e52-423e-9705-38decc2a981a req-90472f48-c11a-4a29-a35f-9f0217a86d6e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444517 Nov 05 15:30:00.693980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e2598f-ae7d-4cc5-9f6d-b2bcd3a55e76 req-deba85bc-32c2-4ced-882f-62df7df21889 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:30:00.695444 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10e2598f-ae7d-4cc5-9f6d-b2bcd3a55e76 req-deba85bc-32c2-4ced-882f-62df7df21889 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0477238 Nov 05 15:30:00.743389 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-10e2598f-ae7d-4cc5-9f6d-b2bcd3a55e76 req-eb30f2bd-d67d-40da-b9d7-fb8d6283d043 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409949 Nov 05 15:30:13.519859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:30:18.691642 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:20.169814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-adfa4fea-911d-49a6-9ecd-887768b7886a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:22.489682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f329078-312b-4d36-8818-82b434a6852f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:23.598549 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:25.052904 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:26.041210 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:46.464811 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-60e6fcac-818b-404b-bbf9-9a77b45fe3bd service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0382214 Nov 05 15:30:46.551347 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-b1db1b61-32fb-4a24-b8b6-53be5658ba4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:30:46.552819 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-b1db1b61-32fb-4a24-b8b6-53be5658ba4f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0438905 Nov 05 15:30:46.651884 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-1ddfd72e-04e3-4924-90b1-a1d285e1112f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:30:46.652997 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-1ddfd72e-04e3-4924-90b1-a1d285e1112f service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.0821273 Nov 05 15:30:46.733846 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-8a560ff9-5b07-492e-aaa7-614e27b622b1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 1001 time: 0.0739915 Nov 05 15:30:46.782151 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-20cfd236-7161-44fc-8acd-1c68b32860be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:30:46.783554 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-20cfd236-7161-44fc-8acd-1c68b32860be service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0430555 Nov 05 15:30:46.827368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-8020d8a4-6bb9-49ea-a2b6-a4c4627e4d17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:30:46.828850 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-8020d8a4-6bb9-49ea-a2b6-a4c4627e4d17 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0385330 Nov 05 15:30:47.227728 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-728b2115-6f3e-4c9e-baed-5db8016721fb service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3916395 Nov 05 15:30:47.315355 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-ca1d3c01-67b9-4581-9d82-5e06542b2914 req-be504193-a501-48e8-96dd-885e996ddf76 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0793426 Nov 05 15:30:48.700995 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:50.171244 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-af9f2ef8-ceb9-43cf-ab46-8c2d745a760c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:50.519118 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:30:52.491086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a7b301b3-1f17-4917-96e3-38e516679ce6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:53.599855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:55.057762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:30:56.042544 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.386332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52606) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:13.547956 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Deleting port 805cb9ab-ada5-45ab-8930-5dd3b671d7c1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:13.548292 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.620477 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.620802 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.632103 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Calling delete_port for 805cb9ab-ada5-45ab-8930-5dd3b671d7c1 owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:13.775163 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.802365 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'Port': ['ID=805cb9ab-ada5-45ab-8930-5dd3b671d7c1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:13.825645 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.826001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.826344 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.826684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.827017 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.827353 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.827699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.828023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.828348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.828700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.829054 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.829384 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:13.873901 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:13.874235 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Floating IP 1ac7462b-57da-41ba-a04b-664f658a0fb1 disassociated (deleted). External IP: 172.26.5.184, port: e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b. Nov 05 15:31:14.075888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:14.183465 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:14.188359 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:14.195274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:14.205860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:14.206481 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:30:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:14.217972 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ba70920-c694-4436-ac36-673e6dccc7e7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "DELETE /v2.0/floatingips/1ac7462b-57da-41ba-a04b-664f658a0fb1 HTTP/1.1" status: 204 len: 168 time: 0.8305755 Nov 05 15:31:14.218561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:31:14.221438 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c352f224-c6c8-4e8a-9991-c82562ed6e75" -d '{"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:31:14.263077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:31:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9afd5027-d9b2-4ba1-aa5c-bd6bca8a5ba9 x-openstack-request-id: req-9afd5027-d9b2-4ba1-aa5c-bd6bca8a5ba9 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:31:14.263405 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:31:14.263615 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-9afd5027-d9b2-4ba1-aa5c-bd6bca8a5ba9 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:31:14.264009 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'status': 'completed', 'code': 200} Nov 05 15:31:14.317350 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:14.326128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-750a089b-b6b3-4dfb-964e-cd0eba28df99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:14.327649 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-750a089b-b6b3-4dfb-964e-cd0eba28df99 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0c7efefc4d474bc2882d41e4cb713041&device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 1098 time: 0.0418477 Nov 05 15:31:14.458987 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-4e3a7097-cd43-4d88-a002-03914cd79277 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:14.460476 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-4e3a7097-cd43-4d88-a002-03914cd79277 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 200 len: 910 time: 0.1263888 Nov 05 15:31:14.477834 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05512b7a-cf31-467a-a4e2-4c5fc1f3b620 req-7ca389d0-6d37-4873-ba77-77b459d5a784 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:14.479314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05512b7a-cf31-467a-a4e2-4c5fc1f3b620 req-7ca389d0-6d37-4873-ba77-77b459d5a784 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0657425 Nov 05 15:31:14.525162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:14.525493 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-a9e30052-bd9c-40b0-a058-f2afc69d670b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 200 len: 217 time: 0.0562348 Nov 05 15:31:14.551376 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:14.559460 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:14.560055 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:30:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:14.595903 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-05512b7a-cf31-467a-a4e2-4c5fc1f3b620 req-0158565d-7856-40ae-ba13-cc3ef3c386d7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1086452 Nov 05 15:31:14.601341 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-95d85fa0-fafb-4a1c-8952-1d684879d759 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:14.602700 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-95d85fa0-fafb-4a1c-8952-1d684879d759 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 200 len: 848 time: 0.0683031 Nov 05 15:31:14.651377 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-914aad20-5578-4edb-ace4-b67de95b01f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:14.653178 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-914aad20-5578-4edb-ace4-b67de95b01f0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e8655efd-122a-4437-a816-c84a823b1b31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0411541 Nov 05 15:31:14.666499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:14.747029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-081eaebc-6807-45ad-b246-a221eed506b2 service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856121 Nov 05 15:31:14.836825 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c352f224-c6c8-4e8a-9991-c82562ed6e75 req-488ef2f0-8a79-4ae0-a90d-802a0de3d96d service neutron] 10.222.0.32 "GET /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815611 Nov 05 15:31:14.862359 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:14.892153 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b80bf2f0-d578-4926-aca5-20092912281c None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:42Z', 'revision_number': 4, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'e8a5571b-afe6-4517-9b2c-9cc70dcfc378', 'name': '', 'network_id': 'e8655efd-122a-4437-a816-c84a823b1b31', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'mac_address': 'fa:16:3e:9e:ce:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_interface', 'standard_attr_id': 1775, 'fixed_ips': [{'subnet_id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:41Z', 'updated_at': '2021-11-05T15:22:47Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'subnets': [{'id': 'f1d2935c-89f4-4fbe-af92-79b9341cb914', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:15.105153 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c25b4f33-7e57-4f0e-a28b-c307cea7013e None None] New status for floating IP 1ac7462b-57da-41ba-a04b-664f658a0fb1: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:31:15.715136 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbb4d30-f087-4724-ba2e-19bccd29e1e2 req-8125b96d-8291-4b68-bdce-5847865faad9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:15.716639 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bfbb4d30-f087-4724-ba2e-19bccd29e1e2 req-8125b96d-8291-4b68-bdce-5847865faad9 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0498791 Nov 05 15:31:15.764927 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-bfbb4d30-f087-4724-ba2e-19bccd29e1e2 req-d6e923e8-b1bd-4d8a-892a-157d347c32f7 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/security-groups?id=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417225 Nov 05 15:31:15.960488 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-7a4064b3-17cd-49f9-a689-373ee7778fe3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:15.961955 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-7a4064b3-17cd-49f9-a689-373ee7778fe3 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 945 time: 0.0524890 Nov 05 15:31:16.048920 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Deleting port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:16.049168 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:16.136680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] For port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:16.137029 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:16.151043 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Calling delete_port for e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:16.271322 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:16.302718 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'Port': ['ID=e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:16.330199 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.330554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.330897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.331235 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.331567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.331898 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.332239 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.332580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.332908 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.333233 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.333550 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.333868 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:16.352011 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] No DVR routers for this DVR port e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:31:16.354381 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:16.357725 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4d7ff3e3-c768-4430-ac36-140750eb213b req-bc6209e2-278c-4821-8f33-212b7db45c05 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.32 "DELETE /v2.0/ports/e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b HTTP/1.1" status: 204 len: 173 time: 0.3890042 Nov 05 15:31:16.358158 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-deleted', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:31:16.360817 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb0a4cef-d620-4330-8947-a953d2700fe7" -d '{"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-deleted", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:31:16.447448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:31:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-347f59b2-1837-428d-a3c3-512f81bded4b x-openstack-request-id: req-347f59b2-1837-428d-a3c3-512f81bded4b {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:31:16.447448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9303778-b3c7-4312-b953-32118159570c", "name": "network-vif-deleted", "tag": "e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:31:16.447784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-347f59b2-1837-428d-a3c3-512f81bded4b {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:31:16.448087 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9303778-b3c7-4312-b953-32118159570c', 'name': 'network-vif-deleted', 'tag': 'e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b', 'status': 'completed', 'code': 200} Nov 05 15:31:16.858804 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-23070a6c-ccd5-45b5-a4e9-e9371d982cbf req-309d10bf-fabf-48ee-9ad8-3cacee74105e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0267162 Nov 05 15:31:17.955580 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-32f96afd-9180-4a34-abe6-84fbd66f3839 req-8226f3da-553e-42d2-bf92-b63266993c44 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0277431 Nov 05 15:31:18.703189 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:19.051453 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c2c5286a-d14f-48e1-a23b-3d131b78a622 req-86983ff3-057e-40b7-b231-af2748c6ca8e tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0269246 Nov 05 15:31:19.299883 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:19.319688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:19.319964 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device e0e3dd80-58de-4003-9ccd-fce2a8bb3f8b not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:20.144170 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1d358846-ba04-48b1-8c14-f29b0c73878d req-27da84d6-0071-4866-805b-7ee874f9704d tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "GET /v2.0/ports?device_id=a9303778-b3c7-4312-b953-32118159570c HTTP/1.1" status: 200 len: 210 time: 0.0269086 Nov 05 15:31:20.173571 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bef6ba1a-f783-4990-81b2-85017fc3c96d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:21.199229 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52642) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:21.257265 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:21.286779 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:21.350541 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:21.353371 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:21.354545 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] 10.222.0.30 "DELETE /v2.0/security-groups/a7dcaa00-ab02-49c0-974b-6a2fe7a13bca HTTP/1.1" status: 204 len: 168 time: 0.1543059 Nov 05 15:31:21.364403 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99cb999-cc81-4cb6-9d8b-d2e565382d18 tempest-TestShelveInstance-1479036487 tempest-TestShelveInstance-1479036487-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7dcaa00-ab02-49c0-974b-6a2fe7a13bca,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:21.419195 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52646) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:21.856275 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.128691 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Deleting port e8a5571b-afe6-4517-9b2c-9cc70dcfc378 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:22.128948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.209760 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] For port e8a5571b-afe6-4517-9b2c-9cc70dcfc378, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:22.210467 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.223428 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Calling delete_port for e8a5571b-afe6-4517-9b2c-9cc70dcfc378 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:22.403888 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.431598 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Pushing event deleted for resources: {'Port': ['ID=e8a5571b-afe6-4517-9b2c-9cc70dcfc378,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:22.506591 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-0d85733d-076b-45ec-b748-98652bf550fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.612670 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:22.836947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:22.942925 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:22.951020 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-fd0018c2-9c76-42dd-9a0f-d52a7525d656 admin admin] 10.222.0.30 "PUT /v2.0/routers/9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5275345 Nov 05 15:31:22.951020 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52650) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:22.953987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Sync routers for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:22.963899 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:22.964525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:23.061933 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.174880 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.227925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:23.234674 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Deleting port 8b12da63-493f-48dd-b9a5-133c81b0dca1 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:23.235198 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.324776 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] For port 8b12da63-493f-48dd-b9a5-133c81b0dca1, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=8b12da63-493f-48dd-b9a5-133c81b0dca1,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:23.325216 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.338348 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Calling delete_port for 8b12da63-493f-48dd-b9a5-133c81b0dca1 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:23.414913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171'}], 'enable_snat': True}, 'gw_port_id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:31:22Z', 'revision_number': 5, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port': {'id': '8b12da63-493f-48dd-b9a5-133c81b0dca1', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:aa:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1774, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:22:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:23.441252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Checking router: 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:23.450159 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Routers {'9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:23.450789 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:23.521930 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.544142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] Set router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:23.549101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Pushing event deleted for resources: {'Port': ['ID=8b12da63-493f-48dd-b9a5-133c81b0dca1,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:23.608634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:31:23Z', 'revision_number': 6, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:23.615148 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:23.640142 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20dac14-cd2f-4a0d-874b-c65e1564f942 None None] The sync data for ids ['9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664'] in dv-neutron-816850-1-hyperv is: [{'id': '9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664', 'name': 'tempest-TestShelveInstance-1157734057-router', 'tenant_id': '0c7efefc4d474bc2882d41e4cb713041', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:39Z', 'updated_at': '2021-11-05T15:31:23Z', 'revision_number': 6, 'project_id': '0c7efefc4d474bc2882d41e4cb713041', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:23.650531 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.033641 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.036223 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.087049 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.087205 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:31:24.091984 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.093197 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-97fc48a0-7c56-4da4-b6cc-b621a72b61f2 admin admin] 10.222.0.30 "DELETE /v2.0/routers/9f9ed87c-06c7-4e7a-a1e7-fba0e4a82664 HTTP/1.1" status: 204 len: 168 time: 1.1419301 Nov 05 15:31:24.096064 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52652) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:24.149575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Deleting subnet f1d2935c-89f4-4fbe-af92-79b9341cb914 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:31:24.152699 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.186709 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.268922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.322166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.349599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f1d2935c-89f4-4fbe-af92-79b9341cb914,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:24.351575 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.357985 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-2ffad302-5a03-4cf9-a703-fe17537810b5 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/f1d2935c-89f4-4fbe-af92-79b9341cb914 HTTP/1.1" status: 204 len: 168 time: 0.2580733 Nov 05 15:31:24.358175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f266f3be-14dc-4af3-9815-b5e6747ef39e None None] Network e8655efd-122a-4437-a816-c84a823b1b31 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:24.358283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52654) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:24.434809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.502475 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Deleting port 601f8a77-6dd5-433b-bc9a-2d3f36941adf {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:24.502809 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.562369 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] DHCP port deletion for e8655efd-122a-4437-a816-c84a823b1b31 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:31:24.576762 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] For port 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=601f8a77-6dd5-433b-bc9a-2d3f36941adf,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:24.577417 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.592068 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Calling delete_port for 601f8a77-6dd5-433b-bc9a-2d3f36941adf owned by network:dhcp {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:24.612860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Deleting port 601f8a77-6dd5-433b-bc9a-2d3f36941adf {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:24.613227 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.684630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] For port 601f8a77-6dd5-433b-bc9a-2d3f36941adf, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=601f8a77-6dd5-433b-bc9a-2d3f36941adf,segment=NetworkSegment(76bcfb05-f136-42d2-8142-74886a796859),segment_id=76bcfb05-f136-42d2-8142-74886a796859)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:24.685023 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.690565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.701034 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Calling delete_port for 601f8a77-6dd5-433b-bc9a-2d3f36941adf owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:24.722027 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] No DVR routers for this DVR port 601f8a77-6dd5-433b-bc9a-2d3f36941adf on host dv-neutron-816850-1-hyperv {{(pid=113581) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:31:24.724638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Pushing event deleted for resources: {'Port': ['ID=601f8a77-6dd5-433b-bc9a-2d3f36941adf,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:24.801106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e8a5571b-afe6-4517-9b2c-9cc70dcfc378 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:24.821766 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.823584 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: e8a5571b-afe6-4517-9b2c-9cc70dcfc378 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:24.823946 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device e8a5571b-afe6-4517-9b2c-9cc70dcfc378 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:24.824372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 601f8a77-6dd5-433b-bc9a-2d3f36941adf no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:24.850508 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 601f8a77-6dd5-433b-bc9a-2d3f36941adf {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:24.850855 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 601f8a77-6dd5-433b-bc9a-2d3f36941adf not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:24.851061 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e8655efd-122a-4437-a816-c84a823b1b31']}} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:24.851276 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b12da63-493f-48dd-b9a5-133c81b0dca1 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:24.853066 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.861172 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76bcfb05-f136-42d2-8142-74886a796859') {'for_net_delete': True} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:24.861473 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.services.segments.db [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76bcfb05-f136-42d2-8142-74886a796859') {} {{(pid=113581) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:24.870945 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2796360'] for segment, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.884681 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.890485 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Releasing vlan 642 on physical network physnet1 to pool {{(pid=113581) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:31:24.890891 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9638618'] for segment, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: Traceback (most recent call last): Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: timer() Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: cb(*args, **kw) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: return func(*args, **kwargs) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: self._notify() Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: self.callback(batched_events) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: event.method(event) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: return f(self, *a, **k) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._get(url).json() Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: return self.request(url, 'GET', **kwargs) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:31:24.892590 dv-neutron-816850-1-hyperv neutron-server[113581]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:31:24.894986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 8b12da63-493f-48dd-b9a5-133c81b0dca1 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:24.894986 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 8b12da63-493f-48dd-b9a5-133c81b0dca1 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:24.897116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] No DVR routers for this DVR port 601f8a77-6dd5-433b-bc9a-2d3f36941adf on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:31:24.898682 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Pushing event deleted for resources: {'Port': ['ID=601f8a77-6dd5-433b-bc9a-2d3f36941adf,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:24.907353 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.907638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.907977 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.908312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.908676 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.909008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.909332 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.909655 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.909983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.910306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.910626 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.910957 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2cd5493-71b9-4c23-b321-251a8880d02e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:24.950145 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.956014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:24.959145 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] 10.222.0.30 "DELETE /v2.0/networks/e8655efd-122a-4437-a816-c84a823b1b31 HTTP/1.1" status: 204 len: 168 time: 0.6000855 Nov 05 15:31:24.962243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52656) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:24.970555 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c6849-bc99-4317-89ce-7597f4e3ea53 admin admin] Pushing event deleted for resources: {'Network': ['ID=e8655efd-122a-4437-a816-c84a823b1b31,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:25.058963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:25.310063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:25.552437 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Deleting port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:25.552805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:25.627598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] For port 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:25.627866 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:25.644597 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Calling delete_port for 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:25.822263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:25.847305 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Pushing event deleted for resources: {'Port': ['ID=48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:26.007496 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.043420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.219876 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:26.336275 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:26.341380 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-2c4c0de5-669d-42fe-ab3b-e38b6b1e3f0c admin admin] 10.222.0.30 "PUT /v2.0/routers/dd188e6d-d7e0-484f-8a36-c001f7c3e0b0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3781257 Nov 05 15:31:26.343886 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52660) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:26.347054 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Sync routers for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:26.357504 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:26.358127 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:26.447926 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.458707 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:26.525436 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-52c6e3f5-38ed-4228-9811-81693626e157 req-ae572c7e-b872-40ec-9f44-13f99082b032 service neutron] (113581) timed out ('10.222.0.32', 61032) {{(pid=113581) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 05 15:31:26.551445 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.602030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Deleting port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:26.602368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.632709 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143'}], 'enable_snat': True}, 'gw_port_id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:31:25Z', 'revision_number': 5, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port': {'id': 'd0303f98-f38a-4c44-83a8-0f7a8fdc0cd2', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:04:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1785, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:22:44Z', 'updated_at': '2021-11-05T15:22:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:26.670583 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Checking router: dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:26.679087 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Routers {'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:26.679690 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:26.685964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] For port d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:26.687137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.705929 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Calling delete_port for d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:26.768470 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] Set router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:26.823109 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:31:26Z', 'revision_number': 6, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:26.848282 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-318c3d6e-15de-4d58-9020-8429110274b3 None None] The sync data for ids ['dd188e6d-d7e0-484f-8a36-c001f7c3e0b0'] in dv-neutron-816850-1-hyperv is: [{'id': 'dd188e6d-d7e0-484f-8a36-c001f7c3e0b0', 'name': 'tempest-TestShelveInstance-1958868172-router', 'tenant_id': '6c72b827433245b98606074803b01137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:22:43Z', 'updated_at': '2021-11-05T15:31:26Z', 'revision_number': 6, 'project_id': '6c72b827433245b98606074803b01137', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:26.868388 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:26.899513 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:26.957102 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.051653 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.053776 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.098680 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.099337 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:31:27.104640 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.105788 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d01a6356-a1c2-4d10-b7cb-df07b9ed7503 admin admin] 10.222.0.30 "DELETE /v2.0/routers/dd188e6d-d7e0-484f-8a36-c001f7c3e0b0 HTTP/1.1" status: 204 len: 168 time: 0.7609649 Nov 05 15:31:27.108241 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52662) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:27.150754 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Deleting subnet daeef1de-5085-4b46-b000-fc1d590abca4 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:31:27.154068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.187405 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.269847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.333167 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.359484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=daeef1de-5085-4b46-b000-fc1d590abca4,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:27.361986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.365168 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-27d281d6-3991-4fac-bb18-132f78f73d93 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/daeef1de-5085-4b46-b000-fc1d590abca4 HTTP/1.1" status: 204 len: 168 time: 0.2559655 Nov 05 15:31:27.366114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f8c973f-17bd-4f09-9964-587ecc9f1f33 None None] Network 4fcde5bb-96d4-4e7f-9291-98f23e14158c requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:27.367771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52664) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:27.433468 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.493825 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Deleting port bfca1588-f6a2-426a-ac59-a0883537a059 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:27.494155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.517844 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:31:27.554709 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] For port bfca1588-f6a2-426a-ac59-a0883537a059, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bfca1588-f6a2-426a-ac59-a0883537a059,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:27.555007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.567712 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Calling delete_port for bfca1588-f6a2-426a-ac59-a0883537a059 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:27.609956 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] DHCP port deletion for 4fcde5bb-96d4-4e7f-9291-98f23e14158c request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:31:27.660997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Deleting port bfca1588-f6a2-426a-ac59-a0883537a059 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:31:27.661662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.667897 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.699850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Pushing event deleted for resources: {'Port': ['ID=bfca1588-f6a2-426a-ac59-a0883537a059,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:27.702162 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] No DVR routers for this DVR port bfca1588-f6a2-426a-ac59-a0883537a059 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:31:27.733005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] For port bfca1588-f6a2-426a-ac59-a0883537a059, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=bfca1588-f6a2-426a-ac59-a0883537a059,segment=NetworkSegment(465ea47e-602e-4d26-b936-1df3ebd1f611),segment_id=465ea47e-602e-4d26-b936-1df3ebd1f611)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:27.733444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.746982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Calling delete_port for bfca1588-f6a2-426a-ac59-a0883537a059 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:31:27.773791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.798973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4fcde5bb-96d4-4e7f-9291-98f23e14158c']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:27.808600 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '465ea47e-602e-4d26-b936-1df3ebd1f611') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:27.808903 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '465ea47e-602e-4d26-b936-1df3ebd1f611') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:27.818842 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.824674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.834324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.840368 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Releasing vlan 632 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:31:27.840791 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:31:27.842440 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:31:27.850414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] Pushing event deleted for resources: {'Port': ['ID=bfca1588-f6a2-426a-ac59-a0883537a059,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:27.854017 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa6cb6cd-dc9e-4dca-8ac1-3ea4b4251af2 None None] No DVR routers for this DVR port bfca1588-f6a2-426a-ac59-a0883537a059 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:31:27.909720 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.914885 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:27.920524 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] 10.222.0.30 "DELETE /v2.0/networks/4fcde5bb-96d4-4e7f-9291-98f23e14158c HTTP/1.1" status: 204 len: 168 time: 0.5517414 Nov 05 15:31:27.935458 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e6c047-e2ce-4e9d-9de8-0b327b207fe8 admin admin] Pushing event deleted for resources: {'Network': ['ID=4fcde5bb-96d4-4e7f-9291-98f23e14158c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:28.031085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52668) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:28.070037 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-8e8cb937-2dab-4cac-b525-e99470b01b62 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0c7efefc4d474bc2882d41e4cb713041&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0377548 Nov 05 15:31:28.072372 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52670) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:28.118116 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.138978 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.184735 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.187214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.188402 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3fb4a5fb-774b-4964-b307-95af11af4776 HTTP/1.1" status: 204 len: 168 time: 0.1151190 Nov 05 15:31:28.197137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d74039-a55c-46a8-b344-8dee2ab8d1f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fb4a5fb-774b-4964-b307-95af11af4776,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:28.488937 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52676) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:28.528857 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-08527d29-cffe-4d20-881a-9e1c13813c2f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6c72b827433245b98606074803b01137&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0386846 Nov 05 15:31:28.531282 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52678) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:28.578184 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.602948 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.648816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.651323 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:28.652817 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d9d6e723-cb8e-4672-9089-10849e95c66b HTTP/1.1" status: 204 len: 168 time: 0.1205783 Nov 05 15:31:28.661220 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10693d4-42ba-4a81-9905-e122bcaac487 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9d6e723-cb8e-4672-9089-10849e95c66b,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:28.738237 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bfca1588-f6a2-426a-ac59-a0883537a059 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:28.758062 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: bfca1588-f6a2-426a-ac59-a0883537a059 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:28.758402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device bfca1588-f6a2-426a-ac59-a0883537a059 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:28.758811 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:28.777409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:28.777738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device d0303f98-f38a-4c44-83a8-0f7a8fdc0cd2 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:28.778409 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:31:28.797183 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:31:28.797525 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 48c2cb5a-5f16-44ce-a266-ec9bfb8e47cc not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:31:29.341579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52700) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:29.435843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-520356236-network', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:29.457610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Made reservation on behalf of aa4b30adba9f49dfaa932f987a22ec06 for: {'network': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:31:29.459873 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.468085 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks [] for security_group, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.540087 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.543758 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.567412 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 610} {{(pid=113581) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:31:29.576849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ec71fc3-21b6-42c1-81d3-fe90363e68d3,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:29.582083 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.582418 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.segments_db [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Added segment 191d825a-b543-4983-9f9f-ca830a59892c of type vlan for network 41cf0049-d48d-471e-b660-0dd94cf07e44 Nov 05 15:31:29.621388 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.644700 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.645631 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:29.646197 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Publish callbacks [] for network, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.703142 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3603976 Nov 05 15:31:29.706200 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52704) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:29.710391 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12397ee-6938-437d-ae95-74598975dcdf admin admin] Pushing event updated for resources: {'Network': ['ID=41cf0049-d48d-471e-b660-0dd94cf07e44,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:29.711173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Request body: {'subnet': {'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-520356236-subnet', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'ip_version': 4}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:29.722634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:31:29.737250 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Made reservation on behalf of aa4b30adba9f49dfaa932f987a22ec06 for: {'subnet': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:31:29.739593 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10020756'] for subnet, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.896030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-10356574', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10020742'] for subnet, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.947789 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Pushing event updated for resources: {'Subnet': ['ID=37d12ab7-f690-473d-aa8c-8a85b5e6ac24,revision_number=0']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:29.962153 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Checking segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:29.962500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Network hostable DHCP agents. Network: 41cf0049-d48d-471e-b660-0dd94cf07e44, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113580) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:31:29.978656 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113580) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:31:29.987664 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, 41cf0049-d48d-471e-b660-0dd94cf07e44) {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:29.991435 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:29.992019 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:29.996991 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-059586a3-179e-4343-a165-9e837e78f347 None None] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:30.010293 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-6aba521c-4a03-47dd-9ed1-d151a42c8b39 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3029621 Nov 05 15:31:30.012953 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52706) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:30.017297 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:30.037179 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.038155 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-059586a3-179e-4343-a165-9e837e78f347 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:31:30.070316 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:31:30.080985 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d7220ba-bc8b-411e-a653-199aa0dabdca None None] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:30.088057 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-9d7220ba-bc8b-411e-a653-199aa0dabdca None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:31:30.154824 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:31:30.164175 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f0fc2d6-12f9-4668-9c39-df1298771251 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:31:30.226306 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.228737 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f0fc2d6-12f9-4668-9c39-df1298771251 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:31:30.420962 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.423059 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-41cf0049-d48d-471e-b660-0dd94cf07e44', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:31:30.423959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.443326 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.544830 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Allocated IP 172.26.5.82 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/0d834ffb-757a-482f-9e31-ea309ee1f110) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:30.561691 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Allocated IP 172.20.0.2 (41cf0049-d48d-471e-b660-0dd94cf07e44/37d12ab7-f690-473d-aa8c-8a85b5e6ac24/2040d077-f04c-4cfb-bfde-0f62e5606499) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:30.711278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.717608 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.757729 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:30.762647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:30.765106 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:30.777870 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Pushing event updated for resources: {'Port': ['ID=2040d077-f04c-4cfb-bfde-0f62e5606499,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:30.829079 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Attempting to bind port 2040d077-f04c-4cfb-bfde-0f62e5606499 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:30.829450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Attempting to bind port 2040d077-f04c-4cfb-bfde-0f62e5606499 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:30.829814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Attempting to bind port 2040d077-f04c-4cfb-bfde-0f62e5606499 on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:30.835638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:30.836013 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Checking segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:30.836419 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.836845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Bound using segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:30.837333 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Bound port: 2040d077-f04c-4cfb-bfde-0f62e5606499, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:30.837697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.904762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] For port 2040d077-f04c-4cfb-bfde-0f62e5606499, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:30.908320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] For port 2040d077-f04c-4cfb-bfde-0f62e5606499, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2040d077-f04c-4cfb-bfde-0f62e5606499,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:30.912819 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.966625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:30.969045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f3b5304-a491-4b96-bdd2-86e7924a3f22 None None] Pushing event updated for resources: {'Port': ['ID=2040d077-f04c-4cfb-bfde-0f62e5606499,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:30.992783 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:31.031021 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:31.034000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:31.039567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:31.066263 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Pushing event updated for resources: {'Port': ['ID=0d834ffb-757a-482f-9e31-ea309ee1f110,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:31.310258 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:31.504827 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:31.636007 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113580) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:31:31.747148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:31.757666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:31.768040 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:31.772859 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:31.773116 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-91f6f24c-3d8f-4a8d-806e-76f173e8ee52 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.7556732 Nov 05 15:31:31.773306 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:31.773529 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52708) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:31.880239 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:31.909274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f8912d8-8dad-482f-8603-2f56a8e407b6 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:31:32.027103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] Provisioning complete for port 2040d077-f04c-4cfb-bfde-0f62e5606499 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:32.027476 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.106463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f8912d8-8dad-482f-8603-2f56a8e407b6 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:31:32.198734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.359514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Allocated IP 172.20.0.1 (41cf0049-d48d-471e-b660-0dd94cf07e44/37d12ab7-f690-473d-aa8c-8a85b5e6ac24/c9a14611-544c-48ed-b194-08eec431ca39) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:32.388756 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.429772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:31Z', 'revision_number': 3, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:32.466961 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.475253 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:32.475609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Updating router 87646f43-ec0f-4274-b2a6-f197bc38ea1e port 0d834ffb-757a-482f-9e31-ea309ee1f110 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:31:32.506421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.508234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] For port 2040d077-f04c-4cfb-bfde-0f62e5606499, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2040d077-f04c-4cfb-bfde-0f62e5606499,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:32.516228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.521431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.545590 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:32.550338 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:32.552727 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:32.582148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Pushing event updated for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:32.600794 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.668187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1747963f-6dae-4aec-bcd3-70e99d4a54b4 None None] Pushing event updated for resources: {'Port': ['ID=2040d077-f04c-4cfb-bfde-0f62e5606499,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:32.733051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.802521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2040d077-f04c-4cfb-bfde-0f62e5606499 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:32.911701 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.915312 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 2040d077-f04c-4cfb-bfde-0f62e5606499 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:32.915860 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.918473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.921155 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.949202 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.987923 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:32.991311 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Pushing event updated for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:33.016489 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c803c5-1006-4639-af1c-a5ca96185f81 None None] Pushing event updated for resources: {'Port': ['ID=0d834ffb-757a-482f-9e31-ea309ee1f110,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:33.020425 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Attempting to bind port 0d834ffb-757a-482f-9e31-ea309ee1f110 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:33.020824 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Attempting to bind port 0d834ffb-757a-482f-9e31-ea309ee1f110 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:33.021195 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Attempting to bind port 0d834ffb-757a-482f-9e31-ea309ee1f110 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:33.029554 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:33.029931 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:33.030335 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.030722 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:33.031198 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Bound port: 0d834ffb-757a-482f-9e31-ea309ee1f110, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:33.031577 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.093099 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:33.094567 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:33.121808 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] For port 0d834ffb-757a-482f-9e31-ea309ee1f110, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:33.126200 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] For port 0d834ffb-757a-482f-9e31-ea309ee1f110, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0d834ffb-757a-482f-9e31-ea309ee1f110,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:33.132224 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.186585 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:33.187116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:33.227581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:33.230847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c803c5-1006-4639-af1c-a5ca96185f81 None None] Pushing event updated for resources: {'Port': ['ID=0d834ffb-757a-482f-9e31-ea309ee1f110,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:33.307399 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:33.357679 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-50efbce5-b037-4453-a660-981433d3a2c1 None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:33.358046 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50efbce5-b037-4453-a660-981433d3a2c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.361775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:33.366900 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b2373e3a-f147-455d-95ed-3bd9d1abb610 admin admin] 10.222.0.30 "PUT /v2.0/routers/87646f43-ec0f-4274-b2a6-f197bc38ea1e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5924220 Nov 05 15:31:33.463605 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-50efbce5-b037-4453-a660-981433d3a2c1 None None] Port c9a14611-544c-48ed-b194-08eec431ca39 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:33.499342 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-50efbce5-b037-4453-a660-981433d3a2c1 None None] Provisioning complete for port 2040d077-f04c-4cfb-bfde-0f62e5606499 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:33.499750 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-50efbce5-b037-4453-a660-981433d3a2c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.638235 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 2, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:33.671918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a9b8c5-8b30-4ba2-b49e-a17ba1897768 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 2, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:33.763550 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-ce653449-e00e-4b3d-99c4-924b7164232c None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:33.763923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ce653449-e00e-4b3d-99c4-924b7164232c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.804559 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-ce653449-e00e-4b3d-99c4-924b7164232c None None] Port c9a14611-544c-48ed-b194-08eec431ca39 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:33.920569 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52724) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:33.925625 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-1122613408-network', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:33.947670 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Made reservation on behalf of 3ca6c245780b4f08a37fee95bd6c84c2 for: {'network': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:31:33.950308 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for network, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:33.961286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.043841 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.047952 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.076875 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 640} {{(pid=113580) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 05 15:31:34.084039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df329b8a-68cb-4018-957d-3f2c39564a85,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:34.091581 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.091925 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.segments_db [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Added segment b5498b2e-8acc-43b1-ab42-c2dce1f61a84 of type vlan for network fbbc48bf-c077-48a5-9eaa-f0d56b067103 Nov 05 15:31:34.134856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785316054429'] for network, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.160433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080'] for network, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.161425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:34.162003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.224001 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3022916 Nov 05 15:31:34.226944 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52726) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:34.232001 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Request body: {'subnet': {'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-1122613408-subnet', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'ip_version': 4}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:34.237601 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c8ce1c-8cc5-4273-b8b6-f02e15879fd0 admin admin] Pushing event updated for resources: {'Network': ['ID=fbbc48bf-c077-48a5-9eaa-f0d56b067103,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:34.248295 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 details requested by agent ovs-agent-dv-neutron-816850-1-hyperv with host dv-neutron-816850-1-hyperv {{(pid=113582) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 05 15:31:34.259614 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Made reservation on behalf of 3ca6c245780b4f08a37fee95bd6c84c2 for: {'subnet': 1} {{(pid=113581) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:31:34.269550 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9931205'] for subnet, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.459950 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9638077', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9931223'] for subnet, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.518792 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=b771b7dd-20f0-4db8-ac95-47c47cfcc689,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:34.529416 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Checking segment: {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113581) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:34.529781 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Network hostable DHCP agents. Network: fbbc48bf-c077-48a5-9eaa-f0d56b067103, hostable agents: ['e00c03f2-9866-481b-b4b5-10f75e3fb25b'], hosted agents: [] {{(pid=113581) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 05 15:31:34.547381 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 is scheduled to be hosted by DHCP agent e00c03f2-9866-481b-b4b5-10f75e3fb25b with binding_index 1 {{(pid=113581) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 05 15:31:34.557440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-816850-1-hyperv, fbbc48bf-c077-48a5-9eaa-f0d56b067103) {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:34.562015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:34.562782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.568437 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1285cd6a-89a2-4d6f-b031-eb674abd9e5a None None] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:34.580194 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9db95024-dd39-4702-bb8b-40cbdb247a4c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3520927 Nov 05 15:31:34.582726 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52728) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:34.587113 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:34.610565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1040234', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13885'] for router, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.612796 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1040326', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1032819', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-954612', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13830'] for router, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-1285cd6a-89a2-4d6f-b031-eb674abd9e5a None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:31:34.655312 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:31:34.668328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dee06643-74e3-4bec-b69b-66b41ce58760 None None] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:31:34.673578 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server [None req-dee06643-74e3-4bec-b69b-66b41ce58760 None None] Exception during message handling: KeyError: 'segment_id' Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in get_network_info Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server seg_subnets = [subnet for subnet in subnets if subnet['segment_id']] Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server KeyError: 'segment_id' Nov 05 15:31:34.760040 dv-neutron-816850-1-hyperv neutron-server[113582]: ERROR oslo_messaging.rpc.server Nov 05 15:31:34.771864 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b0d966e-6899-4f83-9ecb-7cdb0e1e773b None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:31:34.796193 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0d834ffb-757a-482f-9e31-ea309ee1f110 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:34.840283 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:34.887431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b0d966e-6899-4f83-9ecb-7cdb0e1e773b None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:31:34.893590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0d834ffb-757a-482f-9e31-ea309ee1f110 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:34.893963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.059207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.067931 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.088122 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.199273 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Allocated IP 172.26.5.80 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/838a79e6-6e5c-4a9f-85e1-a0f29ec97789) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:35.248367 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 0d834ffb-757a-482f-9e31-ea309ee1f110, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0d834ffb-757a-482f-9e31-ea309ee1f110,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:35.254269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.308332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.340610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=0d834ffb-757a-482f-9e31-ea309ee1f110,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:35.346845 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.373547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpa38f3cc2-c9b1-54e8-8140-d2da33fdf964-fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'fixed_ips': [{'subnet_id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689'}]}} from dv-neutron-816850-1-hyperv. {{(pid=113582) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:290}} Nov 05 15:31:35.374428 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.385740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:35.392079 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:35.396859 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:35.400044 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Pushing event updated for resources: {'Port': ['ID=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:35.526807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.db_base_plugin_common [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Allocated IP 172.20.0.2 (fbbc48bf-c077-48a5-9eaa-f0d56b067103/b771b7dd-20f0-4db8-ac95-47c47cfcc689/0b438fff-906e-48b7-b674-7645bfa07132) {{(pid=113582) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:35.664953 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.676365 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks [] for port, precommit_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.682328 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868'] for port, after_create {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.718845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 is already hosted by enough agents. {{(pid=113582) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:35.726134 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.base_scheduler [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Resources bound (agent type, host, resource id): {{(pid=113582) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:35.729814 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Received port after_create {{(pid=113582) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:35.736041 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Pushing event updated for resources: {'Port': ['ID=0b438fff-906e-48b7-b674-7645bfa07132,revision_number=1']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:35.791606 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Attempting to bind port 0b438fff-906e-48b7-b674-7645bfa07132 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:35.792168 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Attempting to bind port 0b438fff-906e-48b7-b674-7645bfa07132 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:35.792557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Attempting to bind port 0b438fff-906e-48b7-b674-7645bfa07132 on network fbbc48bf-c077-48a5-9eaa-f0d56b067103 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:35.797877 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:35.798252 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Checking segment: {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:35.798652 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.799137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Bound using segment: {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:35.799609 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Bound port: 0b438fff-906e-48b7-b674-7645bfa07132, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:35.799988 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.816335 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:35.826194 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:35.826906 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:35.869865 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] For port 0b438fff-906e-48b7-b674-7645bfa07132, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:35.871584 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1040381', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1032718'] for router, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.873178 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] For port 0b438fff-906e-48b7-b674-7645bfa07132, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0b438fff-906e-48b7-b674-7645bfa07132,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:35.878801 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:35.946003 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b965308-37c9-49bb-805f-6a635282fda8 None None] Pushing event updated for resources: {'Port': ['ID=0b438fff-906e-48b7-b674-7645bfa07132,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:35.947057 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:36.013721 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Router 42976b4f-2862-417e-ae91-4732bcc87c89 is scheduled to L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 with binding_index 1 {{(pid=113581) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 05 15:31:36.156613 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:36.172440 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Sync routers for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:36.176777 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 2, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:36.178023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.187667 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e3bccbb0-9955-4e47-b7e5-32bd0c8ccc95 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.6015196 Nov 05 15:31:36.188074 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52730) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:36.198822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:36.199728 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:36.216605 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:36.217132 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Updating router 87646f43-ec0f-4274-b2a6-f197bc38ea1e port c9a14611-544c-48ed-b194-08eec431ca39 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:31:36.249722 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.317545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:36.513880 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 3, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:36.541410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Checking router: 42976b4f-2862-417e-ae91-4732bcc87c89 for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:36.541768 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Updating router 42976b4f-2862-417e-ae91-4732bcc87c89 port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 binding host dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:31:36.570589 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.644085 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.652652 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.713013 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Pushing event updated for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:36.744721 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.745066 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.745399 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.746005 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.746381 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.746714 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.747680 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.748015 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.748339 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.749049 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.749382 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.749697 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113583) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:31:36.790781 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Attempting to bind port c9a14611-544c-48ed-b194-08eec431ca39 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:36.791162 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Attempting to bind port c9a14611-544c-48ed-b194-08eec431ca39 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:36.791491 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Attempting to bind port c9a14611-544c-48ed-b194-08eec431ca39 on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:36.801585 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:36.801958 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Checking segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:36.802364 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.802771 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Bound using segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:36.803239 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Bound port: c9a14611-544c-48ed-b194-08eec431ca39, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:36.803614 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.902077 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] For port c9a14611-544c-48ed-b194-08eec431ca39, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:36.908732 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] For port c9a14611-544c-48ed-b194-08eec431ca39, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c9a14611-544c-48ed-b194-08eec431ca39,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:36.925556 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.941982 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0d834ffb-757a-482f-9e31-ea309ee1f110 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:36.970022 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:36.970654 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:36.976211 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks [] for port, precommit_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:36.988674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.025148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.051495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Attempting to bind port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:37.052020 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Attempting to bind port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:37.052681 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Attempting to bind port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 on network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:37.071781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:37.072285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Checking segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113582) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:37.072949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.073449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Bound using segment: {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'} {{(pid=113582) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:37.074033 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.managers [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Bound port: 838a79e6-6e5c-4a9f-85e1-a0f29ec97789, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61488534-ae2d-4393-8e51-d7a4f47ad1d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6'}}] {{(pid=113582) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:37.074524 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.079326 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ed3930-c168-41fc-bcc8-39e945759b30 None None] Pushing event updated for resources: {'Port': ['ID=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,revision_number=2']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:37.104872 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:37.115228 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0d834ffb-757a-482f-9e31-ea309ee1f110 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:37.115745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.180705 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] For port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113582) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:37.184746 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] For port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:37.187846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-306023b9-cde0-4b22-9125-c8d775349c37 None None] get_active_networks_info from dv-neutron-816850-1-hyperv {{(pid=113582) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Nov 05 15:31:37.231211 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Allocated IP 172.20.0.1 (fbbc48bf-c077-48a5-9eaa-f0d56b067103/b771b7dd-20f0-4db8-ac95-47c47cfcc689/12825622-c2c1-4674-9534-ba57ff45d938) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:37.243649 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.249080 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b8b6c9-353a-4392-a38a-8986267e6488 None None] Pushing event updated for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:37.356621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.358158 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] Provisioning complete for port 0b438fff-906e-48b7-b674-7645bfa07132 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:37.358547 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.362996 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:36Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:37.367420 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-306023b9-cde0-4b22-9125-c8d775349c37 None None] Resources bound (agent type, host, resource id): {{(pid=113582) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 05 15:31:37.391967 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1cd07189-033d-41b5-9ee6-d655ced82807 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:36Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:37.393734 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.410897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ed3930-c168-41fc-bcc8-39e945759b30 None None] Pushing event updated for resources: {'Port': ['ID=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:37.416293 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:37.416879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:37.419321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0b438fff-906e-48b7-b674-7645bfa07132 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:37.440503 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:37.443643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:37.447291 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:37.484058 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Pushing event updated for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:37.500805 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1033843'] for router_interface, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.637965 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.698009 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:37.699963 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0b438fff-906e-48b7-b674-7645bfa07132 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:37.700496 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.731628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.819085 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.824613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:37.897747 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Pushing event updated for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:37.902912 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-621066', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1033935'] for router_interface, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:38.005063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:38.006448 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:38.044360 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] For port 0b438fff-906e-48b7-b674-7645bfa07132, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0b438fff-906e-48b7-b674-7645bfa07132,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:38.063772 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:38.135950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Router 42976b4f-2862-417e-ae91-4732bcc87c89 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:38.222579 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cd557ac-824e-40fd-bf43-ead939b873c1 None None] Pushing event updated for resources: {'Port': ['ID=0b438fff-906e-48b7-b674-7645bfa07132,revision_number=3']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:38.243182 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:38.251111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-4afe7ee1-5dca-4875-8293-21683c957a05 admin admin] 10.222.0.30 "PUT /v2.0/routers/42976b4f-2862-417e-ae91-4732bcc87c89/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0590377 Nov 05 15:31:38.279393 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 3, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:38.306913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6a9b436-4bde-4865-a1b4-4304aa44b6fb None None] The sync data for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv is: [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 3, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:38.908726 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0b438fff-906e-48b7-b674-7645bfa07132 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:38.972052 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c96cce6a-2c7c-4bf7-a806-acda23ff5e21 None None] Provisioning complete for port 0b438fff-906e-48b7-b674-7645bfa07132 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:38.972538 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c96cce6a-2c7c-4bf7-a806-acda23ff5e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:38.989053 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 52738) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:38.996077 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2036907838', 'description': 'tempest-secgroup-smoke-2036907838 description', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.031353 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.045978 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 0b438fff-906e-48b7-b674-7645bfa07132 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.046551 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.145473 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.151938 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.192218 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroup': ['ID=261b9e10-821e-4b9f-ad57-c700869f79bd,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.203974 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:39.207795 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-c96cce6a-2c7c-4bf7-a806-acda23ff5e21 None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.208164 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c96cce6a-2c7c-4bf7-a806-acda23ff5e21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.212217 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.216683 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-e2006b54-2bf8-4cd8-b040-1f5dd32c589a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2231302 Nov 05 15:31:39.217108 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52740) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.222446 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.275800 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.313002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-c96cce6a-2c7c-4bf7-a806-acda23ff5e21 None None] Port 12825622-c2c1-4674-9534-ba57ff45d938 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:39.338354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.338730 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.344425 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.349730 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.374133 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4c461d30-996a-4e95-b735-ab939de84d77,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.387710 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.389403 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7ac89be3-f229-4862-a09d-e97ee431edf3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1713827 Nov 05 15:31:39.394213 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52742) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.399407 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.450166 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.484781 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.485254 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.519507 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.520772 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.524716 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.547581 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=33974bbd-570f-48d3-ba74-9f1280b49be1,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.555907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] For port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:39.556115 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.557457 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-e4468dc7-c2ec-456b-945b-04a9760198bf tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1617556 Nov 05 15:31:39.559225 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.560080 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c9a14611-544c-48ed-b194-08eec431ca39 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:39.560214 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52744) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.565099 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.592610 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.649152 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.653916 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.672182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f684993-039c-4960-93f9-86d4570c2027,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.673067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Pushing event updated for resources: {'Port': ['ID=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.685090 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.685241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.686450 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9c1bdc61-2144-4269-95fe-3914689b803c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1252367 Nov 05 15:31:39.689094 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52746) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.693844 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.715495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.715866 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.722839 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.755442 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] For port c9a14611-544c-48ed-b194-08eec431ca39, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c9a14611-544c-48ed-b194-08eec431ca39,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:39.761151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.781142 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.785663 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.800525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3049d179-7bbc-4eb8-a809-7dbf7380dc97,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.811507 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.812728 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-7743ef8c-b1fc-4cac-9af4-51ecac24c7f9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1225626 Nov 05 15:31:39.816114 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52748) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.820849 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.821934 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:39.822315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.842098 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Project aa4b30adba9f49dfaa932f987a22ec06 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:31:39.847032 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.851043 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Pushing event updated for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.888869 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-97b00013-b6b9-4024-89b7-f8c23c5bf381 None None] Port 12825622-c2c1-4674-9534-ba57ff45d938 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:39.909595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.913010 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.927704 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1ee35ac6-30db-473e-8982-3a1e4930c7c9,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:39.937603 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:39.938776 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-17bdc8ef-205e-4c47-a6eb-fd66191591c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1216788 Nov 05 15:31:39.941985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52750) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:39.946218 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'security_group_rule': {'security_group_id': '261b9e10-821e-4b9f-ad57-c700869f79bd', 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:39.967149 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.securitygroups_db [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Project aa4b30adba9f49dfaa932f987a22ec06 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 05 15:31:39.972014 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.007753 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-584c5f82-ee3b-4a49-8b70-299afb7e7302 None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:40.008125 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-584c5f82-ee3b-4a49-8b70-299afb7e7302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.036967 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.040900 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996825'] for security_group_rule, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.061310 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a591b9a9-6e6c-499c-b4a0-c8b756cc908f,revision_number=0']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:40.067469 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group_rule, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.068702 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-9aebe48f-ec24-4ee4-b1d3-192cc6255956 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1257820 Nov 05 15:31:40.098992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-584c5f82-ee3b-4a49-8b70-299afb7e7302 None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:40.099576 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-584c5f82-ee3b-4a49-8b70-299afb7e7302 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.140688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-584c5f82-ee3b-4a49-8b70-299afb7e7302 None None] Port 12825622-c2c1-4674-9534-ba57ff45d938 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:40.222477 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-f0cbd270-1b73-48c4-92c3-65bc32637a1e tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2036907838&fields=id&tenant_id=aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 267 time: 0.0446789 Nov 05 15:31:40.333533 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-cd862b4b-7e57-4439-a83e-37e38a506022 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:40.336070 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-cd862b4b-7e57-4439-a83e-37e38a506022 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 809 time: 0.1068411 Nov 05 15:31:40.351537 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-4c6c2d7c-2337-4993-8bf1-4be4e87ab421 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/quotas/aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 375 time: 0.0099318 Nov 05 15:31:40.401814 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-9bb75bd8-3c2d-42cd-a803-2eea2d156520 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0449469 Nov 05 15:31:40.417436 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-814f77e0-4dbd-429e-8be9-5c354c0e6422 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:31:40.418407 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-814f77e0-4dbd-429e-8be9-5c354c0e6422 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051506 Nov 05 15:31:40.517512 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-9a849ece-f86a-4fc6-841c-c6563ad4c4c5 service neutron] 10.222.0.30 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0935097 Nov 05 15:31:40.608597 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8fbd25aa-1afe-4cd7-b256-a879daf188b4 service neutron] 10.222.0.30 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848866 Nov 05 15:31:40.764160 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:40.776797 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-e2f7afa3-e48a-4fc3-8184-1448b77776d7 req-360d01af-b89c-4f8d-bdf7-c06fd50ef5f7 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 210 time: 0.0286310 Nov 05 15:31:40.802642 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Sync routers for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:40.813466 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:40.814095 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:40.822007 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:40.822375 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:40.910740 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c9a14611-544c-48ed-b194-08eec431ca39 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:40.921435 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:40.958966 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port c9a14611-544c-48ed-b194-08eec431ca39 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:40.959334 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.128208 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 4, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '12825622-c2c1-4674-9534-ba57ff45d938', 'name': '', 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'mac_address': 'fa:16:3e:ba:08:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_interface', 'standard_attr_id': 1835, 'fixed_ips': [{'subnet_id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:37Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 2, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'subnets': [{'id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:41.161783 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Checking router: 42976b4f-2862-417e-ae91-4732bcc87c89 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:41.162137 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Updating router 42976b4f-2862-417e-ae91-4732bcc87c89 port 12825622-c2c1-4674-9534-ba57ff45d938 binding host dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 05 15:31:41.186235 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.442300 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks [] for port, precommit_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.447174 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.494889 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb8f30d-c031-435a-b70f-174346fd01f9 None None] Pushing event updated for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=3']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:41.553501 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Attempting to bind port 12825622-c2c1-4674-9534-ba57ff45d938 on host dv-neutron-816850-1-hyperv for vnic_type normal with profile {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:41.553859 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Attempting to bind port 12825622-c2c1-4674-9534-ba57ff45d938 by drivers openvswitch,hyperv on host dv-neutron-816850-1-hyperv at level 0 using segments [{'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:41.554216 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Attempting to bind port 12825622-c2c1-4674-9534-ba57ff45d938 on network fbbc48bf-c077-48a5-9eaa-f0d56b067103 {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:41.559683 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Checking agent: {'id': '47aa66e3-e472-4abb-91bc-3620392cb0ad', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-816850-1-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 36, 56), 'started_at': datetime.datetime(2021, 11, 5, 14, 37, 26), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-816850-1-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:41.560045 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Checking segment: {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113583) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:41.560440 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.560852 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Bound using segment: {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'} {{(pid=113583) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:41.561302 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.managers [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Bound port: 12825622-c2c1-4674-9534-ba57ff45d938, host: dv-neutron-816850-1-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103'}}] {{(pid=113583) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:41.561676 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.626193 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] For port 12825622-c2c1-4674-9534-ba57ff45d938, host dv-neutron-816850-1-hyperv, cleared binding levels {{(pid=113583) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:41.633296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.plugins.ml2.db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] For port 12825622-c2c1-4674-9534-ba57ff45d938, host dv-neutron-816850-1-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=12825622-c2c1-4674-9534-ba57ff45d938,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113583) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:41.639105 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron_lib.callbacks.manager [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113583) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.690724 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:41.691365 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:22Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:41.752979 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb8f30d-c031-435a-b70f-174346fd01f9 None None] Pushing event updated for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=4']} {{(pid=113583) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:41.785863 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:41.787209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.814757 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:41.896181 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.948422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] For port 12825622-c2c1-4674-9534-ba57ff45d938, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=12825622-c2c1-4674-9534-ba57ff45d938,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:41.959412 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:41.959611 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-8b4627b5-7f52-46c9-9b69-111edef3778e req-160f9380-8ca6-40bf-b882-25b9b7d09a69 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 210 time: 0.0496547 Nov 05 15:31:42.009758 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-dec85e75-5ba4-4d14-92c4-f42c31190215 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:42.011365 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-dec85e75-5ba4-4d14-92c4-f42c31190215 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 809 time: 0.2660966 Nov 05 15:31:42.030402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf42af6d-7ebf-4e77-ab9b-26f5ea34dccc None None] Pushing event updated for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:42.086952 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-a7b1d17d-044b-46a7-88a8-c56a6b98081f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 380 time: 0.0630720 Nov 05 15:31:42.089738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-7e8cdf25-bf27-4952-9777-bfe5a6df236e None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:42.090122 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-7e8cdf25-bf27-4952-9777-bfe5a6df236e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.098580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'port': {'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'admin_state_up': True, 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'security_groups': ['261b9e10-821e-4b9f-ad57-c700869f79bd']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:42.189296 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 4, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '12825622-c2c1-4674-9534-ba57ff45d938', 'name': '', 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'mac_address': 'fa:16:3e:ba:08:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_interface', 'standard_attr_id': 1835, 'fixed_ips': [{'subnet_id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:37Z', 'updated_at': '2021-11-05T15:31:41Z', 'revision_number': 4, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'subnets': [{'id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:42.215453 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b08e1de-6c0b-4e72-8778-09add69c7fff None None] The sync data for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv is: [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:31:37Z', 'revision_number': 4, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': '12825622-c2c1-4674-9534-ba57ff45d938', 'name': '', 'network_id': 'fbbc48bf-c077-48a5-9eaa-f0d56b067103', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'mac_address': 'fa:16:3e:ba:08:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_interface', 'standard_attr_id': 1835, 'fixed_ips': [{'subnet_id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:37Z', 'updated_at': '2021-11-05T15:31:41Z', 'revision_number': 4, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'subnets': [{'id': 'b771b7dd-20f0-4db8-ac95-47c47cfcc689', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:42.220324 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Made reservation on behalf of aa4b30adba9f49dfaa932f987a22ec06 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:31:42.223389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.380983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Allocated IP 172.20.0.10 (41cf0049-d48d-471e-b660-0dd94cf07e44/37d12ab7-f690-473d-aa8c-8a85b5e6ac24/a840bce8-9be7-4296-b334-5b2b7e4ea71c) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:42.532839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.567412 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.612993 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:42.618187 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:42.621191 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:42.657357 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:42.683663 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:42.684502 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.707865 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-8788a68a-3818-4204-8ad8-7dc696ac75f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6134093 Nov 05 15:31:42.797170 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 12825622-c2c1-4674-9534-ba57ff45d938 up at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:42.860395 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Request body: {'port': {'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:42.863021 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Provisioning complete for port 12825622-c2c1-4674-9534-ba57ff45d938 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:42.863414 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:42.919280 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.005495 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-898e5d88-3183-48db-a36b-ea0d97b98260 None None] Provisioning complete for port a840bce8-9be7-4296-b334-5b2b7e4ea71c triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:43.006105 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-898e5d88-3183-48db-a36b-ea0d97b98260 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.048698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-898e5d88-3183-48db-a36b-ea0d97b98260 None None] Port a840bce8-9be7-4296-b334-5b2b7e4ea71c cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:31:43.097668 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af92511-28ee-4d80-aa81-e7f68fd9293b req-75d1c8de-fe82-451c-abc8-7bd947fa5e64 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:43.099902 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3af92511-28ee-4d80-aa81-e7f68fd9293b req-75d1c8de-fe82-451c-abc8-7bd947fa5e64 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 932 time: 0.0621433 Nov 05 15:31:43.157855 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-3af92511-28ee-4d80-aa81-e7f68fd9293b req-fec868fa-fedc-4822-8ca7-48fe78fb5520 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510614 Nov 05 15:31:43.233361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a840bce8-9be7-4296-b334-5b2b7e4ea71c {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:31:43.241380 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.253986 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Transition to ACTIVE for port object a840bce8-9be7-4296-b334-5b2b7e4ea71c will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:31:43.257560 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.323220 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:43.383056 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Attempting to bind port a840bce8-9be7-4296-b334-5b2b7e4ea71c on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:31:43.383392 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Attempting to bind port a840bce8-9be7-4296-b334-5b2b7e4ea71c by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:31:43.383729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Attempting to bind port a840bce8-9be7-4296-b334-5b2b7e4ea71c on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:43.388317 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Port a840bce8-9be7-4296-b334-5b2b7e4ea71c on network 41cf0049-d48d-471e-b660-0dd94cf07e44 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:31:43.388678 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Attempting to bind port a840bce8-9be7-4296-b334-5b2b7e4ea71c on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:31:43.394618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 31, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:31:43.395164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Checking segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:31:43.395736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Bound using segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:31:43.396175 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Bound port: a840bce8-9be7-4296-b334-5b2b7e4ea71c, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:31:43.396595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.466706 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:31:43.469763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:31:43.475318 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.508589 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:43.509214 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:43.510594 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] 10.222.0.32 "PUT /v2.0/ports/a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 1094 time: 0.7943223 Nov 05 15:31:43.511033 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:31:43.513363 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86a56930-3c77-4492-be42-fdc6939a31d6" -d '{"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:31:43.554359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56019041-7350-4783-8407-1d3d2bba9077 service neutron] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:43.575880 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:31:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1cff2840-4671-4022-aaad-b343327ebef3 x-openstack-request-id: req-1cff2840-4671-4022-aaad-b343327ebef3 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:31:43.576173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:31:43.576428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1cff2840-4671-4022-aaad-b343327ebef3 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:31:43.576863 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'status': 'completed', 'code': 200} Nov 05 15:31:43.611261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-e9a64368-0a99-41c4-bff1-140aca949620 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:43.613462 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-e9a64368-0a99-41c4-bff1-140aca949620 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1097 time: 0.0464969 Nov 05 15:31:43.657852 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-6ad69598-a356-4f89-8a59-c6954ba606b6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 217 time: 0.0352442 Nov 05 15:31:43.715025 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-6609a966-9a7e-4e64-82f6-18885ba35ef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:43.716520 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-6609a966-9a7e-4e64-82f6-18885ba35ef5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0520928 Nov 05 15:31:43.761878 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-4eac069d-487a-4378-92ce-69dffffa472a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:43.763330 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-4eac069d-487a-4378-92ce-69dffffa472a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0401175 Nov 05 15:31:43.856534 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-20805b34-8ec5-4fad-9c34-084bd11f9fe7 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861452 Nov 05 15:31:43.945044 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-40ce6caf-cf26-4aa0-a777-8b21c26e3979 req-3846d5b5-a638-4c1f-a901-5b083c964862 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812974 Nov 05 15:31:44.029960 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-3454cd02-db45-413c-9703-b92ba716531d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:44.031382 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-3454cd02-db45-413c-9703-b92ba716531d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1097 time: 0.0409348 Nov 05 15:31:44.121836 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-e623fd45-aa74-4402-a189-ca9d728e2410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:44.123257 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-e623fd45-aa74-4402-a189-ca9d728e2410 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0852137 Nov 05 15:31:44.165452 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-ac7fd404-c429-47ab-9c57-41e81810b50a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 217 time: 0.0348325 Nov 05 15:31:44.216572 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-4258d10b-15cf-4bea-9f07-3b4e71ab68bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:44.218052 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-4258d10b-15cf-4bea-9f07-3b4e71ab68bd service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0450480 Nov 05 15:31:44.274346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-fb29357e-edf9-4a7b-beff-2d7d99af10fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:44.275888 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-fb29357e-edf9-4a7b-beff-2d7d99af10fe service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0502367 Nov 05 15:31:44.281727 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c7a3ad-6c5c-498d-8ee7-20275da02eaa req-49847e45-0d77-4934-a6e9-a4af3e9af55b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:44.283140 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-06c7a3ad-6c5c-498d-8ee7-20275da02eaa req-49847e45-0d77-4934-a6e9-a4af3e9af55b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0558190 Nov 05 15:31:44.332681 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-06c7a3ad-6c5c-498d-8ee7-20275da02eaa req-36894677-c600-4147-97cd-dfcffa3b236b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430055 Nov 05 15:31:44.367847 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-fc7d6f8a-c364-4c8d-8e0a-b17300a984a4 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831156 Nov 05 15:31:44.460036 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-86a56930-3c77-4492-be42-fdc6939a31d6 req-59bffa21-1218-4cff-8916-d2bef9ecd6d9 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841100 Nov 05 15:31:45.452072 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a342dc-523c-4214-9346-38abc337cab4 req-07614c38-fe63-4b84-a97b-4b7450fa1efc tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:45.453559 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-12a342dc-523c-4214-9346-38abc337cab4 req-07614c38-fe63-4b84-a97b-4b7450fa1efc tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0511162 Nov 05 15:31:45.501747 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-12a342dc-523c-4214-9346-38abc337cab4 req-cdfa03dd-31a9-486a-8c2b-d6af45aef1c5 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422635 Nov 05 15:31:46.615486 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3749cc-932b-42fe-b548-63e1342fa619 req-f132a113-30cf-4cd5-be7c-67acd98e14b4 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:46.617002 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8e3749cc-932b-42fe-b548-63e1342fa619 req-f132a113-30cf-4cd5-be7c-67acd98e14b4 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0496490 Nov 05 15:31:46.667549 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8e3749cc-932b-42fe-b548-63e1342fa619 req-7842c213-f627-428a-9093-024d6ea6657b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428472 Nov 05 15:31:47.424483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:31:47.520557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:47.531822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 610, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:31:47.568166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:47.580733 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a840bce8-9be7-4296-b334-5b2b7e4ea71c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:31:47.599635 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:47.603526 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:47.653462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:47.781032 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb6979d4-456d-4601-b88f-3eae719fc905 req-6cad3210-79fd-4a1e-bfd1-5bae3333d525 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:47.782466 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fb6979d4-456d-4601-b88f-3eae719fc905 req-6cad3210-79fd-4a1e-bfd1-5bae3333d525 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 945 time: 0.0496981 Nov 05 15:31:47.810993 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['a840bce8-9be7-4296-b334-5b2b7e4ea71c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:31:47.834981 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fb6979d4-456d-4601-b88f-3eae719fc905 req-ecd9bb46-838d-4694-b6c6-87bd2c541a70 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465569 Nov 05 15:31:48.704897 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:48.947358 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab99d242-8133-4a86-94ad-92a37f09aca3 req-d9be0269-5679-4aef-ac1e-f2013377552f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:48.948863 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab99d242-8133-4a86-94ad-92a37f09aca3 req-d9be0269-5679-4aef-ac1e-f2013377552f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 945 time: 0.0486157 Nov 05 15:31:49.000796 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-ab99d242-8133-4a86-94ad-92a37f09aca3 req-7717b60b-7970-43ce-9e41-f87f49e63862 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460384 Nov 05 15:31:49.455803 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:31:49.503745 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port a840bce8-9be7-4296-b334-5b2b7e4ea71c completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:31:49.508095 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port a840bce8-9be7-4296-b334-5b2b7e4ea71c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:31:49.508482 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:49.587044 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:49.608620 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:31:49.610837 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3730f535-202e-433a-b545-040127460ba2" -d '{"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-plugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:31:49.622817 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:31:49.627180 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:49.674374 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:49.710067 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:31:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-476c9982-66b4-4342-a146-03e293f34959 x-openstack-request-id: req-476c9982-66b4-4342-a146-03e293f34959 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:31:49.710687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-plugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:31:49.710687 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-476c9982-66b4-4342-a146-03e293f34959 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:31:49.710979 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'code': 200} Nov 05 15:31:49.871643 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fc5797-cb3e-4998-8b66-1a7a5aff3186 req-7c472196-3079-466f-9068-bca846d80b1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:49.873201 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17fc5797-cb3e-4998-8b66-1a7a5aff3186 req-7c472196-3079-466f-9068-bca846d80b1c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1099 time: 0.0395551 Nov 05 15:31:49.918106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-17fc5797-cb3e-4998-8b66-1a7a5aff3186 req-f7b64faf-f2db-4fb9-b5b8-70121bade899 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379179 Nov 05 15:31:50.116932 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f0bbe8f-c3e1-48f1-bfb0-578489b47d9d req-5afdf177-4b33-4dcd-8576-566c6f495eb1 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:50.118281 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f0bbe8f-c3e1-48f1-bfb0-578489b47d9d req-5afdf177-4b33-4dcd-8576-566c6f495eb1 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 946 time: 0.0488977 Nov 05 15:31:50.166947 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-2f0bbe8f-c3e1-48f1-bfb0-578489b47d9d req-172d7450-a252-4f1e-9c36-9f6a65e1da7c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429244 Nov 05 15:31:50.177517 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-46a025c2-1b27-4595-8a53-391cb34fb48b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:51.286784 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e70e3fc-a20b-43bc-924f-439dd6881097 req-10038c5c-a535-481c-b9c9-e5431bbe90a6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:51.288470 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e70e3fc-a20b-43bc-924f-439dd6881097 req-10038c5c-a535-481c-b9c9-e5431bbe90a6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 946 time: 0.0500393 Nov 05 15:31:51.337858 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-7e70e3fc-a20b-43bc-924f-439dd6881097 req-bf6540d9-3204-4053-8a60-e9690a390631 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433102 Nov 05 15:31:51.455476 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4292d949-438c-4368-93f0-18bf402e8fa2 req-e09c5062-8d0b-49e8-a719-5d7c6c814a19 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:51.457679 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4292d949-438c-4368-93f0-18bf402e8fa2 req-e09c5062-8d0b-49e8-a719-5d7c6c814a19 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 946 time: 0.0523391 Nov 05 15:31:51.507148 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-4292d949-438c-4368-93f0-18bf402e8fa2 req-2bd71340-a390-42c8-a4c3-79b1f7a77191 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430586 Nov 05 15:31:51.528542 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52812) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:51.612236 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-907ce910-2cdc-4db1-8548-6987432b6212 tempest-TestSnapshotPattern-962176979 tempest-TestSnapshotPattern-962176979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:51.613783 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-907ce910-2cdc-4db1-8548-6987432b6212 tempest-TestSnapshotPattern-962176979 tempest-TestSnapshotPattern-962176979-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1094 time: 0.0840518 Nov 05 15:31:51.616629 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 52816) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:31:51.620826 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address': '172.20.0.10'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:31:51.642016 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:51.741301 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:51.844075 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Allocated IP 172.26.5.72 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/177d86d8-3d55-4842-b256-252bd353bf5c) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:31:51.944339 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:51.976117 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.015740 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:31:52.018382 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:31:52.023798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:31:52.046985 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=177d86d8-3d55-4842-b256-252bd353bf5c,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:52.372752 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.441395 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.500572 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5a6d414e-8065-4c57-ac7e-6df2730aa9b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.590105 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.594463 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.663601 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=177d86d8-3d55-4842-b256-252bd353bf5c,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:31:52.671548 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:52.771222 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Floating IP a8dc3a2c-597a-484a-b7ea-13efd6919e6b associated. External IP: 172.26.5.72, port: a840bce8-9be7-4296-b334-5b2b7e4ea71c. Nov 05 15:31:53.291202 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:31:53.397349 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:31:53.407006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:31:53.416768 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:53.417139 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:53.417845 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:53.446427 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-54b8dfa0-0cd4-4116-8294-023ebe0f9031 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8287699 Nov 05 15:31:53.447009 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:31:53.449332 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4470e1ab-4c07-40af-b4ec-83fddd544440" -d '{"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:31:53.530586 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:53.540807 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:31:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2268c28f-ad82-48cf-87bc-53166f156872 x-openstack-request-id: req-2268c28f-ad82-48cf-87bc-53166f156872 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:31:53.541098 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:31:53.541402 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2268c28f-ad82-48cf-87bc-53166f156872 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:31:53.541750 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'status': 'completed', 'code': 200} Nov 05 15:31:53.610176 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-619d3749-773e-4bb5-92be-24aed23fe4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:53.611676 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-619d3749-773e-4bb5-92be-24aed23fe4b8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1099 time: 0.0440218 Nov 05 15:31:53.630207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:53.702752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-36b689e2-b252-4f36-b88b-05b06d6431eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:53.704291 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-36b689e2-b252-4f36-b88b-05b06d6431eb service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0846560 Nov 05 15:31:53.771209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:52Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:53.774700 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-b0aa3636-a581-490f-ac13-26e244c04dd1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 999 time: 0.0626147 Nov 05 15:31:53.798182 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:31:53.807117 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:31:53.807723 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:31:52Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:53.825344 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-3d61df7e-99e2-435d-824e-629a3a8094d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:53.826800 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-3d61df7e-99e2-435d-824e-629a3a8094d0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0439847 Nov 05 15:31:53.873634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-f443a3be-85c7-4db0-83b4-e0505bd9e8a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:31:53.875111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-f443a3be-85c7-4db0-83b4-e0505bd9e8a8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0413785 Nov 05 15:31:53.914774 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:31:53.967845 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-e6bc20b8-f7ed-4f62-88c0-bc81d3343027 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849578 Nov 05 15:31:54.061038 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4470e1ab-4c07-40af-b4ec-83fddd544440 req-f700bdb0-8c62-445b-942d-0dd12317e72a service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860298 Nov 05 15:31:54.143503 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:52Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:31:54.170286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4d79cf2-1137-473a-b120-e1f396053f14 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:52Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:31:54.357609 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f88b3bf-e6ce-4820-9786-e9cb3a33fdab None None] New status for floating IP a8dc3a2c-597a-484a-b7ea-13efd6919e6b: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:31:55.061615 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:31:56.045357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:04.516337 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:32:18.703407 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:20.179074 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-afd824b4-8a40-4656-8659-9134bc11b415 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:22.506094 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-346b1554-a2d3-42a0-8b9f-0f6092429ab3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:23.607617 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:25.063629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:26.046206 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:41.517008 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:32:48.487058 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-cf12f3b7-8917-41de-a84a-c2a140197769 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0392573 Nov 05 15:32:48.571964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-42700187-77a4-482f-bf5e-1aba2ca71ad5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:32:48.573486 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-42700187-77a4-482f-bf5e-1aba2ca71ad5 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1099 time: 0.0459096 Nov 05 15:32:48.674272 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-2f269178-44f8-43ba-a98b-3da037f47235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:32:48.675720 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-2f269178-44f8-43ba-a98b-3da037f47235 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0831432 Nov 05 15:32:48.721970 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:48.744882 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-1bb54cba-8916-4099-9191-89bd6680cd3d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 1001 time: 0.0625994 Nov 05 15:32:48.793976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-4f9881fb-8f6a-4526-aa8d-c640d6c4d562 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:32:48.795399 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-4f9881fb-8f6a-4526-aa8d-c640d6c4d562 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0441098 Nov 05 15:32:48.840645 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-b574215b-736b-4b10-b926-6c3744d5d13b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:32:48.842086 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-b574215b-736b-4b10-b926-6c3744d5d13b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384943 Nov 05 15:32:48.932626 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-6749b143-4713-4e99-87e7-5ff9bc4c5423 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816953 Nov 05 15:32:49.020111 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-96fb48b4-98ef-459d-b145-a6b0a03b9515 req-b09f1378-89c9-4af7-8c8c-4f4676a0f431 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801766 Nov 05 15:32:50.181321 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-83f052be-d78f-450c-93f6-4077f1e76b2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:52.508769 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-686f9b47-043d-4350-aca4-b6a48d165f7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:53.610100 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:55.066562 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:32:56.038832 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:18.516441 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:33:18.723927 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:20.181942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-56825ed3-2379-4394-b94d-d60a3017275f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:22.510422 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-db57244e-404d-4f03-ba47-607f4024fd12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:23.616279 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:25.068614 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:26.041047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:48.721271 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:49.486692 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-49af89d8-2351-4dda-af59-7f5a105e21a8 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0398870 Nov 05 15:33:49.573141 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-1cefdb42-9f8d-4bfa-a4f4-bfd5165db356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:33:49.574602 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-1cefdb42-9f8d-4bfa-a4f4-bfd5165db356 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1099 time: 0.0451415 Nov 05 15:33:49.674559 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-c7889e38-ffcf-4761-b306-1fec76df2ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:33:49.675973 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-c7889e38-ffcf-4761-b306-1fec76df2ec8 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0828135 Nov 05 15:33:49.743781 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-7f60248e-1463-4da6-a69c-904fb689e3f6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 1001 time: 0.0604963 Nov 05 15:33:49.791296 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-6d2b864c-4561-4e74-8e7a-31edfe5d9a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:33:49.792684 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-6d2b864c-4561-4e74-8e7a-31edfe5d9a70 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0424976 Nov 05 15:33:49.836546 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-9a600c33-579a-4b0d-81f6-2a3369b0c166 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:33:49.838043 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-9a600c33-579a-4b0d-81f6-2a3369b0c166 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0384991 Nov 05 15:33:49.927582 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-ba35e610-caa4-4779-8705-2b96f34bbc03 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823450 Nov 05 15:33:50.184088 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-75f81a9a-8067-4798-8017-a8f91394438f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:50.327524 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-fafec0e0-68ad-469b-a5c4-6a4f18a11251 req-044c05e6-1d84-415e-99ca-78443506ffa1 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3932784 Nov 05 15:33:52.511336 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-cfa6b1dc-9b72-4197-ab78-c20924f4a0fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:53.615603 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:54.182448 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:33:54.306987 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:33:54.318979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 610, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:33:54.357499 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:54.370638 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id a840bce8-9be7-4296-b334-5b2b7e4ea71c {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:33:54.390032 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:33:54.394238 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:54.447920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:33:54.456702 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.457083 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.457429 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.457771 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.458103 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.458462 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.458792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.459123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.459846 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.459932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.460209 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.460555 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:33:54.467530 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['a840bce8-9be7-4296-b334-5b2b7e4ea71c'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:33:55.074677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:55.518916 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:33:56.043006 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:56.189856 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:33:56.243309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port a840bce8-9be7-4296-b334-5b2b7e4ea71c triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:33:56.243790 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:56.348840 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:56.373969 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:33:56.376494 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11c4e7ed-dce3-4b26-a4f2-943a98fe6f86" -d '{"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-plugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:33:56.394646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:33:56.404815 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:33:56.444256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:33:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b51d5441-425a-4bb1-8cb1-56ba558ec5d6 x-openstack-request-id: req-b51d5441-425a-4bb1-8cb1-56ba558ec5d6 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:33:56.444610 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-plugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:33:56.444874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b51d5441-425a-4bb1-8cb1-56ba558ec5d6 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:33:56.445937 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'code': 200} Nov 05 15:33:56.467116 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:04.695070 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-449585ee-9566-4364-9877-64b63d3f4ef8 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2036907838&fields=id&tenant_id=aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 267 time: 0.0456755 Nov 05 15:34:04.803819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-41025eac-94ff-4cf9-8d13-b3cb94b5810e tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:04.805353 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-41025eac-94ff-4cf9-8d13-b3cb94b5810e tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 809 time: 0.1034839 Nov 05 15:34:04.819722 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-b862c96e-0e14-44a9-8e59-ce9e71276cea tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/quotas/aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 375 time: 0.0086949 Nov 05 15:34:04.874046 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-ec828e08-a2a5-4ccf-b601-ab5f0eb35a2b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0492666 Nov 05 15:34:04.943564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-331c27db-7d79-49f5-a6b3-4c48f33a1ec8 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113581) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:34:04.944570 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-331c27db-7d79-49f5-a6b3-4c48f33a1ec8 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0590961 Nov 05 15:34:05.033507 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-ff579475-b8fb-413b-9cf2-b570b6df3fdb service neutron] 10.222.0.30 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821354 Nov 05 15:34:05.123444 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-90683604-b847-4d53-a036-89ed16231079 service neutron] 10.222.0.30 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840392 Nov 05 15:34:05.301711 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-414e1dc2-9273-431d-8d1e-b942fa8465a0 req-0b5f8d6d-7816-4b35-b296-bdd50cedf38b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 210 time: 0.0285356 Nov 05 15:34:06.392577 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f314ce50-4a3e-417a-a8a7-6b3db440223e req-4574c1cb-26cb-4b7f-b231-93cb651ad24f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 210 time: 0.0274088 Nov 05 15:34:07.246955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-eaf8a870-0fca-416c-b8b1-18195bb1bb2d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:07.248424 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-eaf8a870-0fca-416c-b8b1-18195bb1bb2d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 809 time: 0.1082811 Nov 05 15:34:07.318774 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-8d054c09-80b7-42b8-a342-c67e590975d0 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aa4b30adba9f49dfaa932f987a22ec06 HTTP/1.1" status: 200 len: 380 time: 0.0614057 Nov 05 15:34:07.328304 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'port': {'device_id': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'admin_state_up': True, 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'security_groups': ['261b9e10-821e-4b9f-ad57-c700869f79bd']}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:34:07.437486 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Made reservation on behalf of aa4b30adba9f49dfaa932f987a22ec06 for: {'port': 1} {{(pid=113580) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 05 15:34:07.441414 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:07.518211 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-bcd16442-3623-452b-990f-a7398e2b2df8 req-35a159b0-869b-4169-804b-728b95314fbd tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 210 time: 0.0525477 Nov 05 15:34:07.604921 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_common [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Allocated IP 172.20.0.7 (41cf0049-d48d-471e-b660-0dd94cf07e44/37d12ab7-f690-473d-aa8c-8a85b5e6ac24/f6be4be7-bb38-405e-93c1-61afb930afa3) {{(pid=113580) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:34:07.779737 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:07.819907 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_create {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:07.883243 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 is already hosted by enough agents. {{(pid=113580) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:34:07.887271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.base_scheduler [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Resources bound (agent type, host, resource id): {{(pid=113580) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:34:07.892137 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Received port after_create {{(pid=113580) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:34:07.896812 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=1']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:07.925554 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.925982 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.926450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.926853 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.927411 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.927814 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.928266 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.928682 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.929078 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.929474 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.930144 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.930598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:07.959450 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:07.960409 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:07.979991 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-223ce08f-1b67-4bb9-9673-fcd44d073eb3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6553330 Nov 05 15:34:08.232519 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-954554c4-b3ec-404c-92e7-105c56be6ba9 None None] Provisioning complete for port f6be4be7-bb38-405e-93c1-61afb930afa3 triggered by entity DHCP. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:34:08.233081 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-954554c4-b3ec-404c-92e7-105c56be6ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:08.268011 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-954554c4-b3ec-404c-92e7-105c56be6ba9 None None] Port f6be4be7-bb38-405e-93c1-61afb930afa3 cannot update to ACTIVE because it is not bound. {{(pid=113582) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 05 15:34:08.281704 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:34:08.360287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:08.384959 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:34:08.387256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93fa636d-7f86-4ee3-99ff-10d183973f2e" -d '{"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-unplugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:34:08.399680 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:34:08.403533 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:08.429472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:34:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-324332ae-5f26-4ee3-b151-5bb4e7074d5c x-openstack-request-id: req-324332ae-5f26-4ee3-b151-5bb4e7074d5c {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:34:08.429760 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-unplugged", "status": "completed", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:34:08.430008 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-324332ae-5f26-4ee3-b151-5bb4e7074d5c {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:34:08.430382 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'code': 200} Nov 05 15:34:08.462905 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:08.638621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61aa309e-77de-4877-9686-c44af050c4b4 req-c115c3cc-997f-4a1d-b6c7-49b461604fd0 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:08.641040 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-61aa309e-77de-4877-9686-c44af050c4b4 req-c115c3cc-997f-4a1d-b6c7-49b461604fd0 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0533001 Nov 05 15:34:08.692716 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-61aa309e-77de-4877-9686-c44af050c4b4 req-82720894-e81a-4493-8631-7c758ed7617d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456624 Nov 05 15:34:09.821712 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b770934b-9011-4e89-bee7-dd4fa891295c req-000324b7-f8a4-4713-870b-19b50ce1ec90 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:09.825120 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b770934b-9011-4e89-bee7-dd4fa891295c req-000324b7-f8a4-4713-870b-19b50ce1ec90 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0496280 Nov 05 15:34:09.877766 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-b770934b-9011-4e89-bee7-dd4fa891295c req-306240d8-5f89-4491-889f-808be3a26672 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465753 Nov 05 15:34:11.002345 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0672f0e6-f8f7-49e4-8229-f89a120779c9 req-c0986b8e-a6ab-4405-81fc-d921972825ae tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:11.003814 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0672f0e6-f8f7-49e4-8229-f89a120779c9 req-c0986b8e-a6ab-4405-81fc-d921972825ae tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0497513 Nov 05 15:34:11.060326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0672f0e6-f8f7-49e4-8229-f89a120779c9 req-0e00eb65-31f0-420b-a3fd-ec3d39a536e4 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500886 Nov 05 15:34:12.199005 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939e1812-2737-465c-9da1-a919387f2dcf req-d1edd2c0-6e73-44ce-ae69-d40d2b76282c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:12.200505 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-939e1812-2737-465c-9da1-a919387f2dcf req-d1edd2c0-6e73-44ce-ae69-d40d2b76282c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0567045 Nov 05 15:34:12.250053 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-939e1812-2737-465c-9da1-a919387f2dcf req-0dcbb60c-8534-4168-8082-48ff679e177e tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436990 Nov 05 15:34:13.385996 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0241b263-640e-475c-a108-4c446bdcaa41 req-b7ea6400-2d01-4fb0-9b4d-ecd3a7de6967 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:13.387528 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0241b263-640e-475c-a108-4c446bdcaa41 req-b7ea6400-2d01-4fb0-9b4d-ecd3a7de6967 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0501945 Nov 05 15:34:13.436521 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-0241b263-640e-475c-a108-4c446bdcaa41 req-6ba7325b-bc12-4746-8b1d-234ce572134a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429537 Nov 05 15:34:14.552266 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c263a5e4-f11f-4a2b-a45c-edd9dafbde68 req-9f554d01-952c-4f96-8230-ad044229a567 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:14.553787 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c263a5e4-f11f-4a2b-a45c-edd9dafbde68 req-9f554d01-952c-4f96-8230-ad044229a567 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0512488 Nov 05 15:34:14.605758 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-c263a5e4-f11f-4a2b-a45c-edd9dafbde68 req-aa7f8735-d6c9-4297-8807-8c1bda754d55 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447052 Nov 05 15:34:15.736741 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7f7116e-987b-4472-8823-cf38ceb65a57 req-4727f596-504c-4c92-9d92-6a317354fdf8 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:15.738236 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b7f7116e-987b-4472-8823-cf38ceb65a57 req-4727f596-504c-4c92-9d92-6a317354fdf8 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0621307 Nov 05 15:34:15.789171 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-b7f7116e-987b-4472-8823-cf38ceb65a57 req-0bb32229-54b4-4f71-b545-b949cef57289 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443280 Nov 05 15:34:16.909634 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f313066a-ac12-442f-a646-ef8666842a2b req-a4148b78-35ea-4b24-97fc-8b08a7a399dd tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:16.911413 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f313066a-ac12-442f-a646-ef8666842a2b req-a4148b78-35ea-4b24-97fc-8b08a7a399dd tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0557418 Nov 05 15:34:16.966019 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-f313066a-ac12-442f-a646-ef8666842a2b req-9f04dc39-7c3f-43b7-a4d2-9f382b929045 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467875 Nov 05 15:34:18.088063 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92895f62-db44-43bd-8f74-4546e5ad547b req-090d4831-62b3-4a63-8d00-989eb345f8f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:18.089927 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92895f62-db44-43bd-8f74-4546e5ad547b req-090d4831-62b3-4a63-8d00-989eb345f8f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0569808 Nov 05 15:34:18.151033 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-92895f62-db44-43bd-8f74-4546e5ad547b req-32d354b9-e1cc-4762-b31e-1a15452e7418 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537386 Nov 05 15:34:18.716907 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:19.263175 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ae3a72-96df-47d1-a2b4-cb7a4220a024 req-ebbe508a-9e2c-4ce7-bf9b-a699fd9868ea tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:19.264631 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74ae3a72-96df-47d1-a2b4-cb7a4220a024 req-ebbe508a-9e2c-4ce7-bf9b-a699fd9868ea tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 931 time: 0.0479901 Nov 05 15:34:19.312600 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-74ae3a72-96df-47d1-a2b4-cb7a4220a024 req-5c12066b-bf9f-4b25-9226-5e735e66ea6f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421500 Nov 05 15:34:19.641261 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.v2.base [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Request body: {'port': {'device_id': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8168'}} {{(pid=113580) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:34:19.694015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:19.944942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6be4be7-bb38-405e-93c1-61afb930afa3 {{(pid=113580) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:34:19.952613 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks [] for port, precommit_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:19.964902 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.provisioning_blocks [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Transition to ACTIVE for port object f6be4be7-bb38-405e-93c1-61afb930afa3 will not be triggered until provisioned by entity L2. {{(pid=113580) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 05 15:34:19.968931 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:20.021455 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=2']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:20.090997 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Attempting to bind port f6be4be7-bb38-405e-93c1-61afb930afa3 on host hv-neutron-8168 for vnic_type normal with profile {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 05 15:34:20.091333 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Attempting to bind port f6be4be7-bb38-405e-93c1-61afb930afa3 by drivers openvswitch,hyperv on host hv-neutron-8168 at level 0 using segments [{'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 05 15:34:20.091662 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Attempting to bind port f6be4be7-bb38-405e-93c1-61afb930afa3 on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:34:20.096359 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Port f6be4be7-bb38-405e-93c1-61afb930afa3 on network 41cf0049-d48d-471e-b660-0dd94cf07e44 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8168 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 05 15:34:20.096736 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Attempting to bind port f6be4be7-bb38-405e-93c1-61afb930afa3 on network 41cf0049-d48d-471e-b660-0dd94cf07e44 {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 05 15:34:20.101872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Checking agent: {'id': '840579a4-c1db-42cf-a422-41286f4c101f', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8168', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'started_at': datetime.datetime(2021, 11, 5, 14, 42, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 5, 15, 34, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 05 15:34:20.102210 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Checking segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=113580) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 05 15:34:20.102599 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Bound using segment: {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'} {{(pid=113580) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 05 15:34:20.103020 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.managers [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Bound port: f6be4be7-bb38-405e-93c1-61afb930afa3, host: hv-neutron-8168, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '191d825a-b543-4983-9f9f-ca830a59892c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44'}}] {{(pid=113580) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 05 15:34:20.103374 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:20.167654 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, cleared binding levels {{(pid=113580) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 05 15:34:20.170763 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 05 15:34:20.174501 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-10356197'] for port, after_update {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:20.188241 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b621e31-48be-4fd1-9553-607f7af9aaa7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:20.207198 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.207887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:20.209283 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] 10.222.0.32 "PUT /v2.0/ports/f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 1093 time: 0.5725834 Nov 05 15:34:20.209723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:34:20.212001 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-deef6a8e-57f5-497d-a1bd-267e27156861" -d '{"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:34:20.242874 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-309438ef-bca8-458b-aec6-41c2a56ecb78 service neutron] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=3']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:20.263470 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:34:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a8c819e-0f41-4121-a806-7b9dba2b8ec9 x-openstack-request-id: req-6a8c819e-0f41-4121-a806-7b9dba2b8ec9 {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:34:20.264066 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:34:20.264565 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6a8c819e-0f41-4121-a806-7b9dba2b8ec9 {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:34:20.265045 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'status': 'completed', 'code': 200} Nov 05 15:34:20.300356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f137d277-d9ef-49a3-9679-a4cfcf44d3e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.301924 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f137d277-d9ef-49a3-9679-a4cfcf44d3e2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1096 time: 0.0510108 Nov 05 15:34:20.351156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-a655f057-5970-4f9e-b538-d0931e30b541 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 217 time: 0.0391667 Nov 05 15:34:20.405618 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f54525d0-d853-409e-bec7-3ed1bbdfd741 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.407106 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f54525d0-d853-409e-bec7-3ed1bbdfd741 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0480301 Nov 05 15:34:20.432751 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e9b86-f60b-4d7f-8914-9a75b5f68839 req-c2465c46-be10-489f-9d28-7e71f74474a0 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.434244 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-962e9b86-f60b-4d7f-8914-9a75b5f68839 req-c2465c46-be10-489f-9d28-7e71f74474a0 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 943 time: 0.0514402 Nov 05 15:34:20.454425 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f8072e13-d66f-491f-8367-6a8021464665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.456013 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-f8072e13-d66f-491f-8367-6a8021464665 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0419548 Nov 05 15:34:20.487731 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-962e9b86-f60b-4d7f-8914-9a75b5f68839 req-2f751ffb-005e-4229-93ae-a148a0aaaa05 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474489 Nov 05 15:34:20.559455 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-15dcd791-4590-4e86-b1db-4efc59a2d26e service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0967264 Nov 05 15:34:20.649314 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-1c3dc6f5-bfae-4f59-8993-b22e01835884 req-98a38e31-8def-41a2-9893-ff64f5c01d6d service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834889 Nov 05 15:34:20.741660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-0c8350fc-9d11-4278-a0e6-31be2943085d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.743072 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-0c8350fc-9d11-4278-a0e6-31be2943085d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1096 time: 0.0412061 Nov 05 15:34:20.839777 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-177bc101-de07-437c-96bf-37f3d466d3fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.841295 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-177bc101-de07-437c-96bf-37f3d466d3fe service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0898175 Nov 05 15:34:20.884781 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-8fa91ace-79e6-4f3f-a125-48f697581673 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 217 time: 0.0348036 Nov 05 15:34:20.940494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-6f53d1ce-26b9-4f23-8fba-1a09d75f9fe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.941975 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-6f53d1ce-26b9-4f23-8fba-1a09d75f9fe4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0496631 Nov 05 15:34:20.988196 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-fb641550-ecd8-464e-8dc7-f93e182c84af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:20.989661 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-fb641550-ecd8-464e-8dc7-f93e182c84af service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0394759 Nov 05 15:34:21.091529 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-5556e660-ccf5-476b-b9bf-9e75027f5f17 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931804 Nov 05 15:34:21.184231 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-deef6a8e-57f5-497d-a1bd-267e27156861 req-bd11a58c-f432-41b2-bc9e-7fb664cf4547 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850823 Nov 05 15:34:21.606717 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48504ff5-8c65-49ad-b724-4af6fb3c43fd req-799e6922-cba4-4b02-8044-88bb1a245e91 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:21.608196 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48504ff5-8c65-49ad-b724-4af6fb3c43fd req-799e6922-cba4-4b02-8044-88bb1a245e91 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 943 time: 0.0495872 Nov 05 15:34:21.657471 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-48504ff5-8c65-49ad-b724-4af6fb3c43fd req-5feb0808-dc77-4a39-b088-f7603c41635f tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434287 Nov 05 15:34:22.343998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:34:22.437747 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:34:22.449236 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'mac_address': 'fa:16:3e:20:67:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 610, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:34:22.484641 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:22.508243 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6be4be7-bb38-405e-93c1-61afb930afa3 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:34:22.523710 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5e0e8094-1e2e-4d6b-b546-3dae640da230 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:22.532309 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:34:22.536135 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:22.581439 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=4']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:22.768713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['f6be4be7-bb38-405e-93c1-61afb930afa3'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:34:22.774595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23b0284-10fc-466c-b9a7-dc48a37d5e73 req-27a1214e-7cb2-4d18-95bd-6bfb6934e2e9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:22.776068 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a23b0284-10fc-466c-b9a7-dc48a37d5e73 req-27a1214e-7cb2-4d18-95bd-6bfb6934e2e9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 944 time: 0.0500143 Nov 05 15:34:22.825922 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-a23b0284-10fc-466c-b9a7-dc48a37d5e73 req-4cab54e2-6109-4cbc-83e8-01644228e3e3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438623 Nov 05 15:34:23.618980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:23.943494 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa7add2f-709a-4fad-9375-74be1c3f56ff req-a0a3ab3b-9063-422c-9aed-0e3e6c8501a2 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:23.945011 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa7add2f-709a-4fad-9375-74be1c3f56ff req-a0a3ab3b-9063-422c-9aed-0e3e6c8501a2 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 944 time: 0.0518045 Nov 05 15:34:23.993007 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-aa7add2f-709a-4fad-9375-74be1c3f56ff req-3105e167-aca2-4319-a97d-c296a9d3f4a7 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416908 Nov 05 15:34:24.346315 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:34:24.393999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning for port f6be4be7-bb38-405e-93c1-61afb930afa3 completed by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 05 15:34:24.397567 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port f6be4be7-bb38-405e-93c1-61afb930afa3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:34:24.397925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:24.472701 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:24.495688 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:34:24.497925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1bde19d9-53ce-4fe3-b0f9-d5ddeb437125" -d '{"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-plugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:34:24.510926 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:34:24.515201 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:24.538234 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:34:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d0dabaf-d3a4-4961-a4c8-10b8ba28535d x-openstack-request-id: req-7d0dabaf-d3a4-4961-a4c8-10b8ba28535d {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:34:24.538521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-plugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:34:24.538773 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7d0dabaf-d3a4-4961-a4c8-10b8ba28535d {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:34:24.539156 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'code': 200} Nov 05 15:34:24.564693 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=5']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:24.706687 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f3efd6-b46c-4102-b964-56ca860287cc req-826de14b-e0c5-4a98-8682-68eaa531e609 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:24.708192 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-07f3efd6-b46c-4102-b964-56ca860287cc req-826de14b-e0c5-4a98-8682-68eaa531e609 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1098 time: 0.0470200 Nov 05 15:34:24.753139 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-07f3efd6-b46c-4102-b964-56ca860287cc req-dbed5741-fa64-4bc0-8811-e2606a7aea34 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384419 Nov 05 15:34:25.076269 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:25.108723 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533f0c63-a98a-464a-ac47-b6728e41f9ee req-f37aaeb5-aca1-4ad8-8adb-cd6d42ddac0a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:25.111188 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-533f0c63-a98a-464a-ac47-b6728e41f9ee req-f37aaeb5-aca1-4ad8-8adb-cd6d42ddac0a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.0504274 Nov 05 15:34:25.163946 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-533f0c63-a98a-464a-ac47-b6728e41f9ee req-f60514c6-e6d0-4462-ab05-08eb8db30670 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465319 Nov 05 15:34:26.044634 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:26.278048 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f03539-8f06-44de-938f-8ff9f34e00cf req-97516810-516e-41a6-adfb-8fc4789205da tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:26.279478 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-80f03539-8f06-44de-938f-8ff9f34e00cf req-97516810-516e-41a6-adfb-8fc4789205da tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.0476875 Nov 05 15:34:26.327405 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-80f03539-8f06-44de-938f-8ff9f34e00cf req-581db7a8-5dbf-413a-99d8-d5cb1bf001da tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417740 Nov 05 15:34:26.440421 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9055d32-95f0-4261-bb50-eaadce9e86bb req-dbf86349-e912-4422-ab1e-9dcbeb3a9cf9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:26.441892 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9055d32-95f0-4261-bb50-eaadce9e86bb req-dbf86349-e912-4422-ab1e-9dcbeb3a9cf9 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.0485072 Nov 05 15:34:26.489850 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-c9055d32-95f0-4261-bb50-eaadce9e86bb req-4b442bba-71af-4c2b-80f3-a18ba390ebd8 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421879 Nov 05 15:34:26.510713 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53090) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:34:26.554440 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a0b07db-f886-4f7a-9d25-483524a1d9b8 tempest-TestSnapshotPattern-962176979 tempest-TestSnapshotPattern-962176979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:26.555936 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-0a0b07db-f886-4f7a-9d25-483524a1d9b8 tempest-TestSnapshotPattern-962176979 tempest-TestSnapshotPattern-962176979-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1093 time: 0.0442414 Nov 05 15:34:26.558612 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53092) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:34:26.562798 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.v2.base [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Request body: {'floatingip': {'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address': '172.20.0.7'}} {{(pid=113581) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 05 15:34:26.584319 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:26.679366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:26.784979 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_common [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Allocated IP 172.26.5.149 (6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6/55057ba1-ab5e-4ba9-9c9a-e58663fd982d/b465a91a-e4f4-4042-ad9d-78ddbb90dcee) {{(pid=113581) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 05 15:34:26.881474 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:26.914580 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785316033868', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:26.953689 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Network 6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6 is already hosted by enough agents. {{(pid=113581) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 05 15:34:26.956397 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.base_scheduler [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Resources bound (agent type, host, resource id): {{(pid=113581) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 05 15:34:26.961816 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Received port after_create {{(pid=113581) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 05 15:34:26.986929 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=b465a91a-e4f4-4042-ad9d-78ddbb90dcee,revision_number=1']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:27.000638 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.000988 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.001331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.001666 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.001998 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.002331 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.002659 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.002986 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.003321 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.003643 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.003961 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.004280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:34:27.336372 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, precommit_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:27.403595 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:27.551620 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for port, precommit_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:27.556041 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9638406'] for port, after_update {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:27.627004 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event updated for resources: {'Port': ['ID=b465a91a-e4f4-4042-ad9d-78ddbb90dcee,revision_number=2']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:34:27.633461 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1032948'] for floatingip, after_create {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:27.736131 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Floating IP 180ee24c-2069-4161-9bfa-94ba8e90d8bd associated. External IP: 172.26.5.149, port: f6be4be7-bb38-405e-93c1-61afb930afa3. Nov 05 15:34:27.940717 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:34:28.045843 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:34:28.055267 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:34:28.064922 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:28.065472 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:34:28.066084 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:34:23Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:34:28.092882 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-eb4cdb65-c402-44b9-84ae-e1ac6b1645b3 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5332375 Nov 05 15:34:28.093593 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:34:28.095829 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63818667-371c-4522-9e97-e7df483ff69f" -d '{"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:34:28.133101 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:34:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f28befc5-c2a9-405c-a054-9fd22847e435 x-openstack-request-id: req-f28befc5-c2a9-405c-a054-9fd22847e435 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:34:28.133470 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:34:28.133723 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f28befc5-c2a9-405c-a054-9fd22847e435 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:34:28.134131 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'status': 'completed', 'code': 200} Nov 05 15:34:28.179913 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:34:28.197755 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63818667-371c-4522-9e97-e7df483ff69f req-269e2a94-c7ba-4115-a073-3b2042cb53d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:28.199172 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-269e2a94-c7ba-4115-a073-3b2042cb53d3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1098 time: 0.0406327 Nov 05 15:34:28.292510 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63818667-371c-4522-9e97-e7df483ff69f req-54d100de-80e5-407f-866b-cbf0a718fd5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:28.293982 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-54d100de-80e5-407f-866b-cbf0a718fd5e service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0866108 Nov 05 15:34:28.359026 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-5af0e327-93ac-4753-b34a-e30964a4c670 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 999 time: 0.0578978 Nov 05 15:34:28.398520 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '180ee24c-2069-4161-9bfa-94ba8e90d8bd', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.149', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:20:67:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:34:27Z', 'updated_at': '2021-11-05T15:34:27Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}, {'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:34:28.406610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63818667-371c-4522-9e97-e7df483ff69f req-5434c205-2a9f-4491-bd98-e138de474e77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:28.408406 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-5434c205-2a9f-4491-bd98-e138de474e77 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0428681 Nov 05 15:34:28.428497 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:34:28.437510 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:34:28.438112 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:34:23Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:34:28.458514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63818667-371c-4522-9e97-e7df483ff69f req-32723db7-776f-4cbc-a658-174f4f63fc51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:28.460029 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-32723db7-776f-4cbc-a658-174f4f63fc51 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0446339 Nov 05 15:34:28.539674 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:34:28.548794 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-4557f945-eb46-430d-a46d-1102216246c4 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809319 Nov 05 15:34:28.643501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63818667-371c-4522-9e97-e7df483ff69f req-901a490f-5bb5-4830-af54-ff2e24fb1c23 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868082 Nov 05 15:34:28.780698 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '180ee24c-2069-4161-9bfa-94ba8e90d8bd', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.149', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:20:67:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:34:27Z', 'updated_at': '2021-11-05T15:34:27Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}, {'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:34:28.807119 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dcd715-4985-45e7-8c2c-ab6e7fe9c428 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': '180ee24c-2069-4161-9bfa-94ba8e90d8bd', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.149', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:20:67:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:34:27Z', 'updated_at': '2021-11-05T15:34:27Z', 'revision_number': 0, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}, {'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:34:28.997639 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-275962b8-3588-4448-bed6-1667453b9b3c None None] New status for floating IP 180ee24c-2069-4161-9bfa-94ba8e90d8bd: ACTIVE {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:34:32.519044 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:34:48.718602 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:50.188975 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-5f7f2a50-6c35-4493-bf1a-8d26edcd609a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:50.473779 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-5c1185fd-20cb-495c-bb41-a901e6bba193 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0415976 Nov 05 15:34:50.561030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-2b9b9753-fec1-4ae1-b5c8-99c9f4d82bba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:50.562601 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-2b9b9753-fec1-4ae1-b5c8-99c9f4d82bba service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1097 time: 0.0420134 Nov 05 15:34:50.669440 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-372d1326-c2f9-426f-956b-3a338f82973d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:50.670867 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-372d1326-c2f9-426f-956b-3a338f82973d service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0893679 Nov 05 15:34:50.735707 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-9e374763-4fca-4a69-87cf-b392db5d76e4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 999 time: 0.0582767 Nov 05 15:34:50.785970 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-fc740bc4-f47d-486e-955d-9d7835504d03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:50.787501 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-fc740bc4-f47d-486e-955d-9d7835504d03 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0452070 Nov 05 15:34:50.838660 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-25294270-61c2-491d-ada1-0b0c25ff1a45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:34:50.840150 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-25294270-61c2-491d-ada1-0b0c25ff1a45 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0456324 Nov 05 15:34:50.928916 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-4b9ed643-6471-4b59-8d33-4bb5ddd8a3bf service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803268 Nov 05 15:34:51.020156 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-27cc28d0-dd88-434d-b605-e2bd6fabd62a req-76dce11a-5b8e-4332-a892-f115d619518a service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845840 Nov 05 15:34:52.514713 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2083f5a0-d01e-4be2-b21b-93dd31ec5a2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:53.621997 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:55.078078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:34:56.045546 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:09.518191 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:35:18.723282 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:20.192468 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-d21d83e8-7c18-4526-94d9-4869bdd3e3f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:22.515509 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ab1ad8c8-9a5b-48ee-860d-90992d5dba06 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:23.625501 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:25.080308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:26.047266 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:46.518125 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:35:48.734937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:50.195418 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8c8bfce8-a9c0-4c56-bebc-f3257dd86793 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:52.494508 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-25af04d2-5c21-4330-975e-ba769b69e4b6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0394044 Nov 05 15:35:52.516341 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a776af71-cadf-4f37-99b6-e3538a30294d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:52.557055 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-0b76e98d-5bc6-47c9-81fb-ca8aface7e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:35:52.558544 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-0b76e98d-5bc6-47c9-81fb-ca8aface7e55 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1098 time: 0.0425718 Nov 05 15:35:52.662819 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-ac800166-5b5f-430d-bafe-d8c27ed67663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:35:52.664326 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-ac800166-5b5f-430d-bafe-d8c27ed67663 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0860674 Nov 05 15:35:52.727555 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-09e0ae1f-b019-474d-8f4e-9843e553d5a1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 1001 time: 0.0565712 Nov 05 15:35:52.774667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-58511f3a-b0cf-4940-9df7-faab3c6d35f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:35:52.775964 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-58511f3a-b0cf-4940-9df7-faab3c6d35f7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0420477 Nov 05 15:35:52.824173 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-938080c4-3b49-4564-89db-ea00b9c1b053 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:35:52.825659 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-938080c4-3b49-4564-89db-ea00b9c1b053 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0429602 Nov 05 15:35:52.837389 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-51f111f2-8afd-4ca9-830a-41798d4df587 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=113580) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 05 15:35:52.838299 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-51f111f2-8afd-4ca9-830a-41798d4df587 service neutron] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047705 Nov 05 15:35:52.926056 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-d068521e-3e27-4eb3-86aa-ec0d5b5e85cf service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805891 Nov 05 15:35:53.017280 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-4fb28110-f1cc-4af2-a8a1-2e7c65f71f9a req-cda12747-b052-45e0-ab80-a1e71d411fed service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847247 Nov 05 15:35:53.627297 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:55.083086 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:56.049291 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:58.986762 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 details requested by agent hyperv_hv-neutron-8168 with host hv-neutron-8168 {{(pid=113582) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 05 15:35:59.097666 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:35:59.109557 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Returning: {'device': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'port_id': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'mac_address': 'fa:16:3e:20:67:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 610, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=113582) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 05 15:35:59.163822 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:59.190755 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id f6be4be7-bb38-405e-93c1-61afb930afa3 {{(pid=113582) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 05 15:35:59.216216 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:35:59.223757 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:35:59.283798 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=6']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:35:59.293570 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.293914 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.294272 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.294599 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.294935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.295308 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.295646 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.295979 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.296313 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.296662 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.297146 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.297479 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113582) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:35:59.332485 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] get_ports_and_sgs() called for port_ids ['f6be4be7-bb38-405e-93c1-61afb930afa3'] {{(pid=113582) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 05 15:36:00.994779 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 up at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 05 15:36:01.049402 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.provisioning_blocks [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Provisioning complete for port f6be4be7-bb38-405e-93c1-61afb930afa3 triggered by entity L2. {{(pid=113582) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 05 15:36:01.049922 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1987512'] for port, provisioning_complete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:01.142878 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:01.175799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:01.179232 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4a9b461-0bcd-4a8c-a96c-ec7f3894f04e" -d '{"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-plugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:01.194799 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:01.200001 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:01.235285 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3937c7b-3ea3-499c-a759-2117f9688189 x-openstack-request-id: req-b3937c7b-3ea3-499c-a759-2117f9688189 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:01.235640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-plugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:01.235889 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b3937c7b-3ea3-499c-a759-2117f9688189 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:01.236373 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'code': 200} Nov 05 15:36:01.256896 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=7']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:08.487591 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53300) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:08.644561 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Deleting port b465a91a-e4f4-4042-ad9d-78ddbb90dcee {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:08.644828 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:08.719558 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:08.719875 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:08.731466 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Calling delete_port for b465a91a-e4f4-4042-ad9d-78ddbb90dcee owned by network:floatingip {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:08.880531 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:08.911599 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event deleted for resources: {'Port': ['ID=b465a91a-e4f4-4042-ad9d-78ddbb90dcee,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:08.952819 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.953293 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.953527 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.953863 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.954194 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.954525 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.954855 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.955182 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.955509 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.955832 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.956155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.956494 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113581) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:08.978015 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:08.978341 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.db.l3_db [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Floating IP 180ee24c-2069-4161-9bfa-94ba8e90d8bd disassociated (deleted). External IP: 172.26.5.149, port: f6be4be7-bb38-405e-93c1-61afb930afa3. Nov 05 15:36:09.183280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:36:09.288264 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:36:09.293070 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:09.297590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:36:09.306581 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:09.307188 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:09.322862 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-236658e4-2ef3-4245-bd05-177ab8c4046d tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "DELETE /v2.0/floatingips/180ee24c-2069-4161-9bfa-94ba8e90d8bd HTTP/1.1" status: 204 len: 168 time: 0.8341889 Nov 05 15:36:09.323812 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113581) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:09.326242 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}116c4b550a409c9aae813de715f517d56da8ca1a1fc8e57d4b4c9938d9f6bcee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-935d265d-ae12-4bed-bd92-6818eecc5ad5" -d '{"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113581) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:09.367987 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18c18c2c-ab75-4707-b3fd-80609ca94ce4 x-openstack-request-id: req-18c18c2c-ab75-4707-b3fd-80609ca94ce4 {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:09.368280 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "status": "completed", "code": 200}]} {{(pid=113581) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:09.368563 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-18c18c2c-ab75-4707-b3fd-80609ca94ce4 {{(pid=113581) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:09.369130 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'status': 'completed', 'code': 200} Nov 05 15:36:09.423992 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:09.435429 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-2787769f-bdb0-4531-9a8c-cd837428d9f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:09.436893 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-2787769f-bdb0-4531-9a8c-cd837428d9f5 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 1098 time: 0.0460854 Nov 05 15:36:09.541030 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-fbc7a77c-09e8-47a8-bc4c-d5da0ac72455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:09.542934 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-fbc7a77c-09e8-47a8-bc4c-d5da0ac72455 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0943553 Nov 05 15:36:09.587232 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-b9ea2fd3-ab5a-4a61-8953-b1add7cf560e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 200 len: 217 time: 0.0359740 Nov 05 15:36:09.644213 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-a2423957-f68d-4111-b0e7-92f9be4c53f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:09.646285 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-a2423957-f68d-4111-b0e7-92f9be4c53f8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.0505419 Nov 05 15:36:09.663215 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:09.690935 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:36:09.697895 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-9e47bdd8-796e-4cb6-9979-fb56cbdcefd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:09.699411 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-9e47bdd8-796e-4cb6-9979-fb56cbdcefd2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0437887 Nov 05 15:36:09.699847 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:09.700590 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:09.706646 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2e4303-443a-454d-835a-25e6936e7229 req-a6c370a8-f009-4c1f-baf1-09889a71837a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:09.708160 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a2e4303-443a-454d-835a-25e6936e7229 req-a6c370a8-f009-4c1f-baf1-09889a71837a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.1853070 Nov 05 15:36:09.760713 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-9a2e4303-443a-454d-835a-25e6936e7229 req-11b15eb5-85cf-40be-b47c-92359c514e34 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463734 Nov 05 15:36:09.797036 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-7810a914-68b9-437e-a10e-b02b02c6c944 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890064 Nov 05 15:36:09.809261 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:09.891834 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-935d265d-ae12-4bed-bd92-6818eecc5ad5 req-801517a6-036e-4b0a-a70b-ffb67344fa15 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860105 Nov 05 15:36:10.031078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:10.065929 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61746a77-47fd-4057-aa05-6337f71421d6 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_floatingips': [{'id': 'a8dc3a2c-597a-484a-b7ea-13efd6919e6b', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'floating_ip_address': '172.26.5.72', 'floating_network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'router_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'port_id': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 1847, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'mac_address': 'fa:16:3e:b0:29:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e31727-87b3-427d-ae19-58cd2415677c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-05T15:31:52Z', 'updated_at': '2021-11-05T15:31:54Z', 'revision_number': 1, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:36:10.284565 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dcf3c6f-4584-4bcc-97d8-c1c7d1eb54bd None None] New status for floating IP 180ee24c-2069-4161-9bfa-94ba8e90d8bd: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:36:10.880269 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377175b8-95f5-4d88-b785-c7f65d65b837 req-1a78cc19-e908-4eab-b8f0-ca7a13477581 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:10.881787 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-377175b8-95f5-4d88-b785-c7f65d65b837 req-1a78cc19-e908-4eab-b8f0-ca7a13477581 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.0487776 Nov 05 15:36:10.930174 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-377175b8-95f5-4d88-b785-c7f65d65b837 req-a2f24131-263c-4612-a894-f282847c8b2e tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425677 Nov 05 15:36:11.002953 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:11.073394 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01170522-6d3f-4328-9d70-bb279c78be2f req-6eddd61d-a773-4f29-96dc-c047d139871a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:11.074941 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-01170522-6d3f-4328-9d70-bb279c78be2f req-6eddd61d-a773-4f29-96dc-c047d139871a tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/ports?device_id=9aece879-5eee-4b52-b985-ff3c6944c4e2 HTTP/1.1" status: 200 len: 945 time: 0.0494096 Nov 05 15:36:11.081115 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1973526'] for port, before_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.102925 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113582) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:11.105166 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b66876016e11470f2cc868ab240ff2b5809795a87448e7080f621ba5873c8c87" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e27ddac5-cee5-4997-b54c-90534cc05f55" -d '{"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-unplugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113582) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:11.117287 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:11.122475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785316530270', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785316033886', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785316033904'] for port, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.150874 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5e345bb-efa7-4cf2-bd5c-094c26146787 x-openstack-request-id: req-c5e345bb-efa7-4cf2-bd5c-094c26146787 {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:11.151162 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-unplugged", "status": "completed", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "code": 200}]} {{(pid=113582) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:11.151410 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c5e345bb-efa7-4cf2-bd5c-094c26146787 {{(pid=113582) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:11.151794 dv-neutron-816850-1-hyperv neutron-server[113582]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'code': 200} Nov 05 15:36:11.175400 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Deleting port f6be4be7-bb38-405e-93c1-61afb930afa3 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:11.175729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.178465 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Pushing event updated for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=8']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:11.259523 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] For port f6be4be7-bb38-405e-93c1-61afb930afa3, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=f6be4be7-bb38-405e-93c1-61afb930afa3,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:11.259877 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.272060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Calling delete_port for f6be4be7-bb38-405e-93c1-61afb930afa3 owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:11.395068 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.422963 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event deleted for resources: {'Port': ['ID=f6be4be7-bb38-405e-93c1-61afb930afa3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:11.449037 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.449382 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.449714 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.450041 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.450361 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.450683 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.451002 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.451320 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.451636 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.451951 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.452265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.452610 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-816850-1-hyperv {{(pid=113580) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 05 15:36:11.475771 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] No DVR routers for this DVR port f6be4be7-bb38-405e-93c1-61afb930afa3 on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:36:11.478302 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:11.481604 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-01170522-6d3f-4328-9d70-bb279c78be2f req-3f588df4-09f7-498f-8b5f-fc0c9b9f6906 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "DELETE /v2.0/ports/f6be4be7-bb38-405e-93c1-61afb930afa3 HTTP/1.1" status: 204 len: 173 time: 0.4010093 Nov 05 15:36:11.482051 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-deleted', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:11.484295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d45e607-b28b-4586-a028-d5f7dc241d0a" -d '{"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-deleted", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:11.525507 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90fc4e3a-295f-4e8c-8763-b9e10423418d x-openstack-request-id: req-90fc4e3a-295f-4e8c-8763-b9e10423418d {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:11.526128 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9aece879-5eee-4b52-b985-ff3c6944c4e2", "name": "network-vif-deleted", "tag": "f6be4be7-bb38-405e-93c1-61afb930afa3", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:11.526384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-90fc4e3a-295f-4e8c-8763-b9e10423418d {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:11.526785 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aece879-5eee-4b52-b985-ff3c6944c4e2', 'name': 'network-vif-deleted', 'tag': 'f6be4be7-bb38-405e-93c1-61afb930afa3', 'status': 'completed', 'code': 200} Nov 05 15:36:12.509164 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53364) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:12.659230 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Deleting port 177d86d8-3d55-4842-b256-252bd353bf5c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:12.659561 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:12.731688 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:12.732012 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:12.744142 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Calling delete_port for 177d86d8-3d55-4842-b256-252bd353bf5c owned by network:floatingip {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:12.887446 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:12.917838 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event deleted for resources: {'Port': ['ID=177d86d8-3d55-4842-b256-252bd353bf5c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:12.972516 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for floatingip, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:12.972841 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.db.l3_db [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Floating IP a8dc3a2c-597a-484a-b7ea-13efd6919e6b disassociated (deleted). External IP: 172.26.5.72, port: a840bce8-9be7-4296-b334-5b2b7e4ea71c. Nov 05 15:36:13.174739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:36:13.279423 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:36:13.284086 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for floatingip, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:13.288830 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:36:13.299137 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:13.299738 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:13.311440 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0f915ba7-b35b-4a37-8b7e-463c40214a54 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "DELETE /v2.0/floatingips/a8dc3a2c-597a-484a-b7ea-13efd6919e6b HTTP/1.1" status: 204 len: 168 time: 0.8012080 Nov 05 15:36:13.404850 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:13.527506 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:13.529950 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95068f0b-af7d-4b85-8ca5-80552505e6fb" -d '{"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:13.531366 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b345fcd-230d-4a36-8b2f-d450defdbc35 req-2d2ab756-b25f-441a-970f-a98079047df1 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113581) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:13.533575 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8b345fcd-230d-4a36-8b2f-d450defdbc35 req-2d2ab756-b25f-441a-970f-a98079047df1 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0505092 Nov 05 15:36:13.570694 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa32d16b-1282-4c1a-9e22-c0a385b5165c x-openstack-request-id: req-fa32d16b-1282-4c1a-9e22-c0a385b5165c {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:13.571123 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:13.571384 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fa32d16b-1282-4c1a-9e22-c0a385b5165c {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:13.572571 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'status': 'completed', 'code': 200} Nov 05 15:36:13.588000 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [req-8b345fcd-230d-4a36-8b2f-d450defdbc35 req-57ca0c1e-8f30-480f-bb64-c50bf76562f6 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465987 Nov 05 15:36:13.615787 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:13.642127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:36:13.646449 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-caaace1b-d0bb-47d7-a43c-e45e07272a53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:13.647956 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-caaace1b-d0bb-47d7-a43c-e45e07272a53 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 1097 time: 0.0546083 Nov 05 15:36:13.650463 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:13.651051 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:13.739475 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-6ecda317-9e6e-4618-b0f0-77e1d4211871 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:13.741185 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-6ecda317-9e6e-4618-b0f0-77e1d4211871 service neutron] 10.222.0.32 "GET /v2.0/networks?id=41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 200 len: 910 time: 0.0834074 Nov 05 15:36:13.755057 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:13.787652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-df17033c-8792-4363-a65f-9b55d7270586 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 200 len: 217 time: 0.0383666 Nov 05 15:36:14.100794 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:14.131320 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad19a6ee-25de-45c6-b39a-5abbda162321 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:32Z', 'revision_number': 4, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv', '_interfaces': [{'id': 'c9a14611-544c-48ed-b194-08eec431ca39', 'name': '', 'network_id': '41cf0049-d48d-471e-b660-0dd94cf07e44', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'mac_address': 'fa:16:3e:51:c6:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1823, 'fixed_ips': [{'subnet_id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:32Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'subnets': [{'id': '37d12ab7-f690-473d-aa8c-8a85b5e6ac24', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:36:14.153619 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-992e29a0-5582-4a86-bb41-08f67d5d4dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:14.155093 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-992e29a0-5582-4a86-bb41-08f67d5d4dd7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 200 len: 848 time: 0.3603692 Nov 05 15:36:14.202022 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-41e85693-0724-46c6-bb2d-292838d7305b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:14.204323 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-41e85693-0724-46c6-bb2d-292838d7305b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=41cf0049-d48d-471e-b660-0dd94cf07e44&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0405447 Nov 05 15:36:14.307277 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-320f0c69-7490-4e57-9dd5-a8de044d0ea3 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0942516 Nov 05 15:36:14.364265 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dfd0ba3-286f-4156-8ea3-08f431e74ef7 None None] New status for floating IP a8dc3a2c-597a-484a-b7ea-13efd6919e6b: DOWN {{(pid=113583) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 05 15:36:14.397525 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-95068f0b-af7d-4b85-8ca5-80552505e6fb req-0e9fc186-53e5-4cf7-9fe0-7ba6ba224b65 service neutron] 10.222.0.32 "GET /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827463 Nov 05 15:36:14.705346 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d09631-21c7-476f-b1c8-b52de2791a0d req-734622bf-223d-48ed-ba0d-16811e176619 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:14.706812 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19d09631-21c7-476f-b1c8-b52de2791a0d req-734622bf-223d-48ed-ba0d-16811e176619 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0497329 Nov 05 15:36:14.760109 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-19d09631-21c7-476f-b1c8-b52de2791a0d req-eadd46f1-9f6a-4b3a-8a39-89a2505ad24b tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/security-groups?id=261b9e10-821e-4b9f-ad57-c700869f79bd&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473852 Nov 05 15:36:15.001372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:15.021161 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: f6be4be7-bb38-405e-93c1-61afb930afa3 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:15.021504 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device f6be4be7-bb38-405e-93c1-61afb930afa3 not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:15.118676 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-072c4fb6-9433-4016-98cc-83c115ef3627 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=113580) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 05 15:36:15.120095 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-072c4fb6-9433-4016-98cc-83c115ef3627 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 944 time: 0.0477924 Nov 05 15:36:15.206484 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Deleting port a840bce8-9be7-4296-b334-5b2b7e4ea71c {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:15.206835 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:15.301369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] For port a840bce8-9be7-4296-b334-5b2b7e4ea71c, host hv-neutron-8168, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8168',level=0,port_id=a840bce8-9be7-4296-b334-5b2b7e4ea71c,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:15.301634 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:15.313713 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Calling delete_port for a840bce8-9be7-4296-b334-5b2b7e4ea71c owned by compute:nova {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:15.437160 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:15.462740 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event deleted for resources: {'Port': ['ID=a840bce8-9be7-4296-b334-5b2b7e4ea71c,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:15.505839 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] No DVR routers for this DVR port a840bce8-9be7-4296-b334-5b2b7e4ea71c on host hv-neutron-8168 {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:36:15.508378 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-97633'] for port, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:15.511667 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-085b7de6-4632-42ad-bb84-defe19394bd0 req-fa696f00-a263-4462-b496-93b57a5a885c tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.32 "DELETE /v2.0/ports/a840bce8-9be7-4296-b334-5b2b7e4ea71c HTTP/1.1" status: 204 len: 173 time: 0.3856621 Nov 05 15:36:15.573521 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-deleted', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c'}] {{(pid=113580) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 05 15:36:15.575850 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}043a4f8df7180acde26cd6c9552b84c8e92df8d6f993cfce9a45b812ca28e7c1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c84a4608-4f65-48fc-b6ad-b53e59fca097" -d '{"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-deleted", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c"}]}' {{(pid=113580) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 05 15:36:15.677314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 05 Nov 2021 15:36:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ed52620-3e52-4430-a994-11b5e290abce x-openstack-request-id: req-4ed52620-3e52-4430-a994-11b5e290abce {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 05 15:36:15.677609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55e31727-87b3-427d-ae19-58cd2415677c", "name": "network-vif-deleted", "tag": "a840bce8-9be7-4296-b334-5b2b7e4ea71c", "status": "completed", "code": 200}]} {{(pid=113580) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 05 15:36:15.677856 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4ed52620-3e52-4430-a994-11b5e290abce {{(pid=113580) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 05 15:36:15.678251 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55e31727-87b3-427d-ae19-58cd2415677c', 'name': 'network-vif-deleted', 'tag': 'a840bce8-9be7-4296-b334-5b2b7e4ea71c', 'status': 'completed', 'code': 200} Nov 05 15:36:15.868846 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [req-63727fda-2ab2-4e2a-9868-b82808d819c6 req-a8dcf45a-1bd7-4fdb-b51a-fe2eb1f46520 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "GET /v2.0/ports?device_id=55e31727-87b3-427d-ae19-58cd2415677c HTTP/1.1" status: 200 len: 210 time: 0.0280540 Nov 05 15:36:16.926083 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53384) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:16.999751 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.024255 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.082061 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.084595 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.085760 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] 10.222.0.30 "DELETE /v2.0/security-groups/261b9e10-821e-4b9f-ad57-c700869f79bd HTTP/1.1" status: 204 len: 168 time: 0.1586781 Nov 05 15:36:17.095366 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53a56aa4-175c-4878-8fba-1fb0907cce25 tempest-TestSnapshotPattern-394424259 tempest-TestSnapshotPattern-394424259-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=261b9e10-821e-4b9f-ad57-c700869f79bd,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:17.137439 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53388) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:17.481693 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.718265 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Deleting port c9a14611-544c-48ed-b194-08eec431ca39 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:17.718598 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.797314 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] For port c9a14611-544c-48ed-b194-08eec431ca39, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=c9a14611-544c-48ed-b194-08eec431ca39,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:17.797594 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:17.810047 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Calling delete_port for c9a14611-544c-48ed-b194-08eec431ca39 owned by network:router_interface {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:17.985742 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.013846 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Pushing event deleted for resources: {'Port': ['ID=c9a14611-544c-48ed-b194-08eec431ca39,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:18.169117 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.378872 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Router 87646f43-ec0f-4274-b2a6-f197bc38ea1e has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113580) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:36:18.491428 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113580) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:36:18.499773 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-702f79ba-b84c-4644-aaf4-84583808e86c admin admin] 10.222.0.30 "PUT /v2.0/routers/87646f43-ec0f-4274-b2a6-f197bc38ea1e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3586938 Nov 05 15:36:18.499773 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53390) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:18.505568 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Sync routers for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:36:18.516749 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:18.517354 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:18.607942 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks [] for router, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.621221 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: dv-neutron-816850-1-hyperv {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:18.710015 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.761807 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.762331 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Deleting port 0d834ffb-757a-482f-9e31-ea309ee1f110 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:18.762677 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.812392 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82'}], 'enable_snat': True}, 'gw_port_id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:36:17Z', 'revision_number': 5, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port': {'id': '0d834ffb-757a-482f-9e31-ea309ee1f110', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:aa:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1822, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:31:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:18.841214 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Checking router: 87646f43-ec0f-4274-b2a6-f197bc38ea1e for host: dv-neutron-816850-1-hyperv {{(pid=113582) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:36:18.849647 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Routers {'87646f43-ec0f-4274-b2a6-f197bc38ea1e'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113582) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:18.850246 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'], 'active': True} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:18.855039 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] For port 0d834ffb-757a-482f-9e31-ea309ee1f110, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0d834ffb-757a-482f-9e31-ea309ee1f110,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:18.855519 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:18.869957 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Calling delete_port for 0d834ffb-757a-482f-9e31-ea309ee1f110 owned by network:router_gateway {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:18.935792 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvr_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] Set router 87646f43-ec0f-4274-b2a6-f197bc38ea1e gateway port host: None {{(pid=113582) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:18.990764 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_hamode_db [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:36:18Z', 'revision_number': 6, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113582) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:19.019092 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c no longer exists at agent hyperv_hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:19.021449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-430c1c16-6e12-4464-a13c-05ce95951970 None None] The sync data for ids ['87646f43-ec0f-4274-b2a6-f197bc38ea1e'] in dv-neutron-816850-1-hyperv is: [{'id': '87646f43-ec0f-4274-b2a6-f197bc38ea1e', 'name': 'tempest-TestSnapshotPattern-520356236-router', 'tenant_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:30Z', 'updated_at': '2021-11-05T15:36:18Z', 'revision_number': 6, 'project_id': 'aa4b30adba9f49dfaa932f987a22ec06', 'gw_port_host': None}] {{(pid=113582) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:36:19.042653 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] No Port match for: a840bce8-9be7-4296-b334-5b2b7e4ea71c {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:19.043005 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Device a840bce8-9be7-4296-b334-5b2b7e4ea71c not bound to the agent host hv-neutron-8168 {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:19.050006 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.078188 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Pushing event deleted for resources: {'Port': ['ID=0d834ffb-757a-482f-9e31-ea309ee1f110,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:19.136186 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.230847 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.232983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.273580 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.274009 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 87646f43-ec0f-4274-b2a6-f197bc38ea1e {{(pid=113580) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:36:19.278573 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] Publish callbacks [] for router, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.279713 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-3c8953dc-dd31-4fbc-888b-30b82f8b77b6 admin admin] 10.222.0.30 "DELETE /v2.0/routers/87646f43-ec0f-4274-b2a6-f197bc38ea1e HTTP/1.1" status: 204 len: 168 time: 0.7791646 Nov 05 15:36:19.282788 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53392) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:19.328509 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.db_base_plugin_v2 [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Deleting subnet 37d12ab7-f690-473d-aa8c-8a85b5e6ac24 {{(pid=113580) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:36:19.332936 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.367621 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10351126'] for subnet, precommit_delete_associations {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.454964 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.505286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-10356115', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10020745'] for subnet, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.528319 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=37d12ab7-f690-473d-aa8c-8a85b5e6ac24,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:19.533924 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] Publish callbacks [] for subnet, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.537395 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-0dd4a8a8-5e05-4d92-9805-f17ebe33de86 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/37d12ab7-f690-473d-aa8c-8a85b5e6ac24 HTTP/1.1" status: 204 len: 168 time: 0.2536964 Nov 05 15:36:19.539706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e20d8b6d-3e23-461b-a297-077073ac52d2 None None] Network 41cf0049-d48d-471e-b660-0dd94cf07e44 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:36:19.540194 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53394) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:19.609998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.685134 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Deleting port 2040d077-f04c-4cfb-bfde-0f62e5606499 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:19.685500 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.745008 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] For port 2040d077-f04c-4cfb-bfde-0f62e5606499, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=2040d077-f04c-4cfb-bfde-0f62e5606499,segment=NetworkSegment(191d825a-b543-4983-9f9f-ca830a59892c),segment_id=191d825a-b543-4983-9f9f-ca830a59892c)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:19.745286 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.757971 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Calling delete_port for 2040d077-f04c-4cfb-bfde-0f62e5606499 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:19.806751 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] DHCP port deletion for 41cf0049-d48d-471e-b660-0dd94cf07e44 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:36:19.840729 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.857632 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Deleting port 2040d077-f04c-4cfb-bfde-0f62e5606499 {{(pid=113582) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:19.858114 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.868749 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Pushing event deleted for resources: {'Port': ['ID=2040d077-f04c-4cfb-bfde-0f62e5606499,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:19.870587 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] No DVR routers for this DVR port 2040d077-f04c-4cfb-bfde-0f62e5606499 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:36:19.935064 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.db [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] For port 2040d077-f04c-4cfb-bfde-0f62e5606499, host dv-neutron-816850-1-hyperv, got binding levels [] {{(pid=113582) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:19.935449 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.944983 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.948921 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Calling delete_port for 2040d077-f04c-4cfb-bfde-0f62e5606499 owned by network:dhcp {{(pid=113582) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:19.951981 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.ipam_backend_mixin [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Port 2040d077-f04c-4cfb-bfde-0f62e5606499 was not found and therefore no delete operation was performed {{(pid=113582) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 05 15:36:19.953274 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877'] for port, after_delete {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:19.971475 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] No DVR routers for this DVR port 2040d077-f04c-4cfb-bfde-0f62e5606499 on host dv-neutron-816850-1-hyperv {{(pid=113582) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:36:19.979465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41cf0049-d48d-471e-b660-0dd94cf07e44']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:19.989671 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '191d825a-b543-4983-9f9f-ca830a59892c') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:19.989976 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '191d825a-b543-4983-9f9f-ca830a59892c') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:19.991721 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78230cf-d105-428d-be6e-6f2b9778f1b7 None None] Pushing event deleted for resources: {'Port': ['ID=2040d077-f04c-4cfb-bfde-0f62e5606499,revision_number=None']} {{(pid=113582) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:20.004433 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.018000 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.025262 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Releasing vlan 610 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:36:20.025586 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:36:20.027284 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:36:20.084852 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.091540 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.094878 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] 10.222.0.30 "DELETE /v2.0/networks/41cf0049-d48d-471e-b660-0dd94cf07e44 HTTP/1.1" status: 204 len: 168 time: 0.5535731 Nov 05 15:36:20.097784 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53396) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:20.108060 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d7821b-c626-4d9b-8eb2-41210778268e admin admin] Pushing event deleted for resources: {'Network': ['ID=41cf0049-d48d-471e-b660-0dd94cf07e44,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:20.196629 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9c204bc-4c69-4486-90b2-a80aed04fa99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.451169 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1033972'] for router_interface, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.698747 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Deleting port 12825622-c2c1-4674-9534-ba57ff45d938 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:20.699077 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.773958 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] For port 12825622-c2c1-4674-9534-ba57ff45d938, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=12825622-c2c1-4674-9534-ba57ff45d938,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:20.774235 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:20.790143 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Calling delete_port for 12825622-c2c1-4674-9534-ba57ff45d938 owned by network:router_interface {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:20.874596 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0d834ffb-757a-482f-9e31-ea309ee1f110 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:20.895560 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0d834ffb-757a-482f-9e31-ea309ee1f110 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:20.895999 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0d834ffb-757a-482f-9e31-ea309ee1f110 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:20.896521 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2040d077-f04c-4cfb-bfde-0f62e5606499 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:20.917357 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 2040d077-f04c-4cfb-bfde-0f62e5606499 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:20.917706 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 2040d077-f04c-4cfb-bfde-0f62e5606499 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:20.918129 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c9a14611-544c-48ed-b194-08eec431ca39 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:20.938348 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: c9a14611-544c-48ed-b194-08eec431ca39 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:20.938692 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device c9a14611-544c-48ed-b194-08eec431ca39 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:21.287651 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:21.312347 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Pushing event deleted for resources: {'Port': ['ID=12825622-c2c1-4674-9534-ba57ff45d938,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:21.470565 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-621075', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1034052'] for router_interface, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:21.686947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Router 42976b4f-2862-417e-ae91-4732bcc87c89 has already been hosted by L3 agent 720631e7-593a-4825-9d12-ae4f4d318a59 {{(pid=113581) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 05 15:36:21.797725 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] Notify agent at l3_agent.dv-neutron-816850-1-hyperv the message routers_updated {{(pid=113581) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 05 15:36:21.802794 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-aefad019-bb8b-4e1c-88e9-29d968d9ea63 admin admin] 10.222.0.30 "PUT /v2.0/routers/42976b4f-2862-417e-ae91-4732bcc87c89/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7039752 Nov 05 15:36:21.805289 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53398) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:21.807543 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Sync routers for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 05 15:36:21.817707 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:21.818293 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:21.910756 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks [] for router, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.003648 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: dv-neutron-816850-1-hyperv {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:22.015679 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.069947 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Deleting port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 {{(pid=113581) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:22.070287 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.151394 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.db [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] For port 838a79e6-6e5c-4a9f-85e1-a0f29ec97789, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,segment=NetworkSegment(61488534-ae2d-4393-8e51-d7a4f47ad1d7),segment_id=61488534-ae2d-4393-8e51-d7a4f47ad1d7)] {{(pid=113581) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:22.151754 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.165564 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.plugins.ml2.plugin [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Calling delete_port for 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 owned by network:router_gateway {{(pid=113581) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:22.178548 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'external_fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80'}], 'enable_snat': True}, 'gw_port_id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:36:21Z', 'revision_number': 5, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port': {'id': '838a79e6-6e5c-4a9f-85e1-a0f29ec97789', 'name': '', 'network_id': '6aa3bcc9-dc1a-4ecf-be23-aa9c9d7dbff6', 'tenant_id': '', 'mac_address': 'fa:16:3e:5c:0e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1833, 'fixed_ips': [{'subnet_id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'ip_address': '172.26.5.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-816850-1-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-05T15:31:35Z', 'updated_at': '2021-11-05T15:31:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '55057ba1-ab5e-4ba9-9c9a-e58663fd982d', 'cidr': '172.26.5.0/24', 'gateway_ip': '172.26.5.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-816850-1-hyperv'}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:22.209004 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Checking router: 42976b4f-2862-417e-ae91-4732bcc87c89 for host: dv-neutron-816850-1-hyperv {{(pid=113583) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 05 15:36:22.216971 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvrscheduler_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Routers {'42976b4f-2862-417e-ae91-4732bcc87c89'} bound to L3 agent in host dv-neutron-816850-1-hyperv {{(pid=113583) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 05 15:36:22.217562 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-816850-1-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-05T14:36:52Z,description=,heartbeat_timestamp=2021-11-05T15:35:53Z,host='dv-neutron-816850-1-hyperv',id=720631e7-593a-4825-9d12-ae4f4d318a59,load=0,resource_versions=,resources_synced=,started_at=2021-11-05T14:36:52Z,topic='l3_agent')) {'router_ids': ['42976b4f-2862-417e-ae91-4732bcc87c89'], 'active': True} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:22.303104 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_dvr_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] Set router 42976b4f-2862-417e-ae91-4732bcc87c89 gateway port host: None {{(pid=113583) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 05 15:36:22.327871 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9638413'] for port, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.354062 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.l3_hamode_db [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:36:22Z', 'revision_number': 6, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port_host': None}], 'dv-neutron-816850-1-hyperv', False) {} {{(pid=113583) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:22.355159 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=838a79e6-6e5c-4a9f-85e1-a0f29ec97789,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:22.383838 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-754b4b23-b3ce-4e77-84a8-cb8021533cf5 None None] The sync data for ids ['42976b4f-2862-417e-ae91-4732bcc87c89'] in dv-neutron-816850-1-hyperv is: [{'id': '42976b4f-2862-417e-ae91-4732bcc87c89', 'name': 'tempest-TestSnapshotPattern-1122613408-router', 'tenant_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-05T15:31:34Z', 'updated_at': '2021-11-05T15:36:22Z', 'revision_number': 6, 'project_id': '3ca6c245780b4f08a37fee95bd6c84c2', 'gw_port_host': None}] {{(pid=113583) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 05 15:36:22.415155 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1032738'] for router_gateway, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.511019 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1040264', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13839'] for router, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.513191 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.518398 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8c4b2b17-ed62-4408-aee8-7c3c9489d9f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.557684 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1040263'] for router, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.558208 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 42976b4f-2862-417e-ae91-4732bcc87c89 {{(pid=113581) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 05 15:36:22.562952 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] Publish callbacks [] for router, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.564080 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-1250a1c2-336d-4574-bba6-2d97c5acf9e8 admin admin] 10.222.0.30 "DELETE /v2.0/routers/42976b4f-2862-417e-ae91-4732bcc87c89 HTTP/1.1" status: 204 len: 168 time: 0.7578962 Nov 05 15:36:22.566579 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.wsgi [-] (113581) accepted ('10.222.0.30', 53400) {{(pid=113581) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:22.609782 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Deleting subnet b771b7dd-20f0-4db8-ac95-47c47cfcc689 {{(pid=113581) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 05 15:36:22.613408 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.646023 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2796353'] for subnet, precommit_delete_associations {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.727062 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1998030'] for subnet, precommit_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.783547 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1998039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-527964', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9638512', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9931224'] for subnet, after_delete {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.813757 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron_lib.callbacks.manager [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Publish callbacks [] for subnet, before_response {{(pid=113581) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.818073 dv-neutron-816850-1-hyperv neutron-server[113581]: INFO neutron.wsgi [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] 10.222.0.30 "DELETE /v2.0/subnets/b771b7dd-20f0-4db8-ac95-47c47cfcc689 HTTP/1.1" status: 204 len: 168 time: 0.2505853 Nov 05 15:36:22.818593 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a0c8468-1db8-49d6-a6b5-6bee2e0cdd12 None None] Network fbbc48bf-c077-48a5-9eaa-f0d56b067103 requested from dv-neutron-816850-1-hyperv {{(pid=113582) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Nov 05 15:36:22.819150 dv-neutron-816850-1-hyperv neutron-server[113581]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a1f002-47b6-49c8-a405-dc457049e3bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b771b7dd-20f0-4db8-ac95-47c47cfcc689,revision_number=None']} {{(pid=113581) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:22.820710 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53402) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:22.892166 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-2023702'] for network, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:22.947955 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Deleting port 0b438fff-906e-48b7-b674-7645bfa07132 {{(pid=113580) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 05 15:36:22.948295 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785316442754'] for port, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.008887 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.db [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] For port 0b438fff-906e-48b7-b674-7645bfa07132, host dv-neutron-816850-1-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-816850-1-hyperv',level=0,port_id=0b438fff-906e-48b7-b674-7645bfa07132,segment=NetworkSegment(b5498b2e-8acc-43b1-ab42-c2dce1f61a84),segment_id=b5498b2e-8acc-43b1-ab42-c2dce1f61a84)] {{(pid=113580) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 05 15:36:23.009245 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1028959'] for port, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.022181 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.plugin [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Calling delete_port for 0b438fff-906e-48b7-b674-7645bfa07132 owned by network:dhcp {{(pid=113580) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 05 15:36:23.109790 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1973661', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-345745', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785316530252', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785316033877', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-10356206'] for port, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.137176 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-903e1ab4-c75d-4771-9299-de549a657ce4 None None] DHCP port deletion for fbbc48bf-c077-48a5-9eaa-f0d56b067103 request from dv-neutron-816850-1-hyperv {{(pid=113582) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:271}} Nov 05 15:36:23.137369 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Pushing event deleted for resources: {'Port': ['ID=0b438fff-906e-48b7-b674-7645bfa07132,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:23.142775 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.db.l3_dvrscheduler_db [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] No DVR routers for this DVR port 0b438fff-906e-48b7-b674-7645bfa07132 on host dv-neutron-816850-1-hyperv {{(pid=113580) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 05 15:36:23.210486 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 12825622-c2c1-4674-9534-ba57ff45d938 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:23.224514 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1983811', 'neutron.services.segments.db._delete_segments_for_network-8785316554487'] for network, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.236207 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 12825622-c2c1-4674-9534-ba57ff45d938 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:23.236628 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 12825622-c2c1-4674-9534-ba57ff45d938 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:23.237058 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:23.247271 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fbbc48bf-c077-48a5-9eaa-f0d56b067103']}} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:23.256256 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:23.256630 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 838a79e6-6e5c-4a9f-85e1-a0f29ec97789 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:23.256980 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84') {'for_net_delete': True} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:23.257111 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0b438fff-906e-48b7-b674-7645bfa07132 no longer exists at agent ovs-agent-dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 05 15:36:23.257289 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.services.segments.db [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5498b2e-8acc-43b1-ab42-c2dce1f61a84') {} {{(pid=113580) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 05 15:36:23.266904 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785316557828', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10351135'] for segment, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.275879 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.plugin [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] No Port match for: 0b438fff-906e-48b7-b674-7645bfa07132 {{(pid=113582) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 05 15:36:23.276230 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron.plugins.ml2.rpc [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Device 0b438fff-906e-48b7-b674-7645bfa07132 not bound to the agent host dv-neutron-816850-1-hyperv {{(pid=113582) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 05 15:36:23.280003 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943'] for segment, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Releasing vlan 640 on physical network physnet1 to pool {{(pid=113580) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1996943', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-10356025'] for segment, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: Traceback (most recent call last): Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: timer() Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: cb(*args, **kw) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: return func(*args, **kwargs) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: self._notify() Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: self.callback(batched_events) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: event.method(event) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: aggregate_uuid = self.p_client.list_aggregates( Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: return f(self, *a, **k) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._get(url).json() Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: return self.request(url, 'GET', **kwargs) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: base_url = self.get_endpoint(auth, allow=allow, Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 05 15:36:23.292609 dv-neutron-816850-1-hyperv neutron-server[113580]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 05 15:36:23.357531 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1983816', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-532858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-621080', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1032902'] for network, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.362998 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Publish callbacks [] for network, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.366268 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] 10.222.0.30 "DELETE /v2.0/networks/fbbc48bf-c077-48a5-9eaa-f0d56b067103 HTTP/1.1" status: 204 len: 168 time: 0.5444465 Nov 05 15:36:23.379356 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601ba80e-b880-4f47-ba8b-ff7e2b88252a admin admin] Pushing event deleted for resources: {'Network': ['ID=fbbc48bf-c077-48a5-9eaa-f0d56b067103,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:23.517487 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:36:23.553779 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53406) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:23.596639 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d34dc6e0-29b8-477e-8b0c-53ac202cbc56 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=aa4b30adba9f49dfaa932f987a22ec06&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0416527 Nov 05 15:36:23.599073 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53408) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:23.632937 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.646752 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.667355 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.723667 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.726148 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:23.727334 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6ec71fc3-21b6-42c1-81d3-fe90363e68d3 HTTP/1.1" status: 204 len: 168 time: 0.1273394 Nov 05 15:36:23.734918 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc545011-bd6b-431c-b17f-c0872c712462 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ec71fc3-21b6-42c1-81d3-fe90363e68d3,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:24.033985 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53414) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:24.074652 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-d9f31a6c-a5ab-4bc1-8ef3-94ca38fa31fa admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3ca6c245780b4f08a37fee95bd6c84c2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0394547 Nov 05 15:36:24.076973 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.wsgi [-] (113580) accepted ('10.222.0.30', 53416) {{(pid=113580) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 05 15:36:24.122465 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:24.143829 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:24.190739 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-996744'] for security_group, after_delete {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:24.193459 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron_lib.callbacks.manager [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] Publish callbacks [] for security_group, before_response {{(pid=113580) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:24.195120 dv-neutron-816850-1-hyperv neutron-server[113580]: INFO neutron.wsgi [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/df329b8a-68cb-4018-957d-3f2c39564a85 HTTP/1.1" status: 204 len: 168 time: 0.1172652 Nov 05 15:36:24.203094 dv-neutron-816850-1-hyperv neutron-server[113580]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7cdb0e-41dc-4c47-8666-3d7a69b4c81a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df329b8a-68cb-4018-957d-3f2c39564a85,revision_number=None']} {{(pid=113580) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 05 15:36:25.085901 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:26.052187 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:48.763976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:50.197949 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f929f655-78eb-4021-9eb6-fa98d8e442a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:52.522240 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-82c59a80-1972-470b-80bc-f7d9285a0681 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:53.633932 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:55.089697 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:36:56.053853 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:00.517821 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:37:18.768403 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:20.199039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-65a2233d-0ee0-401c-9a9f-8283586c0b02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:22.527127 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-46007049-9b3f-412b-a5fb-4e178f4d4fe7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:23.637278 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:25.092113 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:26.056047 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:37.517672 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:37:48.763741 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:50.201831 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8599ffc5-429c-46a3-a861-a9fc1478fd5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:52.529373 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b2684778-e8e1-4e38-96b9-cfa793401acd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:53.638427 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:55.093908 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:37:56.057331 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:14.516403 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:38:18.761073 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:20.203677 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-daf2a9eb-85a5-45ff-a46f-eccce4670b25 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:22.530152 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-fd7da44e-7b78-4abe-89b8-9bd97058f97a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:23.641923 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:25.096264 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:26.058545 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:48.777091 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:50.208002 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-35efa665-bfcd-43ae-b30e-8f20ca3fa540 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:51.515038 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:38:52.531998 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-42537de8-a852-4b75-ba00-3f0fc659d635 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:53.645177 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:55.098918 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:38:56.059972 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:18.794056 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:20.208670 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-1b0dba89-f8ae-46cf-a4fd-434e24289976 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:22.534349 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-a77dff0f-e093-473c-89e7-53ae316d7dc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:23.647483 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:25.101039 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:26.061286 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:28.513798 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:39:48.791289 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:50.211714 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ddcf38db-fecd-4c6b-a9a1-b89bdccc01ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:52.535131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4d5a32c4-01ee-4ab6-ac49-cb9f30fc0121 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:53.651431 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:55.104012 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:39:56.061983 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:05.513124 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:40:18.790604 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:20.213372 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-ab551619-2290-405a-b401-dac59af4377f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:22.536450 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-2e3c1433-9c8c-49d5-94d3-bbb98d3a0599 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:23.653587 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:25.109540 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:26.064444 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:42.511644 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:40:48.793078 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:50.215457 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-648502bb-c662-4de9-9e94-20e3b96e5a87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:52.537942 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-c17717a4-bca6-4229-8835-8727c8c55569 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:53.656734 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:55.109980 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:40:56.066045 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:18.799678 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:19.511382 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 05 15:41:20.216015 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-8da00614-030e-4871-aab0-f152ebc94327 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:22.538766 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-65b4fb4c-df07-4d3c-a90f-7cf2bb9e6e92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:23.660919 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:25.112123 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:26.066976 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:48.805990 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-17c5ac63-a58e-47a2-94dd-6474dc1df656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:50.218920 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-48b47e0f-370e-4eaf-84ad-8fa217aada2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:52.540131 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-f8f56753-d084-4876-a448-fb51c9ae03ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:53.664151 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-4a48600c-26fa-4a23-9eea-ae5754002750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:55.116640 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-40d80966-bb01-46ce-a083-603ff8f1b31f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:56.070621 dv-neutron-816850-1-hyperv neutron-server[113582]: DEBUG neutron_lib.callbacks.manager [None req-b9a60dc0-306e-454a-a166-75eb77e0af1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785316554469', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1987337'] for agent, after_update {{(pid=113582) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 05 15:41:56.511135 dv-neutron-816850-1-hyperv neutron-server[113583]: DEBUG neutron.db.agents_db [None req-75a93eae-3c1e-4408-98ab-e0e7d8f0513d None None] Agent healthcheck: found 6 active agents {{(pid=113583) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}